Saccades to a remembered location elicit spatially specific activation in human retinotopic visual cortex

Eye blinking, musical processing, and subjective states-A methods account

Affective sciences often make use of self-reports to assess subjective states. Seeking a more implicit measure for states and emotions, our study explored spontaneous eye blinking during music listening. However, blinking is understudied in the context of research on subjective states. Therefore, a second goal was to explore different ways of analyzing blink activity recorded from infra-red eye trackers, using two additional data sets from earlier studies differing in blinking and viewing instructions. We first replicate the effect of increased blink rates during music listening in comparison with silence and show that the effect is not related to changes in self-reported valence, arousal, or to specific musical features. Interestingly, but in contrast, felt absorption reduced participants' blinking. The instruction to inhibit blinking did not change results. From a methodological perspective, we make suggestions about how to define blinks from data loss periods recorded by eye trackers and report a data-driven outlier rejection procedure and its efficiency for subject-mean analyses, as well as trial-based analyses. We ran a variety of mixed effects models that differed in how trials without blinking were treated. The main results largely converged across accounts. The broad consistency of results across different experiments, outlier treatments, and statistical models demonstrates the reliability of the reported effects. As recordings of data loss periods come for free when interested in eye movements or pupillometry, we encourage researchers to pay attention to blink activity and contribute to the further understanding of the relation between blinking, subjective states, and cognitive processing.

Neural correlates of proactive and reactive inhibition of saccadic eye movements

Although research on goal-directed, proactive inhibitory control (IC) and stimulus-driven, reactive IC is growing, no previous study has compared proactive IC in conditions of uncertainty with regard to upcoming inhibition to conditions of certain upcoming IC. Therefore, we investigated effects of certainty and uncertainty on behavior and blood oxygen level dependent (BOLD) signal in proactive and reactive IC. In two studies, healthy adults performed saccadic go/no-go and prosaccade/antisaccade tasks. The certainty manipulation had a highly significant behavioral effect in both studies, with inhibitory control being more successful under certain than uncertain conditions on both tasks (p ≤ 0.001). Saccadic go responses were significantly less efficient under conditions of uncertainty than certain responding (p < 0.001). Event-related functional magnetic resonance imaging (fMRI) (one study) revealed a dissociation of certainty- and uncertainty-related proactive inhibitory neural correlates in the go/no-go task, with lateral and medial prefrontal and occipital cortex showing stronger deactivations during uncertainty than during certain upcoming inhibition, and lateral parietal cortex being activated more strongly during certain upcoming inhibition than uncertainty or certain upcoming responding. In the antisaccade task, proactive BOLD effects arose due to stronger deactivations in uncertain response conditions of both tasks and before certain prosaccades than antisaccades. Reactive inhibition-related BOLD increases occurred in inferior parietal cortex and supramarginal gyrus (SMG) in the go/no-go task only. Proactive IC may imply focusing attention on the external environment for encoding salient or alerting events as well as inhibitory mechanisms that reduce potentially distracting neural processes. SMG and inferior parietal cortex may play an important role in both proactive and reactive IC of saccades.

Population Dynamics of Early Visual Cortex during Working Memory

Although the content of working memory (WM) can be decoded from the spatial patterns of brain activity in early visual cortex, how populations encode WM representations remains unclear. Here, we address this limitation by using a model-based approach that reconstructs the feature encoded by population activity measured with fMRI. Using this approach, we could successfully reconstruct the locations of memory-guided saccade goals based on the pattern of activity in visual cortex during a memory delay. We could reconstruct the saccade goal even when we dissociated the visual stimulus from the saccade goal using a memory-guided antisaccade procedure. By comparing the spatiotemporal population dynamics, we find that the representations in visual cortex are stable but can also evolve from a representation of a remembered visual stimulus to a prospective goal. Moreover, because the representation of the antisaccade goal cannot be the result of bottom-up visual stimulation, it must be evoked by top-down signals presumably originating from frontal and/or parietal cortex. Indeed, we find that trial-by-trial fluctuations in delay period activity in frontal and parietal cortex correlate with the precision with which our model reconstructed the maintained saccade goal based on the pattern of activity in visual cortex. Therefore, the population dynamics in visual cortex encode WM representations, and these representations can be sculpted by top-down signals from frontal and parietal cortex.

Effects of Scene Properties and Emotional Valence on Brain Activations: A Fixation-Related fMRI Study

Temporal and spatial characteristics of fixations are affected by image properties, including high-level scene characteristics, such as object-background composition, and low-level physical characteristics, such as image clarity. The influence of these factors is modulated by the emotional content of an image. Here, we aimed to establish whether brain correlates of fixations reflect these modulatory effects. To this end, we simultaneously scanned participants and measured their eye movements, while presenting negative and neutral images in various image clarity conditions, with controlled object-background composition. The fMRI data were analyzed using a novel fixation-based event-related (FIBER) method, which allows the tracking of brain activity linked to individual fixations. The results revealed that fixating an emotional object was linked to greater deactivation in the right lingual gyrus than fixating the background of an emotional image, while no difference between object and background was found for neutral images. We suggest that deactivation in the lingual gyrus might be linked to inhibition of saccade execution. This was supported by fixation duration results, which showed that in the negative condition, fixations falling on the object were longer than those falling on the background. Furthermore, increase in the image clarity was correlated with fixation-related activity within the lateral occipital complex, the structure linked to object recognition. This correlation was significantly stronger for negative images, presumably due to greater deployment of attention towards emotional objects. Our eye-tracking results are in line with these observations, showing that the chance of fixating an object rose faster for negative images over neutral ones as the level of noise decreased. Overall, our study demonstrated that emotional value of an image changes the way that low and high-level scene properties affect the characteristics of fixations. The fixation-related brain activity is affected by the low-level scene properties and this impact differs between negative and neutral images. The high-level scene properties also affect brain correlates of fixations, but only in the case of the negative images.

The Fixation Distance to the Stimulus Influences ERP Quality: An EEG and Eye Tracking N400 Study

In a typical visual Event Related Potential (ERP) study, the stimulus is presented centrally on the screen. Normally an ERP response will be measured provided that the participant directs their gaze towards the stimulus. The aim of this study was to assess how the N400 component of an ERP was affected when the stimulus was presented in the foveal, parafoveal or peripheral vision of the participant's visual field. Utilizing stimuli that have previously produced an N400 response to action incongruities, the same stimuli sequences were presented at 0°, 4°, 8° and 12° of visual angle from a fixation location. In addition to the EEG data, eye tracking data were recorded to act as a fixation control method and to allow for eye artifact detection. The results show a significant N400 effect in the right parieto-temporal electrodes within the 0° visual angle condition. For the other conditions, the N400 effect was reduced (4°) or not present (8° and 12°). Our results suggest that the disappearance of the N400 effect with eccentricity is due to the fixation distance to the stimulus. However, variables like attentional allocation could have also had an impact on the results. This study highlights the importance of presenting a stimulus within the foveal vision of the participant in order to maximize ERP effects related to higher order cognitive processes.

Saccade planning evokes topographically specific activity in the dorsal and ventral streams

Saccade planning may invoke spatially-specific feedback signals that bias early visual activity in favor of top-down goals. We tested this hypothesis by measuring cortical activity at the early stages of the dorsal and ventral visual processing streams. Human subjects maintained saccade plans to (prosaccade) or away (antisaccade) from a spatial location over long memory-delays. Results show that cortical activity persists in early visual cortex at the retinotopic location of upcoming saccade goals. Topographically specific activity persists as early as V1, and activity increases along both dorsal (V3A/B, IPS0) and ventral (hV4, VO1) visual areas. Importantly, activity persists when saccade goals are available only via working memory and when visual targets and saccade goals are spatially disassociated. We conclude that top-down signals elicit retinotopically specific activity in visual cortex both in the dorsal and ventral streams. Such activity may underlie mechanisms that prioritize locations of task-relevant objects.

Three key regions for supervisory attentional control: evidence from neuroimaging meta-analyses

The supervisory attentional system has been proposed to mediate non-routine, goal-oriented behaviour by guiding the selection and maintenance of the goal-relevant task schema. Here, we aimed to delineate the brain regions that mediate these high-level control processes via neuroimaging meta-analysis. In particular, we investigated the core neural correlates of a wide range of tasks requiring supervisory control for the suppression of a routine action in favour of another, non-routine one. Our sample comprised n=173 experiments employing go/no-go, stop-signal, Stroop or spatial interference tasks. Consistent convergence across all four paradigm classes was restricted to right anterior insula and inferior frontal junction, with anterior midcingulate cortex and pre-supplementary motor area being consistently involved in all but the go/no-go task. Taken together with lesion studies in patients, our findings suggest that the controlled activation and maintenance of adequate task schemata relies, across paradigms, on a right-dominant midcingulo-insular-inferior frontal core network. This also implies that the role of other prefrontal and parietal regions may be less domain-general than previously thought.

Human fMRI reveals that delayed action re-recruits visual perception

Behavioral and neuropsychological research suggests that delayed actions rely on different neural substrates than immediate actions; however, the specific brain areas implicated in the two types of actions remain unknown. We used functional magnetic resonance imaging (fMRI) to measure human brain activation during delayed grasping and reaching. Specifically, we examined activation during visual stimulation and action execution separated by a 18-s delay interval in which subjects had to remember an intended action toward the remembered object. The long delay interval enabled us to unambiguously distinguish visual, memory-related, and action responses. Most strikingly, we observed reactivation of the lateral occipital complex (LOC), a ventral-stream area implicated in visual object recognition, and early visual cortex (EVC) at the time of action. Importantly this reactivation was observed even though participants remained in complete darkness with no visual stimulation at the time of the action. Moreover, within EVC, higher activation was observed for grasping than reaching during both vision and action execution. Areas in the dorsal visual stream were activated during action execution as expected and, for some, also during vision. Several areas, including the anterior intraparietal sulcus (aIPS), dorsal premotor cortex (PMd), primary motor cortex (M1) and the supplementary motor area (SMA), showed sustained activation during the delay phase. We propose that during delayed actions, dorsal-stream areas plan and maintain coarse action goals; however, at the time of execution, motor programming requires re-recruitment of detailed visual information about the object through reactivation of (1) ventral-stream areas involved in object perception and (2) early visual areas that contain richly detailed visual representations, particularly for grasping.

Intermodal attention modulates visual processing in dorsal and ventral streams

Attending to visual objects while ignoring information from other modalities is necessary for performing difficult visual discriminations, but it is unclear how selecting between sensory modalities alters processing within the visual system. We used an audio-visual intermodal selective attention paradigm with fMRI to study the effects of visual attention on cortical activity in the absence of competitive interactions between multiple visual stimuli. Complex stimuli (faces and words) activated higher visual areas even in the absence of visual attention. These stimulus-dependent activations (SDAs) covered foveal retinotopic cortex, extended ventrally to the anterior fusiform gyrus and dorsally to include multiple distinct foci in the intraparietal sulcus (IPS). Attention amplified the baseline response in posterior retinotopic regions and altered activity in different ways in the extrastriate dorsal and ventral pathways. The majority of the IPS was strongly and exclusively activated by visual attention: attention-related modulations (ARMs) encompassed and spread well beyond the focal SDAs. In contrast, in the fusiform gyrus only a small subset of the regions activated by unattended stimuli showed ARMs. Ventral cortex was also heterogeneous: we found a distinct ventrolateral region in the occipitotemporal sulcus (OTS) that was activated exclusively by attention, showing neither SDAs nor any significant stimulus preferences. Attention-dependent activations in the IPS and the OTS suggest that these regions play critical roles in intermodal visual attention.

Common neural mechanisms supporting spatial working memory, attention and motor intention

The prefrontal cortex (PFC) and posterior parietal cortex (PPC) are critical neural substrates for working memory. Neural activity persists in these regions during the maintenance of a working memory representation. Persistent activity, therefore, may be the neural mechanism by which information is temporarily maintained. However, the nature of the representation or what is actually being represented by this persistent activity is not well understood. In this review, we summarize the recent functional magnetic resonance imaging (fMRI) studies conducted in our laboratory that test hypotheses about the nature of persistent activity during a variety of spatial cognition tasks. We find that the same areas in the PFC and PPC that show persistent activity during the maintenance of a working memory representation also show persistent activity during the maintenance of spatial attention and the maintenance of motor intention. Therefore, we conclude that persistent activity is not specific to working memory, but instead, carries information that can be used generally to support a variety of cognitions. Specifically, activity in topographically organized maps of prioritized space in PFC and PPC could be read out to guide attention allocation, spatial memory, and motor planning.

Antisaccade cost is modulated by contextual experience of location probability

It is well known that pro- and antisaccades may deploy different cognitive processes. However, the specific reason why antisaccades have longer latencies than prosaccades is still under debate. In three experiments, we studied the factors contributing to the antisaccade cost by taking attentional orienting and target location probabilities into account. In experiment 1, using a new antisaccade paradigm, we directly tested Olk and Kingstone's hypothesis, which attributes longer antisaccade latency to the time it takes to reorient from the visual target to the opposite saccadic target. By eliminating the reorienting component in our paradigm, we found no significant difference between the latencies of the two saccade types. In experiment 2, we varied the proportion of prosaccades made to certain locations and found that latencies in the high location-probability (75%) condition were faster than those in the low location-probability condition. Moreover, antisaccade latencies were significantly longer when location probability was high. This pattern can be explained by the notion of competing pathways for pro- and antisaccades in findings of others. In experiment 3, we further explored the degrees of modulation of location probability by decreasing the magnitude of high probability from 75 to 65%. We again observed a pattern similar to that seen in experiment 2 but with smaller modulation effects. Together, these experiments indicate that the reorienting process is a critical factor in producing the antisaccade cost. Furthermore, the antisaccade cost can be modulated by probabilistic contextual information such as location probabilities.

Decoding reveals the contents of visual working memory in early visual areas

Visual working memory provides an essential link between perception and higher cognitive functions, allowing for the active maintenance of information regarding stimuli no longer in view1,2. Research suggests that sustained activity in higher-order prefrontal, parietal, inferotemporal and lateral occipital areas supports visual maintenance3-11, and may account for working memory’s limited capacity to hold up to 3-4 items9-11. Because higher-order areas lack the visual selectivity of early sensory areas, it has remained unclear how observers can remember specific visual features, such as the precise orientation of a grating, with minimal decay in performance over delays of many seconds12. One proposal is that sensory areas serve to maintain fine-tuned feature information13, but early visual areas show little to no sustained activity over prolonged delays14-16. Using fMRI decoding methods17, here we show that orientations held in working memory can be decoded from activity patterns in the human visual cortex, even when overall levels of activity are low. Activity patterns in areas V1-V4 could predict which of two oriented gratings was held in memory with mean accuracy levels upwards of 80%, even in participants exhibiting activity that fell to baseline levels after a prolonged delay. These orientation-selective activity patterns were sustained throughout the delay period, evident in individual visual areas, and similar to the responses evoked by unattended, task-irrelevant gratings. Our results demonstrate that early visual areas can retain specific information about visual features held in working memory, over periods of many seconds when no physical stimulus is present.