Task modulates functional connectivity networks in free viewing behavior

Refixation behavior in naturalistic viewing: Methods, mechanisms, and neural correlates

When freely viewing a scene, the eyes often return to previously visited locations. By tracking eye movements and coregistering eye movements and EEG, such refixations are shown to have multiple roles: repairing insufficient encoding from precursor fixations, supporting ongoing viewing by resampling relevant locations prioritized by precursor fixations, and aiding the construction of memory representations. All these functions of refixation behavior are understood to be underpinned by three oculomotor and cognitive systems and their associated brain structures. First, immediate saccade planning prior to refixations involves attentional selection of candidate locations to revisit. This process is likely supported by the dorsal attentional network. Second, visual working memory, involved in maintaining task-related information, is likely supported by the visual cortex. Third, higher-order relevance of scene locations, which depends on general knowledge and understanding of scene meaning, is likely supported by the hippocampal memory system. Working together, these structures bring about viewing behavior that balances exploring previously unvisited areas of a scene with exploiting visited areas through refixations.

Revealing Whole-Brain Causality Networks During Guided Visual Searching

In our daily lives, we use eye movements to actively sample visual information from our environment ("active vision"). However, little is known about how the underlying mechanisms are affected by goal-directed behavior. In a study of 31 participants, magnetoencephalography was combined with eye-tracking technology to investigate how interregional interactions in the brain change when engaged in two distinct forms of active vision: freely viewing natural images or performing a guided visual search. Regions of interest with significant fixation-related evoked activity (FRA) were identified with spatiotemporal cluster permutation testing. Using generalized partial directed coherence, we show that, in response to fixation onset, a bilateral cluster consisting of four regions (posterior insula, transverse temporal gyri, superior temporal gyrus, and supramarginal gyrus) formed a highly connected network during free viewing. A comparable network also emerged in the right hemisphere during the search task, with the right supramarginal gyrus acting as a central node for information exchange. The results suggest that all four regions are vital to visual processing and guiding attention. Furthermore, the right supramarginal gyrus was the only region where activity during fixations on the search target was significantly negatively correlated with search response times. Based on our findings, we hypothesize that, following a fixation, the right supramarginal gyrus supplies the right supplementary eye field (SEF) with new information to update the priority map guiding the eye movements during the search task.

Prestimulus Low-Alpha Frontal Networks Are Associated with Pareidolias in Parkinson's Disease

Background: Pareidolias are visual phenomena wherein ambiguous, abstract forms or shapes appear meaningful due to incorrect perception. In Parkinson's disease (PD), patients susceptible to visual hallucinations experience visuo-perceptual deficits in the form of pareidolias. Although pareidolias necessitate top-down modulation of visual processing, the cortical dynamics of internally generated perceptual priors on these visual misperceptions is unknown. Objectives: To study prestimulus-related electroencephalography (EEG) spectral and network abnormalities in PD patients experiencing pareidolias. Methods: Twenty-one PD in-patients and 10 age-matched controls were evaluated. Neuropsychological assessments included tests for cognition, attention, and executive functions. Pareidolias were quantified by using the "noise pareidolia test" with simultaneous EEG recording. The PD patients were subdivided into two groups-those with high pareidolia counts (n = 10) and those without (n = 11). The EEG was analyzed 1000 msec before stimulus presentation in the spectral domain (theta, low-alpha, and high-alpha frequencies) with corresponding graph networks to evaluate network properties. Statistical analysis included analysis of variance and multiple regression to evaluate the differences. Results: The PD patients with high pareidolia counts were older with lower scores on neuropsychological tests. Their prestimulus EEG low-alpha band showed a tendency toward higher frontal activity (p = 0.07). Graph networks showed increased normalized clustering coefficient (p = 0.05) and lower frontal degree centrality (p = 0.005). These network indices correlated positively to patients' pareidolia scores. Discussion: We suggest that pareidolias in PD are a consequence of an abnormal top-down modulation of visual processing; they are defined by their frontal low-alpha spectral and network alterations in the prestimulus phase due to a dissonance between patients' internally generated mental processing with external stimuli. Impact statement Pareidolias in Parkinson's disease (PD) are considered to be promising early markers of visual hallucinations and an indicator of PD prognosis. In certain susceptible PD patients, pareidolias can be evoked and studied. Here, via electroencephalography, we aimed at understanding this visual phenomenon by studying how neural information is processed before stimulus presentation in such patients. Using spectral and graph network measures, we revealed how top-down modulated internally generated processes affect visual perception in patients with pareidolias. Our findings highlight how prestimulus network alterations in the frontal cortex shape poststimulus pareidolic manifestations in PD.

Refixation patterns reveal memory-encoding strategies in free viewing

We investigated visual working memory encoding across saccadic eye movements, focusing our analysis on refixation behavior. Over 10-s periods, participants performed a visual search for three, four, or five targets and remembered their orientations for a subsequent change-detection task. In 50% of the trials, one of the targets had its orientation changed. From the visual search period, we scored three types of refixations and applied measures for quantifying eye-fixation recurrence patterns. Repeated fixations on the same regions as well as repeated fixation patterns increased with memory load. Correct change detection was associated with more refixations on targets and less on distractors, with increased frequency of recurrence, and with longer intervals between refixations. The results are in accordance with the view that patterns of eye movement are an integral part of visual working memory representation.

Scene Buildup From Latent Memory Representations Across Eye Movements

An unresolved problem in eye movement research is how a representation is constructed on-line from several consecutive fixations of a scene. Such a scene representation is generally understood to be sparse; yet, for meeting behavioral goals a certain level of detail is needed. We propose that this is achieved through the buildup of latent representations acquired at fixation. Latent representations are retained in an activity-silent manner, require minimal energy expenditure for their maintenance, and thus allow a larger storage capacity than traditional, activation based, visual working memory. The latent representations accumulate and interact in working memory to form to the scene representation. The result is rich in detail while sparse in the sense that it is restricted to the task-relevant aspects of the scene sampled through fixations. Relevant information can quickly and flexibly be retrieved by dynamical attentional prioritization. Latent representations are observable as transient functional connectivity patterns, which emerge due to short-term changes in synaptic weights. We discuss how observing latent representations could benefit from recent methodological developments in EEG-eye movement co-registration.

Target probability modulates fixation-related potentials in visual search

This study investigated the influence of target probability on the neural response to target detection in free viewing visual search. Participants were asked to indicate the number of targets (one or two) among distractors in a visual search task while EEG and eye movements were co-registered. Target probability was manipulated by varying the set size of the displays between 10, 22, and 30 items. Fixation-related potentials time-locked to first target fixations revealed a pronounced P300 at the centro-parietal cortex with larger amplitudes for set sizes 22 and 30 than for set size 10. With increasing set size, more distractor fixations preceded the detection of the target, resulting in a decreased target probability and, consequently, a larger P300. For distractors, no increase of P300 amplitude with set size was observed. The findings suggest that set size specifically affects target but not distractor processing in overt serial visual search.

Feature-dependent intrinsic functional connectivity across cortical depths in the human auditory cortex

Frequency preference and spectral tuning are two cardinal features of information processing in the auditory cortex. However, sounds should not only be processed in separate frequency bands because information needs to be integrated to be meaningful. One way to better understand the integration of acoustic information is to examine the functional connectivity across cortical depths, as neurons are already connected differently across laminar layers. Using a tailored receiver array and surface-based cortical depth analysis, we revealed the frequency-preference as well as tuning-width dependent intrinsic functional connectivity (iFC) across cortical depths in the human auditory cortex using functional magnetic resonance imaging (fMRI). We demonstrated feature-dependent iFC in both core and noncore regions at all cortical depths. The selectivity of frequency-preference dependent iFC was higher at deeper depths than at intermediate and superficial depths in the core region. Both the selectivity of frequency-preference and tuning-width dependent iFC were stronger in the core than in the noncore region at deep cortical depths. Taken together, our findings provide evidence for a cortical depth-specific feature-dependent functional connectivity in the human auditory cortex.

Large-Scale Traveling Waves in EEG Activity Following Eye Movement

In spontaneous, stimulus-evoked, and eye-movement evoked EEG, the oscillatory signal shows large scale, dynamically organized patterns of phase. We investigated eye-movement evoked patterns in free-viewing conditions. Participants viewed photographs of natural scenes in anticipation of a memory test. From 200 ms intervals following saccades, we estimated the EEG phase gradient over the entire scalp, and the wave activity, i.e. the goodness of fit of a wave model involving a phase gradient assumed to be smooth over the scalp. In frequencies centered at 6.5 Hz, large-scale phase organization occurred, peaking around 70 ms after fixation onset and taking the form of a traveling wave. According to the wave gradient, most of the times the wave spreads from the posterior-inferior to anterior-superior direction. In these directions, the gradients depended on the size and direction of the saccade. Wave propagation velocity decreased in the course of the fixation, particularly in the interval from 50 to 150 ms after fixation onset. This interval corresponds to the fixation-related lambda activity, which reflects early perceptual processes following fixation onset. We conclude that lambda activity has a prominent traveling wave component. This component consists of a short-term whole-head phase pattern of specific direction and velocity, which may reflect feedforward propagation of visual information at fixation.