Early interaction between perceptual load and involuntary attention: An event-related potential study

Differences between overt, covert and natural attention shifts to emotional faces

In daily life, individuals pay attention to emotional facial expressions and dynamically choose how to shift their attention, i.e. either overtly (with eye-movements) or covertly (without eye-movements). However, research on attention to emotional faces has mostly been conducted in controlled laboratory settings, in which people were instructed where to look. The current preregistered study co-registered EEG and eye-tracking to investigate differences in emotion-driven attention between instructed and uninstructed natural attention shifts in 48 adults. While a central stimulus was presented to the participant, a face appeared in the periphery, showing either a happy, neutral or an angry expression. In three counterbalanced blocks participants were instructed to either move their eyes overtly to the peripheral face, keep fixating the center and therefore covertly shift their attention, or freely look wherever they would like to look. We found that emotional content had stronger effects on the amplitude of the Early Posterior Negativity when participants shifted attention naturally, and that natural shifts of attention differed from instructed shifts in both saccade behavior and neural mechanisms. In summary, our results emphasize the importance of investigating modulation of attention using paradigms that allow participants to allocate their attention naturally.

Attention modulates early visual processing: An association between subjective contrast perception and early C1 ERP component

The question of whether spatial attention can modulate initial afferent activity in area V1, as measured by the earliest visual event-related potential (ERP) component "C1", is still the subject of debate. Because attention always enhances behavioral performance, previous research has focused on finding evidence of attention-related enhancements in visual neural responses. However, recent psychophysical studies revealed a complex picture of attention's influence on visual perception: attention amplifies the perceived contrast of low-contrast stimuli while dampening the perceived contrast of high-contrast stimuli. This evidence suggests that attention may not invariably augment visual neural responses but could instead exert inhibitory effects under certain circumstances. Whether this bi-directional modulation of attention also manifests in C1 and whether the modulation of C1 underpins the attentional influence on contrast perception remain unknown. To address these questions, we conducted two experiments (N = 67 in total) by employing a combination of behavioral and ERP methodologies. Our results did not unveil a uniform attentional enhancement or attenuation effect of C1 across all subjects. However, an intriguing correlation between the attentional effects of C1 and contrast appearance for high-contrast stimuli did emerge, revealing an association between attentional modulation of C1 and the attentional modulation of contrast appearance. This finding offers new insights into the relationship between attention, perceptual experience, and early visual neural processing, suggesting that the attentional effect on subjective visual perception could be mediated by the attentional modulation of the earliest visual cortical response.

Event-related potential patterns of selective attention modulated by perceptual load

INTRODUCTION

A high perceptual load can effectively prevent attention from being drawn to irrelevant stimuli; however, the neural pattern underlying this process remains unclear.

METHODS

This study adopted a perceptual load paradigm to examine the temporal processes of attentional modulation by incorporating conditions of perceptual load, distractor-target compatibility, and eccentricity.

RESULTS

The behavioral results showed that a high perceptual load significantly reduced attentional distraction caused by peripheral distractors. The event-related potential results further revealed that shorter P2 latencies were observed for peripheral distractors than for central distractors under a high perceptual load and that a suppressed compatibility effect with increasing load was reflected by the P3 component.

CONCLUSION

These findings suggested that (1) P2 and P3 components effectively captured different sides of attentional processing modulated by load (i.e., the filter processing of the object and the overall attentional resource allocation) and (2) response patterns of selective attention modulated by perceptual load were influenced by eccentricity. Our electrophysiological evidence confirmed the behavioral findings, indicating the neural mechanisms of attentional modulation.

Spatial and temporal processing difficulties in Chinese children with developmental dyslexia: An ERP study

Magnocellular (M) deficit theory indicates that individuals with developmental dyslexia (DD) have low sensitivity to stimuli with high temporal frequencies (HTF) and low spatial frequencies (LSF). However, some studies found that temporal processing and spatial processing were correlated with different reading-related skills. Chinese is a logographic language, and visual skills are particularly important for reading in Chinese. It is necessary to investigate the temporal and spatial processing abilities in the M pathway of Chinese children with DD. Using electrophysiological recordings, the present study examined the mean amplitude and latency of P1 during a grating direction judgment task in 13 children with DD and 13 age-matched normal children. Dyslexic children showed a low amplitude and long latency of P1 in the HTF condition and LSF condition compared with age-matched children. In the HTF condition, the amplitude of P1 correlated with phonological awareness, and the latency of P1 correlated with reading fluency and rapid naming of digits. The amplitude of P1 in the LSF condition correlated with reading accuracy. This result suggested that Chinese children with DD had difficulties in both temporal and spatial processing in the M pathway. However, temporal processing and spatial processing played different roles in Chinese reading.

Effects of selective attention on the C1 ERP component: A systematic review and meta-analysis

The C1 event-related potential (ERP) captures the earliest stage of feedforward processing in the primary visual cortex (V1). An ongoing debate is whether top-down selective attention can modulate the C1. One side of the debate pointed out that null findings appear to outnumber positive findings; thus, selective attention does not seem to influence the C1. However, this suggestion is not based on a valid approach to summarizing evidence across studies. Therefore, we conducted a systematic review and meta-analysis investigating the effects of selective attention on the C1, involving 47 experiments and 794 subjects in total. Despite heterogeneity across studies, results suggested that attention has a moderate effect on the C1 (Cohen's d z $$ {d}_z $$  = 0.33, p < .0001); that is, C1 amplitude is larger for visual stimuli that are attended than unattended. These results suggest that C1 is affected by top-down selective attention.

Perceptual Judgments for Table Tennis Serve Recognition: An Event-Related Potentials Study

In the present study, visual attention processes in complex, sport-related decision-making tasks were examined. Psychophysiological and performance data recorded from 15 advanced table tennis athletes and 15 intermediate level undergraduates were compared. A total of 240 three-dimensional pictures of stimuli composed of a white ball and hitting location (black shade point) were presented via a screen, in which 25% represented side-backspin serves, and the other 75% represented non-side-topspin serves. Participants were instructed to report the types of serves. The results indicated that table tennis athletes responded more quickly and accurately. C1 and P1components were induced in the occipital region, N1 in the central region, and P3 in all regions. For table tennis athletes, in the phase of early sensory processing for stimuli features (such as hitting location), the cerebral cortex was activated at a higher level in comparison with undergraduates. This may be caused by the long-term exercise training. Athletes have to be very sensitive to the physical features of relevant movement stimuli. In the phase of recognizing stimuli structures or patterns, advanced athletes’ cerebral cortexes were activated higher and faster. This may help them more effectively match visual information about serves to patterns stored in long-term memory.

Top-Down Modulation of Early Visual Processing in V1: Dissociable Neurophysiological Effects of Spatial Attention, Attentional Load and Task-Relevance

Until today, there is an ongoing discussion if attention processes interact with the information processing stream already at the level of the C1, the earliest visual electrophysiological response of the cortex. We used two highly powered experiments (each N = 52) and examined the effects of task relevance, spatial attention, and attentional load on individual C1 amplitudes for the upper or lower visual hemifield. Bayesian models revealed evidence for the absence of load effects but substantial modulations by task-relevance and spatial attention. When the C1-eliciting stimulus was a task-irrelevant, interfering distracter, we observed increased C1 amplitudes for spatially unattended stimuli. For spatially attended stimuli, different effects of task-relevance for the two experiments were found. Follow-up exploratory single-trial analyses revealed that subtle but systematic deviations from the eye-gaze position at stimulus onset between conditions substantially influenced the effects of attention and task relevance on C1 amplitudes, especially for the upper visual field. For the subsequent P1 component, attentional modulations were clearly expressed and remained unaffected by these deviations. Collectively, these results suggest that spatial attention, unlike load or task relevance, can exert dissociable top-down modulatory effects at the C1 and P1 levels.

Modulation of the Earliest Component of the Human VEP by Spatial Attention: An Investigation of Task Demands

Spatial attention modulations of initial afferent activity in area V1, indexed by the first component “C1” of the human visual evoked potential, are rarely found. It has thus been suggested that early modulation is induced only by special task conditions, but what these conditions are remains unknown. Recent failed replications—findings of no C1 modulation using a certain task that had previously produced robust modulations—present a strong basis for examining this question. We ran 3 experiments, the first to more exactly replicate the stimulus and behavioral conditions of the original task, and the second and third to manipulate 2 key factors that differed in the failed replication studies: the provision of informative performance feedback, and the degree to which the probed stimulus features matched those facilitating target perception. Although there was an overall significant C1 modulation of 11%, individually, only experiments 1 and 2 showed reliable effects, underlining that the modulations do occur but not consistently. Better feedback induced greater P1, but not C1, modulations. Target-probe feature matching had an inconsistent influence on modulation patterns, with behavioral performance differences and signal-overlap analyses suggesting interference from extrastriate modulations as a potential cause.

Spatial attention affects the early processing of neutral versus fearful faces when they are task-irrelevant: a classifier study of the EEG C1 component

EEG studies suggest that the emotional content of visual stimuli is processed rapidly. In particular, the C1 component, which occurs up to 100 ms after stimulus onset and likely reflects activity in primary visual cortex V1, has been reported to be sensitive to emotional faces. However, difficulties replicating these results have been reported. We hypothesized that the nature of the task and attentional condition are key to reconcile the conflicting findings. We report three experiments of EEG activity during the C1 time range elicited by peripherally presented neutral and fearful faces under various attentional conditions: the faces were spatially attended or unattended and were either task-relevant or not. Using traditional event-related potential analysis, we found that the early activity changed depending on facial expression, attentional condition, and task. In addition, we trained classifiers to discriminate the different conditions from the EEG signals. Although the classifiers were not able to discriminate between facial expressions in any condition, they uncovered differences between spatially attended and unattended faces but solely when these were task-irrelevant. In addition, this effect was only present for neutral faces. Our study provides further indication that attention and task are key parameters when measuring early differences between emotional and neutral visual stimuli.

Beauty in mind: Aesthetic appreciation correlates with perceptual facilitation and attentional amplification

Neuroaesthetic research suggests that aesthetic appreciation results from the interaction between the object perceptual features and the perceiver's sensory processing dynamics. In the present study, we investigated the relationship between aesthetic appreciation and attentional modulation at a behavioural and psychophysiological level. In a first experiment, fifty-eight healthy participants performed a visual search task with abstract stimuli containing more or less natural spatial frequencies and subsequently were asked to give an aesthetic evaluation of the images. The results evidenced that response times were faster for more appreciated stimuli. In a second experiment, we recorded visual evoked potentials (VEPs) during exposure to the same stimuli. The results showed, only for more appreciated images, an enhancement in C1 and N1, P3 and N4 VEP components. Moreover, we found increased attention-related occipital alpha desynchronization for more appreciated images. We interpret these data as indicative of the existence of a correlation between aesthetic appreciation and perceptual processing enhancement, both at a behavioural and at a neurophysiological level.

Cognitive penetration of early vision in face perception

Cognitive and affective penetration of perception refers to the influence that higher mental states such as beliefs and emotions have on perceptual systems. Psychological and neuroscientific studies appear to show that these states modulate the visual system at the visuomotor, attentional, and late levels of processing. However, empirical evidence showing that similar consequences occur in early stages of visual processing seems to be scarce. In this paper, I argue that psychological evidence does not seem to be either sufficient or necessary to argue in favour of or against the cognitive penetration of perception in either late or early vision. In order to do that we need to have recourse to brain imaging techniques. Thus, I introduce a neuroscientific study and argue that it seems to provide well-grounded evidence for the cognitive penetration of early vision in face perception. I also examine and reject alternative explanations to my conclusion.

Several studies with significant C1 attention effects survive critical analysis

In a discussion paper (Slotnick, this issue), I conducted a selective review of spatial attention studies to compare experimental parameters and determine whether particular stimulus, task, or analysis conditions were more likely to produce significant attentional modulation of the event-related potential (ERP) C1 component. It was concluded that to maximize C1 attention effects, stimuli should be in the upper visual field, there should be distractors, conditions should be high perceptual or attentional load, there should be exogenous cuing, and effects should be measured at midline parietal-occipital electrodes POz, Pz, and CPz. Commentaries were received by Fu (this issue), Qu and Ding (this issue), Zani and Proverbio (this issue), Pitts and Hillyard (this issue), Di Russo (this issue), and Mohr and Kelly (this issue). Comments included additional ideas to amplify C1 attention effects, support for some conclusions, and challenges to some conclusions. The challenges led to a more in depth analysis of many issues pertaining to C1 attention effects including optimal electrode and stimulus locations, null V1 source localization attention effects, whether all significant C1 attention effects can be discounted, and the number of studies with null versus significant C1 attention effects. Analysis of the studies that survived critical analysis, which included several that observed significant C1 attention effects, led to the same conclusions as Slotnick (this issue). Lines of future research include replicating studies that have observed C1 attention effects using identical experimental parameters and systematically manipulating parameters to determine the impact of each parameter on C1 spatial attention effects.

Does spatial attention modulate the C1 component? The jury continues to deliberate

The thoughful comments on our study (Baumgartner et al., this issue) that failed to replicate the C1 attention effect reported by a previous study roughly fall into three broad categories. First, the commentators identified specific differences between the two studies that may have contributed to the discrepant results. Second, they highlighted some of the theoretical and methodological problems that are encountered when trying to demonstrate attention effects on the initial evoked response in primary visual cortex. Third, they offered a number of proposals for optimizing experimental designs and analysis methods that may increase the likelihood of observing attention-related modulations of the C1. We consider each of these topics in turn.

The spatiotemporal characteristics of the C1 component and its modulation by attention

Slotnick (this issue) provided a selective review of studies on the attentional modulation of the C1 component of the visual evoked potential, and offers a number of guidelines to maximize the likelihood of observing such modulation in terms of electrode choice, stimulus placement, and types of attentional cue and target stimulus. However, the broader literature pertaining to attentional modulation of the C1 does not support many of these guidelines, and the question of why exactly C1 modulations are so rare remains very much open. Here, we provide clarifications that are critical to an accurate appraisal of the current state of this literature.

Still wanted: a reproducible demonstration of a genuine C1 attention effect

Slotnick (this issue) has specified a number of experimental parameters that appear critical for enabling an attention-related modulation of the C1 component. These include stimulus presentation in the upper visual field, the presence of distractors, a high perceptual or attentional load, and measurements at midline occipito-parietal sites. While we agree with many of these recommendations, we would modify others and even dispute a few. Despite the employment of these parameters in a few existing studies, there has not yet been a convincing, reproducible demonstration of a modulation of the C1 component by spatial attention that can be localized to primary visual cortex.

'Tricks' for revealing potential attentional modulations on the C1 component

The t-test formula for a within-subject design suggests that the C1 attentional effect is more likely to be significant if the C1 attentional difference, as the numerator, is large and the standard deviation of the C1 difference that affects the denominator is small. Experimental manipulations for exploring potential C1 attentional effects can be evaluated by their contributions to the numerator and/or the denominator of the t-test formula. 'Tricks' that may enhance the C1 attentional difference and minimize the standard deviation of the sampled C1 are discussed.

Open and cautious towards the "minority view"

According to the 'minority view', the initial afferent processing on C1 can be modulated by attention under certain experimental conditions. However, evidence supporting this 'minority view' is relatively rare and needs more replication, and the optimal conditions for eliciting attentional modulations on C1 have not yet been clearly defined. V1-tuned stimuli with distractors, peripheral cuing paradigms, and high perceptual loads seem to be important factors in favor of the 'minority view'. The signal-noise issue for C1, especially between attended and unattended conditions, needs to be considered.

Earliest stages of visual cortical processing are not modified by attentional load

This study investigated the effects of attentional load on neural responses to attended and irrelevant visual stimuli by recording high-density event-related potentials (ERPs) from the scalp in normal adult subjects. Peripheral (upper and lower visual field) and central stimuli were presented in random order at a rapid rate while subjects responded to targets among the central stimuli. Color detection and color-orientation conjunction search tasks were used as the low- and high-load tasks, respectively. Behavioral results showed significant load effects on both accuracy and reaction time for target detections. ERP results revealed no significant load effect on the initial C1 component (60-100 ms) evoked by either central-relevant or peripheral-irrelevant stimuli. Source analysis with dipole modeling confirmed previous reports that the C1 includes the initial evoked response in primary visual cortex. Source analyses indicated that high attentional load enhanced the early (70-140 ms) neural response to central-relevant stimuli in ventral-lateral extrastriate cortex, whereas load effects on peripheral-irrelevant stimulus processing started at 110 ms and were localized to more dorsal and anterior extrastriate cortical areas. These results provide evidence that the earliest stages of visual cortical processing are not modified by attentional load and show that attentional load affects the processing of task relevant and irrelevant stimuli in different ways.

Prestimulus oscillations in the alpha band of the EEG are modulated by the difficulty of feature discrimination and predict activation of a sensory discrimination process

Recent work has demonstrated that the occipital-temporal N1 component of the ERP is sensitive to the difficulty of visual discrimination, in a manner that cannot be explained by simple differences in low-level visual features, arousal, or time on task. These observations provide evidence that the occipital-temporal N1 component is modulated by the application of top-down control. However, the timing of this control process remains unclear. Previous work has demonstrated proactive, top-down modulation of cortical excitability for cued spatial attention or feature selection tasks. Here, the possibility that a similar top-down process facilitates performance of a difficult stimulus discrimination task is explored. Participants performed an oddball task at two levels of discrimination difficulty, with difficulty manipulated by modulating the similarity between target and nontarget stimuli. Discrimination processes and cortical excitability were assessed via the amplitude of the occipital-temporal N1 component and prestimulus alpha oscillation of the EEG, respectively. For correct discriminations, prestimulus alpha power was reduced, and the occipital-temporal N1 was enhanced in the hard relative to the easy condition. Furthermore, within the hard condition, prestimulus alpha power was reduced, and the occipital-temporal N1 was enhanced for correct relative to incorrect discriminations. The generation of ERPs contingent on relative prestimulus alpha power additionally suggests that diminished alpha power preceding stimulus onset is related to enhancement of the occipital-temporal N1. As in spatial attention, proactive control appears to enhance cortical excitability and facilitate discrimination performance in tasks requiring nonspatial, feature-based attention, even in the absence of competing stimulus features.

Different spatial frequency bands selectively signal for natural image statistics in the early visual system

Early visual evoked potentials (VEPs) measured in humans have recently been observed to be modulated by the image statistics of natural scene imagery. Specifically, the early VEP is dominated by a strong positivity when participants view minimally complex natural scene imagery, with the magnitude of that component being modulated by luminance contrast differences across spatial frequency (i.e., the slope of the amplitude spectrum). For scenes high in structural complexity, the early VEP is dominated by a prominent negativity that exhibits little dependency on luminance contrast. However, since natural scene imagery is broad band in terms of spatial frequency, it is not known whether the above-mentioned modulation results from a complex interaction within or between the early neural processes tuned to different bands of spatial frequency. Here, we sought to address this question by measuring early VEPs (specifically, the C1, P1, and N1 components) while human participants viewed natural scene imagery that was filtered to contain specific bands of spatial frequency information. The results show that the C1 component is largely unmodulated by the luminance statistics of natural scene imagery (being only measurable when such stimuli were made to contain high spatial frequencies). The P1 and N1, on the other hand, were observed to exhibit strong spatial frequency-dependent modulation to the luminance statistics of natural scene imagery. The results therefore suggest that the dependency of early VEPs on natural image statistics results from an interaction between the early neural processes tuned to different bands of spatial frequency.

Systematic biases in early ERP and ERF components as a result of high-pass filtering

The event-related potential (ERP) and event-related field (ERF) techniques provide valuable insights into the time course of processes in the brain. Because neural signals are typically weak, researchers commonly filter the data to increase the signal-to-noise ratio. However, filtering may distort the data, leading to false results. Using our own EEG data, we show that acausal high-pass filtering can generate a systematic bias easily leading to misinterpretations of neural activity. In particular, we show that the early ERP component C1 is very sensitive to such effects. Moreover, we found that about half of the papers reporting modulations in the C1 range used a high-pass digital filter cut-off above the recommended maximum of 0.1 Hz. More generally, among 185 relevant ERP/ERF publications, 80 used cutoffs above 0.1 Hz. As a consequence, part of the ERP/ERF literature may need to be re-analyzed. We provide guidelines on how to minimize filtering artifacts.

Effects of attentional load on early visual processing depend on stimulus timing

A growing number of studies suggest that early visual processing is not only affected by low-level perceptual attributes but also by higher order cognitive factors such as attention or emotion. Using high-density electroencephalography, we recently demonstrated that attentional load of a task at fixation reduces the response of primary visual cortex to irrelevant peripheral stimuli, as indexed by the C1 component. In the latter study, peripheral stimuli were always presented during intervals without task-relevant stimuli. Here, we use a similar paradigm but present central task stimuli and irrelevant peripheral stimuli simultaneously while keeping all other stimulus characteristics constant. Results show that rather than to suppress responses to peripheral stimulation, high attentional load elicits higher C1 amplitudes under these conditions. These findings suggest that stimulus timing can profoundly alter the effects of attentional load on the earliest stages of processing in human visual cortex.

Top-down effects on early visual processing in humans: a predictive coding framework

An increasing number of human electroencephalography (EEG) studies examining the earliest component of the visual evoked potential, the so-called C1, have cast doubts on the previously prevalent notion that this component is impermeable to top-down effects. This article reviews the original studies that (i) described the C1, (ii) linked it to primary visual cortex (V1) activity, and (iii) suggested that its electrophysiological characteristics are exclusively determined by low-level stimulus attributes, particularly the spatial position of the stimulus within the visual field. We then describe conflicting evidence from animal studies and human neuroimaging experiments and provide an overview of recent EEG and magnetoencephalography (MEG) work showing that initial V1 activity in humans may be strongly modulated by higher-level cognitive factors. Finally, we formulate a theoretical framework for understanding top-down effects on early visual processing in terms of predictive coding.

Dissociation of visual C1 and P1 components as a function of attentional load: an event-related potential study

The earliest cortical location at which attention influences visual processing is controversial. To address this issue, the C1 and P1 components of cue-elicited ERPs were examined in a spatially-cued task under high and low levels of attentional load (active vs. passive viewing). Cues were presented either to the left or to the right visual field in separate trials (unilateral presentation), or to both visual fields simultaneously (bilateral presentation). For the unilateral presentation, C1 (peak latency approximately 80 ms) was not modulated by attentional load, whereas P1 (peak latency approximately 120-140 ms) was larger for high-relative to low-load condition. Bilateral presentation of the stimuli enhanced the amplitude of the C1 component relative to unilateral presentation; however, the increase of signal/noise ratio of C1 revealed no attentional load effect on C1. Results show that attentional load modulates visual processing in the P1, but not in the C1 time range, regardless of the increased signal/noise ratio by bilateral presentation. While it remains unclear about the conditions under which a C1 attentional effect is reliably elicited, the present results suggest that the direct manipulation of attentional load under a voluntary attention task seems not crucial for eliciting C1 attentional effect.