What does polarity inversion of extrastriate activity tell us about striate contributions to the early VEP? A comment on Ales et al. (2010)

The divisive normalization model of visual number sense: model predictions and experimental confirmation

Our intuitive sense of number allows rapid estimation for the number of objects (numerosity) in a scene. How does the continuous nature of neural information processing create a discrete representation of number? A neurocomputational model with divisive normalization explains this process and existing data; however, a successful model should not only explain existing data but also generate novel predictions. Here, we experimentally test novel predictions of this model to evaluate its merit for explaining mechanisms of numerosity perception. We did so by consideration of the coherence illusion: the underestimation of number for arrays containing heterogeneous compared to homogeneous items. First, we established the existence of the coherence illusion for homogeneity manipulations of both area and orientation of items in an array. Second, despite the behavioral similarity, the divisive normalization model predicted that these two illusions should reflect activity in different stages of visual processing. Finally, visual evoked potentials from an electroencephalography experiment confirmed these predictions, showing that area and orientation coherence modulate brain responses at distinct latencies and topographies. These results demonstrate the utility of the divisive normalization model for explaining numerosity perception, according to which numerosity perception is a byproduct of canonical neurocomputations that exist throughout the visual pathway.

An extremely fast neural mechanism to detect emotional visual stimuli: A two-experiment study

Defining the brain mechanisms underlying initial emotional evaluation is a key but unexplored clue to understanding affective processing. Event-related potentials (ERPs), especially suited for investigating this issue, were recorded in two experiments (n = 36 and n = 35). We presented emotionally negative (spiders) and neutral (wheels) silhouettes homogenized regarding their visual parameters. In Experiment 1, stimuli appeared at fixation or in the periphery (200 trials per condition and location), the former eliciting a N40 (39 milliseconds) and a P80 (or C1: 80 milliseconds) component, and the latter only a P80. In Experiment 2, stimuli were presented only at fixation (500 trials per condition). Again, an N40 (45 milliseconds) was observed, followed by a P100 (or P1: 105 milliseconds). Analyses revealed significantly greater N40-C1P1 peak-to-peak amplitudes for spiders in both experiments, and ANCOVAs showed that these effects were not explained by C1P1 alone, but that processes underlying N40 significantly contributed. Source analyses pointed to V1 as an N40 focus (more clearly in Experiment 2). Sources for C1P1 included V1 (P80) and V2/LOC (P80 and P100). These results and their timing point to low-order structures (such as visual thalamic nuclei or superior colliculi) or the visual cortex itself, as candidates for initial evaluation structures.

Sound suppresses earliest visual cortical processing after sight recovery in congenitally blind humans

Neuroscientific research has consistently shown more extensive non-visual activity in the visual cortex of congenitally blind humans compared to sighted controls; a phenomenon known as crossmodal plasticity. Whether or not crossmodal activation of the visual cortex retracts if sight can be restored is still unknown. The present study, involving a rare group of sight-recovery individuals who were born pattern vision blind, employed visual event-related potentials to investigate persisting crossmodal modulation of the initial visual cortical processing stages. Here we report that the earliest, stimulus-driven retinotopic visual cortical activity (<100 ms) was suppressed in a spatially specific manner in sight-recovery individuals when concomitant sounds accompanied visual stimulation. In contrast, sounds did not modulate the earliest visual cortical response in two groups of typically sighted controls, nor in a third control group of sight-recovery individuals who had suffered a transient phase of later (rather than congenital) visual impairment. These results provide strong evidence for persisting crossmodal activity in the visual cortex after sight recovery following a period of congenital visual deprivation. Based on the time course of this modulation, we speculate on a role of exuberant crossmodal thalamic input which may arise during a sensitive phase of brain development.

Prestimulus oscillatory brain activity interacts with evoked recurrent processing to facilitate conscious visual perception

We investigated whether prestimulus alpha-band oscillatory activity and stimulus-elicited recurrent processing interact to facilitate conscious visual perception. Participants tried to perceive a visual stimulus that was perceptually masked through object substitution masking (OSM). We showed that attenuated prestimulus alpha power was associated with greater negative-polarity stimulus-evoked ERP activity that resembled the visual awareness negativity (VAN), previously argued to reflect recurrent processing related to conscious perception. This effect, however, was not associated with better perception. Instead, when prestimulus alpha power was elevated, a preferred prestimulus alpha phase was associated with a greater VAN-like negativity, which was then associated with better cue perception. Cue perception was worse when prestimulus alpha power was elevated but the stimulus occurred at a nonoptimal prestimulus alpha phase and the VAN-like negativity was low. Our findings suggest that prestimulus alpha activity at a specific phase enables temporally selective recurrent processing that facilitates conscious perception in OSM.

Effects of selective attention on the C1 ERP component: A systematic review and meta-analysis

The C1 event-related potential (ERP) captures the earliest stage of feedforward processing in the primary visual cortex (V1). An ongoing debate is whether top-down selective attention can modulate the C1. One side of the debate pointed out that null findings appear to outnumber positive findings; thus, selective attention does not seem to influence the C1. However, this suggestion is not based on a valid approach to summarizing evidence across studies. Therefore, we conducted a systematic review and meta-analysis investigating the effects of selective attention on the C1, involving 47 experiments and 794 subjects in total. Despite heterogeneity across studies, results suggested that attention has a moderate effect on the C1 (Cohen's d z $$ {d}_z $$  = 0.33, p < .0001); that is, C1 amplitude is larger for visual stimuli that are attended than unattended. These results suggest that C1 is affected by top-down selective attention.

A visual encoding model links magnetoencephalography signals to neural synchrony in human cortex

Synchronization of neuronal responses over large distances is hypothesized to be important for many cortical functions. However, no straightforward methods exist to estimate synchrony non-invasively in the living human brain. MEG and EEG measure the whole brain, but the sensors pool over large, overlapping cortical regions, obscuring the underlying neural synchrony. Here, we developed a model from stimulus to cortex to MEG sensors to disentangle neural synchrony from spatial pooling of the instrument. We find that synchrony across cortex has a surprisingly large and systematic effect on predicted MEG spatial topography. We then conducted visual MEG experiments and separated responses into stimulus-locked and broadband components. The stimulus-locked topography was similar to model predictions assuming synchronous neural sources, whereas the broadband topography was similar to model predictions assuming asynchronous sources. We infer that visual stimulation elicits two distinct types of neural responses, one highly synchronous and one largely asynchronous across cortex.

Scalp-recorded N40 visual evoked potential: Sensory and attentional properties

N40 is a well-known component of evoked potentials with respect to the auditory and somatosensory modality but not much recognized with regard to the visual modality. To be detected with event-related potentials (ERPs), it requires an optimal signal-to-noise ratio. To investigate the nature of visual N40, we recorded EEG/ERP signals from 20 participants. Each of them was presented with 1800 spatial frequency gratings of 0.75, 1.5, 3 and 6 c/deg. Data were collected from 128 sites while participants were engaged in both passive viewing and attention conditions. N40 (30-55 ms) was modulated by alertness and selective attention; in fact, it was larger to targets than irrelevant and passively viewed spatial frequency gratings. Its strongest intracranial sources were the bilateral thalamic nuclei of pulvinar, according to swLORETA. The active network included precuneus, insula and inferior parietal lobule. An N80 component (60-90 ms) was also identified, which was larger to targets than irrelevant/passive stimuli and more negative to high than low spatial frequencies. In contrast, N40 was not sensitive to spatial frequency per se, nor did it show a polarity inversion as a function of spatial frequency. Attention, alertness and spatial frequency effects were also found for the later components P1, N2 and P300. The attentional effects increased in magnitude over time. The data showed that ERPs can pick up the earliest synchronized activity, deriving in part from thalamic nuclei, before the visual information has actually reached the occipital cortex.

Modulation of the Earliest Component of the Human VEP by Spatial Attention: An Investigation of Task Demands

Spatial attention modulations of initial afferent activity in area V1, indexed by the first component “C1” of the human visual evoked potential, are rarely found. It has thus been suggested that early modulation is induced only by special task conditions, but what these conditions are remains unknown. Recent failed replications—findings of no C1 modulation using a certain task that had previously produced robust modulations—present a strong basis for examining this question. We ran 3 experiments, the first to more exactly replicate the stimulus and behavioral conditions of the original task, and the second and third to manipulate 2 key factors that differed in the failed replication studies: the provision of informative performance feedback, and the degree to which the probed stimulus features matched those facilitating target perception. Although there was an overall significant C1 modulation of 11%, individually, only experiments 1 and 2 showed reliable effects, underlining that the modulations do occur but not consistently. Better feedback induced greater P1, but not C1, modulations. Target-probe feature matching had an inconsistent influence on modulation patterns, with behavioral performance differences and signal-overlap analyses suggesting interference from extrastriate modulations as a potential cause.

Numerosities and Other Magnitudes in the Brains: A Comparative View

The ability to represent, discriminate, and perform arithmetic operations on discrete quantities (numerosities) has been documented in a variety of species of different taxonomic groups, both vertebrates and invertebrates. We do not know, however, to what extent similarity in behavioral data corresponds to basic similarity in underlying neural mechanisms. Here, we review evidence for magnitude representation, both discrete (countable) and continuous, following the sensory input path from primary sensory systems to associative pallial territories in the vertebrate brains. We also speculate on possible underlying mechanisms in invertebrate brains and on the role played by modeling with artificial neural networks. This may provide a general overview on the nervous system involvement in approximating quantity in different animal species, and a general theoretical framework to future comparative studies on the neurobiology of number cognition.

Human Sensory Cortex Contributes to the Long-Term Storage of Aversive Conditioning

Growing animal data evince a critical role of the sensory cortex in the long-term storage of aversive conditioning, following acquisition and consolidation in the amygdala. Whether and how this function is conserved in the human sensory cortex is nonetheless unclear. We interrogated this question in a human aversive conditioning study using multidimensional assessments of conditioning and long-term (15 d) retention. Conditioned stimuli (CSs; Gabor patches) were calibrated to differentially activate the parvocellular (P) and magnocellular (M) visual pathways, further elucidating cortical versus subcortical mechanisms. Full-blown conditioning and long-term retention emerged for M-biased CS (vs limited effects for P-biased CS), especially among anxious individuals, in all four dimensions assessed: threat appraisal (threat ratings), physiological arousal (skin conductance response), perceptual learning [discrimination sensitivity (d') and response speed], and cortical plasticity [visual evoked potentials (VEPs) and cortical current density]. Interestingly, while behavioral, physiological, and VEP effects were comparable at immediate and delayed assessments, the cortical substrates evolved markedly over time, transferring from high-order cortices [inferotemporal/fusiform cortex and orbitofrontal cortex (OFC)] immediately to the primary and secondary visual cortex after the delay. In sum, the contrast between P- and M-biased conditioning confirms privileged conditioning acquisition via the subcortical pathway while the immediate cortical plasticity lends credence to the triadic amygdala-OFC-fusiform network thought to underlie threat processing. Importantly, long-term retention of conditioning in the basic sensory cortices supports the conserved role of the human sensory cortex in the long-term storage of aversive conditioning.SIGNIFICANCE STATEMENT A growing network of neural substrates has been identified in threat learning and memory. The sensory cortex plays a key role in long-term threat memory in animals, but such a function in humans remains unclear. To explore this problem, we conducted multidimensional assessments of immediate and delayed (15 d) effects of human aversive conditioning. Behavioral, physiological, and scalp electrophysiological data demonstrated conditioning effects and long-term retention. High-density EEG intracranial source analysis further revealed the cortical underpinnings, implicating high-order cortices immediately and primary and secondary visual cortices after the long delay. Therefore, while high-order cortices support aversive conditioning acquisition (i.e., threat learning), the human sensory cortex (akin to the animal homolog) underpins long-term storage of conditioning (i.e., long-term threat memory).

Anatomic and functional asymmetries interactively shape human early visual cortex responses

Early visual processing is surprisingly flexible even in the adult brain. This flexibility involves both long-term structural plasticity and online adaptations conveyed by top-down feedback. Although this view is supported by rich evidence from both human behavioral studies and invasive electrophysiology in nonhuman models, it has proven difficult to close the gap between species. In particular, it remains debated whether noninvasive measures of neural activity can capture top-down modulations of the earliest stages of processing in the human visual cortex. We previously reported modulations of retinotopic C1, the earliest component of the human visual evoked potential. However, these effects were selectively observed in the upper visual field (UVF). Here we test whether this asymmetry is linked to an interaction between differences in spatial resolution across the visual field and the specific stimuli used in previous studies. We measured visual evoked potentials in response to task-irrelevant, high-contrast textures of different densities in a comparatively large sample of healthy volunteers (N = 31) using high-density electroencephalogram. Our results show differential response profiles for upper and lower hemifields, with UVF responses saturating at higher stimulus densities. In contrast, lower visual field responses did not increase, and even showed a tendency toward a decrease at the highest density tested. We propose that these findings reflect feature- and task-specific pooling of signals from retinotopic regions with different sensitivity profiles. Such complex interactions between anatomic and functional asymmetries need to be considered to resolve whether human early visual cortex activity is modulated by top-down factors.

Dissociating electrophysiological correlates of contextual and perceptual learning in a visual search task

Perceptual learning and contextual learning are two types of implicit visual learning that can co-occur in the same tasks. For example, to find an animal in the woods, you need to know where to look in the environment (contextual learning) and you must be able to discriminate its features (perceptual learning). However, contextual and perceptual learning are typically studied using distinct experimental paradigms, and little is known regarding their comparative neural mechanisms. In this study, we investigated contextual and perceptual learning in 12 healthy adult humans as they performed the same visual search task, and we examined psychophysical and electrophysiological (event-related potentials) measures of learning. Participants were trained to look for a visual stimulus, a small line with a specific orientation, presented among distractors. We found better performance for the trained target orientation as compared to an untrained control orientation, reflecting specificity of perceptual learning for the orientation of trained elements. This orientation specificity effect was associated with changes in the C1 component. We also found better performance for repeated spatial configurations as compared to novel ones, reflecting contextual learning. This context-specific effect was associated with the N2pc component. Taken together, these results suggest that contextual and perceptual learning are distinct visual learning phenomena that have different behavioral and electrophysiological characteristics.

The time course of different surround suppression mechanisms

What we see depends on the spatial context in which it appears. Previous work has linked the suppression of perceived contrast by surrounding stimuli to reduced neural responses in early visual cortex. This surround suppression depends on at least two separable neural mechanisms, "low-level" and "higher level," which can be differentiated by their response characteristics. We used electroencephalography to demonstrate for the first time that human occipital neural responses show evidence of these two suppression mechanisms. Eighteen adults (10 women, 8 men) each participated in three experimental sessions, in which they viewed visual stimuli through a mirror stereoscope. The first session was used to identify the C1 component, while the second and third comprised the main experiment. Event-related potentials were measured in response to center gratings either with no surround or with surrounding gratings oriented parallel or orthogonal, and presented in either the same eye (monoptic) or the opposite eye (dichoptic). We found that the earliest component of an event-related potential (C1; ∼60 ms) was suppressed by surrounding stimuli, but that suppression did not depend on surround configuration. This suggests a suppression mechanism that is not tuned for relative orientation acting on the earliest cortical response to the target. A later response component (N1; ∼160 ms) showed stronger suppression for parallel and monoptic surrounds, consistent with our earlier psychophysical results and a second form of suppression that is binocular and orientation tuned. We conclude that these two forms of surround suppression have distinct response time courses in the human visual system, which can be differentiated using electrophysiology.

The malleability of emotional perception: Short-term plasticity in retinotopic neurons accompanies the formation of perceptual biases to threat

Emotional experience changes visual perception, leading to the prioritization of sensory information associated with threats and opportunities. These emotional biases have been extensively studied by basic and clinical scientists, but their underlying mechanism is not known. The present study combined measures of brain-electric activity and autonomic physiology to establish how threat biases emerge in human observers. Participants viewed stimuli designed to differentially challenge known properties of different neuronal populations along the visual pathway: location, eye, and orientation specificity. Biases were induced using aversive conditioning with only 1 combination of eye, orientation, and location predicting a noxious loud noise and replicated in a separate group of participants. Selective heart rate-orienting responses for the conditioned threat stimulus indicated bias formation. Retinotopic visual brain responses were persistently and selectively enhanced after massive aversive learning for only the threat stimulus and dissipated after extinction training. These changes were location-, eye-, and orientation-specific, supporting the hypothesis that short-term plasticity in primary visual neurons mediates the formation of perceptual biases to threat. (PsycINFO Database Record

The spatiotemporal characteristics of the C1 component and its modulation by attention

Slotnick (this issue) provided a selective review of studies on the attentional modulation of the C1 component of the visual evoked potential, and offers a number of guidelines to maximize the likelihood of observing such modulation in terms of electrode choice, stimulus placement, and types of attentional cue and target stimulus. However, the broader literature pertaining to attentional modulation of the C1 does not support many of these guidelines, and the question of why exactly C1 modulations are so rare remains very much open. Here, we provide clarifications that are critical to an accurate appraisal of the current state of this literature.

Tuned by experience: How orientation probability modulates early perceptual processing

Probable stimuli are more often and more quickly detected. While stimulus probability is known to affect decision-making, it can also be explained as a perceptual phenomenon. Using spatial gratings, we have previously shown that probable orientations are also more precisely estimated, even while participants remained naive to the manipulation. We conducted an electrophysiological study to investigate the effect that probability has on perception and visual-evoked potentials. In line with previous studies on oddballs and stimulus prevalence, low-probability orientations were associated with a greater late positive 'P300' component which might be related to either surprise or decision-making. However, the early 'C1' component, thought to reflect V1 processing, was dampened for high-probability orientations while later P1 and N1 components were unaffected. Exploratory analyses revealed a participant-level correlation between C1 and P300 amplitudes, suggesting a link between perceptual processing and decision-making. We discuss how these probability effects could be indicative of sharpening of neurons preferring the probable orientations, due either to perceptual learning, or to feature-based attention.

Early retinotopic responses to violations of emotion-location associations may depend on conscious awareness

Reports of modulations of early visual processing suggest that retinotopic visual cortex may actively predict upcoming stimuli. We tested this idea by showing healthy human participants images of human faces at fixation, with different emotional expressions predicting stimuli in either the upper or the lower visual field. On infrequent test trials, emotional faces were followed by combined stimulation of upper and lower visual fields, thus violating previously established associations. Results showed no effects of such violations at the level of the retinotopic C1 of the visual evoked potential over the full sample. However, when separating participants who became aware of these associations from those who did not, we observed significant group differences during extrastriate processing of emotional faces, with inverse solution results indicating stronger activity in unaware subjects throughout the ventral visual stream. Moreover, within-group comparisons showed that the same peripheral stimuli elicited differential activity patterns during the C1 interval, depending on which stimulus elements were predictable. This effect was selectively observed in manipulation-aware subjects. Our results provide preliminary evidence for the notion that early visual processing stages implement predictions of upcoming events. They also point to conscious awareness as a moderator of predictive coding.

Numerosity processing in early visual cortex

While parietal cortex is thought to be critical for representing numerical magnitudes, we recently reported an event-related potential (ERP) study demonstrating selective neural sensitivity to numerosity over midline occipital sites very early in the time course, suggesting the involvement of early visual cortex in numerosity processing. However, which specific brain area underlies such early activation is not known. Here, we tested whether numerosity-sensitive neural signatures arise specifically from the initial stages of visual cortex, aiming to localize the generator of these signals by taking advantage of the distinctive folding pattern of early occipital cortices around the calcarine sulcus, which predicts an inversion of polarity of ERPs arising from these areas when stimuli are presented in the upper versus lower visual field. Dot arrays, including 8-32dots constructed systematically across various numerical and non-numerical visual attributes, were presented randomly in either the upper or lower visual hemifields. Our results show that neural responses at about 90ms post-stimulus were robustly sensitive to numerosity. Moreover, the peculiar pattern of polarity inversion of numerosity-sensitive activity at this stage suggested its generation primarily in V2 and V3. In contrast, numerosity-sensitive ERP activity at occipito-parietal channels later in the time course (210-230ms) did not show polarity inversion, indicating a subsequent processing stage in the dorsal stream. Overall, these results demonstrate that numerosity processing begins in one of the earliest stages of the cortical visual stream.

Motivational Salience Modulates Early Visual Cortex Responses across Task Sets

Motivationally relevant stimuli benefit from strengthened sensory processing. It is unclear, however, if motivational value of positive and negative valence has similar or dissociable effects on early visual processing. Moreover, whether these perceptual effects are task-specific, stimulus-specific, or more generally feature-based is unknown. In this study, we compared the effects of positive and negative motivational value on early sensory processing using ERPs. We tested the extent to which these effects could generalize to new task contexts and to stimuli sharing common features with the motivationally significant ones. At the behavioral level, stimuli paired with positive incentives were learned faster than stimuli paired with neutral or negative outcomes. The ERP results showed that monetary loss elicited higher neural activity in V1 (at the C1 level) compared with reward, whereas the latter influenced postperceptual processing stages (P300). Importantly, the early loss-related effect generalized to new contexts and to new stimuli with common features, whereas the later reward effects did not spill over to the new context. These results suggest that acquired negative motivational salience can influence early sensory processing by means of plastic changes in feature-based processing in V1.

Effects of Stimulus Size and Contrast on the Initial Primary Visual Cortical Response in Humans

Decades of intracranial electrophysiological investigation into the primary visual cortex (V1) have produced many fundamental insights into the computations carried out in low-level visual circuits of the brain. Some of the most important work has been simply concerned with the precise measurement of neural response variations as a function of elementary stimulus attributes such as contrast and size. Surprisingly, such simple but fundamental characterization of V1 responses has not been carried out in human electrophysiology. Here we report such a detailed characterization for the initial "C1" component of the scalp-recorded visual evoked potential (VEP). The C1 is known to be dominantly generated by initial afferent activation in V1, but is difficult to record reliably due to interindividual anatomical variability. We used pattern-pulse multifocal VEP mapping to identify a stimulus position that activates the left lower calcarine bank in each individual, and afterwards measured robust negative C1s over posterior midline scalp to gratings presented sequentially at that location. We found clear and systematic increases in C1 peak amplitude and decreases in peak latency with increasing size as well as with increasing contrast. With a sample of 15 subjects and ~180 trials per condition, reliable C1 amplitudes of -0.46 µV were evoked at as low a contrast as 3.13% and as large as -4.82 µV at 100% contrast, using stimuli of 3.33° diameter. A practical implication is that by placing sufficiently-sized stimuli to target favorable calcarine cortical loci, robust V1 responses can be measured at contrasts close to perceptual thresholds, which could greatly facilitate principled studies of early visual perception and attention.

To see or not to see; the ability of the magno- and parvocellular response to manifest itself in the VEP determines its appearance to a pattern reversing and pattern onset stimulus

INTRODUCTION

The relationship between stimulus property, brain activity, and the VEP is still a matter of uncertainty.

METHOD

We recorded the VEP of 43 volunteers when viewing a series of dartboard images presented as both a pattern reversing and pattern onset/offset stimulus. Across the dartboard images, the total stimulus area undergoing a luminance contrast change was varied in a graded manner.

RESULTS

We confirmed the presence of two independent neural processing stages. The amplitude of VEP components across our pattern reversing stimuli signaled a phasic neural response based on a temporal luminance contrast selective mechanism. The amplitude of VEP components across the pattern onset stimuli signaled both a phasic and a tonic neural response based on a temporal- and spatial luminance contrast selective mechanism respectively. Oscillation frequencies in the VEP suggested modulation of the phasic neural response by feedback from areas of the dorsal stream, while feedback from areas of the ventral stream modulated the tonic neural response. Each processing stage generated a sink and source phase in the VEP. Source localization indicated that during the sink phase electric current density was highest in V1, while during the source phase electric current density was highest in extra-striate cortex. Our model successfully predicted the appearance of the VEP to our images whether presented as a pattern reversing or a pattern onset/offset stimulus.

CONCLUSIONS

Focussing on the effects of a phasic and tonic response rather than contrast response function on the VEP, enabled us to develop a theory linking stimulus property, neural activity and the VEP.

Neurofeedback Therapy for Enhancing Visual Attention: State-of-the-Art and Challenges

We have witnessed a rapid development of brain-computer interfaces (BCIs) linking the brain to external devices. BCIs can be utilized to treat neurological conditions and even to augment brain functions. BCIs offer a promising treatment for mental disorders, including disorders of attention. Here we review the current state of the art and challenges of attention-based BCIs, with a focus on visual attention. Attention-based BCIs utilize electroencephalograms (EEGs) or other recording techniques to generate neurofeedback, which patients use to improve their attention, a complex cognitive function. Although progress has been made in the studies of neural mechanisms of attention, extraction of attention-related neural signals needed for BCI operations is a difficult problem. To attain good BCI performance, it is important to select the features of neural activity that represent attentional signals. BCI decoding of attention-related activity may be hindered by the presence of different neural signals. Therefore, BCI accuracy can be improved by signal processing algorithms that dissociate signals of interest from irrelevant activities. Notwithstanding recent progress, optimal processing of attentional neural signals remains a fundamental challenge for the development of efficient therapies for disorders of attention.

Feeling happy enhances early spatial encoding of peripheral information automatically: electrophysiological time-course and neural sources

Previous research has shown that positive mood may broaden attention, although it remains unclear whether this effect has a perceptual or a postperceptual locus. In this study, we addressed this question using high-density event-related potential methods. We randomly assigned participants to a positive or a neutral mood condition. Then they performed a demanding oddball task at fixation (primary task ensuring fixation) and a localization task of peripheral stimuli shown at three positions in the upper visual field (secondary task) concurrently. While positive mood did not influence behavioral performance for the primary task, it did facilitate stimulus localization on the secondary task. At the electrophysiological level, we found that the amplitude of the C1 component (reflecting an early retinotopic encoding of the stimulus in V1) was enhanced in the positive, as compared with the neutral, mood group. Importantly, this effect appeared to be largely automatic, because it occurred regardless of the task relevance of the peripheral stimulus and prior to top-down gain control effects seen at the level of the subsequent P1 component. This early effect was also observed irrespective of a change of the target-related P300 component (primary task) by positive mood. These results suggest that positive mood can automatically boost the spatial encoding of peripheral stimuli early on following stimulus onset. This effect can eventually underlie the broadening of spatial attention, which has been associated with this specific mood state.

Visual field asymmetries in visual evoked responses

Behavioral responses to visual stimuli exhibit visual field asymmetries, but cortical folding and the close proximity of visual cortical areas make electrophysiological comparisons between different stimulus locations problematic. Retinotopy-constrained source estimation (RCSE) uses distributed dipole models simultaneously constrained by multiple stimulus locations to provide separation between individual visual areas that is not possible with conventional source estimation methods. Magnetoencephalography and RCSE were used to estimate time courses of activity in V1, V2, V3, and V3A. Responses to left and right hemifield stimuli were not significantly different. Peak latencies for peripheral stimuli were significantly shorter than those for perifoveal stimuli in V1, V2, and V3A, likely related to the greater proportion of magnocellular input to V1 in the periphery. Consistent with previous results, sensor magnitudes for lower field stimuli were about twice as large as for upper field, which is only partially explained by the proximity to sensors for lower field cortical sources in V1, V2, and V3. V3A exhibited both latency and amplitude differences for upper and lower field responses. There were no differences for V3, consistent with previous suggestions that dorsal and ventral V3 are two halves of a single visual area, rather than distinct areas V3 and VP.

Electrophysiological measurement of the effect of inter-stimulus competition on early cortical stages of human vision

Competition between inputs in early visual cortex has been established as a key determinant in perception through decades of animal single cell and human fMRI research. We developed a novel ERP paradigm allowing this competition to be studied in humans, affording an opportunity to gain further insight into how competition is reflected at the neural level. Checkerboard stimuli were presented to elicit C1 (indexing processing in V1), C2 (hypothesized to reflect V1 after extrastriate feedback), and P1 (extrastriate) components. Stimuli were presented in three randomized conditions: single stimulus, near proximity pairs and far proximity pairs. Importantly, near stimuli (0.16° visual angle apart) were positioned to compete in primary visual cortex, whereas far stimuli (2° apart) were positioned to compete in extrastriate visual areas.

As predicted, the degree and spatial range of competition increased from the C1 component to the C2 and P1 components. Specifically, competitive interactions in C1 amplitude were modest and present only for near-proximity pairs, whereas substantial competition was present for the P1, even for far-proximity pairs. To our knowledge, this is the first study to measure how competition unfolds over time in human visual cortex. Importantly, this method provides an empirical means of measuring competitive interactions at specific stages of visual processing, rendering it possible to rigorously test predictions about the effects of competition on perception, attention, and working memory.

•

Novel paradigm measuring how competition unfolds over time in human visual cortex.

•

Degree and spatial range of competition increased over the first 150 ms poststimulus.

•

C1 interactions for near-proximity pairs; large P1 interactions even at far-proximity.

Towards obtaining spatiotemporally precise responses to continuous sensory stimuli in humans: a general linear modeling approach to EEG

Noninvasive investigation of human sensory processing with high temporal resolution typically involves repeatedly presenting discrete stimuli and extracting an average event-related response from scalp recorded neuroelectric or neuromagnetic signals. While this approach is and has been extremely useful, it suffers from two drawbacks: a lack of naturalness in terms of the stimulus and a lack of precision in terms of the cortical response generators. Here we show that a linear modeling approach that exploits functional specialization in sensory systems can be used to rapidly obtain spatiotemporally precise responses to complex sensory stimuli using electroencephalography (EEG). We demonstrate the method by example through the controlled modulation of the contrast and coherent motion of visual stimuli. Regressing the data against these modulation signals produces spatially focal, highly temporally resolved response measures that are suggestive of specific activation of visual areas V1 and V6, respectively, based on their onset latency, their topographic distribution and the estimated location of their sources. We discuss our approach by comparing it with fMRI/MRI informed source analysis methods and, in doing so, we provide novel information on the timing of coherent motion processing in human V6. Generalizing such an approach has the potential to facilitate the rapid, inexpensive spatiotemporal localization of higher perceptual functions in behaving humans.

Modulation of early cortical processing during divided attention to non-contiguous locations

We often face the challenge of simultaneously attending to multiple non-contiguous regions of space. There is ongoing debate as to how spatial attention is divided under these situations. Whereas, for several years, the predominant view was that humans could divide the attentional spotlight, several recent studies argue in favor of a unitary spotlight that rhythmically samples relevant locations. Here, this issue was addressed by the use of high-density electrophysiology in concert with the multifocal m-sequence technique to examine visual evoked responses to multiple simultaneous streams of stimulation. Concurrently, we assayed the topographic distribution of alpha-band oscillatory mechanisms, a measure of attentional suppression. Participants performed a difficult detection task that required simultaneous attention to two stimuli in contiguous (undivided) or non-contiguous parts of space. In the undivided condition, the classic pattern of attentional modulation was observed, with increased amplitude of the early visual evoked response and increased alpha amplitude ipsilateral to the attended hemifield. For the divided condition, early visual responses to attended stimuli were also enhanced, and the observed multifocal topographic distribution of alpha suppression was in line with the divided attention hypothesis. These results support the existence of divided attentional spotlights, providing evidence that the corresponding modulation occurs during initial sensory processing time-frames in hierarchically early visual regions, and that suppressive mechanisms of visual attention selectively target distracter locations during divided spatial attention.

Optimization of retinotopy constrained source estimation constrained by prior

Studying how the timing and amplitude of visual evoked responses (VERs) vary between visual areas is important for understanding visual processing but is complicated by difficulties in reliably estimating VERs in individual visual areas using noninvasive brain measurements. Retinotopy constrained source estimation (RCSE) addresses this challenge by using multiple, retinotopically mapped stimulus locations to simultaneously constrain estimates of VERs in visual areas V1, V2, and V3, taking advantage of the spatial precision of fMRI retinotopy and the temporal resolution of magnetoencephalography (MEG) or electroencephalography (EEG). Nonlinear optimization of dipole locations, guided by a group-constrained RCSE solution as a prior, improved the robustness of RCSE. This approach facilitated the analysis of differences in timing and amplitude of VERs between V1, V2, and V3, elicited by stimuli with varying luminance contrast in a sample of eight adult humans. The V1 peak response was 37% larger than that of V2 and 74% larger than that of V3, and also ~10-20 ms earlier. Normalized contrast response functions were nearly identical for the three areas. Results without dipole optimization, or with other nonlinear methods not constrained by prior estimates were similar but suffered from greater between-subject variability. The increased reliability of estimates offered by this approach may be particularly valuable when using a smaller number of stimulus locations, enabling a greater variety of stimulus and task manipulations.

The cruciform model of striate generation of the early VEP, re-illustrated, not revoked: a reply to Ales et al. (2013)

Here we summarize the points raised in our dialog with Ales and colleagues on the cortical generators of the early visual evoked potential (VEP), and offer observations on the results of additional simulations that were run in response to our original comment. For small stimuli placed at locations in the upper and lower visual field for which the human VEP has been well characterized, simulated scalp projections of each of the visual areas V1, V2 and V3 invert in polarity. However, the empirically measured, earliest VEP component, "C1," matches the simulated V1 generators in terms of polarity and topography, but not the simulated V2 and V3 generators. We thus conclude that, 1) consistent with the title of Ales et al. (2010a), polarity inversion on its own is not a sufficient criterion for inferring neuroelectric sources in primary visual cortex; but 2) inconsistent with additional claims made in Ales et al. (2010a), the simulated topographies provide additional evidence for - not against - the tenet that the C1 component is generated in V1.

Exploiting individual primary visual cortex geometry to boost steady state visual evoked potentials

OBJECTIVE

The steady-state visual evoked potential (SSVEP) is an electroencephalographic response to flickering stimuli generated partly in primary visual area V1. The typical 'cruciform' geometry and retinotopic organization of V1 is such that certain neighboring visual regions project to neighboring cortical regions of opposite orientation. Here, we explored ways to exploit this organization in order to boost scalp SSVEP amplitude via oscillatory summation.

APPROACH

We manipulated flicker-phase offsets among angular segments of a large annular stimulus in three ways, and compared the resultant SSVEP power to a conventional condition with no temporal phase offsets. (1) We divided the annulus into standard octants for all subjects, and flickered upper horizontal octants with opposite temporal phase to the lower horizontal ones, and left vertical octants opposite to the right vertical ones; (2) we individually adjusted the boundaries between the eight contiguous segments of the standard octants condition to coincide with cruciform-consistent, early-latency topographical shifts in pattern-pulse multifocal visual-evoked potentials (PPMVEP) derived for each of 32 equal-sized segments; (3) we assigned phase offsets to stimulus segments following an automatic algorithm based on the relative amplitudes of vertically- and horizontally-oriented PPMVEP components.

MAIN RESULTS

The three flicker-phase manipulations resulted in a significant enhancement of normalized SSVEP power of (1) 202%, (2) 383%, and (3) 300%, respectively.

SIGNIFICANCE

We have thus demonstrated a means to obtain more reliable measures of visual evoked activity purely through consideration of cortical geometry. This principle stands to impact both basic and clinical research using SSVEPs.

On determining the intracranial sources of visual evoked potentials from scalp topography: a reply to Kelly et al. (this issue)

The cruciform model posits that if a Visual Evoked Potential component originates in cortical area V1, then stimuli placed in the upper versus lower visual field will generate responses with opposite polarity at the scalp. In our original paper (Ales et al., 2010b) we showed that the cruciform model provides an insufficient criterion for identifying V1 sources. This conclusion was reached on the basis of simulations that used realistic 3D models of early visual areas to simulate scalp topographies expected for stimuli of different sizes and shapes placed in different field locations. The simulations indicated that stimuli placed in the upper and lower visual field produce polarity inverting scalp topographies for activation of areas V2 and V3, but not for area V1. As a consequence of the non-uniqueness of the polarity inversion criterion, we suggested that past studies using the cruciform model had not adequately excluded contributions from sources outside V1. In their comment on our paper, Kelly et al. (this issue) raise several concerns with this suggestion. They claim that our initial results did not use the proper stimulus locations to constitute a valid test of the cruciform model. Kelly et al., also contend that the cortical source of the initial visually evoked component (C1) can be identified based on latency and polarity criteria derived from intracranial recordings in non-human primates. In our reply we show that simulations using the suggested critical stimulus locations are consistent with our original findings and thus do not change our conclusions regarding the use of the polarity inversion criterion. We further show that the anatomical assumptions underlying the putatively optimal locations are not consistent with available V1 anatomical data. We then address the non-human primate data, describing how differences in stimuli across studies and species confound an effective utilization of the non-human primate data for interpreting human evoked potential responses. We also show that, considered more broadly, the non-human primate literature shows that multiple visual areas onset simultaneously with V1. We suggest several directions for future research that will further clarify how to make the best use of scalp data for inferring cortical sources.

Visual sensory processing deficits in schizophrenia: is there anything to the magnocellular account?

Visual processing studies have repeatedly shown impairment in patients with schizophrenia compared to healthy controls. Electroencephalography (EEG) and, specifically, visual evoked potential (VEP) studies have identified an early marker of this impairment in the form of a decrement in the P1 component of the VEP in patients and their clinically unaffected first-degree relatives. Much behavioral and neuroimaging research has implicated specific dysfunction of either the subcortical magnocellular pathway or the cortical visual dorsal stream in this impairment. In this study, EEG responses were obtained to the contrast modulation of checkerboard stimuli using the VESPA (Visual Evoked Spread Spectrum Analysis) method. This was done for a high contrast condition and, in order to bias the stimuli towards the magnocellular pathway, a low contrast condition. Standard VEPs were also obtained using high contrast pattern reversing checkerboards. Responses were measured using high-density electrical scalp recordings in 29 individuals meeting DSM-IV criteria for schizophrenia and in 18 control subjects. Replicating previous research, a large (Cohen's d=1.11) reduction in the P1 component of the VEP was seen in patients when compared with controls with no corresponding difference in the VESPA response to high contrast stimuli. In addition, the low-contrast VESPA displayed no difference between patients and controls. Furthermore, no differences were seen between patients and controls for the C1 components of either the VEP or the high-contrast VESPA. Based on the differing acquisition methods between VEP and VESPA, we discuss these results in terms of contrast gain control and the possibility of dysfunction at the cortical level with initial afferent activity into V1 along the magnocellular pathway being intact when processing is biased towards that pathway using low contrast stimuli.

Systematic biases in early ERP and ERF components as a result of high-pass filtering

The event-related potential (ERP) and event-related field (ERF) techniques provide valuable insights into the time course of processes in the brain. Because neural signals are typically weak, researchers commonly filter the data to increase the signal-to-noise ratio. However, filtering may distort the data, leading to false results. Using our own EEG data, we show that acausal high-pass filtering can generate a systematic bias easily leading to misinterpretations of neural activity. In particular, we show that the early ERP component C1 is very sensitive to such effects. Moreover, we found that about half of the papers reporting modulations in the C1 range used a high-pass digital filter cut-off above the recommended maximum of 0.1 Hz. More generally, among 185 relevant ERP/ERF publications, 80 used cutoffs above 0.1 Hz. As a consequence, part of the ERP/ERF literature may need to be re-analyzed. We provide guidelines on how to minimize filtering artifacts.

Generation of the VESPA response to rapid contrast fluctuations is dominated by striate cortex: evidence from retinotopic mapping

The VESPA (visual-evoked spread spectrum analysis) method derives an impulse response function of the visual system from scalp electroencephalographic (EEG) data using the controlled modulation of some feature of a visual stimulus. Recent research using VESPA responses to modulations of stimulus contrast has provided new insights into both early visual attention mechanisms and the specificity of visual-processing deficits in schizophrenia. To allow a fuller interpretation of these and future findings, it is necessary to further characterize the VESPA in terms of its underlying cortical generators. To that end, we here examine spatio-temporal variations in the components of the VESPA as a function of stimulus location. We found that the first two VESPA components (C1/P1) each have a posterior dorsal midline focus and reverse in polarity across the horizontal meridian, consistent with retinotopic projections to calcarine cortex (V1) for the stimulus locations tested. Furthermore, the focal scalp topography of the VESPA was strikingly constant across the entire C1-P1 timeframe (50-120 ms) for each stimulus location, with negligible global scalp activity visible at the zero-crossing dividing the two. This indicates a common focal source underpinning both components, which was further supported by a significant correlation between C1 and P1 amplitudes across subjects (r=0.54; p<0.05). These results, along with factors implicit in the method of derivation of the contrast-VESPA, lead us to conclude that these responses are dominated by activity from striate cortex. We discuss the implications of this finding for previous and future research using the VESPA.