Distinct ventral stream and prefrontal cortex representational dynamics during sustained conscious visual perception

Instances of sustained stationary sensory input are ubiquitous. However, previous work focused almost exclusively on transient onset responses. This presents a critical challenge for neural theories of consciousness, which should account for the full temporal extent of experience. To address this question, we use intracranial recordings from ten human patients with epilepsy to view diverse images of multiple durations. We reveal that, in sensory regions, despite dramatic changes in activation magnitude, the distributed representation of categories and exemplars remains sustained and stable. In contrast, in frontoparietal regions, we find transient content representation at stimulus onset. Our results highlight the connection between the anatomical and temporal correlates of experience. To the extent perception is sustained, it may rely on sensory representations and to the extent perception is discrete, centered on perceptual updating, it may rely on frontoparietal representations.

Error monitoring when no errors are possible: Arbitrary free-choice decisions invoke error monitoring processes

Some decisions make a difference, but most are arbitrary and inconsequential, like which of several identical new pairs of socks should I wear? Healthy people swiftly make such decisions even with no rational reasons to rely on. In fact, arbitrary decisions have been suggested as demonstrating "free will". However, several clinical populations and some healthy individuals have significant difficulties in making such arbitrary decisions. Here, we investigate the mechanisms involved in arbitrary picking decisions. We show that these decisions, arguably based on a whim, are subject to similar control mechanisms as reasoned decisions. Specifically, error-related negativity (ERN) brain response is elicited in the EEG following change of intention, without an external definition of error, and motor activity in the non-responding hand resembles actual errors both by its muscle EMG temporal dynamics and by the lateralized readiness potential (LRP) pattern. This provides new directions in understanding decision-making and its deficits.

Distinct interacting cortical networks for stimulus-response and repetition-suppression

Non-invasive studies consider the initial neural stimulus response (SR) and repetition suppression (RS) - the decreased response to repeated sensory stimuli - as engaging the same neurons. That is, RS is a suppression of the SR. We challenge this conjecture using electrocorticographic (ECoG) recordings with high spatial resolution in ten patients listening to task-irrelevant trains of auditory stimuli. SR and RS were indexed by high-frequency activity (HFA) across temporal, parietal, and frontal cortices. HFASR and HFARS were temporally and spatially distinct, with HFARS emerging later than HFASR and showing only a limited spatial intersection with HFASR: most HFASR sites did not demonstrate HFARS, and HFARS was found where no HFASR could be recorded. β activity was enhanced in HFARS compared to HFASR cortical sites. θ activity was enhanced in HFASR compared to HFARS sites. Furthermore, HFASR sites propagated information to HFARS sites via transient θ:β phase-phase coupling. In contrast to predictive coding (PC) accounts our results indicate that HFASR and HFARS are functionally linked but have minimal spatial overlap. HFASR might enable stable and rapid perception of environmental stimuli across extended temporal intervals. In contrast HFARS might support efficient generation of an internal model based on stimulus history.

Neuroscientific Evidence for Processing Without Awareness

The extent to which we are affected by perceptual input of which we are unaware is widely debated. By measuring neural responses to sensory stimulation, neuroscientific data could complement behavioral results with valuable evidence. Here we review neuroscientific findings of processing of high-level information, as well as interactions with attention and memory. Although the results are mixed, we find initial support for processing object categories and words, possibly to the semantic level, as well as emotional expressions. Robust neural evidence for face individuation and integration of sentences or scenes is lacking. Attention affects the processing of stimuli that are not consciously perceived, and such stimuli may exogenously but not endogenously capture attention when relevant, and be maintained in memory over time. Sources of inconsistency in the literature include variability in control for awareness as well as individual differences, calling for future studies that adopt stricter measures of awareness and probe multiple processes within subjects.

Context Sensitivity across Multiple Time scales with a Flexible Frequency Bandwidth

Everyday auditory streams are complex, including spectro-temporal content that varies at multiple timescales. Using EEG, we investigated the sensitivity of human auditory cortex to the content of past stimulation in unattended sequences of equiprobable tones. In 3 experiments including 82 participants overall, we found that neural responses measured at different latencies after stimulus onset were sensitive to frequency intervals computed over distinct timescales. Importantly, early responses were sensitive to a longer history of stimulation than later responses. To account for these results, we tested a model consisting of neural populations with frequency-specific but broad tuning that undergo adaptation with exponential recovery. We found that the coexistence of neural populations with distinct recovery rates can explain our results. Furthermore, the adaptation bandwidth of these populations depended on spectral context-it was wider when the stimulation sequence had a wider frequency range. Our results provide electrophysiological evidence as well as a possible mechanistic explanation for dynamic and multiscale context-dependent auditory processing in the human cortex.

Brain-based concealed memory detection is driven mainly by orientation to salient items

In the pursuit of new methods for concealed memory detection, event-related potential components (ERP) have been placed at the forefront of research. No method, however, is scientifically complete without a theory and the present study therefore aimed to unravel the cognitive processes underlying these ERPs (i.e., orienting and arousal inhibition). This was accomplished by using a Concealed Information Test (CIT) in which participants were once motivated to conceal and once motivated to reveal their identity. The results showed a similarly strong P3 CIT effect in the two motivational conditions, which was enhanced for high salience compared to low salience identity items. Similar results were observed when using a multivariate machine-learning algorithm - suggesting that brain-based concealed memory detection is driven mainly by orientation to salient stimuli, rather than by arousal inhibition. In addition, the algorithm, trained and tested on the ERPs of different identity items, achieved detection rates exceeding those achieved by the P3. This implies that CIT researchers and practitioners could potentially rely on the entire ERP waveform instead of a-priori selecting separate components. Together these results enrich current understanding of the mechanisms underlying neurophysiological responding to concealed information and pave the way for novel and powerful algorithms which could be used in real-life forensic investigations.

Direct Evidence for Prediction Signals in Frontal Cortex Independent of Prediction Error

Predictive coding (PC) has been suggested as one of the main mechanisms used by brains to interact with complex environments. PC theories posit top-down prediction signals, which are compared with actual outcomes, yielding in turn prediction error (PE) signals, which are used, bottom-up, to modify the ensuing predictions. However, disentangling prediction from PE signals has been challenging. Critically, while many studies found indirect evidence for PC in the form of PE signals, direct evidence for the prediction signal is mostly lacking. Here, we provide clear evidence, obtained from intracranial cortical recordings in human surgical patients, that the human lateral prefrontal cortex evinces prediction signals while anticipating an event. Patients listened to task-irrelevant sequences of repetitive tones including infrequent predictable or unpredictable pitch deviants. The broadband high-frequency amplitude (HFA) was decreased prior to the onset of expected relative to unexpected deviants in the frontal cortex only, and its amplitude was sensitive to the increasing likelihood of deviants following longer trains of standards in the unpredictable condition. Single-trial HFA predicted deviations and correlated with poststimulus response to deviations. These results provide direct evidence for frontal cortex prediction signals independent of PE signals.

Face Selective Neural Activity: Comparisons Between Fixed and Free Viewing

Event Related Potentials (ERPs) are widely used to study category-selective EEG responses to visual stimuli, such as the face-selective N170 component. Typically, this is done by flashing stimuli at the point of static gaze fixation. While allowing for good experimental control, these paradigms ignore the dynamic role of eye-movements in natural vision. Fixation-related potentials (FRPs), obtained using simultaneous EEG and eye-tracking, overcome this limitation. Various studies have used FRPs to study processes such as lexical processing, target detection and attention allocation. The goal of this study was to carefully compare face-sensitive activity time-locked to an abrupt stimulus onset at fixation, with that time-locked to a self-generated fixation on a stimulus. Twelve participants participated in three experimental conditions: Free-viewing (FRPs), Cued-viewing (FRPs) and Control (ERPs). We used a multiple regression approach to disentangle overlapping activity components. Our results show that the N170 face-effect is evident for the first fixation on a stimulus, whether it follows a self-generated saccade or stimulus appearance at fixation point. The N170 face-effect has similar topography across viewing conditions, but there were major differences within each stimulus category. We ascribe these differences to an overlap of the fixation-related lambda response and the N170. We tested the plausibility of this account using dipole simulations. Finally, the N170 exhibits category-specific adaptation in free viewing. This study establishes the comparability of the free-viewing N170 face-effect with the classic event-related effect, while highlighting the importance of accounting for eye-movement related effects.

Resting-state EEG topographies: Reliable and sensitive signatures of unilateral spatial neglect

Theoretical advances in the neurosciences are leading to the development of an increasing number of proposed interventions for the enhancement of functional recovery after brain damage. Integration of these novel approaches in clinical practice depends on the availability of reliable, simple, and sensitive biomarkers of impairment level and extent of recovery, to enable an informed clinical-decision process. However, the neuropsychological tests currently in use do not tap into the complex neural re-organization process that occurs after brain insult and its modulation by treatment. Here we show that topographical analysis of resting-state electroencephalography (rsEEG) patterns using singular value decomposition (SVD) could be used to capture these processes. In two groups of subacute stroke patients, we show reliable detection of deviant neurophysiological patterns over repeated measurement sessions on separate days. These patterns generalized across patients groups. Additionally, they maintained a significant association with ipsilesional attention bias, discriminating patients with spatial neglect of different severity levels. The sensitivity and reliability of these rsEEG topographical analyses support their use as a tool for monitoring natural and treatment-induced recovery in the rehabilitation process.

Effect of Aging on Change of Intention

Decision making often requires making arbitrary choices ("picking") between alternatives that make no difference to the agent, that are equally desirable, or when the potential reward is unknown. Using event-related potentials we tested the effect of age on this common type of decision making. We compared two age groups: ages 18-25, and ages 41-67 on a masked-priming paradigm while recording EEG and EMG. Participants pressed a right or left button following either an instructive arrow cue or a neutral free-choice picking cue, both preceded by a masked arrow or neutral prime. The prime affected the behavior on the Instructed and the Free-choice picking conditions both in the younger and older groups. Moreover, electrophysiological "Change of Intention" (ChoI) was observed via lateralized readiness potential (LRP) in both age groups - the polarity of the LRP indicated first preparation to move the primed hand and then preparation to move the other hand. However, the older participants were more conservative in responding to the instructive cue, exhibiting a speed-accuracy trade-off, with slower response times, less errors in incongruent trials, and reduced probability of EMG activity in the non-responding hand. Additionally, "Change of Intention" was observed in both age groups in slow RT trials with a neutral prime as a result of an endogenous early intention to respond in a direction opposite the eventual instructing arrow cue. We conclude that the basic behavioral and electrophysiological signatures of implicit ChoI are common to a wide range of ages. However, older subjects, despite showing a similar dynamic decision trajectory as younger adults, are slower, more prudent and finalize the decision making process before letting the information affect the peripheral motor system. In contrast, the flow of information in younger subjects occurs in parallel to the decision process.

Evidence for Linear but Not Helical Automatic Representation of Pitch in the Human Auditory System

The perceptual organization of pitch is frequently described as helical, with a monotonic dimension of pitch height and a circular dimension of pitch chroma, accounting for the repeating structure of the octave. Although the neural representation of pitch height is widely studied, the way in which pitch chroma representation is manifested in neural activity is currently debated. We tested the automaticity of pitch chroma processing using the MMN—an ERP component indexing automatic detection of deviations from auditory regularity. Musicians trained to classify pure or complex tones across four octaves, based on chroma—C versus G (21 participants, Experiment 1) or C versus F# (27, Experiment 2). Next, they were passively exposed to MMN protocols designed to test automatic detection of height and chroma deviations. Finally, in an “attend chroma” block, participants had to detect the chroma deviants in a sequence similar to the passive MMN sequence. The chroma deviant tones were accurately detected in the training and the attend chroma parts both for pure and complex tones, with a slightly better performance for complex tones. However, in the passive blocks, a significant MMN was found only to height deviations and complex tone chroma deviations, but not to pure tone chroma deviations, even for perfect performers in the active tasks. These results indicate that, although height is represented preattentively, chroma is not. Processing the musical dimension of chroma may require higher cognitive processes, such as attention and working memory.

Human posterior parietal cortex responds to visual stimuli as early as peristriate occipital cortex

Much of what is known about the timing of visual processing in the brain is inferred from intracranial studies in monkeys, with human data limited to mainly noninvasive methods with lower spatial resolution. Here, we estimated visual onset latencies from electrocorticographic (ECoG) recordings in a patient who was implanted with 112 subdural electrodes, distributed across the posterior cortex of the right hemisphere, for presurgical evaluation of intractable epilepsy. Functional MRI prior to surgery was used to determine boundaries of visual areas. The patient was presented with images of objects from several categories. Event-related potentials (ERPs) were calculated across all categories excluding targets, and statistically reliable onset latencies were determined, using a bootstrapping procedure over the single trial baseline activity in individual electrodes. The distribution of onset latencies broadly reflected the known hierarchy of visual areas, with the earliest cortical responses in primary visual cortex, and higher areas showing later responses. A clear exception to this pattern was a robust, statistically reliable and spatially localized, very early response, on the bank of the posterior intraparietal sulcus (IPS). The response in the IPS started nearly simultaneously with responses detected in peristriate visual areas, around 60 ms poststimulus onset. Our results support the notion of early visual processing in the posterior parietal lobe, not respecting traditional hierarchies, and give direct evidence for onset times of visual responses across the human cortex.

Alternative outcomes create biased expectations regarding the received outcome: Evidence from event-related potentials

After choosing between uncertain options, one might get feedback on both the outcome of the chosen option and the outcome of the unchosen option (the alternative). Behavioral research has shown that in such cases people engage in outcome comparison, and that the alternative outcome influences the way one evaluates his own received outcome. Moreover, this influence differs whether one was responsible or not for the choice made. In two studies, we looked for the electrophysiological correlates of outcome comparison. Subjects chose one of two boxes shown on the screen, each box contained a gain or a loss. The alternative outcome was always revealed first, followed by the received outcome. In half of the trials the software picked one box instead of subjects. We tested whether the feedback-related negativity (FRN) and the P3 elicited by the received reflect outcome comparison. As expected, we found that the FRN and P3 were more positive when the received outcome was a gain (vs. a loss). The FRN and P3 were also sensitive to the value of the alternative outcome, but contrary to our predictions, they were more positive when the alternative outcome was a gain (vs. a loss). As the FRN and P3 are sensitive to expectations, we hypothesized that our findings might result from subjects' biased expectations: subjects might have wrongly believed that a good (bad) alternative outcome signaled a bad (good) received outcome. This hypothesis, coined as the Alternative Omen Effect, was confirmed in parallel in a series of behavioral experiments: people see an illusory negative correlation between the uncorrelated outcomes of choice options (reported in Marciano-Romm et al. (2016)). A challenge for future research will be to disentangle the effects of expectation from those of outcome comparison.

Increasing suppression of saccade-related transients along the human visual hierarchy

A key hallmark of visual perceptual awareness is robustness to instabilities arising from unnoticeable eye and eyelid movements. In previous human intracranial (iEEG) work (Golan et al., 2016) we found that excitatory broadband high-frequency activity transients, driven by eye blinks, are suppressed in higher-level but not early visual cortex. Here, we utilized the broad anatomical coverage of iEEG recordings in 12 eye-tracked neurosurgical patients to test whether a similar stabilizing mechanism operates following small saccades. We compared saccades (1.3°−3.7°) initiated during inspection of large individual visual objects with similarly-sized external stimulus displacements. Early visual cortex sites responded with positive transients to both conditions. In contrast, in both dorsal and ventral higher-level sites the response to saccades (but not to external displacements) was suppressed. These findings indicate that early visual cortex is highly unstable compared to higher-level visual regions which apparently constitute the main target of stabilizing extra-retinal oculomotor influences.

Auditory-visual integration modulates location-specific repetition suppression of auditory responses

Space is a dimension shared by different modalities, but at what stage spatial encoding is affected by multisensory processes is unclear. Early studies observed attenuation of N1/P2 auditory evoked responses following repetition of sounds from the same location. Here, we asked whether this effect is modulated by audiovisual interactions. In two experiments, using a repetition-suppression paradigm, we presented pairs of tones in free field, where the test stimulus was a tone presented at a fixed lateral location. Experiment 1 established a neural index of auditory spatial sensitivity, by comparing the degree of attenuation of the response to test stimuli when they were preceded by an adapter sound at the same location versus 30° or 60° away. We found that the degree of attenuation at the P2 latency was inversely related to the spatial distance between the test stimulus and the adapter stimulus. In Experiment 2, the adapter stimulus was a tone presented from the same location or a more medial location than the test stimulus. The adapter stimulus was accompanied by a simultaneous flash displayed orthogonally from one of the two locations. Sound-flash incongruence reduced accuracy in a same-different location discrimination task (i.e., the ventriloquism effect) and reduced the location-specific repetition-suppression at the P2 latency. Importantly, this multisensory effect included topographic modulations, indicative of changes in the relative contribution of underlying sources across conditions. Our findings suggest that the auditory response at the P2 latency is affected by spatially selective brain activity, which is affected crossmodally by visual information.

Neural mechanisms of rhythm-based temporal prediction: Delta phase-locking reflects temporal predictability but not rhythmic entrainment

Predicting the timing of upcoming events enables efficient resource allocation and action preparation. Rhythmic streams, such as music, speech, and biological motion, constitute a pervasive source for temporal predictions. Widely accepted entrainment theories postulate that rhythm-based predictions are mediated by synchronizing low-frequency neural oscillations to the rhythm, as indicated by increased phase concentration (PC) of low-frequency neural activity for rhythmic compared to random streams. However, we show here that PC enhancement in scalp recordings is not specific to rhythms but is observed to the same extent in less periodic streams if they enable memory-based prediction. This is inconsistent with the predictions of a computational entrainment model of stronger PC for rhythmic streams. Anticipatory change in alpha activity and facilitation of electroencephalogram (EEG) manifestations of response selection are also comparable between rhythm- and memory-based predictions. However, rhythmic sequences uniquely result in obligatory depression of preparation-related premotor brain activity when an on-beat event is omitted, even when it is strategically beneficial to maintain preparation, leading to larger behavioral costs for violation of prediction. Thus, while our findings undermine the validity of PC as a sign of rhythmic entrainment, they constitute the first electrophysiological dissociation, to our knowledge, between mechanisms of rhythmic predictions and of memory-based predictions: the former obligatorily lead to resonance-like preparation patterns (that are in line with entrainment), while the latter allow flexible resource allocation in time regardless of periodicity in the input. Taken together, they delineate the neural mechanisms of three distinct modes of preparation: continuous vigilance, interval-timing-based prediction and rhythm-based prediction.

Hierarchies of Attention and Experimental Designs: Effects of Spatial and Intermodal Attention Revisited

When attention is directed to stimuli in a given modality and location, information processing in other irrelevant modalities at this location is affected too. This spread of attention to irrelevant stimuli is often interpreted as superiority of location selection over modality selection. However, this conclusion is based on experimental paradigms in which spatial attention was transient whereas intermodal attention was sustained. Furthermore, whether modality selection affects processing in the task-relevant modality at irrelevant locations remains an open question. Here, we addressed effects of simultaneous spatial and intermodal attention in an EEG study using a balanced design where spatial attention was transient and intermodal attention sustained or vice versa. Effects of spatial attention were not affected by which modality was attended and effects of intermodal attention were not affected by whether the stimuli were at the attended location or not. This suggests not only spread of spatial attention to task-irrelevant modalities but also spread of intermodal attention to task-irrelevant locations. Whether spatial attention was transient or sustained did not alter the effect of spatial attention on visual N1 and Nd1 responses. Prestimulus preparatory occipital alpha band responses were affected by both transient and sustained spatial cueing, whereas late post-stimulus responses were more strongly affected by sustained than by transient spatial attention. Sustained but not transient intermodal attention affected late responses (>200 msec) to visual stimuli. Together, the results undermine the universal superiority of spatial attention and suggest that the mode of attention manipulation is an important factor determining attention effects.

Non-Sinusoidal Activity Can Produce Cross-Frequency Coupling in Cortical Signals in the Absence of Functional Interaction between Neural Sources

The analysis of cross-frequency coupling (CFC) has become popular in studies involving intracranial and scalp EEG recordings in humans. It has been argued that some cases where CFC is mathematically present may not reflect an interaction of two distinct yet functionally coupled neural sources with different frequencies. Here we provide two empirical examples from intracranial recordings where CFC can be shown to be driven by the shape of a periodic waveform rather than by a functional interaction between distinct sources. Using simulations, we also present a generalized and realistic scenario where such coupling may arise. This scenario, which we term waveform-dependent CFC, arises when sharp waveforms (e.g., cortical potentials) occur throughout parts of the data, in particular if they occur rhythmically. Since the waveforms contain both low- and high-frequency components, these components can be inherently phase-aligned as long as the waveforms are spaced with appropriate intervals. We submit that such behavior of the data, which seems to be present in various cortical signals, cannot be interpreted as reflecting functional modulation between distinct neural sources without additional evidence. In addition, we show that even low amplitude periodic potentials that cannot be readily observed or controlled for, are sufficient for significant CFC to occur.

Human intracranial recordings link suppressed transients rather than 'filling-in' to perceptual continuity across blinks

We hardly notice our eye blinks, yet an externally generated retinal interruption of a similar duration is perceptually salient. We examined the neural correlates of this perceptual distinction using intracranially measured ECoG signals from the human visual cortex in 14 patients. In early visual areas (V1 and V2), the disappearance of the stimulus due to either invisible blinks or salient blank video frames ('gaps') led to a similar drop in activity level, followed by a positive overshoot beyond baseline, triggered by stimulus reappearance. Ascending the visual hierarchy, the reappearance-related overshoot gradually subsided for blinks but not for gaps. By contrast, the disappearance-related drop did not follow the perceptual distinction - it was actually slightly more pronounced for blinks than for gaps. These findings suggest that blinks' limited visibility compared with gaps is correlated with suppression of blink-related visual activity transients, rather than with "filling-in" of the occluded content during blinks.

Extracting duration information in a picture category decoding task using hidden Markov Models

OBJECTIVE

Adapting classifiers for the purpose of brain signal decoding is a major challenge in brain-computer-interface (BCI) research. In a previous study we showed in principle that hidden Markov models (HMM) are a suitable alternative to the well-studied static classifiers. However, since we investigated a rather straightforward task, advantages from modeling of the signal could not be assessed.

APPROACH

Here, we investigate a more complex data set in order to find out to what extent HMMs, as a dynamic classifier, can provide useful additional information. We show for a visual decoding problem that besides category information, HMMs can simultaneously decode picture duration without an additional training required. This decoding is based on a strong correlation that we found between picture duration and the behavior of the Viterbi paths.

MAIN RESULTS

Decoding accuracies of up to 80% could be obtained for category and duration decoding with a single classifier trained on category information only.

SIGNIFICANCE

The extraction of multiple types of information using a single classifier enables the processing of more complex problems, while preserving good training results even on small databases. Therefore, it provides a convenient framework for online real-life BCI utilizations.

The Alternative Omen Effect: Illusory negative correlation between the outcomes of choice options

In situations of choice between uncertain options, one might get feedback on both the outcome of the chosen option and the outcome of the unchosen option ("the alternative"). Extensive research has shown that when both outcomes are eventually revealed, the alternative's outcome influences the way people evaluate their own outcome. In a series of experiments, we examined whether the outcome of the alternative plays an additional role in the decision-making process by creating expectations regarding the outcome of the chosen option. Specifically, we hypothesized that people see a good (bad) alternative's outcome as a bad (good) sign regarding their own outcome when the two outcomes are in fact uncorrelated, a phenomenon we call the "Alternative Omen Effect" (ALOE). Subjects had to repeatedly choose between two boxes, the outcomes of which were then sequentially revealed. In Experiments 1 and 2 the alternative's outcome was presented first, and we assessed the individual's prediction of their own outcome. In Experiment 3, subjects had to predict the alternative's outcome after seeing their own. We find that even though the two outcomes were in fact uncorrelated, people tended to see a good (bad) alternative outcome as a bad (good) sign regarding their own outcome. Importantly, this illusory negative correlation affected subsequent behavior and led to irrational choices. Furthermore, the order of presentation was critical: when the outcome of the chosen option was presented first, the effect disappeared, suggesting that this illusory negative correlation is influenced by self-relevance. We discuss the possible sources of this illusory correlation as well as its implications for research on counterfactual thinking.

Evidence of Change of Intention in Picking Situations

Intending to perform an action and then immediately executing it is a mundane process. The cognitive and neural mechanisms involved in this process of "proximal" intention formation and execution, in the face of multiple options to choose from, are not clear, however. Especially, it is not clear how intentions are formed when the choice makes no difference. Here we used behavioral and electrophysiological measures to investigate the temporal dynamics of proximal intention formation and "change of intention" in a free picking scenario, in which the alternatives are on a par for the participant. Participants pressed a right or left button following either an instructive visible arrow cue or a visible neutral "free-choice" cue, both preceded by a masked arrow prime. The goal of the prime was to induce a bias toward pressing the left or right button. Presumably, when the choice is arbitrary, such bias should determine the decision. EEG lateralized readiness potentials and EMG measurements revealed that the prime indeed induced an intention to move in one direction. However, we discovered a signature of "change of intention" in both the Instructed and Free-choice decisions. These results suggest that, even in arbitrary choices, biases present in the neural system for choosing one or another option may be overruled and point to a curious "picking deliberation" phenomenon. We discuss a possible neural scenario that could explain this phenomenon.

Frequency-dependent auditory space representation in the human planum temporale

Functional magnetic resonance imaging (fMRI) findings suggest that a part of the planum temporale (PT) is involved in representing spatial properties of acoustic information. Here, we tested whether this representation of space is frequency-dependent or generalizes across spectral content, as required from high order sensory representations. Using sounds with two different spectral content and two spatial locations in individually tailored virtual acoustic environment, we compared three conditions in a sparse-fMRI experiment: Single Location, in which two sounds were both presented from one location; Fixed Mapping, in which there was one-to-one mapping between two sounds and two locations; and Mixed Mapping, in which the two sounds were equally likely to appear at either one of the two locations. We surmised that only neurons tuned to both location and frequency should be differentially adapted by the Mixed and Fixed mappings. Replicating our previous findings, we found adaptation to spatial location in the PT. Importantly, activation was higher for Mixed Mapping than for Fixed Mapping blocks, even though the two sounds and the two locations appeared equally in both conditions. These results show that spatially tuned neurons in the human PT are not invariant to the spectral content of sounds.

Automatic Bias of Temporal Expectations following Temporally Regular Input Independently of High-level Temporal Expectation

Exposure to rhythmic stimulation results in facilitated responses to events that appear in-phase with the rhythm and modulation of anticipatory and target-evoked brain activity, presumably reflecting “exogenous,” unintentional temporal expectations. However, the extent to which this effect is independent from intentional processes is not clear. In two EEG experiments, we isolated the unintentional component of this effect from high-level, intentional factors. Visual targets were presented either in-phase or out-of-phase with regularly flickering colored stimuli. In different blocks, the rhythm could be predictive (i.e., high probability for in-phase target) or not, and the color could be predictive (i.e., validly cue the interval to the target) or not. Exposure to nonpredictive rhythms resulted in faster responses for in-phase targets, even when the color predicted specific out-of-phase target times. Also, the contingent negative variation, an EEG component reflecting temporal anticipation, followed the interval of the nonpredictive rhythm and not that of the predictive color. Thus, rhythmic stimulation unintentionally induced expectations, even when this was detrimental. Intentional usage of predictive rhythms to form expectations resulted in a stronger behavioral effect, and only predictive cues modulated the latency of the target-evoked P3, presumably reflecting stimulus evaluation. These findings establish the existence of unintentional temporal expectations in rhythmic contexts, dissociate them from intentional expectations, and highlight the need to distinguish between the source of expectation (exogenous–endogenous) and the level of voluntary control involved in it (unintentional–intentional).

Synchronous contextual irregularities affect early scene processing: replication and extension

Whether contextual regularities facilitate perceptual stages of scene processing is widely debated, and empirical evidence is still inconclusive. Specifically, it was recently suggested that contextual violations affect early processing of a scene only when the incongruent object and the scene are presented a-synchronously, creating expectations. We compared event-related potentials (ERPs) evoked by scenes that depicted a person performing an action using either a congruent or an incongruent object (e.g., a man shaving with a razor or with a fork) when scene and object were presented simultaneously. We also explored the role of attention in contextual processing by using a pre-cue to direct subjects׳ attention towards or away from the congruent/incongruent object. Subjects׳ task was to determine how many hands the person in the picture used in order to perform the action. We replicated our previous findings of frontocentral negativity for incongruent scenes that started ~ 210 ms post stimulus presentation, even earlier than previously found. Surprisingly, this incongruency ERP effect was negatively correlated with the reaction times cost on incongruent scenes. The results did not allow us to draw conclusions about the role of attention in detecting the regularity, due to a weak attention manipulation. By replicating the 200-300 ms incongruity effect with a new group of subjects at even earlier latencies than previously reported, the results strengthen the evidence for contextual processing during this time window even when simultaneous presentation of the scene and object prevent the formation of prior expectations. We discuss possible methodological limitations that may account for previous failures to find this an effect, and conclude that contextual information affects object model selection processes prior to full object identification, with semantic knowledge activation stages unfolding only later on.

Is there any electrophysiological evidence for subliminal error processing?

The role of error awareness in executive control and modification of behavior is not fully understood. In line with many recent studies showing that conscious awareness is unnecessary for numerous high-level processes such as strategic adjustments and decision making, it was suggested that error detection can also take place unconsciously. The Error Negativity (Ne) component, long established as a robust error-related component that differentiates between correct responses and errors, was a fine candidate to test this notion: if an Ne is elicited also by errors which are not consciously detected, it would imply a subliminal process involved in error monitoring that does not necessarily lead to conscious awareness of the error. Indeed, for the past decade, the repeated finding of a similar Ne for errors which became aware and errors that did not achieve awareness, compared to the smaller negativity elicited by correct responses (Correct Response Negativity; CRN), has lent the Ne the prestigious status of an index of subliminal error processing. However, there were several notable exceptions to these findings. The study in the focus of this review (Shalgi and Deouell, 2012) sheds new light on both types of previous results. We found that error detection as reflected by the Ne is correlated with subjective awareness: when awareness (or more importantly lack thereof) is more strictly determined using the wagering paradigm, no Ne is elicited without awareness. This result effectively resolves the issue of why there are many conflicting findings regarding the Ne and error awareness. The average Ne amplitude appears to be influenced by individual criteria for error reporting and therefore, studies containing different mixtures of participants who are more confident of their own performance or less confident, or paradigms that either encourage or don't encourage reporting low confidence errors will show different results. Based on this evidence, it is no longer possible to unquestioningly uphold the notion that the amplitude of the Ne is unrelated to subjective awareness, and therefore, that errors are detected without conscious awareness.

Is any awareness necessary for an Ne?

The Error-Related Negativity (Ne or ERN) is a reliable electrophysiological index of error processing, which has been found to be independent of whether a subject is aware of an error or not. A large Ne was equally seen after errors that were consciously detected (Aware errors) and those that were not (Unaware errors), compared to a small negativity for correct responses (CRN). This suggests a dissociation between an automatic, preconscious error processing mechanism and subjective evaluation. A common concern regarding this finding is that subjects could have been somewhat aware of their errors, but did not report them due to lack of confidence. Here we tested this possibility directly using a betting paradigm which allowed us to separate occasions in which the subjects were confident of their response and trials in which they were unsure. In a choice reaction time task, subjects directly judged the accuracy of each response (correct or error) and then bet on this judgment using a high, medium, or low amount of money. The bets were used to determine the level of confidence the subjects had of their response. The average across all subjects regardless of confidence (betting) measure replicated the reported finding of an equal Ne for Aware and Unaware errors which was larger than the CRN. However, when Ne measurement was confined to high confidence (high bet) trials in confident subjects, a prominent Ne was seen only for Aware errors, while confident Unaware errors (i.e., error trials on which subjects made high bets that they were correct) elicited a response that did not differ from the CRN elicited by truly correct answers. In contrast, for low confidence trials in unconfident subjects, an intermediate and equal Ne/CRN was elicited by Correct responses, Aware and Unaware errors. These results provide direct evidence that the Ne is related to error awareness, and suggest the amplitude of the Ne/CRN depends on individual differences in error reporting and confidence.

Coupling between spontaneous (resting state) fMRI fluctuations and human oculo-motor activity

The recent discovery of incessant spontaneous fluctuations in human brain activity (also termed resting state fMRI) has been a focus of intense research in brain imaging. The spontaneous BOLD activity shows organized anatomical specialization as well as disruption in a number of brain pathologies. The link between the spontaneous fMRI fluctuations and human behavior is therefore of acute interest and importance. Here we report that a highly significant correlation exists between spontaneous BOLD fluctuations and eye movements which occur subliminally and spontaneously in the absence of any visual stimulation. Of the various eye movement parameters tested, we found robust and anatomically consistent correlations with both the amplitude and velocity of spontaneous eye movements. Control experiments ruled out a contribution of spatial and visual attention as well as smooth pursuit eye movements to the effect. The consistent anatomical specificity of the correlation patterns and their tight temporal link at the proper hemodynamic delay argues against a non-neuronal explanation of the effect, such as cardiac or respiratory cycles. Our results thus demonstrate a link between resting state and spontaneously emerging subconscious oculo-motor behavior.

Integration Without Awareness

Human conscious awareness is commonly seen as the climax of evolution. However, what function—if any—it serves in human behavior is still debated. One of the leading suggestions is that the cardinal function of conscious awareness is to integrate numerous inputs—including the multitude of features and objects in a complex scene—across different levels of analysis into a unified, coherent, and meaningful perceptual experience. Here we demonstrate, however, that integration of objects with their background scenes can be achieved without awareness of either. We used a binocular rivalry technique known as continuous flash suppression to induce perceptual suppression in a group of human observers. Complex scenes that included incongruent objects escaped perceptual suppression faster than normal scenes did. We conclude that visual awareness is not needed for object-background integration or for processing the likelihood of an object to appear within a given semantic context, but may be needed for dealing with novel situations.

Neural adaptation is related to face repetition irrespective of identity: a reappraisal of the N170 effect

Event-related potentials offer evidence for face distinctive neural activity that peaks at about 170 ms following the onset of face stimuli (the N170 effect). We investigated the role of the perceptual mechanism reflected by the N170 effect by comparing the adaptation of the N170 amplitude when target faces were preceded either by identical face images or by different faces relative to when they were preceded by objects. In two experiments, we demonstrate that the N170 is equally adapted by repetition of the same or different faces. Thus, our findings show that the N170 is sensitive to the category rather than the identity of a face. This outcome supports the hypothesis that the N170 effect reflects the activity of a perceptual mechanism which discriminates faces from objects and streams face stimuli to dedicated circuits, specialized in encoding and decoding information about the face.

Momentary Fluctuations in Allocation of Attention: Cross-modal Effects of Visual Task Load on Auditory Discrimination

Even when our attention is dedicated to an important task, background processes monitor the environment for significant events. The mismatch negativity (MMN) event-related potential is thought to reflect such a monitoring process. Nevertheless, there is continuing debate concerning the susceptibility of the MMN to attentional manipulation. We investigated the trial-by-trial relationship between brain activity related to change detection, reflected in the MMN, and visual psychophysical performance—while varying task difficulty. We find that auditory change detection is indeed “automatic” in that MMN remains robust despite increasing (visual) task load. However, the MMN amplitude and latency are susceptible to both visual load and to momentary attentional fluctuations as reflected in success or failure to identify a following visual target. We conclude that background central auditory processing is sensitive to the demands of a visual task, and fluctuates based on moment-to-moment allocation of attentional resources to the visual task.

Multiperturbation analysis of distributed neural networks: the case of spatial neglect

This study assesses the feasibility of using a multiperturbation analysis (MPA) approach for lesion-symptom mapping. We analyze the relative contribution of damage in different brain regions to the expression of spatial neglect, as revealed in line-bisection performance. The data set comprised of normalized lesion information and bisection test results from 23 first-event right-hemisphere stroke patients. Obtaining quantitative measures of task relevance for different regions of interest (ROIs), the following ROIs were found to be the most contributing: the supramarginal and angular gyri of the inferior parietal lobule, the superior parietal lobule, the anterior part of the temporo-parietal junction connecting the superior temporal and supramarginal gyri, and the thalamus. MPA is likely to play an important role in elucidating the anatomical substrate of complex functions.

ERP evidence for context congruity effects during simultaneous object-scene processing

Contextual regularities help us analyze visual scenes and form judgments on their constituents. The present study investigates the effect of context violation on scene processing using event-related potentials (ERPs). We compared ERPs evoked by congruent vs. incongruent visual scenes (e.g., a man playing a violin vs. a man "playing" a broomstick), when the scene and object are presented simultaneously, so subjects cannot form previous expectations about the object's identity. As expected, an ongoing anterior negativity emerged around 270 ms post-stimulus presentation, lasting for about 330 ms. This negativity, resembling the N300/N400 effect previously associated with semantic integration, was followed by a later and broadly distributed negativity between 650 and 850 ms, possibly related to late processes of semantic evaluation and response preparation. The results confirm that contextual congruity affects scene processing starting from approximately 300 ms or earlier, and that this early electrophysiological congruity effect indeed reflects context violation processing, rather than indexing a mismatch between expected vs. actual events, or between prepared vs. correct responses. They also suggest that contextual information may affect object model selection processes, and influence later stages of semantic knowledge activation and/or decision-making.

Saccadic spike potentials in gamma-band EEG: characterization, detection and suppression

Analysis of high-frequency (gamma-band) neural activity by means of non-invasive EEG is gaining increasing interest. However, we have recently shown that a saccade-related spike potential (SP) seriously confounds the analysis of EEG induced gamma-band responses (iGBR), as the SP eludes traditional EEG artifact rejection methods. Here we provide a comprehensive profile of the SP and evaluate methods for its detection and suppression, aiming to unveil true cerebral gamma-band activity. The SP appears consistently as a sharp biphasic deflection of about 22 ms starting at the saccade onset, with a frequency band of approximately 20-90 Hz. On the average, larger saccades elicit higher SP amplitudes. The SP amplitude gradually changes from the extra-ocular channels towards posterior sites with the steepest gradients around the eyes, indicating its ocular source. Although the amplitude and the sign of the SP depend on the choice of reference channel, the potential gradients remain the same and non-zero for all references. The scalp topography is modulated almost exclusively by the direction of saccades, with steeper gradients ipsilateral to the saccade target. We discuss how the above characteristics impede attempts to remove these SPs from the EEG by common temporal filtering, choice of different references, or rejection of contaminated trials. We examine the extent to which SPs can be reliably detected without an eye tracker, assess the degree to which scalp current density derivation attenuates the effect of the SP, and propose a tailored ICA procedure for minimizing the effect of the SP.

Brain activity during landmark and line bisection tasks

Neglect patients bisect lines far rightward of center whereas normal subjects typically bisect lines with a slight leftward bias supporting a right hemisphere bias for attention allocation. We used fMRI to assess the brain regions related to this function in normals, using two complementary tasks. In the Landmark task subjects were required to judge whether or not a presented line was bisected correctly. During the line bisection task, subjects moved a cursor and indicated when it reached the center of the line. The conjunction of BOLD activity for both tasks showed right lateralized intra-parietal sulcus and lateral peristriate cortex activity. The results provide evidence that predominantly right hemisphere lateralized processes are engaged in normal subjects during tasks that are failed in patients with unilateral neglect and highlight the importance of a right fronto-parietal network in attention allocation.

On the positive side of error processing: error-awareness positivity revisited

Performance errors are indexed in the brain even if they are not consciously registered, as demonstrated by the error-related negativity (ERN or Ne) event-related potential. It has recently been shown that another response-locked potential, the error positivity (Pe), follows the Ne, but only in those trials in which the participants consciously detect making the error ('Aware Errors'). In the present study we generalize these findings to an auditory task and investigate possible caveats in the interpretation of the Pe as an index of error awareness. In an auditory Go/No-Go error-awareness task (auditory EAT) participants pressed an additional 'fix error' button after noticing that they had made an error. As in visual tasks, the Ne was similar for aware ('fixed') and unaware ('unfixed') errors, while the Pe was enhanced only for Aware Errors. Within subjects, the Ne and Pe behaved in similar fashions for auditory and visual errors. A control condition confirmed that the awareness effect was not due to the requirement to report error awareness. These results reinforce the evidence in favor of the Pe as a correlate of conscious error processing, and imply that this process is not modality-specific. Nevertheless, single-trial analysis suggested that the Pe may be a delayed P3b related to stimulus processing rather than to response monitoring.

Detecting violations of sensory expectancies following cerebellar degeneration: a mismatch negativity study

Two hypotheses concerning cerebellar function and predictive behavior are the sensory prediction hypothesis and the timing hypothesis. The former postulates that the cerebellum is critical in generating expectancies regarding forthcoming sensory information. The latter postulates that this structure is critical in generating expectancies that are precisely timed; for example, the expected duration of an event or the time between events. As such, the timing hypothesis constitutes a more specific form of prediction. The present experiment contrasted these two hypotheses by examining the mismatch negativity (MMN) response in patients with cerebellar cortical atrophy and matched controls. While watching a silent movie, a stream of task-irrelevant sounds was presented. A standard sound was presented 60% of the time, whereas the remaining sounds deviated from the standard on one of four dimensions: duration, intensity, pitch, or location. The timing between stimuli was either periodic or aperiodic. Based on the sensory prediction hypothesis, the MMN for the patients should be abnormal across all four dimensions. In contrast, the timing hypothesis would predict a selective impairment of the duration MMN. Moreover, the timing hypothesis would also predict that the enhancement of the MMN observed in controls when the stimuli are presented periodically should be attenuated in the patients. Compared to controls, the patients exhibited a delayed latency in the MMN to duration deviants and a similar trend for the intensity deviants, while pitch and location MMNs did not differ between groups. Periodicity had limited and somewhat inconsistent effects. The present results are at odds with a general role for the cerebellum in sensory prediction and provide partial support for the timing hypothesis.