ERP and MEG correlates of visual consciousness: The second decade

Conscious tactile perception entails distinct neural dynamics within somatosensory areas

Distilling the neural correlates of consciousness (NCCs) in humans is challenging due to limitations in the spatiotemporal resolution of recording techniques and confounds related to pre- and post-perceptual processes. In this study, we leveraged the detailed insights provided by human intracortical recordings to elucidate how somatosensory responses to simple tactile stimuli vary across different stimulus intensities and reporting conditions. Among the various spatiotemporal components of somatosensory processing, we observed tonic responses in posterior perisylvian regions that exhibited all the key characteristics of somatosensory NCCs. These responses remained invariant regardless of reporting, displayed an all-or-nothing pattern at the verge of the sensory threshold, and showed the most pronounced divergence between perceived and non-perceived stimuli. Overall, our findings indicate that conscious perception of simple tactile stimuli depends on higher-order somatosensory regions and that sustained neural dynamics in these areas may serve as an organizational principle of somatosensory awareness.

Event-related potential correlates of consciousness in simple auditory hallucinations

Neural correlates of consciousness (NCC) have been proposed for perceptual awareness in various sensory modalities. To date, perceptual awareness negativity (PAN) and late positivity (LP) are considered the main NCC candidates, and the question remains which one is the NCC proper. Investigating states where the content of consciousness is independent of the physical stimulus, may provide additional theoretical and empirical value. We studied the event-related potential (ERP) markers of auditory awareness in simple auditory hallucinations using a Pavlovian conditioning paradigm, where participants listened to the near-threshold tones and stimulus-absent trials, rating subjective clarity with the perceptual awareness scale (PAS). The results showed auditory awareness negativity (AAN) - an early event-related potential difference between aware and unaware stimuli - in the hallucinatory condition, suggesting that AAN is an NCC proper in auditory consciousness. Late positivity was absent in simple auditory hallucinations.

Neural dynamics of mental state attribution to social robot faces

The interplay of mind attribution and emotional responses is considered crucial in shaping human trust and acceptance of social robots. Understanding this interplay can help us create the right conditions for successful human-robot social interaction in alignment with societal goals. Our study shows that affective information about robots describing positive, negative, or neutral behaviour leads participants (N = 90) to attribute mental states to robot faces, modulating impressions of trustworthiness, facial expression, and intentionality. Electroencephalography recordings from 30 participants revealed that affective information influenced specific processing stages in the brain associated with early face perception (N170 component) and more elaborate stimulus evaluation (late positive potential). However, a modulation of fast emotional brain responses, typically found for human faces (early posterior negativity), was not observed. These findings suggest that neural processing of robot faces alternates between being perceived as mindless machines and intentional agents: people rapidly attribute mental states during perception, literally seeing good or bad intentions in robot faces, but are emotionally less affected than when facing humans. These nuanced insights into the fundamental psychological and neural processes underlying mind attribution can enhance our understanding of human-robot social interactions and inform policies surrounding the moral responsibility of artificial agents.

Deciphering temporal scales of visual awareness: insights from flicker frequency modulation in continuous flash suppression

Evidence from temporal regularities in perception, temporal phenomenology, and neural dynamics indicate that our awareness evolves and devolves over several timescales. However, most theories of consciousness posit a single timescale of processing at the end of which a percept is rendered conscious. To show evidence for multiple timescales, we utilized continuous flash suppression (CFS). Based on a hierarchical framework of temporal phenomenology, we reasoned that different flicker rates (1, 4, 10, and 25 Hz) of the suppressor should be able to perturb phenomenologically distinct tasks. We designed four experiments that used different perceptual tasks (N = 48). The results showed that entry of contents into conscious awareness, their attentional sampling, perceptual grouping, and exiting from awareness were all maximally perturbed at distinct flicker frequencies of the suppressor in a CFS paradigm. Our demonstration shows that different flicker frequencies perturb different phenomenological aspects of awareness, and these flicker frequencies systematically map onto temporal hierarchies of timing of awareness.

Perceptual experience in somatosensory temporal discrimination is indexed by a mid-latency fronto-central ERP difference

The neural correlates of conscious somatosensory perception are usually investigated using threshold detection tasks. However, it is largely unclear how other aspects of conscious somatosensory experience, such as localization, discrimination, and identification, are processed in the brain. Here, we go beyond mere stimulus detection and analyze the EEG data of 34 participants to investigate the event-related potential correlates of somatosensory experience in a temporal discrimination task. We show that the perceptual experience of feeling one vs. two pulses for identical pairs of electrical stimuli is reflected in positive fronto-central ERP activity after ~ 150 ms, even when controlling for task-relevance and post-perceptual processes such as decision-making and response preparation. This effect is a modulation of an ERP component that peaks considerably later at 170 ms and in a different sensor region than the detection-related so-called N140, which was not modulated by our task. Distributed source reconstruction of the sensor-level effect suggested the contralateral primary somatosensory cortex as its origin. We therefore propose that conscious detection and temporal discrimination are likely to both involve early sensory areas but recruit different neuronal processes. Our result adds to the growing body of research investigating the mechanisms underlying different aspects of conscious experience.

Context-Sensitive Conscious Interpretation and Layer-5 Pyramidal Neurons in Multistable Perception

INTRODUCTION

There appears to be a fundamental difference between the two ways of how an object becomes perceptually experienced. One occurs when preconscious object-specifying sensory data processing crosses a certain threshold so that sensory constituents of object depiction become consciously experienced. The other occurs when the already consciously experienced sensory features of the object become interpreted as belonging to a certain visual object category. Surprisingly, experimental facts about neural markers of conscious access gathered so far do not allow us to distinguish mechanisms responsible for these two varieties.

METHODS

A cortical multicompartment layer-5 pyramidal neuron-based generic processing model is presented in order to conceptualize a possible mechanistic solution for the explanatory cul-de-sac. To support the argument, a review of pertinent research is compiled as associated with data from studies where physically invariant perceptual stimuli have underwent alternative interpretation(s) by the brain.

RESULTS

Recent developments in the newly emerging field of cellular psycho(physio)logy are introduced, offering a hypothetical solution for distinguishing the mechanisms subserving sensory content experience and conscious interpretation.

CONCLUSION

The multicompartment single cell-based mechanistic approach to brain process correlates of conscious perception appears to have an added value beyond the traditional inter-areal connectivity-based theoretical stances.

Temporally Dissociable Neural Representations of Pitch Height and Chroma

The extraction and analysis of pitch underpin speech and music recognition, sound segregation, and other auditory tasks. Perceptually, pitch can be represented as a helix composed of two factors: height monotonically aligns with frequency, while chroma cyclically repeats at doubled frequencies. Although the early perceptual and neurophysiological mechanisms for extracting pitch from acoustic signals have been extensively investigated, the equally essential subsequent stages that bridge to high-level auditory cognition remain less well understood. How does the brain represent perceptual attributes of pitch at higher-order processing stages, and how are the neural representations formed over time? We used a machine learning approach to decode time-resolved neural responses of human listeners (10 females and 7 males) measured by magnetoencephalography across different pitches, hypothesizing that different pitches sharing similar neural representations would result in reduced decoding performance. We show that pitch can be decoded from lower-frequency neural responses within auditory-frontal cortical regions. Specifically, linear mixed-effects modeling reveals that height and chroma explain the decoding performance of delta band (0.5-4 Hz) neural activity at distinct latencies: a long-lasting height effect precedes a transient chroma effect, followed by a recurrence of height after chroma, indicating sequential processing stages associated with unique perceptual and neural characteristics. Furthermore, the localization analyses of the decoder demonstrate that height and chroma are associated with overlapping cortical regions, with differences observed in the right orbital and polar frontal cortex. The data provide a perspective motivating new hypotheses on the mechanisms of pitch representation.

The influence of signal strength on conscious and nonconscious neural processing of emotional faces

Consciously perceived emotional relative to neutral facial expressions evoke stronger early and late event-related potential (ERP) components. However, the extent of nonconscious neural processing of emotional information in faces is still a matter of debate. One possible reason for conflicting findings might relate to threshold effects depending on the sensory strength of stimuli. In the current study, we investigated this issue by manipulating the contrast of fearful and neutral faces presented with or without continuous flash suppression (CFS). Low, medium, and high contrasts were calibrated individually so that faces were consciously perceived at all contrast levels if presented without CFS. With CFS, however, low- and medium-contrast faces remained nonconscious, while high-contrast faces broke the suppression. Without CFS, ERPs showed an increased early negativity and late positivity in response to fearful vs. neutral faces regardless of contrast. Under CFS, we observed differential early negativities for suppression-breaking high-contrast fearful vs. neutral faces. For nonconscious faces, however, the contrast level modulated the difference between fearful and neutral faces, showing enhanced early negativities only at medium contrast and an inverted effect at low contrast. Additional analysis of late positivities provided evidence for the absence of an effect at low and medium contrast, while at high-contrast, fearful faces elicited a larger positivity than neutral ones. Taken together, our findings demonstrate the significance of stimulus strength for nonconscious emotion processing under CFS, implying that early negative ERP differences between neutral and fearful faces depend on stimulus contrast near the detection threshold.

Examining experienced lateralization of sounds over headphones with electroencephalography

In the search for the neural correlates of auditory consciousness, a candidate has been found using electroencephalography: the auditory awareness negativity (AAN). Earlier studies have investigated the AAN in response to lateralized sound. With headphones, there is a clear lateralization of AAN when two auditory lateralization cues are combined: the interaural level difference (ILD) and interaural time difference (ITD). To separate the contribution of these cues to a lateralized AAN, we tested three stimulus conditions with headphones: A combination of ILD and ITD, solely ITD, and monaural stimulation. Results suggest that ILD and ITD are required in conjunction for a lateralized AAN, and neither ITD nor monaural stimulation can yield a lateralized AAN. These results suggest that event-related potentials may be limited in measuring the lateralization of the neural correlates of auditory consciousness to lateralized sounds, depending on auditory cues and acoustic environment.

Investigation of sensory attenuation in the somatosensory domain using EEG in a novel virtual reality paradigm

We are not only passively immersed in a sensorial world, but we are active agents that directly produce stimulations. Understanding what is unique about sensory consequences can give valuable insight into the action-perception-cycle. Sensory attenuation is the phenomenon that self-produced stimulations are perceived as less intense compared to externally-generated ones. Studying this phenomenon, however, requires considering a plethora of factors that could otherwise interfere with its interpretation, such as differences in stimulus properties, attentional resources, or temporal predictability. We therefore developed a novel Virtual Reality (VR) setup which allows control over several of these confounding factors. Furthermore, we modulated the expectation of receiving a somatosensory stimulation across self-production and passive perception through a simple probabilistic learning task, allowing us to test to what extent the electrophysiological correlates of sensory attenuation are impacted by stimulus expectation. Therefore, the aim of the present study was twofold: first we aimed validating a novel VR paradigm during electroencephalography (EEG) recoding to investigate sensory attenuation in a highly controlled setup; second, we tested whether electrophysiological differences between self- and externally-generated sensations could be better explained by stimulus predictability factors, corroborating the validity of sensory attenuation. Results of 26 participants indicate that early (P100), mid-latency (P200) and later negative contralateral potentials were significantly attenuated by self-generated sensations, independent of the stimulus expectation. Moreover, a component around 200 ms post-stimulus at frontal sites was found to be enhanced for self-produced stimuli. The P300 was influenced by stimulus expectation, regardless of whether the stimulation was actively produced or passively attended. Together, our results demonstrate that VR opens up new possibilities to study sensory attenuation in more ecological valid yet well-controlled paradigms, and that sensory attenuation is not significantly modulated by stimulus predictability, suggesting that sensory attenuation relies on motor-specific predictions about their sensory outcomes. This not only supports the phenomenon of sensory attenuation, but is also consistent with previous research and the concept that action actually plays a crucial role in perception.

Consciousness Under the Spotlight: The Problem of Measuring Subjective Experience

The study of consciousness is considered by many one of the most difficult contemporary scientific endeavors and confronts several methodological and theoretical challenges. A central issue that makes the study of consciousness so challenging is that, while the rest of science is concerned with problems that can be verified from a "third person" view (i.e., objectively), the study of consciousness deals with the phenomenon of subjective experience, only accessible from a "first person" view. In the present article, we review early (starting during the late 19th century) and later efforts on measuring consciousness and its absence, focusing on the two main approaches used by researchers within the field: objective (i.e., performance based) and subjective (i.e., report based) measures of awareness. In addition, we compare the advantages and disadvantages of both types of awareness measures, evaluate them according to different methodological considerations, and discuss, among other issues, the possibility of comparing them by transforming them to a common sensitivity measure (d'). Finally, we explore several new approaches-such as Bayesian models to support the absence of awareness or new machine-learning based decoding models-as well as future challenges-such as measuring the qualia, the qualitative contents of awareness-in consciousness research.

Neural signatures of visual awareness independent of postperceptual processing

What are the neural processes associated with perceptual awareness that are distinct from preconscious sensory encoding and postperceptual processes such as reporting an experience? Using electroencephalography and a no-report visual masking paradigm, we manipulated stimulus visibility by varying the time between stimuli and masks in linear steps (17, 33, 50, 67, and 83 ms). Awareness increased nonlinearly, with stimuli never seen at the two shortest intervals, always seen at the two longest, and 50% seen at the intermediate interval. Separate report and no-report conditions were used to isolate awareness from task performance. Our results revealed a neural signal closely linked to perceptual awareness, independent of the task: a fronto-central event-related potential that we refer to as the N2 (~250 to 300 ms). Earlier event-related potential signals reflected the linear manipulation of stimulus strength, while later signals like P3b and temporal generalization of decoding were tied to task performance, appearing only in the report condition. Taken together, these findings inform current debates regarding theories of consciousness and offer new avenues for exploring the neural mechanisms supporting conscious processing.

Assessing consciousness in acute coma using name-evoked responses

Detecting consciousness in clinically unresponsive patients remains a significant challenge. Existing studies demonstrate that electroencephalography (EEG) can detect brain responses in behaviorally unresponsive patients, indicating potential for consciousness detection. However, most of this evidence is based on chronic patients, and there is a lack of studies focusing on acute coma cases. This study aims to detect signs of residual consciousness in patients with acute coma by using bedside EEG and electromyography (EMG) during an auditory oddball paradigm. We recruited patients with acute brain injury (either traumatic brain injury or cardiac arrest) who were admitted to the intensive care unit within two weeks after injury, with a Glasgow Coma Scale (GCS) score of 8 or below. Auditory stimuli included the patients' own names and other common names (referred to as standard names), spoken by the patients' relatives, delivered under two conditions: passive listening (where patients were instructed that sounds would be played) and active listening (where patients were asked to move hands when heard their own names). Brain and muscle activity were recorded using EEG and EMG during the auditory paradigm. Event-related potentials (ERP) and EMG spectra were analyzed and compared between responses to the subject's own name and other standard names in both passive and active listening conditions. A total of 22 patients were included in the final analysis. Subjects exhibited enhanced ERP responses when exposed to their own names, particularly during the active listening task. Compared to standard names or passive listening, distinct differences in brain network connectivity and increased EMG responses were detected during active listening to their own names. These findings suggest the presence of residual consciousness, offering the potential for assessing consciousness in behaviorally unresponsive patients.

Task-based EEG and fMRI paradigms in a multimodal clinical diagnostic framework for disorders of consciousness

Disorders of consciousness (DoC) are generally diagnosed by clinical assessment, which is a predominantly motor-driven process and accounts for up to 40 % of non-communication being misdiagnosed as unresponsive wakefulness syndrome (UWS) (previously known as prolonged/persistent vegetative state). Given the consequences of misdiagnosis, a more reliable and objective multimodal protocol to diagnosing DoC is needed, but has not been produced due to concerns regarding their interpretation and reliability. Of the techniques commonly used to detect consciousness in DoC, task-based paradigms (active paradigms) produce the most unequivocal result when findings are positive. It is well-established that command following (CF) reliably reflects preserved consciousness. Task-based electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) can detect motor-independent CF and reveal preserved covert consciousness in up to 14 % of UWS patients. Accordingly, to improve the diagnostic accuracy of DoC, we propose a practical multimodal clinical decision framework centered on task-based EEG and fMRI, and complemented by measures like transcranial magnetic stimulation (TMS-EEG).

Event-related potentials of stimuli inhibition and access in cross-modal distractor-induced blindness

Distractor-induced blindness (DIB) describes a reduced access to a cued visual target-if multiple target-like distractors have been presented beforehand. Previous ERP data suggest a cumulative frontal inhibition triggered by distractors, which affects the updating process of the upcoming target. In the present study, we examine whether the modality of the cue-formerly defined in the visual domain-affects the expression of these neural signatures. 27 subjects were tested in a cross-modal DIB task: Distractors and targets were defined by a transient change of stimuli shape in a random-dot kinematogram. The onset of the target was announced by a rise in amplitude of a sinusoidal tone. Behavioral results confirmed that detection of the target relies on the number of preceding distractor episodes. Replicating previous unimodal results, ERP responses to distractors were characterized by a frontal negativity starting at 100 ms, which increases with an increasing number of distractor episodes. However, the processing-and detection-of the target was not characterized by a more-expressed P3 response, but by an occipital negativity. The current data confirm that the neural signatures of target awareness depend on the experimental setup used: In case of the DIB, the cross-modal setting might lead to a reduction of attentional resources in the visual domain.

Attentional load leads to distinct changes in early and late cortical processing of target visibility under visual masking

Visual masking and attentional selection play important roles in controlling information processing for perception. Using an experimental design combining metacontrast with attentional load, we investigated the time course of changes in event-related potentials under different attentional load and masking conditions. The behavioral results indicated significant effects of attentional load on masking functions (i.e., masking strength as a function of stimulus onset asynchrony between target and mask). The analyses of neural activities revealed significant effects of masking and attentional load on early components located over occipital and parieto-occipital scalp sites. There were also significant modulations in the late positivity range centered over centro-parietal electrodes. However, the nature of modulations in early and late components was different. These findings overall highlight the diverse nature of masking and attentional influences on visual processing, particularly suggesting that attentional load in the visual field may have distinct effects at different stages of perceptual processing.

No electrophysiological evidence for semantic processing during inattentional blindness

A long-standing question concerns whether sensory input can reach semantic stages of processing in the absence of attention and awareness. Here, we examine whether the N400, an event related potential associated with semantic processing, can occur under conditions of inattentional blindness. By employing a novel three-phase inattentional blindness paradigm designed to maximise the opportunity for detecting an N400, we found no evidence for it when participants were inattentionally blind to the eliciting stimuli (related and unrelated word pairs). In contrast, participants noticed the same task-irrelevant word pairs when minimal attention was allocated to them, and a small N400 became evident. When the same stimuli were fully attended and relevant to the task, a robust N400 was observed. In addition to univariate ERP measures, multivariate decoding analyses were unable to classify related from unrelated word pairs when observers were inattentionally blind to the words, with decoding reaching above-chance levels only when the words were (at least minimally) attended. By comparison, decoding reached above-chance levels when contrasting word pairs with non-word stimuli, even when participants were inattentionally blind to these stimuli. Our results also replicated several previous studies by finding a "visual awareness negativity" (VAN) that distinguished task-irrelevant stimuli that participants noticed compared with those that were not perceived, and a P3b (or "late positivity") that was evident only when the stimuli were task relevant. Together, our findings suggest that semantic processing might require at least a minimal amount of attention.

Beyond primary visual cortex: The leading role of lateral occipital complex in early conscious visual processing

The study of the neural substrates that serve conscious vision is one of the unsolved questions of cognitive neuroscience. So far, consciousness literature has endeavoured to disentangle which brain areas and in what order are involved in giving rise to visual awareness, but the problem of consciousness still remains unsolved. Availing of two different but complementary sources of data (i.e., Fast Optical Imaging and EEG), we sought to unravel the neural dynamics responsible for the emergence of a conscious visual experience. Our results revealed that conscious vision is characterized by a significant increase of activation in extra-striate visual areas, specifically in the Lateral Occipital Complex (LOC), and that, more interestingly, such activity occurred in the temporal window of the ERP component commonly thought to represent the electrophysiological signature of visual awareness, i.e., the Visual Awareness Negativity (VAN). Furthermore, Granger causality analysis, performed to further investigate the flow of activity occurring in the investigated areas, unveiled that neural processes relating to conscious perception mainly originated in LOC and subsequently spread towards visual and motor areas. In general, the results of the present study seem to advocate for an early contribution of LOC in conscious vision, thus suggesting that it could represent a reliable neural correlate of visual awareness. Conversely, striate visual areas, showing awareness-related activity only in later stages of stimulus processing, could be part of the cascade of neural events following awareness emergence.

Intracranial neural representation of phenomenal and access consciousness in the human brain

After more than 30 years of extensive investigation, impressive progress has been made in identifying the neural correlates of consciousness (NCC). However, the functional role of spatiotemporally distinct consciousness-related neural activity in conscious perception is debated. An influential framework proposed that consciousness-related neural activities could be dissociated into two distinct processes: phenomenal and access consciousness. However, though hotly debated, its authenticity has not been examined in a single paradigm with more informative intracranial recordings. In the present study, we employed a visual awareness task and recorded the local field potential (LFP) of patients with electrodes implanted in cortical and subcortical regions. Overall, we found that the latency of visual awareness-related activity exhibited a bimodal distribution, and the recording sites with short and long latencies were largely separated in location, except in the lateral prefrontal cortex (lPFC). The mixture of short and long latencies in the lPFC indicates that it plays a critical role in linking phenomenal and access consciousness. However, the division between the two is not as simple as the central sulcus, as proposed previously. Moreover, in 4 patients with electrodes implanted in the bilateral prefrontal cortex, early awareness-related activity was confined to the contralateral side, while late awareness-related activity appeared on both sides. Finally, Granger causality analysis showed that awareness-related information flowed from the early sites to the late sites. These results provide the first LFP evidence of neural correlates of phenomenal and access consciousness, which sheds light on the spatiotemporal dynamics of NCC in the human brain.

Is auditory awareness graded or dichotomous: Electrophysiological correlates of consciousness at different depths of stimulus processing

The level-of-processing (LoP) hypothesis postulates that transition from unaware to aware visual stimuli is either graded or dichotomous depending on the depth of stimulus processing. Humans can be progressively aware of the low-level features, such as colors or shapes, while the high-level features, such as semantic category, enter consciousness in an all-or none fashion. Unlike in vision, sounds always unfold in time, which might require mechanisms dissimilar from visual processing. We tested the LoP hypothesis in hearing for the first time by presenting participants with words of different categories, spoken in different pitches near the perceptual threshold. We also assessed whether different electrophysiological correlates of consciousness, the auditory awareness negativity (AAN) and late positivity (LP), were associated with LoP. Our findings indicate that LoP also applies to the auditory modality. AAN is an early correlate of awareness independent of LoP, while LP was modulated by awareness, performance accuracy and the level of processing.

The influence of feature-based attention and response requirements on ERP correlates of auditory awareness

In search for the neural correlates of consciousness (NCCs), it is important to isolate the true NCCs from their prerequisites, consequences, and co-occurring processes. To date, little is known about how attention affects the event-related potential (ERP) correlates of auditory awareness and there is contradictory evidence on whether one of them, the late positivity (LP), is affected by response requirements. By implementing a GO-NOGO design with target and nontarget stimuli, we controlled for feature-based attention and response requirements in the same experiment, while participants rated their awareness using a perceptual awareness scale. The results showed a prolonged auditory awareness negativity (AAN) for aware trials, which was influenced neither by attention nor by response requirement. The LP was affected by both attention and response requirements. Consistent with the levels of processing hypothesis, the LP was related to consciousness as a correlate of the processing of higher-level stimulus features, likely requiring access to a "global workspace." Our findings further suggest that AAN is a proper ERP correlate of auditory consciousness and thus a true NCC in the auditory modality.

Beyond task response-Pre-stimulus activity modulates contents of consciousness

The current discussion on the neural correlates of the contents of consciousness (NCCc) focuses mainly on the post-stimulus period of task-related activity. This neglects the substantial impact of the spontaneous or ongoing activity of the brain as manifest in pre-stimulus activity. Does the interaction of pre- and post-stimulus activity shape the contents of consciousness? Addressing this gap in our knowledge, we review and converge two recent lines of findings, that is, pre-stimulus alpha power and pre- and post-stimulus alpha trial-to-trial variability (TTV). The data show that pre-stimulus alpha power modulates post-stimulus activity including specifically the subjective features of conscious contents like confidence and vividness. At the same time, alpha pre-stimulus variability shapes post-stimulus TTV reduction including the associated contents of consciousness. We propose that non-additive rather than merely additive interaction of the internal pre-stimulus activity with the external stimulus in the alpha band is key for contents to become conscious. This is mediated by mechanisms on different levels including neurophysiological, neurocomputational, neurodynamic, neuropsychological and neurophenomenal levels. Overall, considering the interplay of pre-stimulus intrinsic and post-stimulus extrinsic activity across wider timescales, not just evoked responses in the post-stimulus period, is critical for identifying neural correlates of consciousness. This is well in line with both processing and especially the Temporo-spatial theory of consciousness (TTC).

Transient Attention Gates Access Consciousness: Coupling N2pc and P3 Latencies Using Dynamic Time Warping

The N2pc and P3 event-related potentials (ERPs), used to index selective attention and access to working memory and conscious awareness, respectively, have been important tools in cognitive sciences. Although it is likely that these two components and the underlying cognitive processes are temporally and functionally linked, such links have not yet been convincingly demonstrated. Adopting a novel methodological approach based on dynamic time warping (DTW), we provide evidence that the N2pc and P3 ERP components are temporally linked. We analyzed data from an experiment where 23 participants (16 women) monitored bilateral rapid serial streams of letters and digits in order to report a target digit indicated by a shape cue, separately for trials with correct responses and trials where a temporally proximal distractor was reported instead (distractor intrusion). DTW analyses revealed that N2pc and P3 latencies were correlated in time, both when the target or a distractor was reported. Notably, this link was weaker on distractor intrusion trials. This N2pc-P3 association is discussed with respect to the relationship between attention and access consciousness. Our results demonstrate that our novel method provides a valuable approach for assessing temporal links between two cognitive processes and their underlying modulating factors. This method allows to establish links and their modulator for any two time-series across all domains of the field (general-purpose MATLAB functions and a Python module are provided alongside this paper).

The influence of spatial and temporal attention on visual awareness-a behavioral and ERP study

Whether attention is a prerequisite of perceptual awareness or an independent and dissociable process remains a matter of debate. Importantly, understanding the relation between attention and awareness is probably not possible without taking into account the fact that both are heterogeneous and multifaceted mechanisms. Therefore, the present study tested the impact on visual awareness of two attentional mechanisms proposed by the Posner model: temporal alerting and spatio-temporal orienting. Specifically, we evaluated the effects of attention on the perceptual level, by measuring objective and subjective awareness of a threshold-level stimulus; and on the neural level, by investigating how attention affects two postulated event-related potential correlates of awareness. We found that alerting and orienting mechanisms additively facilitate perceptual consciousness, with activation of the latter resulting in the most vivid awareness. Furthermore, we found that late positivity is unlikely to constitute a neural correlate of consciousness as its amplitude was modulated by both attentional mechanisms, but early visual awareness negativity was independent of the alerting and orienting mechanisms. In conclusion, our study reveals a nuanced relationship between attention and awareness; moreover, by investigating the effect of the alerting mechanism, this study provides insights into the role of temporal attention in perceptual consciousness.

A measure centrality index for systematic empirical comparison of consciousness theories

Consciousness science is marred by disparate constructs and methodologies, making it challenging to systematically compare theories. This foundational crisis casts doubts on the scientific character of the field itself. Addressing it, we propose a framework for systematically comparing consciousness theories by introducing a novel inter-theory classification interface, the Measure Centrality Index (MCI). Recognizing its gradient distribution, the MCI assesses the degree of importance a specific empirical measure has for a given consciousness theory. We apply the MCI to probe how the empirical measures of the Global Neuronal Workspace Theory (GNW), Integrated Information Theory (IIT), and Temporospatial Theory of Consciousness (TTC) would fare within the context of the other two. We demonstrate that direct comparison of IIT, GNW, and TTC is meaningful and valid for some measures like Lempel-Ziv Complexity (LZC), Autocorrelation Window (ACW), and possibly Mutual Information (MI). In contrast, it is problematic for others like the anatomical and physiological neural correlates of consciousness (NCC) due to their MCI-based differential weightings within the structure of the theories. In sum, we introduce and provide proof-of-principle of a novel systematic method for direct inter-theory empirical comparisons, thereby addressing isolated evolution of theories and confirmatory bias issues in the state-of-the-art neuroscience of consciousness.

Early Electrophysiological Correlates of Perceptual Consciousness Are Affected by Both Exogenous and Endogenous Attention

It has been proposed that visual awareness negativity (VAN), which is an early ERP component, constitutes a neural correlate of visual consciousness that is independent of perceptual and cognitive mechanisms. In the present study, we investigated whether VAN is indeed a specific marker of phenomenal awareness or rather reflects the involvement of attention. To this end, we reanalyzed data collected in a previously published EEG experiment in which awareness of visual stimuli and two aspects that define attentional involvement, namely, the inherent saliency and task relevance of a stimulus, were manipulated orthogonally. During the experimental procedure, participants (n = 41) were presented with images of faces that were backward-masked or unmasked, fearful or neutral, and defined as task-relevant targets or task-irrelevant distractors. Single-trial ERP analysis revealed that VAN was highly dependent on attentional manipulations in the early time window (140-200 msec), up to the point that the effect of awareness was not observed for attentionally irrelevant stimuli (i.e., neutral faces presented as distractors). In the late time window (200-350 msec), VAN was present in all attentional conditions, but its amplitude was significantly higher in response to fearful faces and task-relevant face images than in response to neutral ones and task-irrelevant ones, respectively. In conclusion, we demonstrate that the amplitude of VAN is highly dependent on both exogenous (stimulus saliency) and endogenous attention (task requirements). Our results challenge the view that VAN constitutes an attention-independent correlate of phenomenal awareness.

Late Positivity Correlates with Subjective Reports: Evidence from the Low-frequency and High-frequency Reporting Tasks

Identifying the neural correlates of consciousness (NCCs) is an important way to understand the fundamental nature of consciousness. By recording event-related potentials (ERPs) using EEG, researchers have found three potential electrophysiological NCCs: early positive correlate of consciousness (enhanced P1), visual awareness negativity (VAN), and late positivity (LP). However, LP may reflect post-perceptual processing associated with subjective reports rather than consciousness per se. The present experiment investigated the relationship between LP and subjective reports. We adopted two subjective reporting tasks that differed in the requirement for subjective reports. In the low-frequency reporting task, participants needed to report whether they saw the target picture in 25% of trials, whereas in the high-frequency reporting task, participants needed to report whether they saw the target picture in each trial. Behavioral results showed that the hit rates were lower and false alarm rates were higher on reporting trials in low-frequency reporting tasks than on reporting trials in high-frequency reporting tasks. Unexpectedly, VAN was larger on reporting trials in the low-frequency reporting task than on reporting trials in the high-frequency reporting task. Importantly, our ERP results showed that LP was larger on reporting trials in the high-frequency reporting task than on reporting trials in the low-frequency reporting task. Thus, our findings indicated that when the frequency of reports was increased, the task relevance of the stimuli increased, which led to larger LP amplitudes. These findings suggest that LP correlates with subjective reports.

Electrophysiological correlates of sustained conscious perception

Previous research on the neural correlates of consciousness (NCC) in visual perception revealed an early event-related potential (ERP), the visual awareness negativity (VAN), to be associated with stimulus awareness. However, due to the use of brief stimulus presentations in previous studies, it remains unclear whether awareness-related negativities represent a transient onset-related response or correspond to the duration of a conscious percept. Studies are required that allow prolonged stimulus presentation under aware and unaware conditions. The present ERP study aimed to tackle this challenge by using a novel stimulation design. Male and female human participants (n = 62) performed a visual task while task-irrelevant line stimuli were presented in the background for either 500 or 1000 ms. The line stimuli sometimes contained a face, which needed so-called visual one-shot learning to be seen. Half of the participants were informed about the presence of the face, resulting in faces being perceived by the informed but not by the uninformed participants. Comparing ERPs between the informed and uninformed group revealed an enhanced negativity over occipitotemporal electrodes that persisted for the entire duration of stimulus presentation. Our results suggest that sustained visual awareness negativities (SVAN) are associated with the duration of stimulus presentation.

Conscious perception of fear in faces: Insights from high-density EEG and perceptual awareness scale with threshold stimuli

Contrary to the extensive research on processing subliminal and/or unattended emotional facial expressions, only a minority of studies have investigated the neural correlates of consciousness (NCCs) of emotions conveyed by faces. In the present high-density electroencephalography (EEG) study, we first employed a staircase procedure to identify each participant's perceptual threshold of the emotion expressed by the face and then compared the EEG signals elicited in trials where the participants were aware with the activity elicited in trials where participants were unaware of the emotions expressed by these, otherwise identical, faces. Drawing on existing knowledge of the neural mechanisms of face processing and NCCs, we hypothesized that activity in frontal electrodes would be modulated in relation to participants' awareness of facial emotional content. More specifically, we hypothesized that the NCC of fear seen on someone else's face could be detected as a modulation of a later and more anterior (i.e., at frontal sites) event-related potential (ERP) than the face-sensitive N170. By adopting a data-driven approach and cluster-based statistics to the analysis of EEG signals, the results were clear-cut in showing that visual awareness of fear was associated with the modulation of a frontal ERP component in a 150-300 msec interval. These insights are dissected and contextualized in relation to prevailing theories of visual consciousness and their proposed NCC benchmarks.

N2 Responses in Youths With Psychosis Risk Syndrome and Their Association With Clinical Outcomes: A Cohort Follow-Up Study Based on the Three-Stimulus Visual Oddball Paradigm

OBJECTIVE

Schizophrenia often occurs during youth, and psychosis risk syndrome occurs before the onset of psychosis. The aim of this study was to determine whether the visual event-related potential responses in youths with psychosis risk syndrome were defective in the presence of interference stimuli and associated with their clinical outcomes.

METHODS

A total of 223 participants, including 122 patients with psychosis risk syndrome, 50 patients with emotional disorders, and 51 healthy control subjects, were assessed. Baseline EEG was recorded during the three-stimulus visual oddball task. The event-related potentials induced by square pictures with different colors were measured. Almost all patients with psychosis risk syndrome were followed up for 12 months and were reclassified into three subgroups: conversion, symptomatic, and remission. The differences in baseline event-related potential responses were compared among the clinical outcome subgroups.

RESULTS

The average N2 amplitude of the psychosis risk syndrome group was significantly less negative than that in the healthy control group (d=0.53). The baseline average N2 amplitude in the conversion subgroup was significantly less negative than that in the symptomatic (d=0.58) and remission (d=0.50) subgroups and in the healthy control group (d=0.97). The average N2 amplitude did not differ significantly between the symptomatic and remission subgroups (d=0.02). However, it was significantly less negative in the symptomatic and remission subgroups than in the healthy control group (d=0.46 and d=0.38). No statistically significant results were found in the P3 response.

CONCLUSIONS

Youths with psychosis risk syndrome had significant N2 amplitude defects in attention processing with interference stimuli. N2 amplitude shows potential as a prognostic biomarker of clinical outcome in the psychosis risk syndrome.

Transcranial magnetic stimulation effects support an oscillatory model of ERP genesis

Whether prestimulus oscillatory brain activity contributes to the generation of post-stimulus-evoked neural responses has long been debated, but findings remain inconclusive. We first investigated the hypothesized relationship via EEG recordings during a perceptual task with this correlational evidence causally probed subsequently by means of online rhythmic transcranial magnetic stimulation. Both approaches revealed a close link between prestimulus individual alpha frequency (IAF) and P1 latency, with faster IAF being related to shorter latencies, best explained via phase-reset mechanisms. Moreover, prestimulus alpha amplitude predicted P3 size, best explained via additive (correlational and causal evidence) and baseline shift mechanisms (correlational evidence), each with distinct prestimulus alpha contributors. Finally, in terms of performance, faster prestimulus IAF and shorter P1 latencies were both associated with higher task accuracy, while lower prestimulus alpha amplitudes and higher P3 amplitudes were associated with higher confidence ratings. Our results are in favor of the oscillatory model of ERP genesis and modulation, shedding new light on the mechanistic relationship between prestimulus oscillations and functionally relevant evoked components.

Feedforward connectivity patterns from visual areas to the front of the brain contain information about sensory stimuli regardless of awareness or report

Current theories of consciousness can be categorized to some extent by their predictions about the putative role of the prefrontal cortex (PFC) in conscious perception. One family of the theories proposes that the PFC is necessary for conscious perception. The other postulates that the PFC is not necessary and that other areas (e.g., posterior cortical areas) are more important for conscious perception. No-report paradigms could potentially arbitrate the debate as they disentangle task reporting from conscious perception. While previous no-report paradigms tend to point to a reduction in PFC activity, they have not examined the critical role of the PFC in "monitoring" or "reading out" the patterns of activity in the sensory cortex to generate conscious perception. To address this, we reanalysed electroencephalography (EEG) data from a no-report inattentional blindness paradigm (Shafto & Pitts, 2015). We examined the role of feedforward input patterns to the PFC from sensory cortices. We employed nonparametric spectral Granger causality and quantified the amount of information that reflected the contents of consciousness using multivariate classifiers. Unexpectedly, regardless of whether the stimulus was consciously seen or not, we found that information relating to the current sensory stimulus was present in the pattern of inputs from visual areas to the PFC. In light of these findings, we suggest various theories of consciousness need to be revised to accommodate the fact that the contents of consciousness are decodable from the input patterns from posterior sensory regions to the PFC, regardless of awareness (or report).

Impairment of unconscious emotional processing after unilateral medial temporal structure resection

The role of the amygdala in unconscious emotional processing remains a topic of debate. Past lesion studies have indicated that amygdala damage leads to impaired electrodermal activity in response to subliminally presented emotional stimuli. However, electrodermal activity can reflect both emotional and nonemotional processes. To provide behavioral evidence highlighting the critical role of the amygdala in unconscious emotional processing, we examined patients (n = 16) who had undergone unilateral resection of medial temporal lobe structures, including the amygdala. We utilized the subliminal affective priming paradigm in conjunction with unilateral visual presentation. Fearful or happy dynamic facial expressions were presented in unilateral visual fields for 30 ms, serving as negative or positive primes. Subsequently, neutral target faces were displayed, and participants were tasked with rating the valence of these targets. Positive primes, compared to negative ones, enhanced valence ratings of the target to a greater extent when they stimulated the intact hemisphere (i.e., were presented in the contralateral visual field of the intact hemisphere) than when they stimulated the resected hemisphere (i.e., were presented in the contralateral visual field of the resected hemisphere). These results suggest that the amygdala is causally involved in unconscious emotional processing.

Distrust before first sight? Examining knowledge- and appearance-based effects of trustworthiness on the visual consciousness of faces

The present EEG study with 32 healthy participants investigated whether affective knowledge about a person influences the visual awareness of their face, additionally considering the impact of facial appearance. Faces differing in perceived trustworthiness based on appearance were associated with negative or neutral social information and shown as target stimuli in an attentional blink task. As expected, participants showed enhanced awareness of faces associated with negative compared to neutral social information. On the neurophysiological level, this effect was connected to differences in the time range of the early posterior negativity (EPN)-a component associated with enhanced attention and facilitated processing of emotional stimuli. The findings indicate that the social-affective relevance of a face based on emotional knowledge is accessed during a phase of attentional enhancement for conscious perception and can affect prioritization for awareness. In contrast, no clear evidence for influences of facial trustworthiness during the attentional blink was found.

Multimodal acoustic-electric trigeminal nerve stimulation modulates conscious perception

Multimodal stimulation can reverse pathological neural activity and improve symptoms in neuropsychiatric diseases. Recent research shows that multimodal acoustic-electric trigeminal-nerve stimulation (TNS) (i.e., musical stimulation synchronized to electrical stimulation of the trigeminal nerve) can improve consciousness in patients with disorders of consciousness. However, the reliability and mechanism of this novel approach remain largely unknown. We explored the effects of multimodal acoustic-electric TNS in healthy human participants by assessing conscious perception before and after stimulation using behavioral and neural measures in tactile and auditory target-detection tasks. To explore the mechanisms underlying the putative effects of acoustic-electric stimulation, we fitted a biologically plausible neural network model to the neural data using dynamic causal modeling. We observed that (1) acoustic-electric stimulation improves conscious tactile perception without a concomitant change in auditory perception, (2) this improvement is caused by the interplay of the acoustic and electric stimulation rather than any of the unimodal stimulation alone, and (3) the effect of acoustic-electric stimulation on conscious perception correlates with inter-regional connection changes in a recurrent neural processing model. These results provide evidence that acoustic-electric TNS can promote conscious perception. Alterations in inter-regional cortical connections might be the mechanism by which acoustic-electric TNS achieves its consciousness benefits.

Stimulus awareness is associated with secondary somatosensory cortex activation in an inattentional numbness paradigm

While inattentional blindness and deafness studies have revealed neural correlates of consciousness (NCC) without the confound of task relevance in the visual and auditory modality, comparable studies for the somatosensory modality are lacking. Here, we investigated NCC using functional magnetic resonance imaging (fMRI) in an inattentional numbness paradigm. Participants (N = 44) received weak electrical stimulation on the left hand while solving a demanding visual task. Half of the participants were informed that task-irrelevant weak tactile stimuli above the detection threshold would be applied during the experiment, while the other half expected stimuli below the detection threshold. Unexpected awareness assessments after the experiment revealed that altogether 10 participants did not consciously perceive the somatosensory stimuli during the visual task. Awareness was not significantly modulated by prior information. The fMRI data show that awareness of stimuli led to increased activation in the contralateral secondary somatosensory cortex. We found no significant effects of stimulus awareness in the primary somatosensory cortex or frontoparietal areas. Thus, our results support the hypothesis that somatosensory stimulus awareness is mainly based on activation in higher areas of the somatosensory cortex and does not require strong activation in extended anterior or posterior networks, which is usually seen when perceived stimuli are task-relevant.

Rapid withdrawal from a threatening animal is movement-specific and mediated by reflex-like neural processing

Responses to potentially dangerous stimuli are among the most basic animal behaviors. While research has shown that threats automatically capture the attention of human participants, research has failed to demonstrate automatic behavioral responses to threats in humans. Using a novel naturalistic paradigm, we show that two species of animals humans often report fearing trigger rapid withdrawal responses: participants withdrew their arm from photos of snakes and spiders faster, and with higher acceleration when compared to bird and butterfly stimuli. The behavior was specific to withdrawal as approach movements or button-press/release tasks failed to detect a similar difference. Moreover, between-participant differences in how aversive they found the stimuli predicted the participant's withdrawal speed, indicating that the paradigm was also sensitive to trait-level differences between individuals. Using electroencephalography (EEG), we show that the fast withdrawal was mediated by two attentional processes. First, fast withdrawal responses were associated with early amplification of sensory signals (40-110 ms after stimulus). Second, a later correlate of feature-based attention (early posterior negativity, EPN, 200-240 ms after stimulus) revealed the opposite pattern: Stronger EPN was associated with slower behavioral responses, suggesting that the deployment of attention towards the threatening stimulus features, or failure to "disengage" attention from the stimulus, was detrimental for withdrawal speed. Altogether, the results suggest that rapid behavioral withdrawal from a threatening animal is mediated by reflex-like attentional processing, and later, conscious attention to stimulus features may hinder escaping the treat.

Young children's subjective and objective thresholds and emergent processes of visual consciousness using a backward masking task

Visual consciousness studies in humans have primarily focused on adults. However, whether young children's visual consciousness is similar to or different from that of adults remains unknown. This study examined young children's and adults' subjective awareness and objective discrimination for thresholds and emergent processes of visual consciousness in two experiments. In Experiment 1, 20 5-6-year-olds and 20 adults attempted a figure discrimination task using a square or a diamond as the target stimulus and responded, using a two-point scale, to a question on subjective awareness of the target stimulus with stimulus onset asynchronies (SOA) from 20 to 260 ms. In Experiment 2, 31 5-6-year-olds and 16 adults attempted the task and responded, using a four-point scale, to a question on subjective awareness with SOA from 50 to 550 ms. We measured the discrimination accuracy and the awareness scale with SOA and fit them to the sigmoid function. The results showed that the objective accuracy threshold of young children was larger than that of adults. Moreover, young children's subjective awareness threshold was larger than that of adults in the four-point but not in the two-point scale responses. Finally, there were no age differences in the emergent process of consciousness. This study suggests that the emergent process of consciousness in young children is similar to that in adults, however, the threshold in young children is larger than that in adults.

Decoding neural patterns for the processing of fearful faces under different visual awareness conditions: A multivariate pattern analysis

Previous studies have provided mixed findings regarding the nonconscious processing of fearful faces. Here, we used multivariate pattern analysis on electroencephalography data from three backward masking experiments to examine the processing of fearful faces under different visual awareness conditions. Three groups of participants were shown pairs of face images presented very briefly (for 16 ms) or for sufficiently long (for 266 ms), and completed tasks where the faces were either relevant to the experimental task (Experiment 1) or not (Experiments 2 and 3). Three main decoding analyses were performed. First, in the visual awareness decoding, the visibility of the faces, and hence participants' awareness of them, was maximally decodable in three time windows: 158-168 ms, 235-260 ms and 400-600 ms where the earlier neural patterns were generalized to the later stage activity. Second, we found that the spatial location of a fearful face in the face pairs was decodable, however only when the faces were consciously seen and task-relevant. Finally, we successfully decoded distinct neural patterns associated with the fearful-face-present conditions, compared to the fearful-face-absent conditions, and these patterns were decodable during both short and long presentations of the faces. Together, our results suggest that, while the processing of the spatial location of fearful faces requires awareness and task-relevancy, the mere presence of fearful faces can be processed even when visual awareness is highly restricted.

Differential modulation on neural activity related to flankers during face processing: A visual crowding study

In this visual crowding study, we manipulated the perceivability of a central crowded face (a fearful or a neutral face) by varying the similarity between the central face and the surrounding flanker stimuli. We presented participants with pairs of visual clutters and recorded their electroencephalography during an emotion judgement task. In an upright flanker condition where both the central target face and flanker faces were upright faces, participants were less likely to report seeing the target face, and their P300 was weakened, compared to a scrambled flanker condition where scrambled face images were used as flankers. Additionally, at ∼ 120 ms post-stimulus, a posterior negativity was found for the upright compared to scrambled flanker condition, however only for fearful face targets. We concluded that early neural responses seem to be affected by the perceptual characteristics of both target and flanker stimuli whereas later-stage neural activity is associated with post-perceptual evaluation of the stimuli in this visual crowding paradigm.

Neural electrophysiological correlates of detection and identification awareness

Humans have conscious experiences of the events in their environment. Previous research from electroencephalography (EEG) has shown visual awareness negativity (VAN) at about 200 ms to be a neural correlate of consciousness (NCC). However, when considering VAN as an NCC, it is important to explore which particular experiences are associated with VAN. Recent research proposes that VAN is an NCC of lower-level experiences (detection) rather than higher-level experiences (identification). However, previous results are mixed and have several limitations. In the present study, the stimulus was a ring with a Gabor patch tilting either left or right. On each trial, subjects rated their awareness on a three-level perceptual awareness scale that captured both detection (something vs. nothing) and identification (identification vs. something). Separate staircases were used to adjust stimulus opacity to the detection threshold and the identification threshold. Bayesian linear mixed models provided extreme evidence (BF10 = 131) that VAN was stronger at the detection threshold than at the identification threshold. Mean VAN decreased from [Formula: see text]2.12 microV [[Formula: see text]2.86, [Formula: see text]1.42] at detection to [Formula: see text]0.46 microV [[Formula: see text]0.79, [Formula: see text]0.11] at identification. These results strongly support the claim that VAN is an NCC of lower-level experiences of seeing something rather than of higher-level experiences of specific properties of the stimuli. Thus, results are consistent with recurrent processing theory in that phenomenal visual consciousness is reflected by VAN. Further, results emphasize that it is important to consider the level of experience when searching for NCC.

Faces capture spatial attention only when we want them to: An inattentional blindness EEG study

Previous research on emotional face processing has shown that emotional faces such as fearful faces may be processed without visual awareness. However, evidence for nonconscious attention capture by fearful faces is limited. In fact, studies using sensory manipulation of awareness (e.g., backward masking paradigms) have shown that fearful faces do not attract attention during subliminal viewings nor when they were task-irrelevant. Here, we used a three-phase inattentional blindness paradigm and electroencephalography to examine whether faces (fearful and neutral) capture attention under different conditions of awareness and task-relevancy. We found that the electrophysiological marker for attention capture, the N2-posterior-contralateral (N2pc), was elicited by face stimuli only when participants were aware of the faces and when they were task-relevant (phase 3). When participants were unaware of the presence of faces (phase 1) or when the faces were irrelevant to the task (phase 2), no N2pc was observed. Together with our previous work, we concluded that fearful faces, or faces in general, do not attract attention unless we want them to.

Frontal-occipital phase synchronization predicts occipital alpha power in perceptual decision-making

Numerous studies of perceptual decision-making have shown that lower prestimulus alpha power leads to a higher hit rate in visual detection, which is believed to correlate with the top-down control. However, whether frontal-occipital phase synchronization underlying the top-down control could impact the occipital alpha power that directly affects the perceptual performance remains unclear. In this study, we used analyses of the general linear mixed model (GLMM) and event-related potentials (ERPs) to show that the prestimulus alpha power over the occipital area directly affected visual perception. Using both the univariate and multivariate methods, we found that low-frequency (4-30 Hz) frontal-occipital phase synchronization predicted the prestimulus alpha power over the occipital area. Overall, our results suggested that frontal-occipital phase synchronization could predict occipital alpha power that directly affects perceptual decision-making.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11571-022-09862-7.

Fixation-related electrical potentials during a free visual search task reveal the timing of visual awareness

It has been repeatedly claimed that emotional faces readily capture attention, and that they may be processed without awareness. Yet some observations cast doubt on these assertions. Part of the problem may lie in the experimental paradigms employed. Here, we used a free viewing visual search task during electroencephalographic recordings, where participants searched for either fearful or neutral facial expressions among distractor expressions. Fixation-related potentials were computed for fearful and neutral targets and the response compared for stimuli consciously reported or not. We showed that awareness was associated with an electrophysiological negativity starting at around 110 ms, while emotional expressions were distinguished on the N170 and early posterior negativity only when stimuli were consciously reported. These results suggest that during unconstrained visual search, the earliest electrical correlate of awareness may emerge as early as 110 ms, and fixating at an emotional face without reporting it may not produce any unconscious processing.

The Current of Consciousness: Neural Correlates and Clinical Aspects

PURPOSE OF REVIEW

In this review, we summarize the current understanding of consciousness including its neuroanatomic basis. We discuss major theories of consciousness, physical exam-based and electroencephalographic metrics used to stratify levels of consciousness, and tools used to shed light on the neural correlates of the conscious experience. Lastly, we review an expanded category of 'disorders of consciousness,' which includes disorders that impact either the level or experience of consciousness.

RECENT FINDINGS

Recent studies have revealed many of the requisite EEG, ERP, and fMRI signals to predict aspects of the conscious experience. Neurological disorders that disrupt the reticular activating system can affect the level of consciousness, whereas cortical disorders from seizures and migraines to strokes and dementia may disrupt phenomenal consciousness. The recently introduced memory theory of consciousness provides a new explanation of phenomenal consciousness that may explain better than prior theories both experimental studies and the neurologist's clinical experience. Although the complete neurobiological basis of consciousness remains a mystery, recent advances have improved our understanding of the physiology underlying level of consciousness and phenomenal consciousness.

Neural correlates of conscious processing of emotional faces: Evidence from event-related potentials

There is a theoretical debate between the early and late neural correlates of consciousness (NCCs). Previous studies using neutral face stimuli supported an early NCC and suggested that visual awareness negativity (VAN) is associated with consciousness, while late positivity (LP) reflects post-perceptual activity. However, emotional faces may help to examine the relationship between LP and consciousness due to the differences in late processing between emotional and neutral faces. To explore the effects of facial emotional information on NCCs, the present study manipulated consciousness with the inattentional blindness paradigm and used happy, fearful, and neutral faces as visual stimuli. The results showed that the conscious processing of emotional faces was correlated with VAN and LP, while the conscious processing of neutral faces was associated with VAN. First, the results suggest that VAN is an NCC, and the relationship between LP and consciousness is affected by facial emotional information. Second, VAN reflects the early perceptual experience of emotional faces, whereas LP may reflect the late conscious processing of emotional faces. Furthermore, source localization analysis showed that the LPs of emotional faces were mainly located in the frontal and parietal lobes, whereas those of neutral faces showed no significant activation. This suggests that facial emotional information may affect the brain regions associated with conscious processing. Time-frequency analysis showed that conscious processing is related to the enhancement of alpha and theta oscillation, indicating that conscious processing may be associated with the suppression of irrelevant stimuli. Overall, the present study suggests that the integration of the theories that support early and late NCCs helps explain the conscious processing of emotional faces.

Continuous Theta Burst Stimulation to the left anterior medial prefrontal cortex influences metacognitive efficiency

The contribution of the prefrontal areas to visual awareness is critical for the Global Neuronal Workspace Theory and higher-order theories of consciousness. The goal of the present study was to test the potential engagement of the anterior medial prefrontal cortex (aMPFC) in visual awareness judgements. We aimed to temporarily influence the neuronal dynamics of the left aMPFC via neuroplasticity-like mechanisms. We used different Theta Burst Stimulation (TBS) protocols in combination with a visual identification task and visual awareness ratings. Either continuous TBS (cTBS), intermittent TBS (iTBS), or sham TBS was applied prior to the experimental paradigm in a within-participant design. Compared with sham TBS, we observed an increase in participants' ability to judge their perception adequately (metacognitive efficiency) following cTBS but not iTBS. The effect was accompanied by lower visual awareness ratings in incorrect responses. No significant differences in the identification task performance were observed. We interpret these results as evidence of the involvement of PFC in the brain network that underlies metacognition. Further, we discuss whether the results of TMS studies on perceptual metacognition can be taken as evidence for PFC involvement in awareness itself.

Spatiotemporal profile of altered neural reactivity to food images in obesity: Reward system is altered automatically and predicts efficacy of weight loss intervention

Introduction

Obesity presents a significant public health problem. Brain plays a central role in etiology and maintenance of obesity. Prior neuroimaging studies have found that individuals with obesity exhibit altered neural responses to images of food within the brain reward system and related brain networks. However, little is known about the dynamics of these neural responses or their relationship to later weight change. In particular, it is unknown if in obesity, the altered reward response to food images emerges early and automatically, or later, in the controlled stage of processing. It also remains unclear if the pretreatment reward system reactivity to food images is predictive of subsequent weight loss intervention outcome.

Methods

In this study, we presented high-calorie and low-calorie food, and nonfood images to individuals with obesity, who were then prescribed lifestyle changes, and matched normal-weight controls, and examined neural reactivity using magnetoencephalography (MEG). We performed whole-brain analysis to explore and characterize large-scale dynamics of brain systems affected in obesity, and tested two specific hypotheses: (1) in obese individuals, the altered reward system reactivity to food images occurs early and automatically, and (2) pretreatment reward system reactivity predicts the outcome of lifestyle weight loss intervention, with reduced activity associated with successful weight loss.

Results

We identified a distributed set of brain regions and their precise temporal dynamics that showed altered response patterns in obesity. Specifically, we found reduced neural reactivity to food images in brain networks of reward and cognitive control, and elevated reactivity in regions of attentional control and visual processing. The hypoactivity in reward system emerged early, in the automatic stage of processing (< 150 ms post-stimulus). Reduced reward and attention responsivity, and elevated neural cognitive control were predictive of weight loss after six months in treatment.

Discussion

In summary, we have identified, for the first time with high temporal resolution, the large-scale dynamics of brain reactivity to food images in obese versus normal-weight individuals, and have confirmed both our hypotheses. These findings have important implications for our understanding of neurocognition and eating behavior in obesity, and can facilitate development of novel integrated treatment strategies, including tailored cognitive-behavioral and pharmacological therapies.

The mechanisms of selective attention in phenomenal consciousness

In three experiments we investigated the effects of selective attention in iconic memory and fragile-visual short-term memory (VSTM), which have been related to phenomenal consciousness. We used a novel retro-cue paradigm with different delays (early vs late) and object priorities (high vs equal vs low), to investigate (a) attentional costs and benefits and the role of (b) bottom-up factors and (c) fragile-VSTM in feature-based attentional selection. Experiment 1 showed that attentional costs modulate visual maintenance at longer delays, while Experiment 2 showed that by reducing the time exposure of the memory array from 250 ms to 100 ms, as a bottom-up factor, participants were not able to select the objects based on their priorities. Finally, Experiment 3 showed that a pattern mask presented before the transfer in visual working memory, attenuates the overall performance while preserving the priority effect. The implications for phenomenal consciousness before conscious access are discussed.

Neural processing of lateralised task-irrelevant fearful faces under different awareness conditions

The neural fate of task-irrelevant emotional faces under different awareness conditions is poorly understood. Here, we examined the electrophysiological activity during an experiment where the location of target information (contrast-induced line) was manipulated orthogonally to the location of task-irrelevant fearful faces, under subliminal or supraliminal viewing conditions. We found that only target lines elicited an N2-posterior-contralateral (N2pc), indexing spatial attention shifting, in the supraliminal condition. No N2pc was found for the targets in the subliminal condition or for task-irrelevant fearful faces in either conditions. However, the mere presence of a fearful face enhanced early neural activity between 200 and 300 ms only in the subliminal condition. Additionally, the presence of a target line, but not a fearful face, enhanced the P3. Our results suggest that the N2pc is dependent on visual awareness and task-relevancy of the information and that laterally-presented task-irrelevant fearful expressions can be processed without awareness during early visual processing.