A roadmap for the study of conscious audition and its neural basis

Isolating Neural Signatures of Conscious Speech Perception with a No-Report Sine-Wave Speech Paradigm

Identifying neural correlates of conscious perception is a fundamental endeavor of cognitive neuroscience. Most studies so far have focused on visual awareness along with trial-by-trial reports of task-relevant stimuli, which can confound neural measures of perceptual awareness with postperceptual processing. Here, we used a three-phase sine-wave speech paradigm that dissociated between conscious speech perception and task relevance while recording EEG in humans of both sexes. Compared with tokens perceived as noise, physically identical sine-wave speech tokens that were perceived as speech elicited a left-lateralized, near-vertex negativity, which we interpret as a phonological version of a perceptual awareness negativity. This response appeared between 200 and 300 ms after token onset and was not present for frequency-flipped control tokens that were never perceived as speech. In contrast, the P3b elicited by task-irrelevant tokens did not significantly differ when the tokens were perceived as speech versus noise and was only enhanced for tokens that were both perceived as speech and relevant to the task. Our results extend the findings from previous studies on visual awareness and speech perception and suggest that correlates of conscious perception, across types of conscious content, are most likely to be found in midlatency negative-going brain responses in content-specific sensory areas.

Information-Theoretic Approaches in EEG Correlates of Auditory Perceptual Awareness under Informational Masking

In informational masking paradigms, the successful segregation between the target and masker creates auditory perceptual awareness. The dynamics of the build-up of auditory perception is based on a set of interactions between bottom-up and top-down processes that generate neuronal modifications within the brain network activity. These neural changes are studied here using event-related potentials (ERPs), entropy, and integrated information, leading to several measures applied to electroencephalogram signals. The main findings show that the auditory perceptual awareness stimulated functional activation in the fronto-temporo-parietal brain network through (i) negative temporal and positive centro-parietal ERP components; (ii) an enhanced processing of multi-information in the temporal cortex; and (iii) an increase in informational content in the fronto-central cortex. These different results provide information-based experimental evidence about the functional activation of the fronto-temporo-parietal brain network during auditory perceptual awareness.

Laminar specificity of the auditory perceptual awareness negativity: A biophysical modeling study

How perception of sensory stimuli emerges from brain activity is a fundamental question of neuroscience. To date, two disparate lines of research have examined this question. On one hand, human neuroimaging studies have helped us understand the large-scale brain dynamics of perception. On the other hand, work in animal models (mice, typically) has led to fundamental insight into the micro-scale neural circuits underlying perception. However, translating such fundamental insight from animal models to humans has been challenging. Here, using biophysical modeling, we show that the auditory awareness negativity (AAN), an evoked response associated with perception of target sounds in noise, can be accounted for by synaptic input to the supragranular layers of auditory cortex (AC) that is present when target sounds are heard but absent when they are missed. This additional input likely arises from cortico-cortical feedback and/or non-lemniscal thalamic projections and targets the apical dendrites of layer-5 (L5) pyramidal neurons. In turn, this leads to increased local field potential activity, increased spiking activity in L5 pyramidal neurons, and the AAN. The results are consistent with current cellular models of conscious processing and help bridge the gap between the macro and micro levels of perception-related brain activity.

Tracking auditory mismatch negativity responses during full conscious state and coma

The mismatch negativity (MMN) is considered the electrophysiological change-detection response of the brain, and therefore a valuable clinical tool for monitoring functional changes associated with return to consciousness after severe brain injury. Using an auditory multi-deviant oddball paradigm, we tracked auditory MMN responses in seventeen healthy controls over a 12-h period, and in three comatose patients assessed over 24 h at two time points. We investigated whether the MMN responses show fluctuations in detectability over time in full conscious awareness, or whether such fluctuations are rather a feature of coma. Three methods of analysis were utilized to determine whether the MMN and subsequent event-related potential (ERP) components could be identified: traditional visual analysis, permutation t-test, and Bayesian analysis. The results showed that the MMN responses elicited to the duration deviant-stimuli are elicited and reliably detected over the course of several hours in healthy controls, at both group and single-subject levels. Preliminary findings in three comatose patients provide further evidence that the MMN is often present in coma, varying within a single patient from easily detectable to undetectable at different times. This highlights the fact that regular and repeated assessments are extremely important when using MMN as a neurophysiological predictor of coma emergence.

Laminar Specificity of the Auditory Perceptual Awareness Negativity: A Biophysical Modeling Study

How perception of sensory stimuli emerges from brain activity is a fundamental question of neuroscience. To date, two disparate lines of research have examined this question. On one hand, human neuroimaging studies have helped us understand the large-scale brain dynamics of perception. On the other hand, work in animal models (mice, typically) has led to fundamental insight into the micro-scale neural circuits underlying perception. However, translating such fundamental insight from animal models to humans has been challenging. Here, using biophysical modeling, we show that the auditory awareness negativity (AAN), an evoked response associated with perception of target sounds in noise, can be accounted for by synaptic input to the supragranular layers of auditory cortex (AC) that is present when target sounds are heard but absent when they are missed. This additional input likely arises from cortico-cortical feedback and/or non-lemniscal thalamic projections and targets the apical dendrites of layer-V pyramidal neurons (PNs). In turn, this leads to increased local field potential activity, increased spiking activity in layer-V PNs, and the AAN. The results are consistent with current cellular models of conscious processing and help bridge the gap between the macro and micro levels of perception-related brain activity.

Author Summary

To date, our understanding of the brain basis of conscious perception has mostly been restricted to large-scale, network-level activity that can be measured non-invasively in human subjects. However, we lack understanding of how such network-level activity is supported by individual neurons and neural circuits. This is at least partially because conscious perception is difficult to study in experimental animals, where such detailed characterization of neural activity is possible. To address this gap, we used biophysical modeling to gain circuit-level insight into an auditory brain response known as the auditory awareness negativity (AAN). This response can be recorded non-invasively in humans and is associated with perceptual awareness of sounds of interest. Our model shows that the AAN likely arises from specific cortical layers and cell types. These data help bridge the gap between circuit- and network-level theories of consciousness, and could lead to new, targeted treatments for perceptual dysfunction and disorders of consciousness.

Adaptation in the sensory cortex drives bistable switching during auditory stream segregation

Current theories of perception emphasize the role of neural adaptation, inhibitory competition, and noise as key components that lead to switches in perception. Supporting evidence comes from neurophysiological findings of specific neural signatures in modality-specific and supramodal brain areas that appear to be critical to switches in perception. We used functional magnetic resonance imaging to study brain activity around the time of switches in perception while participants listened to a bistable auditory stream segregation stimulus, which can be heard as one integrated stream of tones or two segregated streams of tones. The auditory thalamus showed more activity around the time of a switch from segregated to integrated compared to time periods of stable perception of integrated; in contrast, the rostral anterior cingulate cortex and the inferior parietal lobule showed more activity around the time of a switch from integrated to segregated compared to time periods of stable perception of segregated streams, consistent with prior findings of asymmetries in brain activity depending on the switch direction. In sound-responsive areas in the auditory cortex, neural activity increased in strength preceding switches in perception and declined in strength over time following switches in perception. Such dynamics in the auditory cortex are consistent with the role of adaptation proposed by computational models of visual and auditory bistable switching, whereby the strength of neural activity decreases following a switch in perception, which eventually destabilizes the current percept enough to lead to a switch to an alternative percept.

Atonal Music as a Model for Investigating Exploratory Behavior

Atonal music is often characterized by low predictability stemming from the absence of tonal or metrical hierarchies. In contrast, Western tonal music exhibits intrinsic predictability due to its hierarchical structure and therefore, offers a directly accessible predictive model to the listener. In consequence, a specific challenge of atonal music is that listeners must generate a variety of new predictive models. Listeners must not only refrain from applying available tonal models to the heard music, but they must also search for statistical regularities and build new rules that may be related to musical properties other than pitch, such as timbre or dynamics. In this article, we propose that the generation of such new predictive models and the aesthetic experience of atonal music are characterized by internal states related to exploration. This is a behavior well characterized in behavioral neuroscience as fulfilling an innate drive to reduce uncertainty but which has received little attention in empirical music research. We support our proposal with emerging evidence that the hedonic value is associated with the recognition of patterns in low-predictability sound sequences and that atonal music elicits distinct behavioral responses in listeners. We end by outlining new research avenues that might both deepen our understanding of the aesthetic experience of atonal music in particular, and reveal core qualities of the aesthetic experience in general.

Sliding Scale Theory of Attention and Consciousness/Unconsciousness

Attention defined as focusing on a unit of information plays a prominent role in both consciousness and the cognitive unconscious, due to its essential role in information processing. Existing theories of consciousness invariably address the relationship between attention and conscious awareness, ranging from attention is not required to crucial. However, these theories do not adequately or even remotely consider the contribution of attention to the cognitive unconscious. A valid theory of consciousness must also be a robust theory of the cognitive unconscious, a point rarely if ever considered. Current theories also emphasize human perceptual consciousness, primarily visual, despite evidence that consciousness occurs in diverse animal species varying in cognitive capacity, and across many forms of perceptual and thought consciousness. A comprehensive and parsimonious perspective applicable to the diversity of species demonstrating consciousness and the various forms—sliding scale theory of attention and consciousness/unconsciousness—is proposed with relevant research reviewed. Consistent with the continuous organization of natural events, attention occupies a sliding scale in regards to time and space compression. Unconscious attention in the form of the “cognitive unconscious” is time and spaced diffused, whereas conscious attention is tightly time and space compressed to the present moment. Due to the special clarity derived from brief and concentrated signals, the tight time and space compression yields conscious awareness as an emergent property. The present moment enhances the time and space compression of conscious attention, and contributes to an evolutionary explanation of conscious awareness.

Modality-specific and modality-general electrophysiological correlates of visual and auditory awareness: Evidence from a bimodal ERP experiment

To date, most studies on the event-related potential (ERP) correlates of conscious perception have examined a single perceptual modality. We compared electrophysiological correlates of visual and auditory awareness in the same experiment to test whether there are modality-specific and modality-general correlates of conscious perception. We used near threshold stimulation and analyzed event-related potentials in response to aware and unaware trials in visual, auditory and bimodal conditions. The results showed modality-specific negative amplitude correlates of conscious perception between 200 and 300 ms after stimulus onset. A combination of these auditory and visual awareness negativities was observed in the bimodal condition. A later positive amplitude difference, whose early part was modality-specific, possibly reflecting access to global workspace, and later part shared modality-general features, possibly indicating higher level cognitive processing involving the decision making, was also observed.

Perceptual awareness negativity: a physiological correlate of sensory consciousness

Much research on the neural correlates of consciousness (NCC) has focused on two evoked potentials, the P3b and the visual or auditory awareness negativity (VAN, AAN). Surveying a broad range of recent experimental evidence, we find that repeated failures to observe the P3b during conscious perception eliminate it as a putative NCC. Neither the VAN nor the AAN have been dissociated from consciousness; furthermore, a similar neural signal correlates with tactile consciousness. These awareness negativities can be maximal contralateral to the evoking stimulus, are likely generated in underlying sensory cortices, and point to the existence of a generalized perceptual awareness negativity (PAN) reflecting the onset of sensory consciousness.

The early but not the late neural correlate of auditory awareness reflects lateralized experiences

Theories disagree as to whether it is the early or the late neural correlate of awareness that plays a critical role in phenomenal awareness. According to recurrent processing theory, early activity in primary sensory areas corresponds closely to phenomenal awareness. In support, research with electroencephalography found that in the visual and somatosensory modality, an early neural correlate of awareness is contralateral to the perceived side of stimulation. Thus, early activity is sensitive to the perceived side of visual and somatosensory stimulation. Critically, it is unresolved whether this is true also for hearing. In the present study (N = 26 students), Bayesian analyses showed that the early neural correlate of awareness (auditory awareness negativity, AAN) was stronger for contralateral than ipsilateral electrodes whereas the late correlate of auditory awareness (late positivity, LP) was not lateralized. These findings demonstrate that the early but not the late neural correlate of auditory awareness reflects lateralized experiences. Thus, these findings imply that AAN is a more suitable NCC than LP because it correlates more closely with lateralized experiences.

Continuous flash suppression: Known and unknowns

Studies utilizing continuous flash suppression (CFS) provide valuable information regarding conscious and nonconscious perception. There are, however, crucial unanswered questions regarding the mechanisms of suppression and the level of visual processing in the absence of consciousness with CFS. Research suggests that the answers to these questions depend on the experimental configuration and how we assess consciousness in these studies. The aim of this review is to evaluate the impact of different experimental configurations and the assessment of consciousness on the results of the previous CFS studies. We review studies that evaluated the influence of different experimental configuration on the depth of suppression with CFS and discuss how different assessments of consciousness may impact the results of CFS studies. Finally, we review behavioral and brain recording studies of CFS. In conclusion, previous studies provide evidence for survival of low-level visual information and complete impairment of high-level visual information under the influence of CFS. That is, studies suggest that nonconscious perception of lower-level visual information happens with CFS, but there is no evidence for nonconscious high-level recognition with CFS.

Similar EEG Activity Patterns During Experimentally-Induced Auditory Illusions and Veridical Perceptions

Hallucinations and illusions are two instances of perceptual experiences illustrating how perception might diverge from external sensory stimulations and be generated or altered based on internal brain states. The occurrence of these phenomena is not constrained to patient populations. Similar experiences can be elicited in healthy subjects by means of suitable experimental procedures. Studying the neural mechanisms underlying these experiences not only has the potential to expand our understanding of the brain's perceptual machinery but also of how it might get impaired. In the current study, we employed an auditory signal detection task to induce auditory illusions by presenting speech snippets at near detection threshold intensity embedded in noise. We investigated the neural correlates of auditory false perceptions by examining the EEG activity preceding the responses in speech absent (false alarm, FA) trials and comparing them to speech present (hit) trials. The results of the comparison of event-related potentials (ERPs) in the activation period vs. baseline revealed the presence of an early negativity (EN) and a late positivity (LP) similar in both hits and FAs, which were absent in misses, correct rejections (CR) and control button presses (BPs). We postulate that the EN and the LP might represent the auditory awareness negativity (AAN) and centro-parietal positivity (CPP) or P300, respectively. The event-related spectral perturbations (ERSPs) exhibited a common power enhancement in low frequencies (<4 Hz) in hits and FAs. The low-frequency power enhancement has been frequently shown to be accompanied with P300 as well as separately being a marker of perceptual awareness, referred to as slow cortical potentials (SCP). Furthermore, the comparison of hits vs. FAs showed a significantly higher LP amplitude and low frequency power in hits compared to FAs. Generally, the observed patterns in the present results resembled some of the major neural correlates associated with perceptual awareness in previous studies. Our findings provide evidence that the neural correlates associated with conscious perception, can be elicited in similar ways in both presence and absence of externally presented sensory stimuli. The present findings did not reveal any pre-stimulus alpha and beta modulations distinguishing conscious vs. unconscious perceptions.

The neural basis of consciousness

Consciousness has evolved and is a feature of all animals with sufficiently complex nervous systems. It is, therefore, primarily a problem for biology, rather than physics. In this review, I will consider three aspects of consciousness: level of consciousness, whether we are awake or in a coma; the contents of consciousness, what determines how a small amount of sensory information is associated with subjective experience, while the rest is not; and meta-consciousness, the ability to reflect upon our subjective experiences and, importantly, to share them with others. I will discuss and compare current theories of the neural and cognitive mechanisms involved in producing these three aspects of consciousness and conclude that the research in this area is flourishing and has already succeeded to delineate these mechanisms in surprising detail.

Bifurcation in brain dynamics reveals a signature of conscious processing independent of report

An outstanding challenge for consciousness research is to characterize the neural signature of conscious access independently of any decisional processes. Here we present a model-based approach that uses inter-trial variability to identify the brain dynamics associated with stimulus processing. We demonstrate that, even in the absence of any task or behavior, the electroencephalographic response to auditory stimuli shows bifurcation dynamics around 250–300 milliseconds post-stimulus. Namely, the same stimulus gives rise to late sustained activity on some trials, and not on others. This late neural activity is predictive of task-related reports, and also of reports of conscious contents that are randomly sampled during task-free listening. Source localization further suggests that task-free conscious access recruits the same neural networks as those associated with explicit report, except for frontal executive components. Studying brain dynamics through variability could thus play a key role for identifying the core signatures of conscious access, independent of report.

Current knowledge on the neural basis of consciousness mostly relies on situations where people report their perception. Here, the authors provide evidence for the idea that bifurcation in brain dynamics reflects conscious perception independent of report.

Auditory cortex activity related to perceptual awareness versus masking of tone sequences

Sequences of repeating tones can be masked by other tones of different frequency. When these tone sequences are perceived, nevertheless, a prominent neural response in the auditory cortex is evoked by each tone of the sequence. When the targets are detected based on their isochrony, participants know that they are listening to the target once they detected it. To explore if the neural activity is more closely related to this detection task or to perceptual awareness, this magnetoencephalography (MEG) study used targets that could only be identified with cues provided after or before the masked target. In experiment 1, multiple mono-tone streams with jittered inter-stimulus interval were used, and the tone frequency of the target was indicated by a cue. Results showed no differential auditory cortex activity between hit and miss trials with post-stimulus cues. A late negative response for hit trials was only observed for pre-stimulus cues, suggesting a task-related component. Since experiment 1 provided no evidence for a link of a difference response with tone awareness, experiment 2 was planned to probe if detection of tone streams was linked to a difference response in auditory cortex. Random-tone sequences were presented in the presence of a multi-tone masker, and the sequence was repeated without masker thereafter. Results showed a prominent difference wave for hit compared to miss trials in experiment 2 evoked by targets in the presence of the masker. These results suggest that perceptual awareness of tone streams is linked to neural activity in auditory cortex.

Dissociating neural correlates of consciousness and task relevance during auditory processing

In recent years, several ERP components have been identified as potential neural correlates of consciousness (NCC), including early negativities and late positivities. Based on experiments in the visual modality, it has recently been shown that awareness is often confounded with reporting it, possibly overestimating the NCC. It is unknown whether similar constraints also exist in the auditory modality. In order to address this gap, we presented spoken words in a sustained inattentional deafness paradigm. Electrophysiological responses were obtained in three physically identical experimental conditions that differed only with respect to the participants' instructions. Participants were either left uninformed or informed about the presence of spoken words while confronted with an auditory distractor task (U/I condition), informed about the words while exposed to the same task as before (I condition), or requested to respond to the now task-relevant speech stimuli (TR condition). After completion of the U/I condition, only informed participants reported awareness of the words. In ERPs, awareness of words in the U/I and I condition was accompanied by an anterior auditory awareness negativity (AAN). Only when stimuli were task-relevant, i.e., during the TR condition, late positivities emerged. Taken together, these results indicate that early negativities but not late positivities index awareness across sensory modalities. Thus, they provide evidence for a recurrent processing framework, which highlights the importance of early sensory processing in conscious perception.

Cortical responses to auditory novelty across task conditions: An intracranial electrophysiology study

Elucidating changes in sensory processing across attentional and arousal states is a major focus in neuroscience. The local/global deviant (LGD) stimulus paradigm engages auditory predictive coding over short (local deviance, LD) and long (global deviance, GD) time scales, and has been used to assay disruption of auditory predictive coding upon loss of consciousness. Our previous work (Nourski et al., 2018, J Neurosci 38:8441-52) examined effects of general anesthesia on short- and long-term novelty detection. GD effects were suppressed at subhypnotic doses of propofol, suggesting that they may be more related to task engagement than consciousness per se. The present study addressed this hypothesis by comparing cortical responses to auditory novelty during passive versus active listening conditions in awake listeners. Subjects were seven adult neurosurgical patients undergoing chronic invasive monitoring for medically intractable epilepsy. LGD stimuli were sequences of four identical vowels followed by a fifth identical or different vowel. In the passive condition, the stimuli were presented to subjects as they watched a silent TV program and were instructed to attend to its content. In the active condition, stimuli were presented in the absence of a TV program, and subjects were instructed to press a button in response to GD target stimuli. Intracranial recordings were made from multiple brain regions, including core and non-core auditory, auditory-related, prefrontal and sensorimotor cortex. Metrics of task performance included hit rate, sensitivity index, and reaction times. Cortical activity was measured as averaged auditory evoked potentials (AEPs) and event-related band power in high gamma (70-150 Hz) and alpha (8-14 Hz) frequency bands. The vowel stimuli and LD elicited robust AEPs in all studied brain areas in both passive and active conditions. High gamma responses to stimulus onset and LD were localized predominantly to the auditory cortex in the superior temporal plane and had a comparable prevalence and spatial extent between the two conditions. In contrast, GD effects (AEPs, high gamma and alpha suppression) were greatly enhanced during the active condition in all studied brain areas. The prevalence of high gamma GD effects was positively correlated with individual subjects' task performance. The data demonstrate distinct task engagement-related effects on responses to auditory novelty across the auditory cortical processing hierarchy. The results motivate a closer examination of effective connectivity underlying attentional modulation of cortical sensory responses, and serve as a foundation for examining changes in sensory processing associated with general anesthesia, sleep and disorders of consciousness.

Cognitive resources are distributed among the entire auditory landscape in auditory scene analysis

Although attention has been shown to enhance neural representations of selected inputs, the fate of unselected background sounds is still debated. The goal of the current study was to understand how processing resources are distributed among attended and unattended sounds during auditory scene analysis. We used a three-stream paradigm with four acoustic features uniquely defining each sound stream (frequency, envelope shape, spatial location, tone quality). We manipulated task load by having participants perform a difficult auditory task and an easy movie-viewing task with the same set of sounds in separate conditions. The mismatch negativity (MMN) component of event-related brain potentials (ERPs) was measured to evaluate sound processing in both conditions. We found no effect of task demands on unattended sound processing: MMNs were elicited by unattended deviants during both low- and high-load task conditions. A key factor of this result was the use of unique tone feature combinations to distinguish each of the three sound streams, strengthening the segregation of streams. In the auditory task, the P3b component demonstrates a two-stage process of target evaluation. Thus, these results, in conjunction with results of previous studies, suggest that stimulus-driven factors that strengthen stream segregation can free up processing capacity for higher-level analyses. The results illustrate the interactive nature of top-down and stimulus-driven processes in stream formation, supporting a distributive theory of attention that balances the strength of the bottom-up input with perceptual goals in analyzing the auditory scene.

Leveraging Nonhuman Primate Multisensory Neurons and Circuits in Assessing Consciousness Theory

Both the global neuronal workspace (GNW) and integrated information theory (IIT) posit that highly complex and interconnected networks engender perceptual awareness. GNW specifies that activity recruiting frontoparietal networks will elicit a subjective experience, whereas IIT is more concerned with the functional architecture of networks than with activity within it. Here, we argue that according to IIT mathematics, circuits converging on integrative versus convergent yet non-integrative neurons should support a greater degree of consciousness. We test this hypothesis by analyzing a dataset of neuronal responses collected simultaneously from primary somatosensory cortex (S1) and ventral premotor cortex (vPM) in nonhuman primates presented with auditory, tactile, and audio-tactile stimuli as they are progressively anesthetized with propofol. We first describe the multisensory (audio-tactile) characteristics of S1 and vPM neurons (mean and dispersion tendencies, as well as noise-correlations), and functionally label these neurons as convergent or integrative according to their spiking responses. Then, we characterize how these different pools of neurons behave as a function of consciousness. At odds with the IIT mathematics, results suggest that convergent neurons more readily exhibit properties of consciousness (neural complexity and noise correlation) and are more impacted during the loss of consciousness than integrative neurons. Last, we provide support for the GNW by showing that neural ignition (i.e., same trial coactivation of S1 and vPM) was more frequent in conscious than unconscious states. Overall, we contrast GNW and IIT within the same single-unit activity dataset, and support the GNW.SIGNIFICANCE STATEMENT A number of prominent theories of consciousness exist, and a number of these share strong commonalities, such as the central role they ascribe to integration. Despite the important and far reaching consequences developing a better understanding of consciousness promises to bring, for instance in diagnosing disorders of consciousness (e.g., coma, vegetative-state, locked-in syndrome), these theories are seldom tested via invasive techniques (with high signal-to-noise ratios), and never directly confronted within a single dataset. Here, we first derive concrete and testable predictions from the global neuronal workspace and integrated information theory of consciousness. Then, we put these to the test by functionally labeling specific neurons as either convergent or integrative nodes, and examining the response of these neurons during anesthetic-induced loss of consciousness.

Odor Identification in Rats: Behavioral and Electrophysiological Evidence of Learned Olfactory-Auditory Associations

The ability to recognize and identify a smell is highly dependent on multisensory context and expectation, for example, hearing the name of the odor source. Here, we develop a novel auditory-odor association task in rats, wherein the animal learns that a specific auditory tone, when associated with a specific odor, predicts reward (Go signal), whereas the same tone associated with a different odor, or vice versa, is not (No-Go signal). The tone occurs prior to the onset of the odor, allowing physiological analyses of sensory-evoked local field potential (LFP) activity to each stimulus in primary auditory cortex and anterior piriform cortex (aPCX). In trained animals that have acquired the task, both auditory and subsequent olfactory cues activate β band oscillations in both the auditory cortex and PCX, suggesting multisensory integration. Naive animals show no such multisensory responses, suggesting the response is learned. In addition to the learned multisensory evoked responses, functional connectivity between auditory cortex and PCX, as assessed with spectral coherence and phase lag index (PLI), is enhanced. Importantly, both the multi-sensory evoked responses and the functional connectivity are context-dependent. In trained animals, the same auditory stimuli presented in the home cage evoke no responses in auditory cortex or PCX, and functional connectivity between the sensory cortices is reduced. Together, the results demonstrate how learning and context shape the expression of multisensory cortical processing. Given that odor identification impairment is associated with preclinical dementia in humans, the mechanisms suggested here may help develop experimental models to assess effects of neuropathology on behavior.

Development of a point of care system for automated coma prognosis: a prospective cohort study protocol

INTRODUCTION

Coma is a deep state of unconsciousness that can be caused by a variety of clinical conditions. Traditional tests for coma outcome prediction are based mainly on a set of clinical observations. Recently, certain event-related potentials (ERPs), which are transient electroencephalogram (EEG) responses to auditory, visual or tactile stimuli, have been introduced as useful predictors of a positive coma outcome (ie, emergence). However, such tests require the skills of clinical neurophysiologists, who are not commonly available in many clinical settings. Additionally, none of the current standard clinical approaches have sufficient predictive accuracies to provide definitive prognoses.

OBJECTIVE

The objective of this study is to develop improved machine learning procedures based on EEG/ERP for determining emergence from coma.

METHODS AND ANALYSIS

Data will be collected from 50 participants in coma. EEG/ERP data will be recorded for 24 consecutive hours at a maximum of five time points spanning 30 days from the date of recruitment to track participants' progression. The study employs paradigms designed to elicit brainstem potentials, middle-latency responses, N100, mismatch negativity, P300 and N400. In the case of patient emergence, data are recorded on that occasion to form an additional basis for comparison. A relevant data set will be developed from the testing of 20 healthy controls, each spanning a 15-hour recording period in order to formulate a baseline. Collected data will be used to develop an automated procedure for analysis and detection of various ERP components that are salient to prognosis. Salient features extracted from the ERP and resting-state EEG will be identified and combined to give an accurate indicator of prognosis.

ETHICS AND DISSEMINATION

This study is approved by the Hamilton Integrated Research Ethics Board (project number 4840). Results will be disseminated through peer-reviewed journal articles and presentations at scientific conferences.

TRIAL REGISTRATION NUMBER

NCT03826407.

Intrinsic Rivalry. Can White Bears Help Us With the Other Side of Consciousness?

Studies of consciousness have traditionally been based mainly upon the perceptual domains of consciousness. However, there is another side of consciousness, represented by various types of intrinsic conscious experiences. Even though intrinsic experiences can represent up to 50% of our conscious experiences, they are still largely neglected in conscious studies. We assume there are two reasons for this. First, the field of intrinsic conscious experiences is methodologically far more problematic than any other. Second, specific paradigms for capturing the correlates of intrinsic conscious experiences are almost nonexistent. Nevertheless, we expect the intrinsic side of consciousness to soon take its place in conscious studies, but first new experimental paradigms will have to be devised, which would be of a similar design to the paradigms used in studies of perceptual consciousness. In this hypothesis and theory article, we propose such a hypothetical paradigm, presenting the exploratory data of our proof-of-concept study, discussing its use, and addressing its shortcomings and their possible remediation.

Evidence of P3a During Sleep, a Process Associated With Intrusions Into Consciousness in the Waking State

The present study examines processes associated with intrusions into consciousness during an unconscious state, natural sleep. The definition of sleep is still much debated. Almost all researchers agree that sleep onset represents a gradual loss of consciousness of the external environment. For sleep to be beneficial, it needs to remain as undisturbed as possible. Nevertheless, unlike other unconsciousness states, sleep is reversible. For purposes of survival, it is critical that the sleeper be able to “detect” and perhaps become conscious of highly relevant biological or personal information. Therefore, even in sleep, the brain must decide whether a new incoming stimulus is relevant and if so, may require an arousal to wakefulness, or whether it is irrelevant and can be gated to prevent disruption of sleep. Event-related potentials (ERPs) were used to measure the extent processing of auditory stimuli some of which elicited an ERP component, the P3a, in the waking state. The P3a is associated with processes resulting in the interruption of frontal central executive, leading to conscious awareness. Very little research has focused on the occurrence of the P3a during sleep. A multi-feature paradigm was used to examine the processing of a frequently occurring “standard” stimulus and six rarely occurring different “deviant” stimuli during wakefulness, NREM, and REM sleep. A P3a was elicited by novel environmental sounds and white noise bursts in the waking state, replicating previous studies. Other deviant stimuli (changes in pitch, intensity, duration) failed to do so. The ERPs indicated that processing of the stimuli that did not elicit a P3a in wakefulness were much inhibited during both NREM and REM sleep. Surprisingly, those deviants that did elicit a P3a in wakefulness continued to do so in stage N2 and REM sleep. The subject did not, however, awaken. These results suggest processes leading to consciousness in wakefulness may still remain active during sleep possibly allowing subjects to act on potentially highly relevant input. This may also explain how sleep can be reversed if the stimulus input is sufficiently critical.

A Machine Learning Framework for Automatic and Continuous MMN Detection With Preliminary Results for Coma Outcome Prediction

Mismatch negativity (MMN) is a component of the event-related potential (ERP) that is elicited through an odd-ball paradigm. The existence of the MMN in a coma patient has a good correlation with coma emergence; however, this component can be difficult to detect. Previously, MMN detection was based on visual inspection of the averaged ERPs by a skilled clinician, a process that is expensive and not always feasible in practice. In this paper, we propose a practical machine learning (ML) based approach for detection of MMN component, thus, improving the accuracy of prediction of emergence from coma. Furthermore, the method can operate on an automatic and continuous basis thus alleviating the need for clinician involvement. The proposed method is capable of the MMN detection over intervals as short as two minutes. This finer time resolution enables identification of waxing and waning cycles of a conscious state. An auditory odd-ball paradigm was applied to 22 healthy subjects and 2 coma patients. A coma patient is tested by measuring the similarity of the patient's ERP responses with the aggregate healthy responses. Because the training process for measuring similarity requires only healthy subjects, the complexity and practicality of training procedure of the proposed method are greatly improved relative to training on coma patients directly. Since there are only two coma patients involved with this study, the results are reported on a very preliminary basis. Preliminary results indicate we can detect the MMN component with an accuracy of 92.7% on healthy subjects. The method successfully predicted emergence in both coma patients when conventional methods failed. The proposed method for collecting training data using exclusively healthy subjects is a novel approach that may prove useful in future, unrelated studies where ML methods are used.

The relationship between attention and consciousness: an expanded taxonomy and implications for 'no-report' paradigms

Tensions between global neuronal workspace theory and recurrent processing theory have sparked much debate in the field of consciousness research. Here, we focus on one of the key distinctions between these theories: the proposed relationship between attention and consciousness. By reviewing recent empirical evidence, we argue that both theories contain key insights and that certain aspects of each theory can be reconciled into a novel framework that may help guide future research. Alternative theories are also considered, including attended intermediate-level representations theory, integrated information theory and higher order thought theory. With the aim of offering a fresh and nuanced perspective to current theoretical debates, an updated taxonomy of conscious and non-conscious states is proposed. This framework maps a wider spectrum of conscious states by incorporating contemporary views from cognitive neuroscience regarding the variety of attentional mechanisms that are known to interact with sensory processing. Whether certain types of attention are necessary for phenomenal and access consciousness is considered and incorporated into this extended taxonomy. To navigate this expanded space, we review recent 'no-report' paradigms and address several methodological misunderstandings in order to pave a clear path forward for identifying the neural basis of perceptual awareness.This article is part of the theme issue 'Perceptual consciousness and cognitive access'.

Processing of auditory novelty across the cortical hierarchy: An intracranial electrophysiology study

Under the predictive coding hypothesis, specific spatiotemporal patterns of cortical activation are postulated to occur during sensory processing as expectations generate feedback predictions and prediction errors generate feedforward signals. Establishing experimental evidence for this information flow within cortical hierarchy has been difficult, especially in humans, due to spatial and temporal limitations of non-invasive measures of cortical activity. This study investigated cortical responses to auditory novelty using the local/global deviant paradigm, which engages the hierarchical network underlying auditory predictive coding over short ('local deviance'; LD) and long ('global deviance'; GD) time scales. Electrocorticographic responses to auditory stimuli were obtained in neurosurgical patients from regions of interest (ROIs) including auditory, auditory-related and prefrontal cortex. LD and GD effects were assayed in averaged evoked potential (AEP) and high gamma (70-150 Hz) signals, the former likely dominated by local synaptic currents and the latter largely reflecting local spiking activity. AEP LD effects were distributed across all ROIs, with greatest percentage of significant sites in core and non-core auditory cortex. High gamma LD effects were localized primarily to auditory cortex in the superior temporal plane and on the lateral surface of the superior temporal gyrus (STG). LD effects exhibited progressively longer latencies in core, non-core, auditory-related and prefrontal cortices, consistent with feedforward signaling. The spatial distribution of AEP GD effects overlapped that of LD effects, but high gamma GD effects were more restricted to non-core areas. High gamma GD effects had shortest latencies in STG and preceded AEP GD effects in most ROIs. This latency profile, along with the paucity of high gamma GD effects in the superior temporal plane, suggest that the STG plays a prominent role in initiating novelty detection signals over long time scales. Thus, the data demonstrate distinct patterns of information flow in human cortex associated with auditory novelty detection over multiple time scales.

Auditory and visual scene analysis: an overview

We perceive the world as stable and composed of discrete objects even though auditory and visual inputs are often ambiguous owing to spatial and temporal occluders and changes in the conditions of observation. This raises important questions regarding where and how 'scene analysis' is performed in the brain. Recent advances from both auditory and visual research suggest that the brain does not simply process the incoming scene properties. Rather, top-down processes such as attention, expectations and prior knowledge facilitate scene perception. Thus, scene analysis is linked not only with the extraction of stimulus features and formation and selection of perceptual objects, but also with selective attention, perceptual binding and awareness. This special issue covers novel advances in scene-analysis research obtained using a combination of psychophysics, computational modelling, neuroimaging and neurophysiology, and presents new empirical and theoretical approaches. For integrative understanding of scene analysis beyond and across sensory modalities, we provide a collection of 15 articles that enable comparison and integration of recent findings in auditory and visual scene analysis.This article is part of the themed issue 'Auditory and visual scene analysis'.

Resolving the neural dynamics of visual and auditory scene processing in the human brain: a methodological approach

In natural environments, visual and auditory stimulation elicit responses across a large set of brain regions in a fraction of a second, yielding representations of the multimodal scene and its properties. The rapid and complex neural dynamics underlying visual and auditory information processing pose major challenges to human cognitive neuroscience. Brain signals measured non-invasively are inherently noisy, the format of neural representations is unknown, and transformations between representations are complex and often nonlinear. Further, no single non-invasive brain measurement technique provides a spatio-temporally integrated view. In this opinion piece, we argue that progress can be made by a concerted effort based on three pillars of recent methodological development: (i) sensitive analysis techniques such as decoding and cross-classification, (ii) complex computational modelling using models such as deep neural networks, and (iii) integration across imaging methods (magnetoencephalography/electroencephalography, functional magnetic resonance imaging) and models, e.g. using representational similarity analysis. We showcase two recent efforts that have been undertaken in this spirit and provide novel results about visual and auditory scene analysis. Finally, we discuss the limits of this perspective and sketch a concrete roadmap for future research.

This article is part of the themed issue ‘Auditory and visual scene analysis’.