The influence of visuospatial attention on unattended auditory 40 Hz responses

Gamma-Band Auditory Steady-State Response and Attention: A Systemic Review

Auditory steady-state response (ASSR) is the result of the brain's ability to follow and entrain its oscillatory activity to the phase and frequency of periodic auditory stimulation. Gamma-band ASSR has been increasingly investigated with intentions to apply it in neuropsychiatric disorders diagnosis as well as in brain-computer interface technologies. However, it is still debatable whether attention can influence ASSR, as the results of the attention effects of ASSR are equivocal. In our study, we aimed to systemically review all known articles related to the attentional modulation of gamma-band ASSRs. The initial literature search resulted in 1283 papers. After the removal of duplicates and ineligible articles, 49 original studies were included in the final analysis. Most analyzed studies demonstrated ASSR modulation with differing attention levels; however, studies providing mixed or non-significant results were also identified. The high versatility of methodological approaches including the utilized stimulus type and ASSR recording modality, as well as tasks employed to modulate attention, were detected and emphasized as the main causality of result inconsistencies across studies. Also, the impact of training, inter-individual variability, and time of focus was addressed.

Enhancement of the neural response during 40 Hz auditory entrainment in closed-eye state in human prefrontal region

Gamma-band activity was thought to be related to several high-level cognitive functions, and Gamma ENtrainment Using Sensory stimulation (GENUS, 40 Hz sensory combined visual and auditory stimulation) was found to have positive effects on patients with Alzheimer's dementia. Other studies found, however, that neural responses induced by single 40 Hz auditory stimulation were relatively weak. To address this, we included several new experimental conditions (sounds with sinusoidal or square wave; open-eye and closed-eye state) combined with auditory stimulation with the aim of investigating which of these induces a stronger 40 Hz neural response. We found that when participant´s eyes were closed, sounds with 40 Hz sinusoidal wave induced the strongest 40 Hz neural response in the prefrontal region compared to responses in other conditions. More interestingly, we also found there is a suppression of alpha rhythms with 40 Hz square wave sounds. Our results provide potential new methods when using auditory entrainment, which may result in a better effect in preventing cerebral atrophy and improving cognitive performance.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11571-022-09834-x.

Dynamic peripheral nerve stimulation can produce cortical activation similar to punctate mechanical stimuli

During contact, phasic and tonic responses provide feedback that is used for task performance and perceptual processes. These disparate temporal dynamics are carried in peripheral nerves, and produce overlapping signals in cortex. Using longitudinal intrafascicular electrodes inserted into the median nerve of a nonhuman primate, we delivered composite stimulation consisting of onset and release bursts to capture rapidly adapting responses and sustained stochastic stimulation to capture the ongoing response of slowly adapting receptors. To measure the stimulation's effectiveness in producing natural responses, we monitored the local field potential in somatosensory cortex. We compared the cortical responses to peripheral nerve stimulation and vibrotactile/punctate stimulation of the fingertip, with particular focus on gamma band (30-65 Hz) responses. We found that vibrotactile stimulation produces consistently phase locked gamma throughout the duration of the stimulation. By contrast, punctate stimulation responses were phase locked at the onset and release of stimulation, but activity maintained through the stimulation was not phase locked. Using these responses as guideposts for assessing the response to the peripheral nerve stimulation, we found that constant frequency stimulation produced continual phase locking, whereas composite stimulation produced gamma enhancement throughout the stimulus, phase locked only at the onset and release of the stimulus. We describe this response as an "Appropriate Response in the gamma band" (ARγ), a trend seen in other sensory systems. Our demonstration is the first shown for intracortical somatosensory local field potentials. We argue that this stimulation paradigm produces a more biomimetic response in somatosensory cortex and is more likely to produce naturalistic sensations for readily usable neuroprosthetic feedback.

An Exploration of the Effects of Cross-Modal Tasks on Selective Attention

Successful performance of a task relies on selectively attending to the target, while ignoring distractions. Studies on perceptual load theory (PLT), conducted involving independent tasks with visual and auditory modalities, have shown that if a task is low-load, distractors and the target are both processed. If the task is high-load, distractions are not processed. The current study expands these findings by considering the effect of cross-modality (target and distractor from separate modalities) and congruency (similarity of target and distractor) on selective attention, using a word-identification task. Parameters were analysed, including response time, accuracy rates, congruency of distractions, and subjective report of load. In contrast to past studies on PLT, the results of the current study show that modality (congruency of the distractors) had a significant effect and load had no effect on selective attention. This study demonstrates that subjective measurement of load is important when studying perceptual load and selective attention.

Aberrant attentional modulation of the auditory steady state response (ASSR) is related to auditory hallucination severity in the first-episode schizophrenia-spectrum

The 40-Hz auditory steady state response (ASSR) is reduced early in schizophrenia, with differences evident even at the first episode of schizophrenia-spectrum psychosis (FESz). Although robust, there is high variability in effect size across studies, possibly due to differences in experimental control of attention and heterogeneity of symptom profiles across studies, both of which may affect the ASSR. We investigated the relationships among ASSR deficits, attention-mediated sensory gain, and auditory hallucinations in 25 FESz (15 male; 23.3 ± 4.5 years) and 32 matched healthy comparison subjects (HC, 22 male; 24.7 ± 5.8 years). ASSR was measured to 40-Hz click trains at three intensities (75, 80, and 85 dB) while participants attended or ignored stimuli. ASSR evoked power and inter-trial phase coherence (ITPC) were measured using the Morlet wavelet transform. FESz did not show overall ASSR power reduction (p > 0.1), but power was significantly increased with attention in HC (p < 0.01), but not in FESz (p > 0.1). Likewise, FESz did not evince overall ASSR ITPC reduction (p > 0.1), and ITPC was significantly increased with attention in HC (p < 0.01), but not in FESz (p > 0.09). Attention-related change in ASSR correlated with auditory hallucination severity for power (r = -0.49, p < 0.05) and ITPC (r = -0.58, p < 0.01). FESz with auditory hallucinations may have pathologically increased basal excitability of auditory cortex and consequent reduced ability to further increase auditory cortex sensory gain with focused attention. These findings indicate hallucination-related pathophysiology early in schizophrenia and may guide novel intervention strategies aimed to modulate basal activity levels.

The Influence of Auditory Attention on Rhythmic Speech Tracking: Implications for Studies of Unresponsive Patients

Language comprehension relies on integrating words into progressively more complex structures, like phrases and sentences. This hierarchical structure-building is reflected in rhythmic neural activity across multiple timescales in E/MEG in healthy, awake participants. However, recent studies have shown evidence for this “cortical tracking” of higher-level linguistic structures also in a proportion of unresponsive patients. What does this tell us about these patients’ residual levels of cognition and consciousness? Must the listener direct their attention toward higher level speech structures to exhibit cortical tracking, and would selective attention across levels of the hierarchy influence the expression of these rhythms? We investigated these questions in an EEG study of 72 healthy human volunteers listening to streams of monosyllabic isochronous English words that were either unrelated (scrambled condition) or composed of four-word-sequences building meaningful sentences (sentential condition). Importantly, there were no physical cues between four-word-sentences. Rather, boundaries were marked by syntactic structure and thematic role assignment. Participants were divided into three attention groups: from passive listening (passive group) to attending to individual words (word group) or sentences (sentence group). The passive and word groups were initially naïve to the sentential stimulus structure, while the sentence group was not. We found significant tracking at word- and sentence rate across all three groups, with sentence tracking linked to left middle temporal gyrus and right superior temporal gyrus. Goal-directed attention to words did not enhance word-rate-tracking, suggesting that word tracking here reflects largely automatic mechanisms, as was shown for tracking at the syllable-rate before. Importantly, goal-directed attention to sentences relative to words significantly increased sentence-rate-tracking over left inferior frontal gyrus. This attentional modulation of rhythmic EEG activity at the sentential rate highlights the role of attention in integrating individual words into complex linguistic structures. Nevertheless, given the presence of high-level cortical tracking under conditions of lower attentional effort, our findings underline the suitability of the paradigm in its clinical application in patients after brain injury. The neural dissociation between passive tracking of sentences and directed attention to sentences provides a potential means to further characterise the cognitive state of each unresponsive patient.

Visual load effects on the auditory steady-state responses to 20-, 40-, and 80-Hz amplitude-modulated tones

Ignoring background sounds while focusing on a visual task is a necessary ability in everyday life. If attentional resources are shared between modalities, processing of task-irrelevant auditory information should become attenuated when attentional capacity is expended by visual demands. According to the early-filter model, top-down attenuation of auditory responses is possible at various stages of the auditory pathway through multiple recurrent loops. Furthermore, the adaptive filtering model of selective attention suggests that filtering occurs early when concurrent visual tasks are demanding (e.g., high load) and late when tasks are easy (e.g., low load). To test these models, this study examined the effects of three levels of visual load on auditory steady-state responses (ASSRs) at three modulation frequencies. Subjects performed a visual task with no, low, and high visual load while ignoring task-irrelevant sounds. The auditory stimuli were 500-Hz tones amplitude-modulated at 20, 40, or 80 Hz to target different processing stages of the auditory pathway. Results from bayesian analyses suggest that ASSRs are unaffected by visual load. These findings imply that attentional resources are modality specific and that the attentional filter of auditory processing does not vary with visual task demands.

Visual load does not decrease the auditory steady-state response to 40-Hz amplitude-modulated tones

The auditory pathway consists of multiple recurrent loops of afferent and efferent connections that extend from the cochlea up to the prefrontal cortex. The early‐filter theory proposes that these loops allow top‐down filtering of early and middle latency auditory responses. Furthermore, the adaptive filtering model suggests that the filtering of irrelevant auditory stimuli should start lower in the pathway during more demanding tasks. If so, the 40‐Hz auditory steady‐state responses (ASSRs) to irrelevant sounds should be affected by top‐down crossmodal attention to a visual task, and effects should vary with the load of the visual task. Because few studies have examined this possibility, we conducted two preregistered studies that manipulated visual load (Study 1: N = 43, Study 2: N = 45). Study 1 used two levels (low and high), and Study 2 used four levels (no, low, high, and very high). Subjects were asked to ignore a 500‐Hz task‐irrelevant tone that was amplitude‐modulated to evoke 40‐Hz ASSRs. Results from Bayesian analyses provided moderate to extreme support for no effect of load (or of a task) on ASSRs. Results also supported no interaction with time (i.e., over blocks, over minutes, or with changes in ASSRs that were synchronized with the onset of the visual stimuli). Further, results provided moderate support for no correlation between the effects of load and working memory capacity. Because the present findings support the robustness of ASSRs against manipulations of crossmodal attention, they are not consistent with the adaptive filtering model.

The adaptive filtering model suggests that the filtering of irrelevant auditory stimuli should start lower in the auditory pathway during more demanding tasks. Two preregistered studies (N = 43, N = 45) examined the effects of visual perceptual load (from no to very high) on the 40‐Hz auditory steady‐state response (ASSR) to a task‐irrelevant tone. Bayesian analyses provided evidence for no effect of load. This robustness of ASSR against manipulations of crossmodal attention is not consistent with the adaptive filter model.

No intermodal interference effects of threatening information during concurrent audiovisual stimulation

Changes in attention can result in sensory processing trade-off effects, in which sensory cortical responses to attended stimuli are heightened and responses to competing distractors are attenuated. However, it is unclear if competition or facilitation effects will be observed at the level of sensory cortex when attending to competing stimuli in two modalities. The present study used electroencephalogram (EEG) and frequency-tagging to quantitatively assess auditory-visual interactions during sustained multimodal sensory stimulation. The emotional content of a 6.66 Hz rapid serial visual presentation (RSVP) was manipulated to elicit well-established emotional attention effects, while a constant 63 dB tone with a 40.8 Hz modulation served as a concurrent auditory stimulus in two experiments. As a directed attention manipulation, participants were instructed to detect transient sound level events in the auditory stream in Experiment 1. To manipulate attention through threat anticipation, participants were instructed to expect an aversive noise burst after a higher 40.8 Hz modulated tone in Experiment 2. Each stimulus evoked reliable steady-state sensory cortical responses in all participants (n = 30) in both experiments. The visual cortical responses were modulated by the auditory detection task, but not by threat anticipation: Visual responses were smaller during auditory streams with a transient target as compared to uninterrupted auditory streams. Conversely, visual stimulus condition had no significant effects on auditory sensory cortical responses in either experiment. These results indicate that there is neither a competition nor facilitation effect of visual content on concurrent auditory sensory cortical processing. They further indicate that competition effects of auditory stream content on sustained visuocortical responses are limited to auditory target processing.

Effect of Task and Attention on Neural Tracking of Speech

EEG-based measures of neural tracking of natural running speech are becoming increasingly popular to investigate neural processing of speech and have applications in audiology. When the stimulus is a single speaker, it is usually assumed that the listener actively attends to and understands the stimulus. However, as the level of attention of the listener is inherently variable, we investigated how this affected neural envelope tracking. Using a movie as a distractor, we varied the level of attention while we estimated neural envelope tracking. We varied the intelligibility level by adding stationary noise. We found a significant difference in neural envelope tracking between the condition with maximal attention and the movie condition. This difference was most pronounced in the right-frontal region of the brain. The degree of neural envelope tracking was highly correlated with the stimulus signal-to-noise ratio, even in the movie condition. This could be due to residual neural resources to passively attend to the stimulus. When envelope tracking is used to measure speech understanding objectively, this means that the procedure can be made more enjoyable and feasible by letting participants watch a movie during stimulus presentation.

40Hz auditory steady-state response in schizophrenia: Sensitivity to stimulation type (clicks versus flutter amplitude-modulated tones)

Auditory steady-state response (ASSR) at 40Hz has been proposed as a potential biomarker for schizophrenia. The ASSR studies in patients have used click stimulation or amplitude-modulated tones. However, the sensitivity of 40Hz ASSRs to different stimulation types in the same group of patients has not been previously evaluated. Two stimulation types for ASSRs were tested in this study: (1) 40Hz clicks and (2) flutter-amplitude modulated tones. The mean phase-locking index, evoked amplitude and event-related spectral perturbation values were compared between schizophrenia patients (n=26) and healthy controls (n=20). Both stimulation types resulted in the observation of impaired phase-locking and power measures of late (200-500ms) 40Hz ASSR in patients compared to healthy controls. The early-latency (0-100ms) 40Hz ASSR part was diminished in the schizophrenia group in response to clicks only. The late-latency 40Hz ASSR parameters obtained through different stimulation types correlated in healthy subjects but not in patients. We conclude that flutter amplitude-modulated tone stimulation, due to its potential to reveal late-latency entrainment deficits, is suitable for use in clinical populations. Careful consideration of experimental stimulation settings can contribute to the interpretation of ASSR deficits and utilization as a potential biomarker.

Estimation of Human Workload from the Auditory Steady-State Response Recorded via a Wearable Electroencephalography System during Walking

Workload in the human brain can be a useful marker of internal brain state. However, due to technical limitations, previous workload studies have been unable to record brain activity via conventional electroencephalography (EEG) and magnetoencephalography (MEG) devices in mobile participants. In this study, we used a wearable EEG system to estimate workload while participants walked in a naturalistic environment. Specifically, we used the auditory steady-state response (ASSR) which is an oscillatory brain activity evoked by repetitive auditory stimuli, as an estimation index of workload. Participants performed three types of N-back tasks, which were expected to command different workloads, while walking at a constant speed. We used a binaural 500 Hz pure tone with amplitude modulation at 40 Hz to evoke the ASSR. We found that the phase-locking index (PLI) of ASSR activity was significantly correlated with the degree of task difficulty, even for EEG data from few electrodes. Thus, ASSR appears to be an effective indicator of workload during walking in an ecologically valid environment.

Cortical Sensitivity to Guitar Note Patterns: EEG Entrainment to Repetition and Key

Music is ubiquitous throughout recent human culture, and many individual's have an innate ability to appreciate and understand music. Our appreciation of music likely emerges from the brain's ability to process a series of repeated complex acoustic patterns. In order to understand these processes further, cortical responses were measured to a series of guitar notes presented with a musical pattern or without a pattern. ERP responses to individual notes were measured using a 24 electrode Bluetooth mobile EEG system (Smarting mBrainTrain) while 13 healthy non-musicians listened to structured (i.e., within musical keys and with repetition) or random sequences of guitar notes for 10 min each. We demonstrate an increased amplitude to the ERP that appears ~200 ms to notes presented within the musical sequence. This amplitude difference between random notes and patterned notes likely reflects individual's cortical sensitivity to guitar note patterns. These amplitudes were compared to ERP responses to a rare note embedded within a stream of frequent notes to determine whether the sensitivity to complex musical structure overlaps with the sensitivity to simple irregularities reflected in traditional auditory oddball experiments. Response amplitudes to the negative peak at ~175 ms are statistically correlated with the mismatch negativity (MMN) response measured to a rare note presented among a series of frequent notes (i.e., in a traditional oddball sequence), but responses to the subsequent positive peak at ~200 do not show a statistical relationship with the P300 response. Thus, the sensitivity to musical structure identified to 4 Hz note patterns appears somewhat distinct from the sensitivity to statistical regularities reflected in the traditional "auditory oddball" sequence. Overall, we suggest that this is a promising approach to examine individual's sensitivity to complex acoustic patterns, which may overlap with higher level cognitive processes, including language.

40Hz auditory steady-state responses in patients with disorders of consciousness: Correlation between phase-locking index and Coma Recovery Scale-Revised score

OBJECTIVE

We aimed to elucidate whether 40Hz auditory steady-state response (ASSR) could be sensitive to the state of patients with disorders of consciousness (DOC) as estimated with Coma Recovery Scale-Revised (CRS-R) diagnostic tool.

METHODS

Fifteen DOC patients and 24 healthy controls took part in the study. The 40Hz click trains were used to evoke ASSRs. Mean evoked amplitude (EA) and phase-locking index (PLI) within 38-42Hz window were calculated for 100ms bins, starting from -200 to 700ms relative to stimulus onset.

RESULTS

The PLI values from the patient group in the period of 200-500ms after the stimulus onset positively correlated with the CRS-R total score and with the scores of the Auditory and Visual subscales.

CONCLUSIONS

The phase-locking index of 40Hz auditory steady-state responses can be an indicator of the level of dysfunction of the central nervous system in DOC.

SIGNIFICANCE

Our results emphasize the role of central auditory system integrity in determining the level of functioning of DOC patients and suggest the possibility to use the ASSR protocol as an objective diagnostic method in DOC patients.

Estimation of the reaction times in tasks of varying difficulty from the phase coherence of the auditory steady-state response using the least absolute shrinkage and selection operator analysis

Quantitative estimation of the workload in the brain is an important factor for helping to predict the behavior of humans. The reaction time when performing a difficult task is longer than that when performing an easy task. Thus, the reaction time reflects the workload in the brain. In this study, we employed an N-back task in order to regulate the degree of difficulty of the tasks, and then estimated the reaction times from the brain activity. The brain activity that we used to estimate the reaction time was the auditory steady-state response (ASSR) evoked by a 40-Hz click sound. Fifteen healthy participants participated in the present study and magnetoencephalogram (MEG) responses were recorded using a 148-channel magnetometer system. The least absolute shrinkage and selection operator (LASSO), which is a type of sparse modeling, was employed to estimate the reaction times from the ASSR recorded by MEG. The LASSO showed higher estimation accuracy than the least squares method. This result indicates that LASSO overcame the over-fitting to the learning data. Furthermore, the LASSO selected channels in not only the parietal region, but also in the frontal and occipital regions. Since the ASSR is evoked by auditory stimuli, it is usually large in the parietal region. However, since LASSO also selected channels in regions outside the parietal region, this suggests that workload-related neural activity occurs in many brain regions. In the real world, it is more practical to use a wearable electroencephalography device with a limited number of channels than to use MEG. Therefore, determining which brain areas should be measured is essential. The channels selected by the sparse modeling method are informative for determining which brain areas to measure.

Phase coherence of auditory steady-state response reflects the amount of cognitive workload in a modified N-back task

The auditory steady-state response (ASSR) is an oscillatory brain activity evoked by repetitive auditory stimuli. Previous studies have reported that the power and phase locking index (PLI) of ASSR could be modulated by the degree of workload. However, those studies used different physical stimuli for tasks of differing difficulty, and the effect of the internal workload itself has not been clearly understood. In this study, we employed the modified N-back task as a visual working memory task in order to vary the degree of difficulty while keeping the physical stimulus constant. The experiment consisted of four types of tasks: No-Load (NL), 1-back, 2-back, and 3-back tasks. The auditory stimulus was a 40 Hz click sound to induce ASSR. Sixteen healthy subjects participated in the present study and magnetoencephalogram responses were recorded using a 148-channel magnetometer system. The hit rate decreased and the reaction time increased according to the task difficulty. Grand averaged phase coherence activities showed the 40 Hz ASSR reductions accompanying an increase in the task difficulty even with the identical external stimuli. In particular, the phase coherence activities in 3-back task were significantly lower than that in the NL and 1-back tasks. Our results suggest that the ASSR can be a useful indicator for the amount of workload in the brain.

Cortical Response Similarities Predict which Audiovisual Clips Individuals Viewed, but Are Unrelated to Clip Preference

Cortical responses to complex natural stimuli can be isolated by examining the relationship between neural measures obtained while multiple individuals view the same stimuli. These inter-subject correlation’s (ISC’s) emerge from similarities in individual’s cortical response to the shared audiovisual inputs, which may be related to their emergent cognitive and perceptual experience. Within the present study, our goal is to examine the utility of using ISC’s for predicting which audiovisual clips individuals viewed, and to examine the relationship between neural responses to natural stimuli and subjective reports. The ability to predict which clips individuals viewed depends on the relationship of the EEG response across subjects and the nature in which this information is aggregated. We conceived of three approaches for aggregating responses, i.e. three assignment algorithms, which we evaluated in Experiment 1A. The aggregate correlations algorithm generated the highest assignment accuracy (70.83% chance = 33.33%) and was selected as the assignment algorithm for the larger sample of individuals and clips within Experiment 1B. The overall assignment accuracy was 33.46% within Experiment 1B (chance = 06.25%), with accuracies ranging from 52.9% (Silver Linings Playbook) to 11.75% (Seinfeld) within individual clips. ISC’s were significantly greater than zero for 15 out of 16 clips, and fluctuations within the delta frequency band (i.e. 0-4 Hz) primarily contributed to response similarities across subjects. Interestingly, there was insufficient evidence to indicate that individuals with greater similarities in clip preference demonstrate greater similarities in cortical responses, suggesting a lack of association between ISC and clip preference. Overall these results demonstrate the utility of using ISC’s for prediction, and further characterize the relationship between ISC magnitudes and subjective reports.