Sound level dependence of auditory evoked potentials: Simultaneous EEG recording and low-noise fMRI

Individualized Closed-Loop Acoustic Stimulation Suggests an Alpha Phase Dependence of Sound Evoked and Induced Brain Activity Measured with EEG Recordings

Following repetitive visual stimulation, post hoc phase analysis finds that visually evoked response magnitudes vary with the cortical alpha oscillation phase that temporally coincides with sensory stimulus. This approach has not successfully revealed an alpha phase dependence for auditory evoked or induced responses. Here, we test the feasibility of tracking alpha with scalp electroencephalogram (EEG) recordings and play sounds phase-locked to individualized alpha phases in real-time using a novel end-point corrected Hilbert transform (ecHT) algorithm implemented on a research device. Based on prior work, we hypothesize that sound-evoked and induced responses vary with the alpha phase at sound onset and the alpha phase that coincides with the early sound-evoked response potential (ERP) measured with EEG. Thus, we use each subject's individualized alpha frequency (IAF) and individual auditory ERP latency to define target trough and peak alpha phases that allow an early component of the auditory ERP to align to the estimated poststimulus peak and trough phases, respectively. With this closed-loop and individualized approach, we find opposing alpha phase-dependent effects on the auditory ERP and alpha oscillations that follow stimulus onset. Trough and peak phase-locked sounds result in distinct evoked and induced post-stimulus alpha level and frequency modulations. Though additional studies are needed to localize the sources underlying these phase-dependent effects, these results suggest a general principle for alpha phase-dependence of sensory processing that includes the auditory system. Moreover, this study demonstrates the feasibility of using individualized neurophysiological indices to deliver automated, closed-loop, phase-locked auditory stimulation.

Neurovascular coupling during auditory stimulation: event-related potentials and fNIRS hemodynamic

Intensity-dependent amplitude changes (IDAP) have been extensively studied using event-related potentials (ERPs) and have been linked to several psychiatric disorders. This study aims to explore the application of functional near-infrared spectroscopy (fNIRS) in IDAP paradigms, which related to ERPs could indicate the existence of neurovascular coupling. Thirty-three and thirty-one subjects participated in two experiments, respectively. The first experiment consisted of the presentation of three-tone intensities (77.9 dB, 84.5 dB, and 89.5 dB) lasting 500 ms, each type randomly presented 54 times, while the second experiment consisted of the presentation of five-tone intensities (70.9 dB, 77.9 dB, 84.5 dB, 89.5 dB, and 94.5 dB) in trains of 8 tones lasting 70 ms each tone, the trains were presented 20 times. EEG was used to measure ERP components: N1, P2, and N1-P2 peak-to-peak amplitude. fNIRS allowed the analysis of the hemodynamic activity in the auditory, visual, and prefrontal cortices. The results showed an increase in N1, P2, and N1-P2 peak-to-peak amplitude with auditory intensity. Similarly, oxyhemoglobin and deoxyhemoglobin concentrations showed amplitude increases and decreases, respectively, with auditory intensity in the auditory and prefrontal cortices. Spearman correlation analysis showed a relationship between the left auditory cortex with N1 amplitude, and the right dorsolateral cortex with P2 amplitude, specifically for deoxyhemoglobin concentrations. These findings suggest that there is a brain response to auditory intensity changes that can be obtained by EEG and fNIRS, supporting the neurovascular coupling process. Overall, this study enhances our understanding of fNIRS application in auditory paradigms and highlights its potential as a complementary technique to ERPs.

Cycling multisensory changes in migraine: more than a headache

PURPOSE OF REVIEW

Research on migraine usually focuses on the headache; however, accumulating evidence suggests that migraine not only changes the somatosensory system for nociception (pain), but also the other modalities of perception, such as visual, auditory or tactile sense. More importantly, the multisensory changes exist beyond the headache (ictal) phase of migraine and show cyclic changes, suggesting a central generator driving the multiple sensory changes across different migraine phases. This review summarizes the latest studies that explored the cyclic sensory changes of migraine.

RECENT FINDINGS

Considerable evidence from recent neurophysiological and functional imaging studies suggests that alterations in brain activation start at least 48 h before the migraine headache and outlast the pain itself for 24 h. Several sensory modalities are involved with cyclic changes in sensitivity that peak during the ictal phase.

SUMMARY

In many ways, migraine represents more than just vascular-mediated headaches. Migraine alters the propagation of sensory information long before the headache attack starts.

Auditory Information Accelerates the Visuomotor Reaction Speed of Elite Badminton Players in Multisensory Environments

Although vision is the dominating sensory system in sports, many situations require multisensory integration. Faster processing of auditory information in the brain may facilitate time-critical abilities such as reaction speed however previous research was limited by generic auditory and visual stimuli that did not consider audio-visual characteristics in ecologically valid environments. This study investigated the reaction speed in response to sport-specific monosensory (visual and auditory) and multisensory (audio-visual) stimulation. Neurophysiological analyses identified the neural processes contributing to differences in reaction speed. Nineteen elite badminton players participated in this study. In a first recording phase, the sound profile and shuttle speed of smash and drop strokes were identified on a badminton court using high-speed video cameras and binaural recordings. The speed and sound characteristics were transferred into auditory and visual stimuli and presented in a lab-based experiment, where participants reacted in response to sport-specific monosensory or multisensory stimulation. Auditory signal presentation was delayed by 26 ms to account for realistic audio-visual signal interaction on the court. N1 and N2 event-related potentials as indicators of auditory and visual information perception/processing, respectively were identified using a 64-channel EEG. Despite the 26 ms delay, auditory reactions were significantly faster than visual reactions (236.6 ms vs. 287.7 ms, p < 0.001) but still slower when compared to multisensory stimulation (224.4 ms, p = 0.002). Across conditions response times to smashes were faster when compared to drops (233.2 ms, 265.9 ms, p < 0.001). Faster reactions were paralleled by a lower latency and higher amplitude of the auditory N1 and visual N2 potentials. The results emphasize the potential of auditory information to accelerate the reaction time in sport-specific multisensory situations. This highlights auditory processes as a promising target for training interventions in racquet sports.

Functional neuroimaging in hearing research and audiology

The various methods of medical imaging are essential for many diagnostic issues in clinical routine, e.g., for the diagnostics and localisation of tumorous diseases, or for the clarification of other lesions in the central nervous system. In addition to these classical roles both positron emission tomography (PET) and magnetic resonance imaging (MRI) allow for the investigation of functional processes in the human brain, when used in a specific way. The last 25 years have seen great progress, especially with respect to functional MRI, in terms of the available experimental paradigms as well as the data analysis strategies, so that a directed investigation of neurophysiological correlates of psychoacoustic performance is possible. This covers fundamental measures of sound perception like loudness and pitch, specific audiological symptoms like tinnitus, which often accompanies hearing disorders, but it also includes experiments on speech perception or on virtual acoustic environments. One important aspect common to many auditory neuroimaging studies is the central question at what stage in the human auditory pathway the sensory coding of the incoming sound is transformed into a universal and context-dependent perceptual representation, which is the basis for what we hear. This overview summarises findings from the literature as well as a few studies from our lab, to discuss the possibilities and the limits of the adoption of functional neuroimaging methods in audiology. Up to this stage, most auditory neuroimaging studies have investigated basic processes in normal hearing listeners. However, the hitherto existing results suggest that the methods of auditory functional neuroimaging - possibly complemented by electrophysiological methods like EEG and MEG - have a great potential to contribute to a deeper understanding of the processes and the impact of hearing disorders.

Changes in Speech-Related Brain Activity During Adaptation to Electro-Acoustic Hearing

Objectives: Hearing improves significantly with bimodal provision, i.e., a cochlear implant (CI) at one ear and a hearing aid (HA) at the other, but performance shows a high degree of variability resulting in substantial uncertainty about the performance that can be expected by the individual CI user. The objective of this study was to explore how auditory event-related potentials (AERPs) of bimodal listeners in response to spoken words approximate the electrophysiological response of normal hearing (NH) listeners. Study Design: Explorative prospective analysis during the first 6 months of bimodal listening using a within-subject repeated measures design. Setting: Academic tertiary care center. Participants: Twenty-seven adult participants with bilateral sensorineural hearing loss who received a HiRes 90K CI and continued use of a HA at the non-implanted ear. Age-matched NH listeners served as controls. Intervention: Cochlear implantation. Main Outcome Measures: Obligatory auditory evoked potentials N1 and P2, and the event-related N2 potential in response to monosyllabic words and their reversed sound traces before, as well as 3 and 6 months post-implantation. The task required word/non-word classification. Stimuli were presented within speech-modulated noise. Loudness of word/non-word signals was adjusted individually to achieve the same intelligibility across groups and assessments. Results: Intelligibility improved significantly with bimodal hearing, and the N1-P2 response approximated the morphology seen in NH with enhanced and earlier responses to the words compared to their reversals. For bimodal listeners, a prominent negative deflection was present between 370 and 570 ms post stimulus onset (N2), irrespective of stimulus type. This was absent for NH controls; hence, this response did not approximate the NH response during the study interval. N2 source localization evidenced extended activation of general cognitive areas in frontal and prefrontal brain areas in the CI group. Conclusions: Prolonged and spatially extended processing in bimodal CI users suggests employment of additional auditory-cognitive mechanisms during speech processing. This does not reduce within 6 months of bimodal experience and may be a correlate of the enhanced listening effort described by CI listeners.

Heightened early-attentional stimulus orienting and impulsive action in men with antisocial personality disorder

We tested whether enhanced stimulus orienting operationalized as N1 and P2 auditory evoked potentials to increasing loudness (50-90 dB clicks) could be associated with trait impulsivity (Barratt Impulsiveness Scale, BIS-11), impulsive action (commission error on the Immediate Memory Task), or impulsive choice (immediate responses on temporal discounting tasks). We measured N1 and P2 loudness sensitivity in a passive listening task as linear intensity-sensitivity slopes in 36 men with antisocial personality disorder with a history of conviction for criminal conduct and 16 healthy control men. Across all subjects, regression analyses revealed that a steeper P2 slope predicted higher IMT commission error/correct detection ratio, and lower stimulus discriminability (A-prime). These associations were also found within both groups. These relationships suggest an association between enhanced early stimulus orienting (P2), impulsive action (response inhibition), and impaired signal-noise discriminability (A-prime).

Electrophysiological Correlates of Emotional Content and Volume Level in Spoken Word Processing

For visual stimuli of emotional content as pictures and written words, stimulus size has been shown to increase emotion effects in the early posterior negativity (EPN), a component of event-related potentials (ERPs) indexing attention allocation during visual sensory encoding. In the present study, we addressed the question whether this enhanced relevance of larger (visual) stimuli might generalize to the auditory domain and whether auditory emotion effects are modulated by volume. Therefore, subjects were listening to spoken words with emotional or neutral content, played at two different volume levels, while ERPs were recorded. Negative emotional content led to an increased frontal positivity and parieto-occipital negativity-a scalp distribution similar to the EPN-between ~370 and 530 ms. Importantly, this emotion-related ERP component was not modulated by differences in volume level, which impacted early auditory processing, as reflected in increased amplitudes of the N1 (80-130 ms) and P2 (130-265 ms) components as hypothesized. However, contrary to effects of stimulus size in the visual domain, volume level did not influence later ERP components. These findings indicate modality-specific and functionally independent processing triggered by emotional content of spoken words and volume level.

Neuromagnetic brain activities associated with perceptual categorization and sound-content incongruency: a comparison between monosyllabic words and pitch names

In human cultures, the perceptual categorization of musical pitches relies on pitch-naming systems. A sung pitch name concurrently holds the information of fundamental frequency and pitch name. These two aspects may be either congruent or incongruent with regard to pitch categorization. The present study aimed to compare the neuromagnetic responses to musical and verbal stimuli for congruency judgments, for example a congruent pair for the pitch C4 sung with the pitch name do in a C-major context (the pitch-semantic task) or for the meaning of a word to match the speaker’s identity (the voice-semantic task). Both the behavioral data and neuromagnetic data showed that congruency detection of the speaker’s identity and word meaning was slower than that of the pitch and pitch name. Congruency effects of musical stimuli revealed that pitch categorization and semantic processing of pitch information were associated with P2m and N400m, respectively. For verbal stimuli, P2m and N400m did not show any congruency effect. In both the pitch-semantic task and the voice-semantic task, we found that incongruent stimuli evoked stronger slow waves with the latency of 500–600 ms than congruent stimuli. These findings shed new light on the neural mechanisms underlying pitch-naming processes.

Time-frequency analysis of resting state and evoked EEG data recorded at higher magnetic fields up to 9.4 T

BACKGROUND

Combining both high temporal and spatial resolution by means of simultaneous electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) is of relevance to neuroscientists. This combination, however, leads to a distortion of the EEG signal by the so-called cardio-ballistic artefacts. The aim of the present study was developing an approach to restore meaningful physiological EEG data from recordings at different magnetic fields.

NEW METHODS

The distortions introduced by the magnetic field were corrected using a combination of concepts from independent component analysis (ICA) and mutual information (MI). Thus, the components were classified as either related to the cardio-ballistic artefacts or to the signals of interest. EEG data from two experimental paradigms recorded at different magnetic field strengths up to 9.4 T were analyzed: (i) spontaneous activity using an eyes-open/eyes-closed alternation, and (ii) responses to auditory stimuli, i.e. auditory evoked potentials.

RESULTS

Even at ultra-high magnetic fields up to 9.4 T the proposed artefact rejection approach restored the physiological time-frequency information contained in the signal of interest and the data were suitable for subsequent analyses.

COMPARISON WITH EXISTING METHODS

Blind source separation (BSS) has been used to retrieve information from EEG data recorded inside the MR scanner in previous studies. After applying the presented method on EEG data recorded at 4 T, 7 T, and 9.4 T, we could retrieve more information than from data cleaned with the BSS method.

CONCLUSIONS

The present work demonstrates that EEG data recorded at ultra-high magnetic fields can be used for studying neuroscientific research question related to oscillatory activity.

Spatial and temporal relationships of electrocorticographic alpha and gamma activity during auditory processing

Neuroimaging approaches have implicated multiple brain sites in musical perception, including the posterior part of the superior temporal gyrus and adjacent perisylvian areas. However, the detailed spatial and temporal relationship of neural signals that support auditory processing is largely unknown. In this study, we applied a novel inter-subject analysis approach to electrophysiological signals recorded from the surface of the brain (electrocorticography (ECoG)) in ten human subjects. This approach allowed us to reliably identify those ECoG features that were related to the processing of a complex auditory stimulus (i.e., continuous piece of music) and to investigate their spatial, temporal, and causal relationships. Our results identified stimulus-related modulations in the alpha (8-12 Hz) and high gamma (70-110 Hz) bands at neuroanatomical locations implicated in auditory processing. Specifically, we identified stimulus-related ECoG modulations in the alpha band in areas adjacent to primary auditory cortex, which are known to receive afferent auditory projections from the thalamus (80 of a total of 15,107 tested sites). In contrast, we identified stimulus-related ECoG modulations in the high gamma band not only in areas close to primary auditory cortex but also in other perisylvian areas known to be involved in higher-order auditory processing, and in superior premotor cortex (412/15,107 sites). Across all implicated areas, modulations in the high gamma band preceded those in the alpha band by 280 ms, and activity in the high gamma band causally predicted alpha activity, but not vice versa (Granger causality, p<1e(-8)). Additionally, detailed analyses using Granger causality identified causal relationships of high gamma activity between distinct locations in early auditory pathways within superior temporal gyrus (STG) and posterior STG, between posterior STG and inferior frontal cortex, and between STG and premotor cortex. Evidence suggests that these relationships reflect direct cortico-cortical connections rather than common driving input from subcortical structures such as the thalamus. In summary, our inter-subject analyses defined the spatial and temporal relationships between music-related brain activity in the alpha and high gamma bands. They provide experimental evidence supporting current theories about the putative mechanisms of alpha and gamma activity, i.e., reflections of thalamo-cortical interactions and local cortical neural activity, respectively, and the results are also in agreement with existing functional models of auditory processing.

Modulatory effects of spectral energy contrasts on lateral inhibition in the human auditory cortex: an MEG study

We investigated the modulation of lateral inhibition in the human auditory cortex by means of magnetoencephalography (MEG). In the first experiment, five acoustic masking stimuli (MS), consisting of noise passing through a digital notch filter which was centered at 1 kHz, were presented. The spectral energy contrasts of four MS were modified systematically by either amplifying or attenuating the edge-frequency bands around the notch (EFB) by 30 dB. Additionally, the width of EFB amplification/attenuation was varied (3/8 or 7/8 octave on each side of the notch). N1m and auditory steady state responses (ASSR), evoked by a test stimulus with a carrier frequency of 1 kHz, were evaluated. A consistent dependence of N1m responses upon the preceding MS was observed. The minimal N1m source strength was found in the narrowest amplified EFB condition, representing pronounced lateral inhibition of neurons with characteristic frequencies corresponding to the center frequency of the notch (NOTCH CF) in secondary auditory cortical areas. We tested in a second experiment whether an even narrower bandwidth of EFB amplification would result in further enhanced lateral inhibition of the NOTCH CF. Here three MS were presented, two of which were modified by amplifying 1/8 or 1/24 octave EFB width around the notch. We found that N1m responses were again significantly smaller in both amplified EFB conditions as compared to the NFN condition. To our knowledge, this is the first study demonstrating that the energy and width of the EFB around the notch modulate lateral inhibition in human secondary auditory cortical areas. Because it is assumed that chronic tinnitus is caused by a lack of lateral inhibition, these new insights could be used as a tool for further improvement of tinnitus treatments focusing on the lateral inhibition of neurons corresponding to the tinnitus frequency, such as the tailor-made notched music training.

Human auditory neuroimaging of intensity and loudness

The physical intensity of a sound, usually expressed in dB on a logarithmic ratio scale, can easily be measured using technical equipment. Loudness is the perceptual correlate of sound intensity, and is usually determined by means of some sort of psychophysical scaling procedure. The interrelation of sound intensity and perceived loudness is still a matter of debate, and the physiological correlate of loudness perception in the human auditory pathway is not completely understood. Various studies indicate that the activation in human auditory cortex is more a representation of loudness sensation rather than of physical sound pressure level. This raises the questions (1), at what stage or stages in the ascending auditory pathway is the transformation of the physical stimulus into its perceptual correlate completed, and (2), to what extent other factors affecting individual loudness judgements might modulate the brain activation as registered by auditory neuroimaging. An overview is given about recent studies on the effects of sound intensity, duration, bandwidth and individual hearing status on the activation in the human auditory system, as measured by various approaches in auditory neuroimaging. This article is part of a Special Issue entitled Human Auditory Neuroimaging.

Pre-attentive modulation of brain responses to tones in coloured-hearing synesthetes

BACKGROUND

Coloured-hearing (CH) synesthesia is a perceptual phenomenon in which an acoustic stimulus (the inducer) initiates a concurrent colour perception (the concurrent). Individuals with CH synesthesia "see" colours when hearing tones, words, or music; this specific phenomenon suggesting a close relationship between auditory and visual representations. To date, it is still unknown whether the perception of colours is associated with a modulation of brain functions in the inducing brain area, namely in the auditory-related cortex and associated brain areas. In addition, there is an on-going debate as to whether attention to the inducer is necessarily required for eliciting a visual concurrent, or whether the latter can emerge in a pre-attentive fashion.

RESULTS

By using the EEG technique in the context of a pre-attentive mismatch negativity (MMN) paradigm, we show that the binding of tones and colours in CH synesthetes is associated with increased MMN amplitudes in response to deviant tones supposed to induce novel concurrent colour perceptions. Most notably, the increased MMN amplitudes we revealed in the CH synesthetes were associated with stronger intracerebral current densities originating from the auditory cortex, parietal cortex, and ventral visual areas.

CONCLUSIONS

The automatic binding of tones and colours in CH synesthetes is accompanied by an early pre-attentive process recruiting the auditory cortex, inferior and superior parietal lobules, as well as ventral occipital areas.

The N1 effect of temporal attention is independent of sound location and intensity: implications for possible mechanisms of temporal attention

It has been repeatedly shown that the auditory N1 is enhanced for sounds presented at an attended time point. The present study investigated the underlying mechanisms using a temporal cuing paradigm. In each trial, an auditory cue indicated at which time point a second sound could be relevant for response selection. Crucially, in addition to temporal attention, two physical sound features with known effects on the sensory N1 were manipulated: location and intensity. Positive evidence for conjoint effects of attention and location or attention and intensity would corroborate the notion that the sensory N1 was modulated by temporal attention, thus supporting a gain mechanism. However, the N1 effect of temporal attention was not similarly lateralized as the sensory N1, and, moreover, it was independent of sound intensity. Thus, the present results do not provide compelling evidence that temporal attention involves an increase in sensory gain.

Dissociation of detection and discrimination of pure tones following bilateral lesions of auditory cortex

It is well known that damage to the peripheral auditory system causes deficits in tone detection as well as pitch and loudness perception across a wide range of frequencies. However, the extent to which to which the auditory cortex plays a critical role in these basic aspects of spectral processing, especially with regard to speech, music, and environmental sound perception, remains unclear. Recent experiments indicate that primary auditory cortex is necessary for the normally-high perceptual acuity exhibited by humans in pure-tone frequency discrimination. The present study assessed whether the auditory cortex plays a similar role in the intensity domain and contrasted its contribution to sensory versus discriminative aspects of intensity processing. We measured intensity thresholds for pure-tone detection and pure-tone loudness discrimination in a population of healthy adults and a middle-aged man with complete or near-complete lesions of the auditory cortex bilaterally. Detection thresholds in his left and right ears were 16 and 7 dB HL, respectively, within clinically-defined normal limits. In contrast, the intensity threshold for monaural loudness discrimination at 1 kHz was 6.5±2.1 dB in the left ear and 6.5±1.9 dB in the right ear at 40 dB sensation level, well above the means of the control population (left ear: 1.6±0.22 dB; right ear: 1.7±0.19 dB). The results indicate that auditory cortex lowers just-noticeable differences for loudness discrimination by approximately 5 dB but is not necessary for tone detection in quiet. Previous human and Old-world monkey experiments employing lesion-effect, neurophysiology, and neuroimaging methods to investigate the role of auditory cortex in intensity processing are reviewed.

Dynamics of electrocorticographic (ECoG) activity in human temporal and frontal cortical areas during music listening

Previous studies demonstrated that brain signals encode information about specific features of simple auditory stimuli or of general aspects of natural auditory stimuli. How brain signals represent the time course of specific features in natural auditory stimuli is not well understood. In this study, we show in eight human subjects that signals recorded from the surface of the brain (electrocorticography (ECoG)) encode information about the sound intensity of music. ECoG activity in the high gamma band recorded from the posterior part of the superior temporal gyrus as well as from an isolated area in the precentral gyrus was observed to be highly correlated with the sound intensity of music. These results not only confirm the role of auditory cortices in auditory processing but also point to an important role of premotor and motor cortices. They also encourage the use of ECoG activity to study more complex acoustic features of simple or natural auditory stimuli.

Simultaneous recording of EEG and BOLD responses: A historical perspective

Electromagnetic fields as measured with electroencephalogram (EEG) are a direct consequence of neuronal activity and feature the same timescale as the underlying cognitive processes, while hemodynamic signals as measured with functional magnetic resonance imaging (fMRI) are related to the energy consumption of neuronal populations. It is obvious that a combination of both techniques is a very attractive aim in neuroscience, in order to achieve both high temporal and spatial resolution for the non-invasive study of cognitive brain function. During the last decade a number of research groups have taken up this challenge. Here, we review the development of the combined EEG-fMRI approach. We summarize the main data integration approaches developed to achieve such a combination, discuss the current state-of-the-art in this field and outline challenges for the future success of this promising approach.