Selective attention and brainstem frequency-following responses

Envelope following responses for hearing diagnosis: Robustness and methodological considerations

Recent studies have found that envelope following responses (EFRs) are a marker of age-related and noise- or ototoxic-induced cochlear synaptopathy (CS) in research animals. Whereas the cochlear injury can be well controlled in animal research studies, humans may have an unknown mixture of sensorineural hearing loss [SNHL; e.g., inner- or outer-hair-cell (OHC) damage or CS] that cannot be teased apart in a standard hearing evaluation. Hence, a direct translation of EFR markers of CS to a differential CS diagnosis in humans might be compromised by the influence of SNHL subtypes and differences in recording modalities between research animals and humans. To quantify the robustness of EFR markers for use in human studies, this study investigates the impact of methodological considerations related to electrode montage, stimulus characteristics, and presentation, as well as analysis method on human-recorded EFR markers. The main focus is on rectangularly modulated pure-tone stimuli to evoke the EFR based on a recent auditory modelling study that showed that the EFR was least affected by OHC damage and most sensitive to CS in this stimulus configuration. The outcomes of this study can help guide future clinical implementations of electroencephalography-based SNHL diagnostic tests.

Brainstem speech encoding is dynamically shaped online by fluctuations in cortical α state

Experimental evidence in animals demonstrates cortical neurons innervate subcortex bilaterally to tune brainstem auditory coding. Yet, the role of the descending (corticofugal) auditory system in modulating earlier sound processing in humans during speech perception remains unclear. Here, we measured EEG activity as listeners performed speech identification tasks in different noise backgrounds designed to tax perceptual and attentional processing. We hypothesized brainstem speech coding might be tied to attention and arousal states (indexed by cortical α power) that actively modulate the interplay of brainstem-cortical signal processing. When speech-evoked brainstem frequency-following responses (FFRs) were categorized according to cortical α states, we found low α FFRs in noise were weaker, correlated positively with behavioral response times, and were more "decodable" via neural classifiers. Our data provide new evidence for online corticofugal interplay in humans and establish that brainstem sensory representations are continuously yoked to (i.e., modulated by) the ebb and flow of cortical states to dynamically update perceptual processing.

Rapid Enhancement of Subcortical Neural Responses to Sine-Wave Speech

The efferent auditory nervous system may be a potent force in shaping how the brain responds to behaviorally significant sounds. Previous human experiments using the frequency following response (FFR) have shown efferent-induced modulation of subcortical auditory function online and over short- and long-term time scales; however, a contemporary understanding of FFR generation presents new questions about whether previous effects were constrained solely to the auditory subcortex. The present experiment used sine-wave speech (SWS), an acoustically-sparse stimulus in which dynamic pure tones represent speech formant contours, to evoke FFR_SWS. Due to the higher stimulus frequencies used in SWS, this approach biased neural responses toward brainstem generators and allowed for three stimuli (/bɔ/, /bu/, and /bo/) to be used to evoke FFR_SWSbefore and after listeners in a training group were made aware that they were hearing a degraded speech stimulus. All SWS stimuli were rapidly perceived as speech when presented with a SWS carrier phrase, and average token identification reached ceiling performance during a perceptual training phase. Compared to a control group which remained naïve throughout the experiment, training group FFR_SWS amplitudes were enhanced post-training for each stimulus. Further, linear support vector machine classification of training group FFR_SWS significantly improved post-training compared to the control group, indicating that training-induced neural enhancements were sufficient to bolster machine learning classification accuracy. These results suggest that the efferent auditory system may rapidly modulate auditory brainstem representation of sounds depending on their context and perception as non-speech or speech.

Attention reinforces human corticofugal system to aid speech perception in noise

Perceiving speech-in-noise (SIN) demands precise neural coding between brainstem and cortical levels of the hearing system. Attentional processes can then select and prioritize task-relevant cues over competing background noise for successful speech perception. In animal models, brainstem-cortical interplay is achieved via descending corticofugal projections from cortex that shape midbrain responses to behaviorally-relevant sounds. Attentional engagement of corticofugal feedback may assist SIN understanding but has never been confirmed and remains highly controversial in humans. To resolve these issues, we recorded source-level, anatomically constrained brainstem frequency-following responses (FFRs) and cortical event-related potentials (ERPs) to speech via high-density EEG while listeners performed rapid SIN identification tasks. We varied attention with active vs. passive listening scenarios whereas task difficulty was manipulated with additive noise interference. Active listening (but not arousal-control tasks) exaggerated both ERPs and FFRs, confirming attentional gain extends to lower subcortical levels of speech processing. We used functional connectivity to measure the directed strength of coupling between levels and characterize "bottom-up" vs. "top-down" (corticofugal) signaling within the auditory brainstem-cortical pathway. While attention strengthened connectivity bidirectionally, corticofugal transmission disengaged under passive (but not active) SIN listening. Our findings (i) show attention enhances the brain's transcription of speech even prior to cortex and (ii) establish a direct role of the human corticofugal feedback system as an aid to cocktail party speech perception.

Explaining Cross-Language Asymmetries in Prosodic Processing: The Cue-Driven Window Length Hypothesis

Cross-language studies have shown that English speakers use suprasegmental cues to lexical stress less consistently than speakers of Spanish and other Germanic languages ; accordingly, these studies have attributed this asymmetry to a possible trade-off between the use of vowel reduction and suprasegmental cues in lexical access. We put forward the hypothesis that this "cue trade-off" modulates intonation processing as well, so that English speakers make less use of suprasegmental cues in comparison to Spanish speakers when processing intonation in utterances causing processing asymmetries between these two languages. In three cross-language experiments comparing English and Spanish speakers' prediction of hypo-articulated utterances in focal sentences and reporting speech, we have provided evidence for our hypothesis and proposed a mechanism, the Cue-Driven Window Length model, which accounts for the observed cross-language processing asymmetries between English and Spanish at both lexical and utterance levels. Altogether, results from these experiments illustrated in detail how different types of low-level acoustic information (e.g., vowel reduction versus duration) interacted with higher-level expectations based on the speakers' knowledge of intonation providing support for our hypothesis. These interactions were coherent with an active model of speech perception that entailed real-time adjusting to feedback and to information from the context, challenging more traditional models that consider speech perception as a passive, bottom-up pattern-matching process.

Human Frequency Following Response Correlates of Spatial Release From Masking

Purpose Speech recognition in complex listening environments is enhanced by the extent of spatial separation between the speech source and background competing sources, an effect known as spatial release from masking (SRM). The aim of this study was to investigate whether the phase-locked neural activity in the central auditory pathways, reflected in the frequency following response (FFR), exhibits SRM. Method Eighteen normal-hearing adults (8 men and 10 women, ranging in age from 20 to 42 years) with no known neurological disorders participated in this study. FFRs were recorded from the participants in response to a target vowel /u/ presented with spatially colocated and separated competing talkers at 3 ranges of signal-to-noise ratios (SNRs), with median SNRs of -5.4, 0.5, and 6.8 dB and for different attentional conditions (attention and no attention). Results Amplitude of the FFR at the fundamental frequency was significantly larger in the spatially separated condition as compared to the colocated condition for only the lowest (< -2.4 dB SNR) of the 3 SNR ranges tested. A significant effect of attention was found when subjects were actively focusing on the target stimuli. No significant interaction effects were found between spatial separation and attention. Conclusions The enhanced representation of the target stimulus in the separated condition suggests that the temporal pattern of phase-locked brainstem neural activity generating the FFR may contain information relevant to the binaural processes underlying SRM but only in challenging listening environments. Attention may modulate FFR fundamental frequency amplitude but does not seem to modulate spatial processing at the level of generating the FFR. Supplemental Material https://doi.org/10.23641/asha.9992597.

Discontinuity of early and late event-related brain potentials for selective attention in dichotic listening

If a representation of an auditory attention channel was present in the auditory cortices but not in the subcortical structures, it would be predicted that the early event-related brain potential (ERP) would disagree with the late ERP in selective attention effects. To examine this idea, the present study recorded the auditory brain stem response (ABR) as an early ERP and also the negative difference, the processing negativity and the irrelevant positive difference waves as late ERPs during dichotic listening. Each participant experienced two dichotic conditions: (i) 500-Hz standard tones to the left ear and 1000-Hz ones to the right ear (L500/R1000), (ii) 1000-Hz standard tones to the left ear and 500-Hz ones to the right ear (L1000/R500). In a control task, participants performed visual detection and ignored auditory stimuli. Although the negative difference and processing negativity were found to be identical between the two dichotic conditions, the ABR demonstrated a significant difference between relevant and irrelevant tasks only for the L500/R1000 condition. A response preference to lower-frequency tones was found for behavioural measures and late ERPs but not for the ABR. These results suggest difficulty in representing attention channels in the auditory brain stem. In addition, a weak effect of dichotic sound combination in behaviours corresponded only with earlier ERPs.

Attentional Modulation of Envelope-Following Responses at Lower (93-109 Hz) but Not Higher (217-233 Hz) Modulation Rates

Directing attention to sounds of different frequencies allows listeners to perceive a sound of interest, like a talker, in a mixture. Whether cortically generated frequency-specific attention affects responses as low as the auditory brainstem is currently unclear. Participants attended to either a high- or low-frequency tone stream, which was presented simultaneously and tagged with different amplitude modulation (AM) rates. In a replication design, we showed that envelope-following responses (EFRs) were modulated by attention only when the stimulus AM rate was slow enough for the auditory cortex to track—and not for stimuli with faster AM rates, which are thought to reflect ‘purer’ brainstem sources. Thus, we found no evidence of frequency-specific attentional modulation that can be confidently attributed to brainstem generators. The results demonstrate that different neural populations contribute to EFRs at higher and lower rates, compatible with cortical contributions at lower rates. The results further demonstrate that stimulus AM rate can alter conclusions of EFR studies.

Cortical Correlates of the Auditory Frequency-Following and Onset Responses: EEG and fMRI Evidence

The frequency-following response (FFR) is a measure of the brain's periodic sound encoding. It is of increasing importance for studying the human auditory nervous system due to numerous associations with auditory cognition and dysfunction. Although the FFR is widely interpreted as originating from brainstem nuclei, a recent study using MEG suggested that there is also a right-lateralized contribution from the auditory cortex at the fundamental frequency (Coffey et al., 2016b). Our objectives in the present work were to validate and better localize this result using a completely different neuroimaging modality and to document the relationships between the FFR, the onset response, and cortical activity. Using a combination of EEG, fMRI, and diffusion-weighted imaging, we show that activity in the right auditory cortex is related to individual differences in FFR-fundamental frequency (f₀) strength, a finding that was replicated with two independent stimulus sets, with and without acoustic energy at the fundamental frequency. We demonstrate a dissociation between this FFR-f₀-sensitive response in the right and an area in left auditory cortex that is sensitive to individual differences in the timing of initial response to sound onset. Relationships to timing and their lateralization are supported by parallels in the microstructure of the underlying white matter, implicating a mechanism involving neural conduction efficiency. These data confirm that the FFR has a cortical contribution and suggest ways in which auditory neuroscience may be advanced by connecting early sound representation to measures of higher-level sound processing and cognitive function.

SIGNIFICANCE STATEMENT

The frequency-following response (FFR) is an EEG signal that is used to explore how the auditory system encodes temporal regularities in sound and is related to differences in auditory function between individuals. It is known that brainstem nuclei contribute to the FFR, but recent findings of an additional cortical source are more controversial. Here, we use fMRI to validate and extend the prediction from MEG data of a right auditory cortex contribution to the FFR. We also demonstrate a dissociation between FFR-related cortical activity from that related to the latency of the response to sound onset, which is found in left auditory cortex. The findings provide a clearer picture of cortical processes for analysis of sound features.

Contributions of Sensory Coding and Attentional Control to Individual Differences in Performance in Spatial Auditory Selective Attention Tasks

Listeners with normal hearing thresholds (NHTs) differ in their ability to steer attention to whatever sound source is important. This ability depends on top-down executive control, which modulates the sensory representation of sound in the cortex. Yet, this sensory representation also depends on the coding fidelity of the peripheral auditory system. Both of these factors may thus contribute to the individual differences in performance. We designed a selective auditory attention paradigm in which we could simultaneously measure envelope following responses (EFRs, reflecting peripheral coding), onset event-related potentials (ERPs) from the scalp (reflecting cortical responses to sound) and behavioral scores. We performed two experiments that varied stimulus conditions to alter the degree to which performance might be limited due to fine stimulus details vs. due to control of attentional focus. Consistent with past work, in both experiments we find that attention strongly modulates cortical ERPs. Importantly, in Experiment I, where coding fidelity limits the task, individual behavioral performance correlates with subcortical coding strength (derived by computing how the EFR is degraded for fully masked tones compared to partially masked tones); however, in this experiment, the effects of attention on cortical ERPs were unrelated to individual subject performance. In contrast, in Experiment II, where sensory cues for segregation are robust (and thus less of a limiting factor on task performance), inter-subject behavioral differences correlate with subcortical coding strength. In addition, after factoring out the influence of subcortical coding strength, behavioral differences are also correlated with the strength of attentional modulation of ERPs. These results support the hypothesis that behavioral abilities amongst listeners with NHTs can arise due to both subcortical coding differences and differences in attentional control, depending on stimulus characteristics and task demands.

Contributions of Sensory Coding and Attentional Control to Individual Differences in Performance in Spatial Auditory Selective Attention Tasks

Listeners with normal hearing thresholds (NHTs) differ in their ability to steer attention to whatever sound source is important. This ability depends on top-down executive control, which modulates the sensory representation of sound in the cortex. Yet, this sensory representation also depends on the coding fidelity of the peripheral auditory system. Both of these factors may thus contribute to the individual differences in performance. We designed a selective auditory attention paradigm in which we could simultaneously measure envelope following responses (EFRs, reflecting peripheral coding), onset event-related potentials (ERPs) from the scalp (reflecting cortical responses to sound) and behavioral scores. We performed two experiments that varied stimulus conditions to alter the degree to which performance might be limited due to fine stimulus details vs. due to control of attentional focus. Consistent with past work, in both experiments we find that attention strongly modulates cortical ERPs. Importantly, in Experiment I, where coding fidelity limits the task, individual behavioral performance correlates with subcortical coding strength (derived by computing how the EFR is degraded for fully masked tones compared to partially masked tones); however, in this experiment, the effects of attention on cortical ERPs were unrelated to individual subject performance. In contrast, in Experiment II, where sensory cues for segregation are robust (and thus less of a limiting factor on task performance), inter-subject behavioral differences correlate with subcortical coding strength. In addition, after factoring out the influence of subcortical coding strength, behavioral differences are also correlated with the strength of attentional modulation of ERPs. These results support the hypothesis that behavioral abilities amongst listeners with NHTs can arise due to both subcortical coding differences and differences in attentional control, depending on stimulus characteristics and task demands.

Processing Complex Sounds Passing through the Rostral Brainstem: The New Early Filter Model

The rostral brainstem receives both “bottom-up” input from the ascending auditory system and “top-down” descending corticofugal connections. Speech information passing through the inferior colliculus of elderly listeners reflects the periodicity envelope of a speech syllable. This information arguably also reflects a composite of temporal-fine-structure (TFS) information from the higher frequency vowel harmonics of that repeated syllable. The amplitude of those higher frequency harmonics, bearing even higher frequency TFS information, correlates positively with the word recognition ability of elderly listeners under reverberatory conditions. Also relevant is that working memory capacity (WMC), which is subject to age-related decline, constrains the processing of sounds at the level of the brainstem. Turning to the effects of a visually presented sensory or memory load on auditory processes, there is a load-dependent reduction of that processing, as manifest in the auditory brainstem responses (ABR) evoked by to-be-ignored clicks. Wave V decreases in amplitude with increases in the visually presented memory load. A visually presented sensory load also produces a load-dependent reduction of a slightly different sort: The sensory load of visually presented information limits the disruptive effects of background sound upon working memory performance. A new early filter model is thus advanced whereby systems within the frontal lobe (affected by sensory or memory load) cholinergically influence top-down corticofugal connections. Those corticofugal connections constrain the processing of complex sounds such as speech at the level of the brainstem. Selective attention thereby limits the distracting effects of background sound entering the higher auditory system via the inferior colliculus. Processing TFS in the brainstem relates to perception of speech under adverse conditions. Attentional selectivity is crucial when the signal heard is degraded or masked: e.g., speech in noise, speech in reverberatory environments. The assumptions of a new early filter model are consistent with these findings: A subcortical early filter, with a predictive selectivity based on acoustical (linguistic) context and foreknowledge, is under cholinergic top-down control. A prefrontal capacity limitation constrains this top-down control as is guided by the cholinergic processing of contextual information in working memory.

Evidence against attentional state modulating scalp-recorded auditory brainstem steady-state responses

Auditory brainstem responses (ABRs) and their steady-state counterpart (subcortical steady-state responses, SSSRs) are generally thought to be insensitive to cognitive demands. However, a handful of studies report that SSSRs are modulated depending on the subject׳s focus of attention, either towards or away from an auditory stimulus. Here, we explored whether attentional focus affects the envelope-following response (EFR), which is a particular kind of SSSR, and if so, whether the effects are specific to which sound elements in a sound mixture a subject is attending (selective auditory attentional modulation), specific to attended sensory input (inter-modal attentional modulation), or insensitive to attentional focus. We compared the strength of EFR-stimulus phase locking in human listeners under various tasks: listening to a monaural stimulus, selectively attending to a particular ear during dichotic stimulus presentation, and attending to visual stimuli while ignoring dichotic auditory inputs. We observed no systematic changes in the EFR across experimental manipulations, even though cortical EEG revealed attention-related modulations of alpha activity during the task. We conclude that attentional effects, if any, on human subcortical representation of sounds cannot be observed robustly using EFRs. This article is part of a Special Issue entitled SI: Prediction and Attention.

Binaural interaction in human auditory brainstem response compared for tone-pips and rectangular clicks under conditions of auditory and visual attention

Binaural interaction in the auditory brainstem response (ABR) represents the discrepancy between the binaural waveform and the sum of monaural ones. A typical ABR binaural interaction in humans is a reduction of the binaural amplitude compared to the monaural sum at the wave-V latency, i.e., the DN1 component. It has been considered that the DN1 is mainly elicited by high frequency components of stimuli whereas some studies have shown the contribution of low-to-middle frequency components to the DN1. To examine this issue, the present study compared the ABR binaural interaction elicited by tone pips (1 kHz, 10-ms duration) with the one by clicks (a rectangular wave, 0.1-ms duration) presented at 80 dB peak equivalent SPL and a fixed stimulus onset interval (180 ms). The DN1 due to tone pips was vulnerable compared to the click-evoked DN1. The pip-evoked DN1 was significantly detected under auditory attention whereas it failed to reach significance under visual attention. The click-evoked DN1 was robustly present for the two attention conditions. The current results might confirm the high frequency sound contribution to the DN1 elicitation.

The influence of executive functions on spatial biases varies during the lifespan

Many perceptual processes, such as language or face perception, are asymmetrically organised in the hemispheres already in childhood. These asymmetries induce behaviourally observable spatial biases in which the observer perceives stimuli in one of the hemispaces more efficiently or more frequently than in the other one. Another source for spatial biases is spatial attention which is also asymmetrically organised in the hemispheres. The bias induced by attention is directed towards the right side, which is clearly demonstrated by patients with neglect but also in lesser degree by healthy observers in cognitively loading situations. Recent findings indicate that children and older adults show stronger spatial biases than young adults. We discuss how the development of executive functions might contribute to the manifestation of spatial biases during the lifespan. We present a model in which the interaction between the asymmetrical perceptual processes, the age-related development of the lateralised spatial attention and the development of the executive functions influence spatial perceptual performance and in which the development and decline of the executive processes during the lifespan modify the spatial biases.

Speech perception as an active cognitive process

One view of speech perception is that acoustic signals are transformed into representations for pattern matching to determine linguistic structure. This process can be taken as a statistical pattern-matching problem, assuming realtively stable linguistic categories are characterized by neural representations related to auditory properties of speech that can be compared to speech input. This kind of pattern matching can be termed a passive process which implies rigidity of processing with few demands on cognitive processing. An alternative view is that speech recognition, even in early stages, is an active process in which speech analysis is attentionally guided. Note that this does not mean consciously guided but that information-contingent changes in early auditory encoding can occur as a function of context and experience. Active processing assumes that attention, plasticity, and listening goals are important in considering how listeners cope with adverse circumstances that impair hearing by masking noise in the environment or hearing loss. Although theories of speech perception have begun to incorporate some active processing, they seldom treat early speech encoding as plastic and attentionally guided. Recent research has suggested that speech perception is the product of both feedforward and feedback interactions between a number of brain regions that include descending projections perhaps as far downstream as the cochlea. It is important to understand how the ambiguity of the speech signal and constraints of context dynamically determine cognitive resources recruited during perception including focused attention, learning, and working memory. Theories of speech perception need to go beyond the current corticocentric approach in order to account for the intrinsic dynamics of the auditory encoding of speech. In doing so, this may provide new insights into ways in which hearing disorders and loss may be treated either through augementation or therapy.

Selective attention modulates human auditory brainstem responses: relative contributions of frequency and spatial cues

Selective attention is the mechanism that allows focusing one’s attention on a particular stimulus while filtering out a range of other stimuli, for instance, on a single conversation in a noisy room. Attending to one sound source rather than another changes activity in the human auditory cortex, but it is unclear whether attention to different acoustic features, such as voice pitch and speaker location, modulates subcortical activity. Studies using a dichotic listening paradigm indicated that auditory brainstem processing may be modulated by the direction of attention. We investigated whether endogenous selective attention to one of two speech signals affects amplitude and phase locking in auditory brainstem responses when the signals were either discriminable by frequency content alone, or by frequency content and spatial location. Frequency-following responses to the speech sounds were significantly modulated in both conditions. The modulation was specific to the task-relevant frequency band. The effect was stronger when both frequency and spatial information were available. Patterns of response were variable between participants, and were correlated with psychophysical discriminability of the stimuli, suggesting that the modulation was biologically relevant. Our results demonstrate that auditory brainstem responses are susceptible to efferent modulation related to behavioral goals. Furthermore they suggest that mechanisms of selective attention actively shape activity at early subcortical processing stages according to task relevance and based on frequency and spatial cues.

Auditory-cortex short-term plasticity induced by selective attention

The ability to concentrate on relevant sounds in the acoustic environment is crucial for everyday function and communication. Converging lines of evidence suggests that transient functional changes in auditory-cortex neurons, “short-term plasticity”, might explain this fundamental function. Under conditions of strongly focused attention, enhanced processing of attended sounds can take place at very early latencies (~50 ms from sound onset) in primary auditory cortex and possibly even at earlier latencies in subcortical structures. More robust selective-attention short-term plasticity is manifested as modulation of responses peaking at ~100 ms from sound onset in functionally specialized nonprimary auditory-cortical areas by way of stimulus-specific reshaping of neuronal receptive fields that supports filtering of selectively attended sound features from task-irrelevant ones. Such effects have been shown to take effect in ~seconds following shifting of attentional focus. There are findings suggesting that the reshaping of neuronal receptive fields is even stronger at longer auditory-cortex response latencies (~300 ms from sound onset). These longer-latency short-term plasticity effects seem to build up more gradually, within tens of seconds after shifting the focus of attention. Importantly, some of the auditory-cortical short-term plasticity effects observed during selective attention predict enhancements in behaviorally measured sound discrimination performance.

An integrative model of subcortical auditory plasticity

In direct conflict with the concept of auditory brainstem nuclei as passive relay stations for behaviorally-relevant signals, recent studies have demonstrated plasticity of the auditory signal in the brainstem. In this paper we provide an overview of the forms of plasticity evidenced in subcortical auditory regions. We posit an integrative model of auditory plasticity, which argues for a continuous, online modulation of bottom-up signals via corticofugal pathways, based on an algorithm that anticipates and updates incoming stimulus regularities. We discuss the negative implications of plasticity in clinical dysfunction and propose novel methods of eliciting brainstem responses that could specify the biological nature of auditory processing deficits.

Working memory capacity and visual-verbal cognitive load modulate auditory-sensory gating in the brainstem: toward a unified view of attention

Two fundamental research questions have driven attention research in the past: One concerns whether selection of relevant information among competing, irrelevant, information takes place at an early or at a late processing stage; the other concerns whether the capacity of attention is limited by a central, domain-general pool of resources or by independent, modality-specific pools. In this article, we contribute to these debates by showing that the auditory-evoked brainstem response (an early stage of auditory processing) to task-irrelevant sound decreases as a function of central working memory load (manipulated with a visual-verbal version of the n-back task). Furthermore, individual differences in central/domain-general working memory capacity modulated the magnitude of the auditory-evoked brainstem response, but only in the high working memory load condition. The results support a unified view of attention whereby the capacity of a late/central mechanism (working memory) modulates early precortical sensory processing.

The frequency following response (FFR) may reflect pitch-bearing information but is not a direct representation of pitch

The frequency following response (FFR), a scalp-recorded measure of phase-locked brainstem activity, is often assumed to reflect the pitch of sounds as perceived by humans. In two experiments, we investigated the characteristics of the FFR evoked by complex tones. FFR waveforms to alternating-polarity stimuli were averaged for each polarity and added, to enhance envelope, or subtracted, to enhance temporal fine structure information. In experiment 1, frequency-shifted complex tones, with all harmonics shifted by the same amount in Hertz, were presented diotically. Only the autocorrelation functions (ACFs) of the subtraction-FFR waveforms showed a peak at a delay shifted in the direction of the expected pitch shifts. This expected pitch shift was also present in the ACFs of the output of an auditory nerve model. In experiment 2, the components of a harmonic complex with harmonic numbers 2, 3, and 4 were presented either to the same ear ("mono") or the third harmonic was presented contralaterally to the ear receiving the even harmonics ("dichotic"). In the latter case, a pitch corresponding to the missing fundamental was still perceived. Monaural control conditions presenting only the even harmonics ("2 + 4") or only the third harmonic ("3") were also tested. Both the subtraction and the addition waveforms showed that (1) the FFR magnitude spectra for "dichotic" were similar to the sum of the spectra for the two monaural control conditions and lacked peaks at the fundamental frequency and other distortion products visible for "mono" and (2) ACFs for "dichotic" were similar to those for "2 + 4" and dissimilar to those for "mono." The results indicate that the neural responses reflected in the FFR preserve monaural temporal information that may be important for pitch, but provide no evidence for any additional processing over and above that already present in the auditory periphery, and do not directly represent the pitch of dichotic stimuli.

Auditory frequency-following response: a neurophysiological measure for studying the "cocktail-party problem"

How do we recognize what one person is saying when others are speaking at the same time? The "cocktail-party problem" proposed by Cherry (1953) has puzzled scientific societies for half a century. This puzzle will not be solved without using appropriate neurophysiological investigation that should satisfy the following four essential requirements: (1) certain critical speech characteristics related to speech intelligibility are recorded; (2) neural responses to different speech sources are differentiated; (3) neural correlates of bottom-up binaural unmasking of responses to target speech are measurable; (4) neural correlates of attentional top-down unmasking of target speech are measurable. Before speech signals reach the cerebral cortex, some critical acoustic features are represented in subcortical structures by the frequency-following responses (FFRs), which are sustained evoked potentials based on precisely phase-locked responses of neuron populations to low-to-middle-frequency periodical acoustical stimuli. This review summarizes previous studies on FFRs associated with each of the four requirements and suggests that FFRs are useful for studying the "cocktail-party problem".

Auditory brain stem response to complex sounds: a tutorial

This tutorial provides a comprehensive overview of the methodological approach to collecting and analyzing auditory brain stem responses to complex sounds (cABRs). cABRs provide a window into how behaviorally relevant sounds such as speech and music are processed in the brain. Because temporal and spectral characteristics of sounds are preserved in this subcortical response, cABRs can be used to assess specific impairments and enhancements in auditory processing. Notably, subcortical auditory function is neither passive nor hardwired but dynamically interacts with higher-level cognitive processes to refine how sounds are transcribed into neural code. This experience-dependent plasticity, which can occur on a number of time scales (e.g., life-long experience with speech or music, short-term auditory training, on-line auditory processing), helps shape sensory perception. Thus, by being an objective and noninvasive means for examining cognitive function and experience-dependent processes in sensory activity, cABRs have considerable utility in the study of populations where auditory function is of interest (e.g., auditory experts such as musicians, and persons with hearing loss, auditory processing, and language disorders). This tutorial is intended for clinicians and researchers seeking to integrate cABRs into their clinical or research programs.

Effect of an auditory cue on chewing cycle kinematics

OBJECTIVES

This study analysed the systematic and random effects of a rhythmic auditory cue on chewing cycle kinematics.

METHODS

The chin movements of 25 subjects (19-35 years of age) with normal class I occlusion were recorded at 100Hz (Optotrak) Northern Digital) during two natural gum chewing (2.5 g) sequences to determine the chewing rate of each subject. Another sequence was recorded with the subjects chewing at their natural rate following an audible cue. Multilevel modeling procedures were used to evaluate differences between natural chewing with and without an audible cue.

RESULTS

Differences were found between experimental conditions for excursions, velocities and cycle shape. When chewing with the audible cue velocities were slower and there was less excursion of the chin marker, with the exception of initial lateral movements toward the balancing side. No differences in between-subject variability were found when chewing with or without an audible cue. Within-subject variability was 44% smaller for total cycle duration and 53% smaller for total 3D excursion when chewing with the auditory cue.

CONCLUSIONS

Chewing at one's normal rate while following an auditory cue produces more consistency in chewing cycle kinematics. This method may be applicable, with some limitations, to reduce within-subject variability in chewing cycle kinematics.

Effects of spatial attention on the brain stem frequency-following potential

Can spatial attention or orienting affect human auditory information processing as peripheral as on the brain stem level? More specifically, is the reduction of the latency of the frequency-following potential (FFP; an evoked lower brain stem response) that we described in an earlier Neuroreport article really specifically attention-related? Here we demonstrate that, indeed, exogenous intramodal (auditory) spatial orienting, but not a transient modulation of general arousal, reduced the latency of the FFP by 27 micros; there were no effects on the FFP-amplitude. Although it might seem small, this reduction may be relevant in spatial hearing. We conclude that under certain conditions spatial attention can affect auditory information processing already on the brain stem level.

Selective attention affects human brain stem frequency-following response

Selective attention modifies long-latency cortical event-related potentials. Amplitudes are typically enhanced and/or latencies reduced when evoking stimuli are attended. However, there is controversy concerning the effects of selective attention on short-latency brain stem evoked potentials. The objective of the present study was to assess possible attention effects on the brain stem auditory frequency-following response (FFR) elicited by a periodic tone. Young adult subjects heard a repetitive auditory stimulus while detecting infrequent target stimuli in either an auditory or visual detection task. Five channels of high frequency electroencephalographic (EEG) activity were recorded along the scalp midline with the center electrode positioned at the vertex. The FFR was elicited by the repetitive tone during both tasks. There were significant individual differences in the electrode sites yielding maximum response amplitudes, but overall FFR amplitudes were significantly larger during the auditory attention task. These results suggest that selective attention in humans can modify signal processing in sensory (afferent) pathways at the level of the brain stem. This may reflect top-down perceptual preprocessing mediated by extensive descending (efferent) pathways that originate in the cortex. Overall, the FFR appears to be a robust indicator of early auditory neural processing and shows effects not seen in brain stem auditory evoked response studies employing transient (click) acoustic stimuli.

Enhanced brainstem and cortical evoked response amplitudes: single-trial covariance analysis

The purpose of the present study was to develop analytic procedures that improve the definition of sensory evoked response components. Such procedures could benefit all recordings but would especially benefit difficult recordings where many trials are contaminated by muscle and movement artifacts. First, cross-correlation and latency adjustment analyses were applied to the human brainstem frequency-following response and cortical auditory evoked response recorded on the same trials. Lagged cross-correlation functions were computed, for each of 17 subjects, between single-trial data and templates consisting of the sinusoid stimulus waveform for the brainstem response and the subject's own smoothed averaged evoked response P2 component for the cortical response. Trials were considered in the analysis only if the maximum correlation-squared (r2) exceeded .5 (negatively correlated trials were thus included). Identical correlation coefficients may be based on signals with quite different amplitudes, but it is possible to assess amplitude by the nonnormalized covariance function. Next, an algorithm is applied in which each trial with negative covariance is matched to a trial with similar, but positive, covariance and these matched-trial pairs are deleted. When an evoked response signal is present in the data, the majority of trials positively correlate with the template. Thus, a residual of positively correlated trials remains after matched covariance trials are deleted. When these residual trials are averaged, the resulting brainstem and cortical responses show greatly enhanced amplitudes. This result supports the utility of this analysis technique in clarifying and assessing evoked response signals.

Brainstem frequency-following response recorded from one vertical and three horizontal electrode derivations

The human brainstem frequency-following response reflects neural activity to periodic auditory stimuli. Responses were simultaneously recorded from one vertically oriented and three horizontally oriented electrode derivations. Nine participants each received a total of 16,000 tone repetitions, 4,000 for each of four stimulus frequencies: 222, 266, 350, and 450 Hz. The responses were digitally filtered, quantified by correlation and spectral analysis, and statistically evaluated by repeated measure analysis of variance. While the various horizontal derivation responses did not differ from each other in latency (values tightly clustered around M= 2.60 msec.), the vertical derivation response occurred significantly later (M=4.38 msec.). The smaller latency for the horizontal responses suggests an origin within the acoustic nerve, while the larger latency for the vertical response suggests a central brainstem origin. The largest response amplitude resulted from gold "tiptrode" electrodes placed in each auditory meatus, suggesting that this electrode derivation provided the most accurate (noninvasive) assessment of short-latency events originating at the level of the auditory nerve.

Putative measure of peripheral and brainstem frequency-following in humans

The human brainstem frequency-following response (FFR) registers phase-locked neural activity to periodic auditory stimuli. FFR waveforms were extracted from the electroencephalogram by averaging responses to repeated auditory stimulation. Two channels of data were simultaneously recorded from horizontally (electrodes placed in ear canals) and vertically (vertex scalp referenced to midline) oriented electrode configurations. Eight participants each received a total of 2000 tone repetitions for each of ten stimulus frequencies ranging from 133 to 950 Hz. FFRs were quantified by fast-Fourier spectral analysis. The largest spectral intensities at the stimulus frequency were recorded in the horizontal FFR, which also followed higher frequencies and showed better signal-to-noise ratios then did the vertical FFR. The horizontal FFR pattern suggests an acoustic nerve origin, while the vertical FFR pattern suggests a central brainstem origin.

Individual differences in autonomic activity affects brainstem auditory frequency-following response amplitude in humans

Innervation of the cochlea by sympathetic fibers suggests that the autonomic nervous system (ANS) may influence auditory information processing. The brainstem frequency-following response (FFR) and spontaneous skin conductance activity (SCA) were measured while subjects discriminated between long (rare) and short (frequent) duration tones. When subjects were divided into three groups on the basis of SCA, those with low SCA variability had larger FFR amplitudes. These results agree with the only other study to report ANS effects on brainstem auditory evoked responses [28]. It is proposed that individual differences in autonomic response patterns may account for some of the amplitude variation reported in brainstem evoked potential studies.

Brainstem frequency-following response and simple motor reaction time

Simple motor reaction times (RT) in humans show marked trial-to-trial variations. In the present study, a brief tone (400 Hz, 37.5 ms duration) that was the imperative stimulus in a RT paradigm evoked the brainstem frequency-following response (FFR). Horizontal and vertical montage FFRs were recorded to evaluate neural responses with putative origins in auditory nerve and central brainstem, respectively. The main question concerned the possible relationship between trial-to-trial variations in RT speed and FFR response properties. The results showed a reliable pattern in which fast RT trials yielded larger amplitudes (relative to slow trials) in earlier milliseconds of the FFR, and slow RT trials yielded relatively larger amplitudes in later milliseconds of the response. These results support the conclusion that early processing in the auditory brainstem is not automatic and invariant. Rather, short-latency evoked potentials appear to reflect trial-to-trial variations related to events far removed from the first synapse of sensory coding, perhaps depending upon cortically mediated influences such as cognition or attention.

Brain stem frequency-following response to dichotic vowels during attention

Frequency-following responses (FFRs) were elicited by English long vowels (female /a/ and male /e/) in a dichotic listening task. Stimuli were simultaneous and of equal duration, but differing spectra permitted unique identification of vowel components in the compound FFR. Horizontal and vertical montage FFRs were recorded with putative origins in the acoustic nerve and central brain stem, respectively. FFRs obtained during attention to each vowel showed significant effects for the voice fundamental frequency, f0, which is perceptually salient and conveys paralinguistic information such as the sex of the speaker. Amplitudes of f0 were larger when vowels were attended than when ignored. These findings provide evidence of short-latency attention effects in humans and suggest that linguistic attention may initially filter inputs based on salient paralinguistic cues.

Speech-evoked brainstem frequency-following responses during verbal transformations due to word repetition

Speech-evoked brainstem frequency-following responses (FFRs) were recorded to repeated presentations of the same stimulus word. Word repetition results in illusory verbal transformations (VTs) in which word perceptions can differ markedly from the actual stimulus. Previous behavioral studies support an explanation of VTs based on changes in arousal or attention. Horizontal and vertical dipole FFRs were recorded to assess responses with putative origins in the auditory nerve and central brainstem, respectively. FFRs were recorded from 18 subjects when they correctly heard the stimulus and when they reported VTs. Although horizontal and vertical dipole FFRs showed different frequency response patterns, dipoles did not differentiate between perceptual conditions. However, when subjects were divided into low- and high-VT groups (based on percentage of VT trials), a significant Condition x Group interaction resulted. This interaction showed the largest difference in FFR amplitudes during VT trials, with the low-VT group showing increased amplitudes, and the high-VT group showing decreased amplitudes, relative to trials in which the stimulus was correctly perceived. These results demonstrate measurable subject differences in the early processing of complex signals, due to possible effects of attention on the brainstem FFR. The present research shows that the FFR is useful in understanding human language as it is coded and processed in the brainstem auditory pathway.

Brainstem frequency-following and behavioral responses during selective attention to pure tone and missing fundamental stimuli

Reaction time (RT), discrimination sensitivity (d'), and the brainstem frequency-following response (FFR) were recorded in 32 subjects performing a selective attention task. Auditory stimuli were a 400 Hz pure tone and a complex "missing fundamental" (MF) presented dichotically to separate ears (channels). In two tasks, infrequent target stimuli were either of lower intensity or greater duration than standard stimuli. Behavioral results showed consistently better performance (faster RTs and higher d' scores) in the duration task, and better overall detection of MF targets. FFR attention effects were evidenced by differing amplitudes in attend and ignore conditions. Amplitudes in the attended channel were larger to MF stimuli in both tasks, and to the tone stimulus in the duration task. Responses to tone in the intensity task, however, were lowest when the channel was attended, perhaps reflecting some property of greater task difficulty. The demonstration of FFR amplitude differences between attended and ignored channels suggests that selective attention can modify brainstem evoked responses in humans.

Two-channel brain-stem frequency-following responses to pure tone and missing fundamental stimuli

In 2 separate experiments the brain-stem frequency-following response (FFR) was recorded to a pure tone (200 Hz) and complex "missing fundamental" (MF) stimuli differing in temporal fine structure and envelope modulation depth. FFRs were simultaneously recorded in 2 channels with horizontal and vertical dipole orientations. Horizontal electrodes were identical in both experiments (right-left ear), but the vertical configuration was varied (vertex-left ear; vertex-linked mastoids). The horizontal channel yielded a well defined FFR to tone stimulation at a latency consistent with an origin along the auditory nerve. However, there was no horizontal response to MF stimulation. This latter finding provides electrophysiological support for the conclusion that MFs are not directly coded in the peripheral neural response. Vertical recordings, however, showed equally well defined FFRs to tone and MF stimuli. Thus, a representation of the missing fundamental frequency is registered in the brain-stem. Vertical latencies were consistent with a source at the level of the lateral lemniscus. The FFR is well suited to elucidate certain brain-stem mechanisms of auditory information processing. Important additional information results when responses are compared in horizontal and vertical dipole orientations. Thus, the present results provide the first evoked response demonstration of a peripheral-brain-stem dichotomy of MF coding.