Intensity coding of auditory stimuli: an fMRI study

Short-Term Effect of Auditory Stimulation on Neural Activities: A Scoping Review of Longitudinal Electroencephalography and Magnetoencephalography Studies

Explored through EEG/MEG, auditory stimuli function as a suitable research probe to reveal various neural activities, including event-related potentials, brain oscillations and functional connectivity. Accumulating evidence in this field stems from studies investigating neuroplasticity induced by long-term auditory training, specifically cross-sectional studies comparing musicians and non-musicians as well as longitudinal studies with musicians. In contrast, studies that address the neural effects of short-term interventions whose duration lasts from minutes to hours are only beginning to be featured. Over the past decade, an increasing body of evidence has shown that short-term auditory interventions evoke rapid changes in neural activities, and oscillatory fluctuations can be observed even in the prestimulus period. In this scoping review, we divided the extracted neurophysiological studies into three groups to discuss neural activities with short-term auditory interventions: the pre-stimulus period, during stimulation, and a comparison of before and after stimulation. We show that oscillatory activities vary depending on the context of the stimuli and are greatly affected by the interplay of bottom-up and top-down modulational mechanisms, including attention. We conclude that the observed rapid changes in neural activitiesin the auditory cortex and the higher-order cognitive part of the brain are causally attributed to short-term auditory interventions.

Sound Level Changes the Auditory Cortical Activation Detected with Functional Near-Infrared Spectroscopy

BACKGROUND

Functional near-infrared spectroscopy (fNIRS) is a viable non-invasive technique for functional neuroimaging in the cochlear implant (CI) population; however, the effects of acoustic stimulus features on the fNIRS signal have not been thoroughly examined. This study examined the effect of stimulus level on fNIRS responses in adults with normal hearing or bilateral CIs. We hypothesized that fNIRS responses would correlate with both stimulus level and subjective loudness ratings, but that the correlation would be weaker with CIs due to the compression of acoustic input to electric output.

METHODS

Thirteen adults with bilateral CIs and 16 with normal hearing (NH) completed the study. Signal-correlated noise, a speech-shaped noise modulated by the temporal envelope of speech stimuli, was used to determine the effect of stimulus level in an unintelligible speech-like stimulus between the range of soft to loud speech. Cortical activity in the left hemisphere was recorded.

RESULTS

Results indicated a positive correlation of cortical activation in the left superior temporal gyrus with stimulus level in both NH and CI listeners with an additional correlation between cortical activity and perceived loudness for the CI group. The results are consistent with the literature and our hypothesis.

CONCLUSIONS

These results support the potential of fNIRS to examine auditory stimulus level effects at a group level and the importance of controlling for stimulus level and loudness in speech recognition studies. Further research is needed to better understand cortical activation patterns for speech recognition as a function of both stimulus presentation level and perceived loudness.

Practical Aspects of Functional Magnetic Resonance Imaging in Children

Functional magnetic resonance imaging (fMRI) has become a broadly accepted presurgical mapping tool for pediatric populations with brain pathology. The aim of this article is to provide general guidelines on the pragmatic aspects of performing and processing fMRI, as well as interpreting its results across children of all age groups. Based on the author's accumulated experience of more than 20 years on this specific field, these guidelines consider many factors that include the particular physiology and anatomy of the child's brain, and how specific peculiarities may pose disadvantages or even certain advantages when performing fMRI procedures. The author carefully details the various challenges that the practitioner might face in dealing with limited volitional behavior and language comprehension of infants and small children and remedial strategies. The type and proper choice of task-based paradigms in keeping with the age and performance of the patient are discussed, as well as the appropriate selection and dosage of sedative agents and their inherent limitations. Recommendations about the scanner and settings for specific sequences are provided, as well as the required devices for appropriate stimulus delivery, response, and motion control. Practical aspects of fMRI postprocessing and quality control are discussed. Finally, given the relevance of resting-state-fMRI for use in noncooperative patients, a praxis-oriented guide to obtain, classify, and understand the spontaneous neural networks (utilizing independent component analysis) is also provided. The article concludes with a thorough discussion about the possible pitfalls at different stages of the fMRI process.

Extracting human cortical responses to sound onsets and acoustic feature changes in real music, and their relation to event rate

Evoked cortical responses (ERs) have mainly been studied in controlled experiments using simplified stimuli. Though, an outstanding question is how the human cortex responds to the complex stimuli encountered in realistic situations. Few electroencephalography (EEG) studies have used Music Information Retrieval (MIR) tools to extract cortical P1/N1/P2 to acoustical changes in real music. However, less than ten events per music piece could be detected leading to ERs due to limitations in automatic detection of sound onsets. Also, the factors influencing a successful extraction of the ERs have not been identified. Finally, previous studies did not localize the sources of the cortical generators. This study is based on an EEG/MEG dataset from 48 healthy normal hearing participants listening to three real music pieces. Acoustic features were computed from the audio signal of the music with the MIR Toolbox. To overcome limits in automatic methods, sound onsets were also manually detected. The chance of obtaining detectable ERs based on ten randomly picked onset points was less than 1:10,000. For the first time, we show that naturalistic P1/N1/P2 ERs can be reliably measured across 100 manually identified sound onsets, substantially improving the signal-to-noise level compared to <10 trials. More ERs were measurable in musical sections with slow event rates (0.2 Hz-2.5 Hz) than with fast event rates (>2.5 Hz). Furthermore, during monophonic sections of the music only P1/P2 were measurable, and during polyphonic sections only N1. Finally, MEG source analysis revealed that naturalistic P2 is located in core areas of the auditory cortex.

A parcellation-based model of the auditory network

INTRODUCTION

The auditory network plays an important role in interaction with the environment. Multiple cortical areas, such as the inferior frontal gyrus, superior temporal gyrus and adjacent insula have been implicated in this processing. However, understanding of this network's connectivity has been devoid of tractography specificity.

METHODS

Using attention task-based functional magnetic resonance imaging (MRI) studies, an activation likelihood estimation (ALE) of the auditory network was generated. Regions of interest corresponding to the cortical parcellation scheme previously published under the Human Connectome Project were co-registered onto the ALE in the Montreal Neurological Institute coordinate space, and visually assessed for inclusion in the network. Diffusion spectrum MRI-based fiber tractography was performed to determine the structural connections between cortical parcellations comprising the network.

RESULTS

Fifteen cortical regions were found to be part of the auditory network: areas 44 and 8C, auditory area 1, 4, and 5, frontal operculum area 4, the lateral belt, medial belt and parabelt, parietal area F centromedian, perisylvian language area, retroinsular cortex, supplementary and cingulate eye field and the temporoparietal junction area 1. These regions showed consistent interconnections between adjacent parcellations. The frontal aslant tract was found to connect areas within the frontal lobe, while the arcuate fasciculus was found to connect the frontal and temporal lobe, and subcortical U-fibers were found to connect parcellations within the temporal area. Further studies may refine this model with the ultimate goal of clinical application.

Masking effects on subjective annoyance to aircraft flyover noise: An fMRI study

Sound masking, a new noise control technology, has been applied to improve subjective perception of noise in recent years. However, the neural mechanisms underlying this technology are still unclear. In this study, 18 healthy subjects were recurited to take subjective annoyance assessments and fMRI scanning with the aircraft noise and the masked aircraft noise. The results showed that the noise annoyance was associated with deficient functional connectivity between anterior cingulate cortex (ACC) and prefrontal cortex and exceeded brain activation in ACC, which might be explained as compensation. The sound masking led to significantly strong activation in the left medial frontal cortex and right medial orbital frontal cortex, which were associated with happy emotion induced by sound masking. This study offered new insights on the underlying neural mechanisms of sound masking effects.

Autistic Traits and Enhanced Perceptual Representation of Pitch and Time

Enhanced basic perceptual discrimination has been reported for pitch in individuals with autism spectrum conditions. We test whether there is a correlational pattern of enhancement across the broader autism phenotype and whether this correlation occurs for the discrimination of pitch, time and loudness. Scores on the Autism-Spectrum Quotient correlated significantly with the pitch discrimination (r = -0.51, p < 0.05) and the time-interval discrimination (r = -0.45, p < 0.05) task that were based on a fixed reference. No correlation was found for intensity discrimination based on a fixed reference, nor for a variable reference based time-interval discrimination. The correlations suggest a relationship between autistic traits and the ability to form an enhanced, stable and highly accurate representation of auditory events in the pitch and time dimensions.

The Artery of Aphasia, A Uniquely Sensitive Posterior Temporal Middle Cerebral Artery Branch that Supplies Language Areas in the Brain: Anatomy and Report of Four Cases

BACKGROUND

Arterial disruption during brain surgery can cause devastating injuries to wide expanses of white and gray matter beyond the tumor resection cavity. Such damage may occur as a result of disrupting blood flow through en passage arteries. Identification of these arteries is critical to prevent unforeseen neurologic sequelae during brain tumor resection. In this study, we discuss one such artery, termed the artery of aphasia (AoA), which when disrupted can lead to receptive and expressive language deficits.

METHODS

We performed a retrospective review of all patients undergoing an awake craniotomy for resection of a glioma by the senior author from 2012 to 2018. Patients were included if they experienced language deficits secondary to postoperative infarction in the left posterior temporal lobe in the distribution of the AoA. The gross anatomy of the AoA was then compared with activation likelihood estimations of the auditory and semantic language networks using coordinate-based meta-analytic techniques.

RESULTS

We identified 4 patients with left-sided posterior temporal artery infarctions in the distribution of the AoA on diffusion-weighted magnetic resonance imaging. All 4 patients developed substantial expressive and receptive language deficits after surgery. Functional language improvement occurred in only 2/4 patients. Activation likelihood estimations localized parts of the auditory and semantic language networks in the distribution of the AoA.

CONCLUSIONS

The AoA is prone to blood flow disruption despite benign manipulation. Patients seem to have limited capacity for speech recovery after intraoperative ischemia in the distribution of this artery, which supplies parts of the auditory and semantic language networks.

Measuring Cortical Activity During Auditory Processing with Functional Near-Infrared Spectroscopy

Functional near-infrared spectroscopy (fNIRS) is an optical, non-invasive neuroimaging technique that investigates human brain activity by calculating concentrations of oxy- and deoxyhemoglobin. The aim of this publication is to review the current state of the art as to how fNIRS has been used to study auditory function. We address temporal and spatial characteristics of the hemodynamic response to auditory stimulation as well as experimental factors that affect fNIRS data such as acoustic and stimulus-driven effects. The rising importance that fNIRS is generating in auditory neuroscience underlines the strong potential of the technology, and it seems likely that fNIRS will become a useful clinical tool.

Neuromodulation of Right Auditory Cortex Selectively Increases Activation in Speech-Related Brain Areas in Brainstem Auditory Agnosia

Auditory agnosia is an inability to make sense of sound that cannot be explained by deficits in low-level hearing. In view of recent promising results in the area of neurorehabilitation of language disorders after stroke, we examined the effect of transcranial direct current stimulation (tDCS) in a young woman with general auditory agnosia caused by traumatic injury to the left inferior colliculus. Specifically, we studied activations to sound embedded in a block design using functional magnetic resonance imaging before and after application of anodal tDCS to the right auditory cortex. Before tDCS, auditory discrimination deficits were associated with abnormally reduced activations of the auditory cortex and bilateral unresponsiveness of the anterior superior temporal sulci and gyri. This session replicated a previous functional scan with the same paradigm a year before the current experiment. We then applied anodal tDCS over right auditory cortex for 20 min-utes and immediately re-scanned the patient. We found increased activation of bilateral auditory cortices and, for speech sounds, selectively increased activation in Broca's and Wernicke's areas. Future research might consider the long-term behavioral effects after neurostimulation in auditory agnosia and its potential use in the neurorehabilitation of more general auditory disorders.

Structural and functional abnormality of the putamen in children with developmental dyslexia

There is currently debate with regards to the role of phonological deficit in Chinese reading difficulty, even though some researchers have suggested that the deficit of phonological processing is also a signature of developmental dyslexia in Chinese, as has been found in alphabetic languages. In this study, we examined the brain mechanisms of phonological deficit in Chinese children with developmental dyslexia (DD) during an auditory rhyming judgment task. First, we examined structural differences in Chinese dyslexia by comparing gray and white matter volume in Chinese children with DD, age-matched controls (AC), and reading-matched controls (RC). Next, we examined whether the regions with an abnormal volume in DD showed deficient functional connectivity with the rest of the brain during a phonological task (i.e. auditory rhyming judgment). We found that both AC and RC had greater gray matter volume (GMV) at the left putamen and right dorsal lateral frontal cortex than DD, suggesting possible neural signatures of developmental dyslexia. Functional connectivity analysis revealed that the left putamen was more connected with the right inferior occipital gyrus (IOG) in AC and RC than in DD, suggesting that automatic orthographic involvement during spoken language processing is more salient in controls, while the left putamen was more connected with the left transverse temporal gyrus (TTG) and left insula in DD than in AC and RC, suggesting the phonological articulation -auditory feedback loop is more involved in DD. These findings suggest that the reduced left putamen might contribute to phonological deficits experienced in DD, since it showed deficient connectivity with the rest of the brain during phonological processing.

Cortical Processing Related to Intensity of a Modulated Noise Stimulus-a Functional Near-Infrared Study

Sound intensity is a key feature of auditory signals. A profound understanding of cortical processing of this feature is therefore highly desirable. This study investigates whether cortical functional near-infrared spectroscopy (fNIRS) signals reflect sound intensity changes and where on the brain cortex maximal intensity-dependent activations are located. The fNIRS technique is particularly suitable for this kind of hearing study, as it runs silently. Twenty-three normal hearing subjects were included and actively participated in a counterbalanced block design task. Four intensity levels of a modulated noise stimulus with long-term spectrum and modulation characteristics similar to speech were applied, evenly spaced from 15 to 90 dB SPL. Signals from auditory processing cortical fields were derived from a montage of 16 optodes on each side of the head. Results showed that fNIRS responses originating from auditory processing areas are highly dependent on sound intensity level: higher stimulation levels led to higher concentration changes. Caudal and rostral channels showed different waveform morphologies, reflecting specific cortical signal processing of the stimulus. Channels overlying the supramarginal and caudal superior temporal gyrus evoked a phasic response, whereas channels over Broca's area showed a broad tonic pattern. This data set can serve as a foundation for future auditory fNIRS research to develop the technique as a hearing assessment tool in the normal hearing and hearing-impaired populations.

Cortical activation patterns to spatially presented pure tone stimuli with different intensities measured by functional near-infrared spectroscopy

Functional near-infrared spectroscopy (fNIRS) is an emerging technique for the assessment of functional activity of the cerebral cortex. Recently fNIRS was also envisaged as a novel neuroimaging approach for measuring the auditory cortex activity in the field of in auditory diagnostics. This study aimed to investigate differences in brain activity related to spatially presented sounds with different intensities in 10 subjects by means of functional near-infrared spectroscopy (fNIRS). We found pronounced cortical activation patterns in the temporal and frontal regions of both hemispheres. In contrast to these activation patterns, we found deactivation patterns in central and parietal regions of both hemispheres. Furthermore our results showed an influence of spatial presentation and intensity of the presented sounds on brain activity in related regions of interest. These findings are in line with previous fMRI studies which also reported systematic changes of activation in temporal and frontal areas with increasing sound intensity. Although clear evidence for contralaterality effects and hemispheric asymmetries were absent in the group data, these effects were partially visible on the single subject level. Concluding, fNIRS is sensitive enough to capture differences in brain responses during the spatial presentation of sounds with different intensities in several cortical regions. Our results may serve as a valuable contribution for further basic research and the future use of fNIRS in the area of central auditory diagnostics.

Investigating the role of temporal lobe activation in speech perception accuracy with normal hearing adults: An event-related fNIRS study

Functional near infrared spectroscopy (fNIRS) is a safe, non-invasive, relatively quiet imaging technique that is tolerant of movement artifact making it uniquely ideal for the assessment of hearing mechanisms. Previous research demonstrates the capacity for fNIRS to detect cortical changes to varying speech intelligibility, revealing a positive relationship between cortical activation amplitude and speech perception score. In the present study, we use an event-related design to investigate the hemodynamic response in the temporal lobe across different listening conditions. We presented participants with a speech recognition task using sentences in quiet, sentences in noise, and vocoded sentences. Hemodynamic responses were examined across conditions and then compared when speech perception was accurate compared to when speech perception was inaccurate in the context of noisy speech. Repeated measures, two-way ANOVAs revealed that the speech in noise condition (-2.8dB signal-to-noise ratio/SNR) demonstrated significantly greater activation than the easier listening conditions on multiple channels bilaterally. Further analyses comparing correct recognition trials to incorrect recognition trials (during the presentation phase of the trial) revealed that activation was significantly greater during correct trials. Lastly, during the repetition phase of the trial, where participants correctly repeated the sentence, the hemodynamic response demonstrated significantly higher deoxyhemoglobin than oxyhemoglobin, indicating a difference between the effects of perception and production on the cortical response. Using fNIRS, the present study adds meaningful evidence to the body of knowledge that describes the brain/behavior relationship related to speech perception.

Loudness counts: Interactions between loudness, number magnitude, and space

ATOM (a theory of magnitude) suggests that magnitude information of different formats (numbers, space, and time) is processed within a generalized magnitude network. In this study we investigated whether loudness, as a possible indicator of intensity and magnitude, interacts with the processing of numbers. Small and large numbers, spoken in a quiet and a loud voice, were simultaneously presented to the left and right ear (Experiments 1a and 1b). Participants judged whether the number presented to the left or right ear was louder or larger. Responses were faster when the smaller number was spoken in a quiet voice, and the larger number in a loud voice. Thus, task-irrelevant numerical information influenced the processing of loudness and vice versa. This bi-directional link was also confirmed by classical SNARC paradigms (spatial-numerical association of response codes; Experiments 2a-2c) when participants again judged the magnitude or loudness of separately presented stimuli. In contrast, no loudness-number association was found in a parity judgment task. Regular SNARC effects were found in the magnitude and parity judgment task, but not in the loudness judgment task. Instead, in the latter task, response side was associated with loudness. Possible explanations for these results are discussed.

Is 9 louder than 1? Audiovisual cross-modal interactions between number magnitude and judged sound loudness

The cross-modal impact of number magnitude (i.e. Arabic digits) on perceived sound loudness was examined. Participants compared a target sound's intensity level against a previously heard reference sound (which they judged as quieter or louder). Paired with each target sound was a task irrelevant Arabic digit that varied in magnitude, being either small (1, 2, 3) or large (7, 8, 9). The degree to which the sound and the digit were synchronized was manipulated, with the digit and sound occurring simultaneously in Experiment 1, and the digit preceding the sound in Experiment 2. Firstly, when target sounds and digits occurred simultaneously, sounds paired with large digits were categorized as loud more frequently than sounds paired with small digits. Secondly, when the events were separated, number magnitude ceased to bias sound intensity judgments. In Experiment 3, the events were still separated, however the participants held the number in short-term memory. In this instance the bias returned.

Adaptation to shifted interaural time differences changes encoding of sound location in human auditory cortex

The auditory system infers the location of sound sources from the processing of different acoustic cues. These cues change during development and when assistive hearing devices are worn. Previous studies have found behavioral recalibration to modified localization cues in human adults, but very little is known about the neural correlates and mechanisms of this plasticity. We equipped participants with digital devices, worn in the ear canal that allowed us to delay sound input to one ear, and thus modify interaural time differences, a major cue for horizontal sound localization. Participants wore the digital earplugs continuously for nine days while engaged in day-to-day activities. Daily psychoacoustical testing showed rapid recalibration to the manipulation and confirmed that adults can adapt to shifted interaural time differences in their daily multisensory environment. High-resolution functional MRI scans performed before and after recalibration showed that recalibration was accompanied by changes in hemispheric lateralization of auditory cortex activity. These changes corresponded to a shift in spatial coding of sound direction comparable to the observed behavioral recalibration. Fitting the imaging results with a model of auditory spatial processing also revealed small shifts in voxel-wise spatial tuning within each hemisphere.

Top-down controlled and bottom-up triggered orienting of auditory attention to pitch activate overlapping brain networks

A number of previous studies have suggested segregated networks of brain areas for top-down controlled and bottom-up triggered orienting of visual attention. However, the corresponding networks involved in auditory attention remain less studied. Our participants attended selectively to a tone stream with either a lower pitch or higher pitch in order to respond to infrequent changes in duration of attended tones. The participants were also required to shift their attention from one stream to the other when guided by a visual arrow cue. In addition to these top-down controlled cued attention shifts, infrequent task-irrelevant louder tones occurred in both streams to trigger attention in a bottom-up manner. Both cued shifts and louder tones were associated with enhanced activity in the superior temporal gyrus and sulcus, temporo-parietal junction, superior parietal lobule, inferior and middle frontal gyri, frontal eye field, supplementary motor area, and anterior cingulate gyrus. Thus, the present findings suggest that in the auditory modality, unlike in vision, top-down controlled and bottom-up triggered attention activate largely the same cortical networks. Comparison of the present results with our previous results from a similar experiment on spatial auditory attention suggests that fronto-parietal networks of attention to location or pitch overlap substantially. However, the auditory areas in the anterior superior temporal cortex might have a more important role in attention to the pitch than location of sounds. This article is part of a Special Issue entitled SI: Prediction and Attention.

Cortical response variation with different sound pressure levels: a combined event-related potentials and FMRI study

INTRODUCTION

Simultaneous recording of electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) provides high spatial and temporal resolution. In this study we combined EEG and fMRI to investigate the structures involved in the processing of different sound pressure levels (SPLs).

METHODS

EEG data were recorded simultaneously with fMRI from 16 healthy volunteers using MR compatible devices at 3 T. Tones with different SPLs were delivered to the volunteers and the N1/P2 amplitudes were included as covariates in the fMRI data analysis in order to compare the structures activated with high and low SPLs. Analysis of variance (ANOVA) and ROI analysis were also performed. Additionally, source localisation analysis was performed on the EEG data.

RESULTS

The integration of averaged ERP parameters into the fMRI analysis showed an extended map of areas exhibiting covariation with the BOLD signal related to the auditory stimuli. The ANOVA and ROI analyses also revealed additional brain areas other than the primary auditory cortex (PAC) which were active with the auditory stimulation at different SPLs. The source localisation analyses showed additional sources apart from the PAC which were active with the high SPLs.

DISCUSSION

The PAC and the insula play an important role in the processing of different SPLs. In the fMRI analysis, additional activation was found in the anterior cingulate cortex, opercular and orbito-frontal cortices with high SPLs. A strong response of the visual cortex was also found with the high SPLs, suggesting the presence of cross-modal effects.

What do differences between multi-voxel and univariate analysis mean? How subject-, voxel-, and trial-level variance impact fMRI analysis

Multi-voxel pattern analysis (MVPA) has led to major changes in how fMRI data are analyzed and interpreted. Many studies now report both MVPA results and results from standard univariate voxel-wise analysis, often with the goal of drawing different conclusions from each. Because MVPA results can be sensitive to latent multidimensional representations and processes whereas univariate voxel-wise analysis cannot, one conclusion that is often drawn when MVPA and univariate results differ is that the activation patterns underlying MVPA results contain a multidimensional code. In the current study, we conducted simulations to formally test this assumption. Our findings reveal that MVPA tests are sensitive to the magnitude of voxel-level variability in the effect of a condition within subjects, even when the same linear relationship is coded in all voxels. We also find that MVPA is insensitive to subject-level variability in mean activation across an ROI, which is the primary variance component of interest in many standard univariate tests. Together, these results illustrate that differences between MVPA and univariate tests do not afford conclusions about the nature or dimensionality of the neural code. Instead, targeted tests of the informational content and/or dimensionality of activation patterns are critical for drawing strong conclusions about the representational codes that are indicated by significant MVPA results.

Musical expertise affects attention as reflected by auditory-evoked gamma-band activity in human EEG

Musical expertise has been shown to induce widespread structural and functional alterations in the brain, even-handedly affecting top-down and bottom-up factors. At the same time, it is known that the early evoked gamma-band response (GBR) can be modulated by top-down as well as bottom-up factors such as attention and sound intensity. In this study, we examined the effects of musicianship and attention on the intensity modulation of the auditory-evoked GBR. We compared the electroencephalogram of 17 professional musicians with that of 17 musical laymen obtained during either a forced-choice discrimination task (active) or a passive listening condition. Pure 1000 Hz sine tones were presented at three systematically varied sound intensities (40, 60, and 80 dB sound pressure levels). The results of auditory-evoked potentials and evoked GBRs obtained in the active condition predominantly corresponded to the findings of previous studies. Besides the already known augmentation of the early evoked GBR because of enhanced intertrial phase coherence with increasing sound intensity, we also observed stronger GBRs and enhanced phase locking under the active condition compared with passive listening, whereas the general shape of intensity modulation was comparable between the two conditions. In addition, phase locking to stimulus onset was increased for stimuli of all three intensities when attended, whereas in musicians, only stimuli of the highest intensity (80 dB) induced significantly increased phase locking under the active condition. Taken together, our results suggest that musical expertise influences attention effects on the intensity-modulated early auditory-evoked GBR with respect to intertrial phase coherence.

Human auditory neuroimaging of intensity and loudness

The physical intensity of a sound, usually expressed in dB on a logarithmic ratio scale, can easily be measured using technical equipment. Loudness is the perceptual correlate of sound intensity, and is usually determined by means of some sort of psychophysical scaling procedure. The interrelation of sound intensity and perceived loudness is still a matter of debate, and the physiological correlate of loudness perception in the human auditory pathway is not completely understood. Various studies indicate that the activation in human auditory cortex is more a representation of loudness sensation rather than of physical sound pressure level. This raises the questions (1), at what stage or stages in the ascending auditory pathway is the transformation of the physical stimulus into its perceptual correlate completed, and (2), to what extent other factors affecting individual loudness judgements might modulate the brain activation as registered by auditory neuroimaging. An overview is given about recent studies on the effects of sound intensity, duration, bandwidth and individual hearing status on the activation in the human auditory system, as measured by various approaches in auditory neuroimaging. This article is part of a Special Issue entitled Human Auditory Neuroimaging.

Environmental reverberation affects processing of sound intensity in right temporal cortex

Although sound reverberation is considered a nuisance variable in most studies investigating auditory processing, it can serve as a cue for loudness constancy, a phenomenon describing constant loudness perception in spite of changing sound source distance. In this study, we manipulated room reverberation characteristics to test their effect on psychophysical loudness constancy and we tested with magnetoencephalography on human subjects for neural responses reflecting loudness constancy. Psychophysically, we found that loudness constancy was present in strong, but not weak, reverberation conditions. In contrast, the dependence of sound distance judgment on actual distance was similar across conditions. We observed brain activity reflecting behavioral loudness constancy, i.e. inverse scaling of the evoked magnetic fields with distance for weak reverberation but constant responses across distance for strong reverberation from ~210 to 270 ms after stimulus onset. Distributed magnetoencephalography source reconstruction revealed underlying neural generators within the right middle temporal and right inferior anterior temporal lobe. Our data suggest a dissociation of loudness constancy and distance perception, implying a direct usage of reverberation cues for constructing constant loudness across distance. Furthermore, our magnetoencephalography data suggest involvement of auditory association areas in the right middle and right inferior anterior temporal cortex in this process.

Perspective of functional magnetic resonance imaging in middle ear research

Functional magnetic resonance imaging (MRI) studies have frequently been applied to study sensory system such as vision, language, and cognition, but have proceeded at a considerably slower speed in investigating middle ear and central auditory processing. This is due to several factors, including the intrinsic anatomy of the middle ear system and inherent acoustic noise during acquisition of MRI data. However, accumulating evidences have demonstrated that clarification of some fundamental neural underpinnings of audition associated with middle ear mechanics can be achieved using functional MRI methods. This mini review attempted to take a narrow snapshot of the currently available functional MRI procedures and gave examples of what may be learned about hearing from their application. It is hoped that with these technical advancements, many new high impact applications in audition would follow. In particular, because the fMRI can be used in humans and in animals, fMRI may represent a unique tool that should promote translational research by enabling parallel analyses of physiological and pathological processes in the human and animal auditory system. This article is part of a special issue entitled "MEMRO 2012".

Pre-attentive modulation of brain responses to tones in coloured-hearing synesthetes

BACKGROUND

Coloured-hearing (CH) synesthesia is a perceptual phenomenon in which an acoustic stimulus (the inducer) initiates a concurrent colour perception (the concurrent). Individuals with CH synesthesia "see" colours when hearing tones, words, or music; this specific phenomenon suggesting a close relationship between auditory and visual representations. To date, it is still unknown whether the perception of colours is associated with a modulation of brain functions in the inducing brain area, namely in the auditory-related cortex and associated brain areas. In addition, there is an on-going debate as to whether attention to the inducer is necessarily required for eliciting a visual concurrent, or whether the latter can emerge in a pre-attentive fashion.

RESULTS

By using the EEG technique in the context of a pre-attentive mismatch negativity (MMN) paradigm, we show that the binding of tones and colours in CH synesthetes is associated with increased MMN amplitudes in response to deviant tones supposed to induce novel concurrent colour perceptions. Most notably, the increased MMN amplitudes we revealed in the CH synesthetes were associated with stronger intracerebral current densities originating from the auditory cortex, parietal cortex, and ventral visual areas.

CONCLUSIONS

The automatic binding of tones and colours in CH synesthetes is accompanied by an early pre-attentive process recruiting the auditory cortex, inferior and superior parietal lobules, as well as ventral occipital areas.

The N1 effect of temporal attention is independent of sound location and intensity: implications for possible mechanisms of temporal attention

It has been repeatedly shown that the auditory N1 is enhanced for sounds presented at an attended time point. The present study investigated the underlying mechanisms using a temporal cuing paradigm. In each trial, an auditory cue indicated at which time point a second sound could be relevant for response selection. Crucially, in addition to temporal attention, two physical sound features with known effects on the sensory N1 were manipulated: location and intensity. Positive evidence for conjoint effects of attention and location or attention and intensity would corroborate the notion that the sensory N1 was modulated by temporal attention, thus supporting a gain mechanism. However, the N1 effect of temporal attention was not similarly lateralized as the sensory N1, and, moreover, it was independent of sound intensity. Thus, the present results do not provide compelling evidence that temporal attention involves an increase in sensory gain.

Functional magnetic resonance imaging of sound pressure level encoding in the rat central auditory system

Intensity is an important physical property of a sound wave and is customarily reported as sound pressure level (SPL). Invasive techniques such as electrical recordings, which typically examine one brain region at a time, have been used to study neuronal encoding of SPL throughout the central auditory system. Non-invasive functional magnetic resonance imaging (fMRI) with large field of view can simultaneously examine multiple auditory structures. We applied fMRI to measure the hemodynamic responses in the rat brain during sound stimulation at seven SPLs over a 72 dB range. This study used a sparse temporal sampling paradigm to reduce the adverse effects of scanner noise. Hemodynamic responses were measured from the central nucleus of the inferior colliculus (CIC), external cortex of the inferior colliculus (ECIC), lateral lemniscus (LL), medial geniculate body (MGB), and auditory cortex (AC). BOLD signal changes generally increase significantly (p<0.001) with SPL and the dependence is monotonic in CIC, ECIC, and LL. The ECIC has higher BOLD signal change than CIC and LL at high SPLs. The difference between BOLD signal changes at high and low SPLs is less in the MGB and AC. This suggests that the SPL dependences of the LL and IC are different from those in the MGB and AC and the SPL dependence of the CIC is different from that of the ECIC. These observations are likely related to earlier observations that neurons with firing rates that increase monotonically with SPL are dominant in the CIC, ECIC, and LL while non-monotonic neurons are dominant in the MGB and AC. Further, the IC's SPL dependence measured in this study is very similar to that measured in our earlier study using the continuous imaging method. Therefore, sparse temporal sampling may not be a prerequisite in auditory fMRI studies of the IC.

Dissociation of detection and discrimination of pure tones following bilateral lesions of auditory cortex

It is well known that damage to the peripheral auditory system causes deficits in tone detection as well as pitch and loudness perception across a wide range of frequencies. However, the extent to which to which the auditory cortex plays a critical role in these basic aspects of spectral processing, especially with regard to speech, music, and environmental sound perception, remains unclear. Recent experiments indicate that primary auditory cortex is necessary for the normally-high perceptual acuity exhibited by humans in pure-tone frequency discrimination. The present study assessed whether the auditory cortex plays a similar role in the intensity domain and contrasted its contribution to sensory versus discriminative aspects of intensity processing. We measured intensity thresholds for pure-tone detection and pure-tone loudness discrimination in a population of healthy adults and a middle-aged man with complete or near-complete lesions of the auditory cortex bilaterally. Detection thresholds in his left and right ears were 16 and 7 dB HL, respectively, within clinically-defined normal limits. In contrast, the intensity threshold for monaural loudness discrimination at 1 kHz was 6.5±2.1 dB in the left ear and 6.5±1.9 dB in the right ear at 40 dB sensation level, well above the means of the control population (left ear: 1.6±0.22 dB; right ear: 1.7±0.19 dB). The results indicate that auditory cortex lowers just-noticeable differences for loudness discrimination by approximately 5 dB but is not necessary for tone detection in quiet. Previous human and Old-world monkey experiments employing lesion-effect, neurophysiology, and neuroimaging methods to investigate the role of auditory cortex in intensity processing are reviewed.

Current state-of-the-art of auditory functional MRI (fMRI) on zebra finches: technique and scientific achievements

Songbirds provide an excellent model system exhibiting vocal learning associated with an extreme brain plasticity linked to quantifiable behavioral changes. This animal model has thus far been intensively studied using electrophysiological, histological and molecular mapping techniques. However, these approaches do not provide a global view of the brain and/or do not allow repeated measures, which are necessary to establish correlations between alterations in neural substrate and behavior. In contrast, functional Magnetic Resonance Imaging (fMRI) is a non-invasive in vivo technique which allows one (i) to study brain function in the same subject over time, and (ii) to address the entire brain at once. During the last decades, fMRI has become one of the most popular neuroimaging techniques in cognitive neuroscience for the study of brain activity during various tasks ranging from simple sensory-motor to highly cognitive tasks. By alternating various stimulation periods with resting periods during scanning, resting and task-specific regional brain activity can be determined with this technique. Despite its obvious benefits, fMRI has, until now, only been sparsely used to study cognition in non-human species such as songbirds. The Bio-Imaging Lab (University of Antwerp, Belgium) was the first to implement Blood Oxygen Level Dependent (BOLD) fMRI in songbirds - and in particular zebra finches - for the visualization of sound perception and processing in auditory and song control brain regions. The present article provides an overview of the establishment and optimization of this technique in our laboratory and of the resulting scientific findings. The introduction of fMRI in songbirds has opened new research avenues that permit experimental analysis of complex sensorimotor and cognitive processes underlying vocal communication in this animal model.

Spatially aggregated multiclass pattern classification in functional MRI using optimally selected functional brain areas

In previous works, boosting aggregation of classifier outputs from discrete brain areas has been demonstrated to reduce dimensionality and improve the robustness and accuracy of functional magnetic resonance imaging (fMRI) classification. However, dimensionality reduction and classification of mixed activation patterns of multiple classes remain challenging. In the present study, the goals were (a) to reduce dimensionality by combining feature reduction at the voxel level and backward elimination of optimally aggregated classifiers at the region level, (b) to compare region selection for spatially aggregated classification using boosting and partial least squares regression methods and (c) to resolve mixed activation patterns using probabilistic prediction of individual tasks. Brain activation maps from interleaved visual, motor, auditory and cognitive tasks were segmented into 144 functional regions. Feature selection reduced the number of feature voxels by more than 50%, leaving 95 regions. The two aggregation approaches further reduced the number of regions to 30, resulting in more than 75% reduction of classification time and misclassification rates of less than 3%. Boosting and partial least squares (PLS) were compared to select the most discriminative and the most task correlated regions, respectively. Successful task prediction in mixed activation patterns was feasible within the first block of task activation in real-time fMRI experiments. This methodology is suitable for sparsifying activation patterns in real-time fMRI and for neurofeedback from distributed networks of brain activation.

Dynamics of electrocorticographic (ECoG) activity in human temporal and frontal cortical areas during music listening

Previous studies demonstrated that brain signals encode information about specific features of simple auditory stimuli or of general aspects of natural auditory stimuli. How brain signals represent the time course of specific features in natural auditory stimuli is not well understood. In this study, we show in eight human subjects that signals recorded from the surface of the brain (electrocorticography (ECoG)) encode information about the sound intensity of music. ECoG activity in the high gamma band recorded from the posterior part of the superior temporal gyrus as well as from an isolated area in the precentral gyrus was observed to be highly correlated with the sound intensity of music. These results not only confirm the role of auditory cortices in auditory processing but also point to an important role of premotor and motor cortices. They also encourage the use of ECoG activity to study more complex acoustic features of simple or natural auditory stimuli.

The auditory and non-auditory brain areas involved in tinnitus. An emergent property of multiple parallel overlapping subnetworks

Tinnitus is the perception of a sound in the absence of an external sound source. It is characterized by sensory components such as the perceived loudness, the lateralization, the tinnitus type (pure tone, noise-like) and associated emotional components, such as distress and mood changes. Source localization of quantitative electroencephalography (qEEG) data demonstrate the involvement of auditory brain areas as well as several non-auditory brain areas such as the anterior cingulate cortex (dorsal and subgenual), auditory cortex (primary and secondary), dorsal lateral prefrontal cortex, insula, supplementary motor area, orbitofrontal cortex (including the inferior frontal gyrus), parahippocampus, posterior cingulate cortex and the precuneus, in different aspects of tinnitus. Explaining these non-auditory brain areas as constituents of separable subnetworks, each reflecting a specific aspect of the tinnitus percept increases the explanatory power of the non-auditory brain areas involvement in tinnitus. Thus, the unified percept of tinnitus can be considered an emergent property of multiple parallel dynamically changing and partially overlapping subnetworks, each with a specific spontaneous oscillatory pattern and functional connectivity signature.

Neural coding of sound intensity and loudness in the human auditory system

Inter-individual differences in loudness sensation of 45 young normal-hearing participants were employed to investigate how and at what stage of the auditory pathway perceived loudness, the perceptual correlate of sound intensity, is transformed into neural activation. Loudness sensation was assessed by categorical loudness scaling, a psychoacoustical scaling procedure, whereas neural activation in the auditory cortex, inferior colliculi, and medial geniculate bodies was investigated with functional magnetic resonance imaging (fMRI). We observed an almost linear increase of perceived loudness and percent signal change from baseline (PSC) in all examined stages of the upper auditory pathway. Across individuals, the slope of the underlying growth function for perceived loudness was significantly correlated with the slope of the growth function for the PSC in the auditory cortex, but not in subcortical structures. In conclusion, the fMRI correlate of neural activity in the auditory cortex as measured by the blood oxygen level-dependent effect appears to be more a linear reflection of subjective loudness sensation rather than a display of physical sound pressure level, as measured using a sound-level meter.

Reducing the interval between volume acquisitions improves "sparse" scanning protocols in event-related auditory fMRI

Sparse and clustered-sparse temporal sampling fMRI protocols have been devised to reduce the influence of auditory scanner noise in the context of auditory fMRI studies. Here, we report an improvement of the previously established clustered-sparse acquisition scheme. The standard procedure currently used by many researchers in the field is a scanning protocol that includes relatively long silent pauses between image acquisitions (and therefore, a relatively long repetition time or cluster-onset asynchrony); it is during these pauses that stimuli are presented. This approach makes it unlikely that stimulus-induced BOLD response is obscured by scanner-noise-induced BOLD response. It also allows the BOLD response to drop near baseline; thus, avoiding saturation of BOLD signal and theoretically increasing effect size. A possible drawback of this approach is the limited number of stimulus presentations and image acquisitions that are possible in a given period of time, which could result in an inaccurate estimation of effect size (higher standard error). Since this line of reasoning has not yet been empirically tested, we decided to vary the cluster-onset asynchrony (7.5, 10, 12.5, and 15 s) in the context of a clustered-sparse protocol. In this study sixteen healthy participants listened to spoken sentences. We performed whole-brain fMRI group statistics and region of interest analysis with anatomically defined regions of interest (auditory core and association areas). We discovered that the protocol, which included a short cluster-onset asynchrony (7.5 s), yielded more advantageous results than the other protocols, which involved longer cluster-onset asynchrony. The short cluster-onset asynchrony protocol exhibited a larger number of activated voxels and larger mean effect sizes with lower standard errors. Our findings suggest that, contrary to prior experience, a short cluster-onset asynchrony is advantageous because more stimuli can be delivered within any given period of time. Alternatively, a given number of stimuli can be presented in less time, and this broadens the spectrum of possible fMRI applications.

The neural network of phantom sound changes over time: a comparison between recent-onset and chronic tinnitus patients

Tinnitus is characterized by an ongoing conscious perception of a sound in the absence of any external sound source. Chronic tinnitus is notoriously characterized by its resistance to treatment. In the present study the objective was to verify whether the neural generators and/or the neural tinnitus network, evaluated through EEG recordings, change over time as previously suggested by MEG. We therefore analyzed the source-localized EEG recordings of a very homogenous group of left-sided narrow-band noise tinnitus patients. Results indicate that the generators involved in tinnitus of recent onset seem to change over time with increased activity in several brain areas [auditory cortex, supplementary motor area and dorsal anterior cingulate cortex (dACC) plus insula], associated with a decrease in connectivity between the different auditory and nonauditory brain structures. An exception to this general connectivity decrease is an increase in gamma-band connectivity between the left primary and secondary auditory cortex and the left insula, and also between the auditory cortices and the right dorsal lateral prefrontal cortex. These networks are both connected to the left parahippocampal area. Thus acute and chronic tinnitus are related to differential activity and connectivity in a network comprising the auditory cortices, insula, dACC and premotor cortex.

Attention and cognitive control networks assessed in a dichotic listening fMRI study

A meaningful interaction with our environment relies on the ability to focus on relevant sensory input and to ignore irrelevant information, i.e. top-down control and attention processes are employed to select from competing stimuli following internal goals. In this, the demands for the recruitment of top-down control processes depend on the relative perceptual salience of the competing stimuli. In the present functional magnetic resonance imaging (fMRI) study, we investigated the recruitment of top-down control processes in response to varying degrees of control demands in the auditory modality. For this purpose, we tested 20 male and 20 female subjects with a dichotic listening paradigm, in which the relative perceptual salience of two simultaneously presented stimuli was systematically manipulated by varying the inter-aural intensity difference (IID) and asking the subjects to selectively attend to either ear. The analysis showed that the interaction between IID and attentional direction involves two networks in the brain. A fronto-parietal network, including the pre-supplementary motor area, anterior cingulate cortex, inferior frontal junction, insula and inferior parietal lobe, was recruited during cognitively demanding conditions and can thus be seen as a top-down cognitive control network. In contrast, a second network including the superior temporal and the post-central gyri was engaged under conditions with low cognitive control demands. These findings demonstrate how cognitive control is achieved through the interplay of distinct brain networks, with their differential engagement determined as a function of the level of competition between the sensory stimuli.

Stimulus complexity and categorical effects in human auditory cortex: an activation likelihood estimation meta-analysis

Investigations of the functional organization of human auditory cortex typically examine responses to different sound categories. An alternative approach is to characterize sounds with respect to their amount of variation in the time and frequency domains (i.e., spectral and temporal complexity). Although the vast majority of published studies examine contrasts between discrete sound categories, an alternative complexity-based taxonomy can be evaluated through meta-analysis. In a quantitative meta-analysis of 58 auditory neuroimaging studies, we examined the evidence supporting current models of functional specialization for auditory processing using grouping criteria based on either categories or spectro-temporal complexity. Consistent with current models, analyses based on typical sound categories revealed hierarchical auditory organization and left-lateralized responses to speech sounds, with high speech sensitivity in the left anterior superior temporal cortex. Classification of contrasts based on spectro-temporal complexity, on the other hand, revealed a striking within-hemisphere dissociation in which caudo-lateral temporal regions in auditory cortex showed greater sensitivity to spectral changes, while anterior superior temporal cortical areas were more sensitive to temporal variation, consistent with recent findings in animal models. The meta-analysis thus suggests that spectro-temporal acoustic complexity represents a useful alternative taxonomy to investigate the functional organization of human auditory cortex.

Functional properties of human auditory cortical fields

While auditory cortex in non-human primates has been subdivided into multiple functionally specialized auditory cortical fields (ACFs), the boundaries and functional specialization of human ACFs have not been defined. In the current study, we evaluated whether a widely accepted primate model of auditory cortex could explain regional tuning properties of fMRI activations on the cortical surface to attended and non-attended tones of different frequency, location, and intensity. The limits of auditory cortex were defined by voxels that showed significant activations to non-attended sounds. Three centrally located fields with mirror-symmetric tonotopic organization were identified and assigned to the three core fields of the primate model while surrounding activations were assigned to belt fields following procedures similar to those used in macaque fMRI studies. The functional properties of core, medial belt, and lateral belt field groups were then analyzed. Field groups were distinguished by tonotopic organization, frequency selectivity, intensity sensitivity, contralaterality, binaural enhancement, attentional modulation, and hemispheric asymmetry. In general, core fields showed greater sensitivity to sound properties than did belt fields, while belt fields showed greater attentional modulation than core fields. Significant distinctions in intensity sensitivity and contralaterality were seen between adjacent core fields A1 and R, while multiple differences in tuning properties were evident at boundaries between adjacent core and belt fields. The reliable differences in functional properties between fields and field groups suggest that the basic primate pattern of auditory cortex organization is preserved in humans. A comparison of the sizes of functionally defined ACFs in humans and macaques reveals a significant relative expansion in human lateral belt fields implicated in the processing of speech.

Altered auditory processing in patients with panic disorder: a pilot study

OBJECTIVES

Clinical and electrophysiological studies suggest that panic disorder (PD) patients show disturbed response inhibition to sensory stimuli. Thus, habituation of neuronal activation after repeated sine tone stimulation was assessed by functional magnetic resonance imaging (fMRI) in patients with PD.

METHODS

Twenty patients with PD and 20 age- and gender-matched healthy controls were assessed by 3T fMRI for auditory habituation. During three stimulation cycles of digitally generated pulsed (ν=5 Hz) 800-Hz sine tones alternating with silent periods, activation of the auditory cortex and other anxiety- or sensory integration-related regions was assessed. Brain activation was further analyzed dependent on functional serotonin transporter (5-HTT) gene variation (5-HTTLPR).

RESULTS

PD patients demonstrated an extended brain activity in the first stimulation block, which normalized during the second stimulation cycle. A positive correlation with anxiety measures (HAMA) and an increased activity of distinct anxiety- or sensory integration-related areas (e.g., BA 22, BA 10) were seen during the third block of auditory stimulation. There was a significant interaction of left amygdala activation and the 5-HTTLPR S allele.

CONCLUSIONS

Our results support the hypothesis of an aberrant processing of sensory information in PD patients. This phenomenon may underlie an enhanced responsiveness to anxiety-relevant or irrelevant stimuli possibly increasing PD vulnerability.

An fMRI study of functional abnormalities in the verbal working memory system and the relationship to clinical symptoms in chronic schizophrenia

There has been evidence for functional abnormalities of the verbal working memory system in schizophrenia. Verbal working memory crucially involves the interplay between the anterior and posterior language systems, and previous studies have shown converging evidence for abnormalities in the posterior language system in schizophrenia. In this functional magnetic resonance imaging study, we measured cortical activity in chronic schizophrenic patients and matched healthy controls during auditory and visual verbal working memory tasks. We employed 1) regional analyses specifically targeting the posterior language system and 2) analyses of functional connectivity between anterior and posterior language regions. We performed these analyses separately for each memory stage and modality. In the regional analyses, the left sylvian-parietal-temporal (Spt) area consistently showed reduced activation during encoding and retrieval stages in schizophrenia. Magnitudes of activation in the left posterior superior temporal sulcus were correlated with the severity of delusions at every memory stage. Functional connectivity analyses revealed reduced connectivity between the left Spt and the anterior insula during the encoding of auditory words. In addition, the connectivity strength was correlated with the severity of auditory hallucinations. These findings identify abnormal components in the verbal working memory system and illustrate their possible overlap with the mechanisms of core schizophrenic symptoms.

Identification of attention and cognitive control networks in a parametric auditory fMRI study

In the competition for limited processing resources, top-down attention and cognitive control processes are needed to separate relevant from irrelevant sensory information and to interact with the environment in a meaningful way. The demands for the recruitment of top-down control processes depend on the relative salience of the competing stimuli. In the present event-related functional magnetic resonance imaging (fMRI) study we investigated the dynamics of neuronal networks during varying degrees of top-down control demands. We tested 20 participants with a dichotic auditory discrimination task in which the relative perceptual salience of two simultaneously presented syllables was parametrically varied by manipulating the inter-aural intensity differences (IIDs) and instructing the subjects to selectively attend to either the louder or weaker of the two stimuli. A significant interaction of IID manipulation and attentional instruction was detected bilaterally in the inferior parietal lobe and pre-supplementary motor area, and in the precentral gyrus, anterior cingulate cortex, and inferior frontal gyrus of the right hemisphere. The post hoc analysis of the interaction pattern allowed for an assignment of these regions to either of two sets of regions which can be interpreted to constitute two different brain networks: a fronto-parietal attention control network, involved in the integration of saliency-based and instruction-based processing preferences, and a medial-lateral frontal cognitive control network, involved in the processing of the conflicts arising in the attempt to follow the attentional instruction in face of the varying inter-aural stimulus salience.