Processing of speech by the auditory nervous system

Spike Generators and Cell Signaling in the Human Auditory Nerve: An Ultrastructural, Super-Resolution, and Gene Hybridization Study

Background: The human auditory nerve contains 30,000 nerve fibers (NFs) that relay complex speech information to the brain with spectacular acuity. How speech is coded and influenced by various conditions is not known. It is also uncertain whether human nerve signaling involves exclusive proteins and gene manifestations compared with that of other species. Such information is difficult to determine due to the vulnerable, "esoteric," and encapsulated human ear surrounded by the hardest bone in the body. We collected human inner ear material for nanoscale visualization combining transmission electron microscopy (TEM), super-resolution structured illumination microscopy (SR-SIM), and RNA-scope analysis for the first time. Our aim was to gain information about the molecular instruments in human auditory nerve processing and deviations, and ways to perform electric modeling of prosthetic devices. Material and Methods: Human tissue was collected during trans-cochlear procedures to remove petro-clival meningioma after ethical permission. Cochlear neurons were processed for electron microscopy, confocal microscopy (CM), SR-SIM, and high-sensitive in situ hybridization for labeling single mRNA transcripts to detect ion channel and transporter proteins associated with nerve signal initiation and conductance. Results: Transport proteins and RNA transcripts were localized at the subcellular level. Hemi-nodal proteins were identified beneath the inner hair cells (IHCs). Voltage-gated ion channels (VGICs) were expressed in the spiral ganglion (SG) and axonal initial segments (AISs). Nodes of Ranvier (NR) expressed Nav1.6 proteins, and encoding genes critical for inter-cellular coupling were disclosed. Discussion: Our results suggest that initial spike generators are located beneath the IHCs in humans. The first NRs appear at different places. Additional spike generators and transcellular communication may boost, sharpen, and synchronize afferent signals by cell clusters at different frequency bands. These instruments may be essential for the filtering of complex sounds and may be challenged by various pathological conditions.

Use of the guinea pig in studies on the development and prevention of acquired sensorineural hearing loss, with an emphasis on noise

Guinea pigs have been used in diverse studies to better understand acquired hearing loss induced by noise and ototoxic drugs. The guinea pig has its best hearing at slightly higher frequencies relative to humans, but its hearing is more similar to humans than the rat or mouse. Like other rodents, it is more vulnerable to noise injury than the human or nonhuman primate models. There is a wealth of information on auditory function and vulnerability of the inner ear to diverse insults in the guinea pig. With respect to the assessment of potential otoprotective agents, guinea pigs are also docile animals that are relatively easy to dose via systemic injections or gavage. Of interest, the cochlea and the round window are easily accessible, notably for direct cochlear therapy, as in the chinchilla, making the guinea pig a most relevant and suitable model for hearing. This article reviews the use of the guinea pig in basic auditory research, provides detailed discussion of its use in studies on noise injury and other injuries leading to acquired sensorineural hearing loss, and lists some therapeutics assessed in these laboratory animal models to prevent acquired sensorineural hearing loss.

The role of broadband inhibition in the rate representation of spectral cues for sound localization in the inferior colliculus

Previous investigations have shown that a subset of inferior colliculus neurons, which have been designated type O units, respond selectively to isolated features of the cat's head-related transfer functions (HRTFs: the directional transformation of a free-field sound as it propagates from the head to the eardrum). Based on those results, it was hypothesized that type O units would show enhanced spatial tuning in a virtual sound field that conveyed the full complement of HRTF-based localization cues. As anticipated, a number of neurons produced representations of virtual sound source locations that were spatially tuned, level tolerant, and effective under monaural conditions. Preferred locations were associated with spectral cues that complemented the highly individualized broadband inhibitory patterns of tuned neurons. That is, higher response magnitudes were achieved when spectral peaks coincided with excitatory influences at best frequency (BF: the most sensitive frequency) and spectral notches fell within flanking inhibitory regions. The directionally dependent modulation of narrowband ON-BF excitation by broadband OFF-BF inhibition was not a unique property of type O units.

Auditory wavelet transform based on auditory wavelet families

The auditory periphery system receives a one dimensional acoustical signal that describes how the local pressure varies with time. However, this one dimensional signal information is then somehow unfolded into a two dimensional time-frequency plane, that tells us when which frequency occurs. The hearing process is based on compromise between time localization and frequency localization. A kind of time-frequency or wavelet type transformation is done in auditory signal processing. In this study the similarities between auditory transform based on the auditory physiological process and wavelet transform are introduced. Specially, band pass filter bank properties and variable time and frequency resolutions with the signal frequency are considered. The main goal is to find the scaling function while the numerical values of the wavelet function were measured. If the wavelet function and the scaling function from the measured data are estimated, then the wavelet coefficients and the scaling coefficients could be calculated. Therefore, the multiresolution implementation of auditory based wavelet transform is possible.

Coding of color and form in the geniculostriate visual pathway (invited review)

We review how neurons in the principal pathway connecting the retina to the visual cortex represent information about the chromatic and spatial characteristics of the retinal image. Our examination focuses particularly on individual neurons: what are their visual properties, how might these properties arise, what do these properties tell us about visual signal transformations, and how might these properties be expressed in perception? Our discussion is inclined toward studies on old-world monkeys and where possible emphasizes quantitative work that has led to or illuminates models of visual signal processing.

Quantifying the information in auditory-nerve responses for level discrimination

An analytical approach for quantifying the information in auditory-nerve (AN) fiber responses for the task of level discrimination is described. A simple analytical model for ANT responses is extended to include temporal response properties, including the nonlinear-phase effects of the cochlear amplifier. Use of simple analytical models for AN discharge patterns allows quantification of the contributions of level-dependent aspects of the patterns to level discrimination. Specifically, the individual and combined contributions of the information contained in discharge rate, synchrony, and relative phase cues are explicitly examined for level discrimination of tonal stimuli. It is shown that the rate information provided by individual AN fibers is more constrained by increases in variance with increases in rate than by saturation. As noted in previous studies, there is sufficient average-rate information within a narrow-CF region to account for robust behavioral performance over a wide dynamic range; however, there is no model based on a simple limitation or use of AN information consistent with parametric variations in performance. This issue is explored in the current study through analysis of performance based on different aspects of AN patterns. For example, we show that performance predicted from use of all rate information degrades significantly as level increases above low-medium levels, inconsistent with Weber's Law. At low frequencies, synchrony information extends the range over which behavioral performance can be explained by 10-15 dB, but only at low levels. In contrast to rate and synchrony, nonlinear-phase cues are shown to provide robust information at medium and high levels in near-CF fibers for low-frequency stimuli. The level dependence of the discharge rate and phase properties of AN fibers are influenced by the compressive nonlinearity of the inner ear. Evaluating the role of the compressive nonlinearity in level coding is important for understanding neural encoding mechanisms and because of its association with the cochlear amplifier, which is a fragile aspect of the ear believed to be affected in common forms of hearing impairment.

Representation of whispered word-final stop consonants in the auditory nerve

Recent physiological results from the auditory nerve suggest that specific response patterns for word-initial /d/ and /t/ are present across acoustic variations. In this study, single cell recordings from the auditory nerve of anesthetized chinchillas in response to the stop consonants /d/ and /t/ presented in a variety of acoustic contexts were analyzed. Consonants had variable word positions, vowel contexts, types of phonation, and speakers. The response patterns from individual auditory nerve fibers did not reliably differentiate the consonants /d/ and /t/. Global average peristimulus time histograms (GAPSTs) contained invariant patterns for all tokens of each word-final consonant, regardless of context. Ensemble responses to word-final consonants had similarities in their temporal patterns to those in GAPSTs for word-initial consonants. The similar representations in the ensemble auditory nerve response for consonants with different acoustic content suggest a possible substrate for perceptual normalization. Both invariant and variable elements of speech can be computed from the ensemble response of the auditory nerve.

Evoked otoacoustic emissions arise by two fundamentally different mechanisms: a taxonomy for mammalian OAEs

Otoacoustic emissions (OAEs) of all types are widely assumed to arise by a common mechanism: nonlinear electromechanical distortion within the cochlea. In this view, both stimulus-frequency (SFOAEs) and distortion-product emissions (DPOAEs) arise because nonlinearities in the mechanics act as "sources" of backward-traveling waves. This unified picture is tested by analyzing measurements of emission phase using a simple phenomenological description of the nonlinear re-emission process. The analysis framework is independent of the detailed form of the emission sources and the nonlinearities that produce them. The analysis demonstrates that the common assumption that SFOAEs originate by nonlinear distortion requires that SFOAE phase be essentially independent of frequency, in striking contradiction with experiment. This contradiction implies that evoked otoacoustic emissions arise by two fundamentally different mechanisms within the cochlea. These two mechanisms (linear reflection versus nonlinear distortion) are described and two broad classes of emissions--reflection-source and distortion-source emissions--are distinguished based on the mechanisms of their generation. The implications of this OAE taxonomy for the measurement, interpretation, and clinical use of otoacoustic emissions as noninvasive probes of cochlear function are discussed.

Defective auditory recognition after small hemorrhage in the inferior colliculi

We report the case of a male patient with a traumatic small hemorrhage partially involving the bilateral inferior colliculi without evidence of a temporal lobe lesion. He was unable to comprehend spoken words although he had intact speech production, reading and writing abilities. Comprehension of environmental sounds was also affected. Among the receptive musical abilities, discrimination of intensity, tone and rhythm were preserved, while recognition of melody was impaired. Audiometry showed normal thresholds for pure tone. Waves I-IV of brainstem auditory evoked potentials were elicited normally, whereas the wave V was elicited with reduced amplitude and prolonged latencies on both sides. The main component of middle latency auditory evoked potentials, which is evoked over both hemispheres by monaural stimulation to either side in normal subjects, was elicited only over the hemisphere contralateral to the ear receiving stimulation. Our patient's auditory findings were similar to those usually found in generalized auditory agnosia. Auditory agnosia is usually considered as a sign of a bitemporal cortical or subcortical disorder, but, in our patient, a brainstem disorder caused a disturbance of auditory recognition similar to auditory agnosia due to a bitemporal lesion. Our patient's auditory findings may belong to the category of a brainstem auditory-processing disorder brought on by a small hemorrhage in the inferior colliculi. In addition, the impairment in our patient implies that, in the neural processing of musical parameters, the decoding of intensity, tone and rhythm is accomplished at the level of inferior colliculus, whereas further cortical processing is necessary for the appropriate recognition of melody.

The role of the temporal coding system in the auditory cortex on speech recognition

To elucidate the temporal coding system for speech recognition, we synthesized stimulation sounds which do not contain formant information but do contain temporal information by transforming original sound wave to click sequences. Using this stimulation sound, we performed a recognition test and used PET to examine the cortical activities in normal subjects listening to this sound. The results of the recognition test showed a good perception of the sounds made from sequential speech. The PET study demonstrated significant activation of the superior temporal gyri while listening to the stimulation speech sounds. Our results imply that these stimulation sounds were processed semantically in the auditory cortices. The temporal processing system is thought to make an important contribution to speech recognition.

Multi-unit mapping of acoustic stimuli in gerbil inferior colliculus

Multi-unit peristimulus time (MU-PST) histograms were recorded in the gerbil inferior colliculus (IC) in response to tone burst stimuli. Histograms were collected every 100 microns as the recording electrode was advanced along the tonotopic axis of the central nucleus of the IC. Space/time maps of neural activity were constructed from these data. In most of our sample the pattern of response changed systematically as the stimulating frequency was increased in octave steps. At low frequencies (< 500 Hz) the pattern of response was broadly distributed spatially and phase-locked to the stimulus frequency. At higher frequencies (> 1 kHz) the pattern of response was more localized and showed no evidence of phase locking. The location of the maximum response to tones from 1 to 32 kHz moved ventrally along the tonotopic axis at an approximate rate of 230 microns/stimulus octave. The patterns of response were localized near stimulus threshold and spread over a larger region as level increased. This method of collecting and displaying multi-unit response maps provides an overview of ensemble activity that allows concurrent observation of spatial and temporal variations in activity patterns. The quantitative analysis of components of MU-PST Maps are consistent with trends illustrated with single-unit tuning and level functions. This perspective of IC activity suggests potential processing mechanisms that are congruent with single-unit reconstructions.

The cochlear place-frequency map of the adult and developing Mongolian gerbil

Gerbils are frequently used in auditory research; however, only limited information on the exact frequency representation in the cochlea is available. Therefore the place-frequency map of the gerbil was determined by iontophoretic application of horseradish peroxidase in physiologically characterized single auditory nerve fibers. Locations of the labeled nerve fibers at the inner hair cells were determined from a '3-dimensional' reconstruction of the cochleae. The map was established for frequencies between 0.3 and 31.9 kHz. As in other mammals, a baso-apical frequency gradient from high to low frequencies was found. The slope of the place-frequency map amounted to 1.5 mm/octave for higher frequencies. Below 4 kHz the slope decreased to a value of 1 mm/octave at 0.5 kHz. A shift in the frequency map occurs during cochlear maturation. The place-frequency map in subadult gerbils (18 days after birth) is shifted by a distance corresponding to an octave, at least for frequencies above 6 kHz.

Discharge pattern in the auditory nerve evoked by vowel stimuli: a comparison between acoustical and electrical stimulation

Single channel cochlear implants only transmit the time structure of the electrically coded input signal. All nerve fibres show similar thresholds for monopolar round window stimulation, i.e., activation does not depend on their site of origin. To investigate the fine structure of the firing pattern elicited by stimulation with an analogue coded speech processing system (VIENNA 1-channel implant), cats were electrically stimulated with German steady-state vowels at the round window. Single fibre activity was recorded from primary auditory fibres and period histograms were calculated. The electrically evoked impulse patterns were compared with those from acoustic stimulation with the same vowels. With acoustic stimulation, the response of a fibre depends on the individual characteristic frequency (CF) with regard to the fundamental F0 and the formants F1, F2 and F3 of the vowels, the spontaneous activity of the fibre and the sound level. The evoked firing pattern was used to calculate period histograms, the frequency content of which was analysed by Fourier transformation. With electrical stimulation in the threshold range, an action potential is strongly synchronized to a cathodic peak of the current within one period of F0. With increasing current level 3-5 impulses can be locked to the same period. The timing of the short intervals is determined by the relative refractory period and current peaks (negative or positive) caused by the dominant higher formant F2 or F3. The acoustically evoked patterns are specific for the CF of the neuron and represent the spectral information of the different vowels.(ABSTRACT TRUNCATED AT 250 WORDS)

Wiener and Volterra analyses applied to the auditory system

The application of a particular branch of non-linear system analysis, the functional series expansion or integral method, to the auditory system is reviewed. Both the Volterra and Wiener approach are discussed and an extension of the Wiener method from its traditional white-noise stimulus approach to that of Poisson distributed clicks is presented. This type of analysis has been applied to compound and single-unit responses from the auditory nerve, cochlear nucleus, auditory midbrain and medial geniculate body. Most studies have estimated only first-order Wiener kernels but in recent years second-order Wiener and Volterra kernels have been estimated, particularly with reference to dynamic non-linearities. A particular form of second-order analysis, the Spectro Temporal Receptive Field, offers an alternative to first-order cross-correlation when phase-lock is absent. The correlation method has revealed that neural synchronization is less affected by intensity changes and damage to the hair cells than is neural firing rate. Although the presence of the static cochlear non-linearity could be demonstrated on the basis of the intensity dependence of the first-order Wiener kernel, the identification of the exact form of the nonlinearity of the peripheral auditory system on basis of higher-order Wiener kernels has so far been inconclusive. However, successes of the method can be found in the description of the dynamic non-linearities and non-linear neural interactions.

Silicon modeling of pitch perception

We have designed and tested an integrated circuit that models human pitch perception. The chip receives as input a time-varying voltage corresponding to sound pressure at the ear and produces as output a map of perceived pitch. The chip is a physiological model; subcircuits on the chip correspond to known and proposed structures in the auditory system. Chip output approximates human performance in response to a variety of classical pitch-perception stimuli. The 125,000-transistor chip computes all outputs in real time by using analog continuous-time processing.

Physiological properties of the electrically stimulated auditory nerve. I. Compound action potential recordings

The electrically evoked compound action potential (CAP) of the auditory nerve exhibits two peaks, termed N0, at 350 microseconds latency, and N1, at 550 microseconds latency. At low stimulus intensities the CAP consists solely of the long latency N1 peak. As the stimulus strength is increased the higher threshold N0 appears. At high stimulus intensities N1 disappears and only the N0 component of the CAP remains. It is postulated that N1 represents action potentials propagated from the dendritic processes of the auditory neurons and that N0 represents action potentials initiated on the axons of these cells. The N1 peak exhibits anomalous refractory behavior which can be identified in the electrically evoked auditory brainstem response (EABR). That behavior may be useful diagnostically in assessing the extent of dendrite degeneration in cochlear implant candidates and users.

Discharge patterns of cat primary auditory fibers with electrical stimulation of the cochlea

Intact and destroyed cat cochleae were electrically stimulated through round window electrodes. Intact cochleae provided information about fiber properties with acoustic stimuli. With sinusoidal currents thresholds for synchronization were 4-68 microA rms. Thresholds were independent of the fiber's characteristic frequencies and thus of their places of origin in the intact cochleae. This shows large current spread. Phase-locking of the responses to electric stimulation was much stronger than it was to acoustic stimulation. Destroyed cochleae had no spontaneous activity and showed even stronger phase-locking. Thresholds obtained using 0.2 ms per phase biphasic pulse stimuli were 60-350 microApp. Action potentials were found to be released with as little as 0.3 ms latency. The neuronal responses to any electric stimulus differed considerably from the responses to corresponding acoustic stimuli. Vestibular fibers were easily activated by electric stimulation.

Frequency selectivity of phase-locking of complex sounds in the auditory nerve of the rat

Frequency selectivity of single auditory nerve fibers in the auditory nerve of the rat was studied using pseudorandom noise as the stimulus. The noise was lowpass filtered ternary m-sequences. Period histograms of the discharges of single auditory nerve fibers, locked to the periodicity of the noise, were cross-correlated with one period of the noise to obtain estimates of the impulse response. These cross-correlograms were subsequently Fourier transformed to obtain estimates of the frequency transfer functions. Earlier results obtained using noise that was based on binary sequences as the stimulus showed a systematic dependence on stimulus intensity of the bandwidth and center frequency of the computer transfer functions. The results of the present study confirmed this dependence and showed that a linear model based upon first-order cross-correlations fit the histograms of response. It is concluded that phase-locked activity of single auditory nerve fibers accurately reproduces the half-wave rectified motion of the basilar membrane over a large range of sound intensities.

Use of pseudorandom noise in studies of frequency selectivity: the periphery of the auditory system

Frequency selectivity of single auditory nerve fibers in the rat was studied using pseudorandom noise based on ternary m-sequences as the stimulus, and the results were compared to those of earlier studies in which noise based on binary m-sequences was used. Pseudorandom noise based on ternary m-sequences has fewer anomalies than noise based on binary m-sequences. Detailed tests using linear and nonlinear filters showed that the present method provides accurate measures of bandwidth and center frequency. Period histograms of the response, locked to the periodicity of the noise, were cross-correlated with one period of the noise to obtain estimates of the impulse response function of the peripheral auditory system. Fourier transforms of these cross-correlograms were used as estimates of the filter function of single auditory nerve fibers. The results obtained using ternary noise were not different from previous results showing a downward shift in center frequency and increase in bandwidth with increasing stimulus intensity for fibers with center frequencies between 1000 and 5000 Hz. The difference between spectral selectivity based on phase-locked responses and that based on discharge rate is discussed.

Auditory-nerve fiber responses to tones in a noise masker

The phase-locked responses of single auditory-nerve fibers were measured for a continuous tonal stimulus presented in a noise background. The response amplitude, the primary Fourier component of the period histogram, was found to be dependent on the relative levels of the noise and tone. Different noise-to-tone level ration resulted in quite different response amplitude; changing overall level keeping noise-to-tone constant (constant dB difference) provided little change in response. With transient stimuli, phase-locked response to the tone at noise onset was consistently greater than to a tone presented during the steady-state noise exposure. When responses were normalized to the average rate, the difference between onset and steady-state responses were not clearcut.