Improving virtual channel discrimination in a multi-channel context

How to vocode: Using channel vocoders for cochlear-implant research

The channel vocoder has become a useful tool to understand the impact of specific forms of auditory degradation-particularly the spectral and temporal degradation that reflect cochlear-implant processing. Vocoders have many parameters that allow researchers to answer questions about cochlear-implant processing in ways that overcome some logistical complications of controlling for factors in individual cochlear implant users. However, there is such a large variety in the implementation of vocoders that the term "vocoder" is not specific enough to describe the signal processing used in these experiments. Misunderstanding vocoder parameters can result in experimental confounds or unexpected stimulus distortions. This paper highlights the signal processing parameters that should be specified when describing vocoder construction. The paper also provides guidance on how to determine vocoder parameters within perception experiments, given the experimenter's goals and research questions, to avoid common signal processing mistakes. Throughout, we will assume that experimenters are interested in vocoders with the specific goal of better understanding cochlear implants.

Combining Place and Rate of Stimulation Improves Frequency Discrimination in Cochlear Implant Users

In the auditory system, frequency is represented as tonotopic and temporal response properties of the auditory nerve. While these response properties are inextricably linked in normal hearing, cochlear implants can separately excite tonotopic location and temporal synchrony using different electrodes and stimulation rates, respectively. This separation allows for the investigation of the contributions of tonotopic and temporal cues for frequency discrimination. The present study examines frequency discrimination in adult cochlear implant users as conveyed by electrode position and stimulation rate, separately and combined. The working hypothesis is that frequency discrimination is better provided by place and rate cues combined compared to either cue alone. This hypothesis was tested in two experiments. In the first experiment, frequency discrimination needed for melodic contour identification was measured for frequencies near 100, 200, and 400 Hz using frequency allocation modeled after clinical processors. In the second experiment, frequency discrimination for pitch ranking was measured for frequencies between 100 and 1600 Hz using an experimental frequency allocation designed to provide better access to place cues. The results of both experiments indicate that frequency discrimination is better with place and rate cues combined than with either cue alone. These results clarify how signal processing for cochlear implants could better encode frequency into place and rate of electrical stimulation. Further, the results provide insight into the contributions of place and rate cues for pitch.

Hybrid optogenetic and electrical stimulation for greater spatial resolution and temporal fidelity of cochlear activation

OBJECTIVE

Compared to electrical stimulation, optogenetic stimulation has the potential to improve the spatial precision of neural activation in neuroprostheses, but it requires intense light and has relatively poor temporal kinetics. We tested the effect of hybrid stimulation, which is the combination of subthreshold optical and electrical stimuli, on spectral and temporal fidelity in the cochlea by recording multiunit activity in the inferior colliculus of channelrhodopsin (H134R variant) transgenic mice.

APPROACH

Pulsed light or biphasic electrical pulses were delivered to cochlear spiral ganglion neurons of acutely deafened mice, either as individual stimuli or as hybrid stimuli for which the timing of the electrical pulse had a varied delay relative to the start of the optical pulse. Response thresholds, spread of activation and entrainment data were obtained from multi-unit recordings from the auditory midbrain.

MAIN RESULTS

Facilitation occurred when subthreshold electrical stimuli were applied at the end of, or up to 3.75 ms after subthreshold optical pulses. The spread of activation resulting from hybrid stimulation was significantly narrower than electrical-only and optical-only stimulation (p < 0.01), measured at equivalent suprathreshold levels of loudness that are relevant to cochlear implant users. Furthermore, temporal fidelity, measured as maximum following rates to 300 ms pulse trains bursts up to 240 Hz, was 2.4-fold greater than optical-only stimulation (p < 0.05).

SIGNIFICANCE

By significantly improving spectral resolution of electrical- and optical-only stimulation and the temporal fidelity of optical-only stimulation, hybrid stimulation has the potential to increase the number of perceptually independent stimulating channels in a cochlear implant.

Dynamic Current Focusing: A Novel Approach to Loudness Coding in Cochlear Implants

OBJECTIVES

In an attempt to improve spectral resolution and speech intelligibility, several current focusing methods have been proposed to increase spatial selectivity by decreasing intracochlear current spread. For example, tripolar stimulation administers current to a central electrode and uses the two flanking electrodes as the return pathway, creating a narrower intracochlear electrical field and hence increases spectral resolution when compared with monopolar (MP) stimulation. However, more current is required, and in some patients, specifically the ones with high electrode impedances, full loudness growth cannot be supported because of compliance limits. The present study describes and analyses a new loudness encoding approach that uses tripolar stimulation near threshold and gradually broadens the excitation (by decreasing compensation coefficient σ) to increase loudness without the need to increase overall current. It is hypothesized that this dynamic current focusing (DCF) strategy increases spatial selectivity, especially at lower loudness levels, while maintaining maximum selectivity at higher loudness levels, without reaching compliance limits.

DESIGN

Eleven adult cochlear implant recipients with postlingual hearing loss, with at least 9 months of experience with their HiRes90K implant, were selected to participate in this study. Baseline performance regarding speech intelligibility in noise (Dutch matrix sentence test), spectral ripple discrimination at 45 and 65 dB, and temporal modulation detection thresholds were assessed using their own clinical program, fitted on a Harmony processor. Subsequently, the DCF strategy was fitted on a research Harmony processor. Threshold levels were determined with σ = 0.8, which means 80% of current is returned to the flanking electrodes and the remaining 20% to the extracochlear ground electrode. Instead of increasing overall pulse magnitude, σ was decreased to determine most comfortable loudness. After 2 to 3 hr of adaptation to the research strategy, the same psychophysical measures were taken.

RESULTS

At 45 dB, average spectral ripple scores improved significantly from 2.4 ripples per octave with their clinical program to 3.74 ripples per octave with the DCF strategy (p = 0.016). Eight out of 11 participants had an improved spectral resolution at 65 dB. Nevertheless, no significant difference between DCF and MP was observed at higher presentation levels. Both speech-in-noise and temporal modulation detection thresholds were equal for MP and DCF strategies. Subjectively, 2 participants preferred the DCF strategy over their own clinical program, 2 preferred their own strategy, while the majority of the participants had no preference. Battery life was decreased and ranged from 1.5 to 4 hr.

CONCLUSIONS

The DCF strategy gives better spectral resolution, at lower loudness levels, but equal performance on speech tests. These outcomes warrant for a longer adaptation period to study long-term outcomes and evaluate if the outcomes in the ripple tests transfer to the speech scores. Further research, for example, with respect to fitting rules and reduction of power consumption, is necessary to make the DCF strategy suitable for routine clinical application.

Use of Research Interfaces for Psychophysical Studies With Cochlear-Implant Users

A growing number of laboratories are using research interfaces to conduct experiments with cochlear-implant (CI) users. Because these interfaces bypass a subject’s clinical sound processor, several concerns exist regarding safety and stimulation levels. Here we suggest best-practice approaches for how to safely and ethically perform this type of research and highlight areas of limited knowledge where further research is needed to help clarify safety limits. The article is designed to provide an introductory level of technical detail about the devices and the effects of electrical stimulation on perception and neurophysiology. From this, we summarize what should be the best practices in the field, based on the literature and our experience. Findings from the review of the literature suggest that there are three main safety concerns: (a) to prevent biological or neural damage, (b) to avoid presentation of uncomfortably loud sounds, and (c) to ensure that subjects have control over stimulus presentation. Researchers must pay close attention to the software–hardware interface to ensure that the three main safety concerns are closely monitored. An important area for future research will be the determination of the amount of biological damage that can occur from electrical stimulation from a CI placed in the cochlea, not in direct contact with neural tissue. As technology used in research with CIs evolve, some of these approaches may change. However, the three main safety principles outlined here are not anticipated to undergo change with technological advances.

A polydopamine peptide coating enables adipose-derived stem cell growth on the silicone surface of cochlear implant electrode arrays

The simultaneous application of neurotrophic factors with cochlear implantation is proposed to enhance the bioelectrical interface between electrodes and auditory neurons, and thus improve speech intelligibility in patients with cochlear implants (CIs). In cell-based approaches, the goal is to colonize CIs with cells producing neurotrophic factors. This study aims to evaluate whether a polydopamine (PD) functionalization of the hydrophobic silicone surface of the electrode carrier enables colonization of adipose-derived stem cells known to deliver neurotrophic factors. Surface characteristics of PD-coated silicone samples and electrode carriers were determined, and the proliferation and viability of adipose-derived stem cells (ASCs) on these surfaces were subsequently analyzed. A homogenous PD coating and cell growth with regular morphology was observed on coated silicone samples and electrode arrays. Hydrophilicity and cell viability was significantly enhanced by PD surface modification. Insertion forces of coated electrode arrays did not increase compared with untreated CIs. Hence, PD coating of the silicone surface of CIs might allow for sufficient colonization with ASCs as a continuous source of neurotrophic factors. © 2017 Wiley Periodicals, Inc. J Biomater Res Part A: 106B: 1431-1438, 2018.

Recovery from forward masking in cochlear implant listeners depends on stimulation mode, level, and electrode location

Psychophysical recovery from forward masking was measured in adult cochlear implant users of Cochlear^TM and Advanced Bionics^TM devices, in monopolar and in focused (bipolar and tripolar) stimulation modes, at four electrode sites across the arrays, and at two levels (loudness balanced across modes and electrodes). Results indicated a steeper psychophysical recovery from forward masking in monopolar over bipolar and tripolar modes, modified by differential effects of electrode and level. The interactions between factors varied somewhat across devices. It is speculated that psychophysical recovery from forward masking may be driven by different populations of neurons in the different modes, with a broader stimulation pattern resulting in a greater likelihood of response by healthier and/or faster-recovering neurons within the stimulated population. If a more rapid recovery from prior stimulation reflects responses of neurons not necessarily close to the activating site, the spectral pattern of the incoming acoustic signal may be distorted. These results have implications for speech processor implementations using different degrees of focusing of the electric field. The primary differences in the shape of the recovery function were observed in the earlier portion (between 2 and 45 ms) of recovery, which is significant in terms of the speech envelope.

Interleaved Processors Improve Cochlear Implant Patients' Spectral Resolution

OBJECTIVE

Cochlear implant patients have difficulty in noisy environments, in part, because of channel interaction. Interleaving the signal by sending every other channel to the opposite ear has the potential to reduce channel interaction by increasing the space between channels in each ear. Interleaving still potentially provides the same amount of spectral information when the two ears are combined. Although this method has been successful in other populations such as hearing aid users, interleaving with cochlear implant patients has not yielded consistent benefits. This may be because perceptual misalignment between the two ears, and the spacing between stimulation locations must be taken into account before interleaving.

DESIGN

Eight bilateral cochlear implant users were tested. After perceptually aligning the two ears, 12-channel maps were made that spanned the entire aligned portions of the array. Interleaved maps were created by removing every other channel from each ear. Participants' spectral resolution and localization abilities were measured with perceptually aligned processing strategies both with and without interleaving.

RESULTS

There was a significant improvement in spectral resolution with interleaving. However, there was no significant effect of interleaving on localization abilities.

CONCLUSIONS

The results indicate that interleaving can improve cochlear implant users' spectral resolution. However, it may be necessary to perceptually align the two ears and/or use relatively large spacing between stimulation locations.

Loudness and pitch perception using Dynamically Compensated Virtual Channels

Reducing power consumption is important for the development of smaller cochlear implant (CI) speech processors. Simultaneous electrode stimulation may improve power efficiency by minimizing the required current applied to a given electrode. Simultaneous in-phase stimulation on adjacent electrodes (i.e. virtual channels) can be used to elicit pitch percepts intermediate to the ones provided by each of the physical electrodes in isolation. Virtual channels are typically implemented in monopolar stimulation mode, producing broad excitation patterns. Focused stimulation may reduce the excitation patterns, but is inefficient in terms of power consumption. To create a more power efficient virtual channel, we developed the Dynamically Compensated Virtual Channel (DC-VC) using four adjacent electrodes. The two central electrodes are current steered using the coefficient α (0<α<1 ) whereas the two flanking electrodes are used to focus/unfocus the stimulation with the coefficient σ (-1<σ<1). With increasing values of σ, power can be saved at the potential expense of generating broader electric fields. Additionally, reshaping the electric fields might also alter place pitch coding. The goal of the present study is to investigate the tradeoff between place pitch encoding and power savings using simultaneous electrode stimulation in the DC-VC configuration. A computational model and psychophysical experiments in CI users have been used for that purpose. Results from 10 adult Advanced Bionics CI users have been collected. Results show that the required current to produce comfortable levels is significantly reduced with increasing σ as predicted by the computational model. Moreover, no significant differences in the estimated number of discriminable steps were detected for the different values of σ. From these results, we conclude that DC-VCs can reduce power consumption without decreasing the number of discriminable place pitch steps.

Perceptual Spaces Induced by Cochlear Implant All-Polar Stimulation Mode

It has been argued that a main limitation of the cochlear implant is the spread of current induced by each electrode, which activates an inappropriately large range of sensory neurons. To reduce this spread, an alternative stimulation mode, the all-polar mode, was tested with five participants. It was designed to activate all the electrodes simultaneously with appropriate current levels and polarities to recruit narrower regions of auditory nerves at specific intracochlear electrode positions (denoted all-polar electrodes). In this study, the all-polar mode was compared with the current commercial stimulation mode: the monopolar mode. The participants were asked to judge the sound dissimilarity between pairs of two-electrode pulse-train stimuli that differed in the electrode positions and were presented in either monopolar or all-polar mode with pulses on the two electrodes presented either sequentially or simultaneously. The dissimilarity ratings were analyzed using a multidimensional scaling technique and three-dimensional stimulus perceptual spaces were produced. For all the conditions (mode and simultaneity), the first perceptual dimension was highly correlated with the position of the most apical activated electrode of the electrical stimulation and the second dimension with the position of the most basal electrode. In both sequential and simultaneous conditions, the monopolar and all-polar stimuli were significantly separated by a third dimension, which may indicate that all-polar stimuli have a perceptual quality that differs from monopolar stimuli. Overall, the results suggest that both modes might successfully represent spectral information in a sound processing strategy.

Reduction in spread of excitation from current focusing at multiple cochlear locations in cochlear implant users

Channel interaction from a broad spread of excitation is likely to be a limiting factor in performance by cochlear implant users. Although partial tripolar stimulation has been shown to reduce spread of excitation, the magnitude of the reduction is highly variable across subjects. Because the reduction in spread of excitation is typically only measured at one electrode for a given subject, the degree of variability across cochlear locations is unknown. The first goal of the present study was to determine if the reduction in spread of excitation observed from partial tripolar current focusing systematically varies across the cochlea. The second goal was to measure the variability in reduction of spread of excitation relative to monopolar stimulation across the cochlea. The third goal was to expand upon previous results that suggest that scaling of verbal descriptors can be used to predict the reduction in spread of excitation, by increasing the limited number of sites previously evaluated and verify the relationships remain with the larger dataset. The spread of excitation for monopolar and partial tripolar stimulation was measured at 5 cochlear locations using a psychophysical forward masking task. Results of the present study suggest that although partial tripolar stimulation typically reduces spread of excitation, the degree of reduction in spread of excitation was found to be highly variable and no effect of cochlear location was found. Additionally, subjective scaling of certain verbal descriptors (Clean/Dirty, Pure/Noisy) correlated with the reduction in spread of excitation suggesting sound quality scaling might be used as a quick clinical estimate of channels providing a reduction in spread of excitation. This quick scaling technique might help clinicians determine which patients would be most likely to benefit from a focused strategy.

Auditory implant research at the House Ear Institute 1989-2013

The House Ear Institute (HEI) had a long and distinguished history of auditory implant innovation and development. Early clinical innovations include being one of the first cochlear implant (CI) centers, being the first center to implant a child with a cochlear implant in the US, developing the auditory brainstem implant, and developing multiple surgical approaches and tools for Otology. This paper reviews the second stage of auditory implant research at House - in-depth basic research on perceptual capabilities and signal processing for both cochlear implants and auditory brainstem implants. Psychophysical studies characterized the loudness and temporal perceptual properties of electrical stimulation as a function of electrical parameters. Speech studies with the noise-band vocoder showed that only four bands of tonotopically arrayed information were sufficient for speech recognition, and that most implant users were receiving the equivalent of 8-10 bands of information. The noise-band vocoder allowed us to evaluate the effects of the manipulation of the number of bands, the alignment of the bands with the original tonotopic map, and distortions in the tonotopic mapping, including holes in the neural representation. Stimulation pulse rate was shown to have only a small effect on speech recognition. Electric fields were manipulated in position and sharpness, showing the potential benefit of improved tonotopic selectivity. Auditory training shows great promise for improving speech recognition for all patients. And the Auditory Brainstem Implant was developed and improved and its application expanded to new populations. Overall, the last 25 years of research at HEI helped increase the basic scientific understanding of electrical stimulation of hearing and contributed to the improved outcomes for patients with the CI and ABI devices. This article is part of a Special Issue entitled .

Optogenetic stimulation of the auditory nerve

Direct electrical stimulation of spiral ganglion neurons (SGNs) by cochlear implants (CIs) enables open speech comprehension in the majority of implanted deaf subjects(1-) (6). Nonetheless, sound coding with current CIs has poor frequency and intensity resolution due to broad current spread from each electrode contact activating a large number of SGNs along the tonotopic axis of the cochlea(7-) (9). Optical stimulation is proposed as an alternative to electrical stimulation that promises spatially more confined activation of SGNs and, hence, higher frequency resolution of coding. In recent years, direct infrared illumination of the cochlea has been used to evoke responses in the auditory nerve(10). Nevertheless it requires higher energies than electrical stimulation(10,11) and uncertainty remains as to the underlying mechanism(12). Here we describe a method based on optogenetics to stimulate SGNs with low intensity blue light, using transgenic mice with neuronal expression of channelrhodopsin 2 (ChR2)(13) or virus-mediated expression of the ChR2-variant CatCh(14). We used micro-light emitting diodes (µLEDs) and fiber-coupled lasers to stimulate ChR2-expressing SGNs through a small artificial opening (cochleostomy) or the round window. We assayed the responses by scalp recordings of light-evoked potentials (optogenetic auditory brainstem response: oABR) or by microelectrode recordings from the auditory pathway and compared them with acoustic and electrical stimulation.

Sensitivity to pulse phase duration in cochlear implant listeners: effects of stimulation mode

The objective of this study was to investigate charge-integration at threshold by cochlear implant listeners using pulse train stimuli in different stimulation modes (monopolar, bipolar, tripolar). The results partially confirmed and extended the findings of previous studies conducted in animal models showing that charge-integration depends on the stimulation mode. The primary overall finding was that threshold vs pulse phase duration functions had steeper slopes in monopolar mode and shallower slopes in more spatially restricted modes. While the result was clear-cut in eight users of the Cochlear Corporation(TM) device, the findings with the six user of the Advanced Bionics(TM) device who participated were less consistent. It is likely that different stimulation modes excite different neuronal populations and/or sites of excitation on the same neuron (e.g., peripheral process vs central axon). These differences may influence not only charge integration but possibly also temporal dynamics at suprathreshold levels and with more speech-relevant stimuli. Given the present interest in focused stimulation modes, these results have implications for cochlear implant speech processor design and protocols used to map acoustic amplitude to electric stimulation parameters.

Electrode spanning with partial tripolar stimulation mode in cochlear implants

The perceptual effects of electrode spanning (i.e., the use of nonadjacent return electrodes) in partial tripolar (pTP) mode were tested on a main electrode EL8 in five cochlear implant (CI) users. Current focusing was controlled by σ (the ratio of current returned within the cochlea), and current steering was controlled by α (the ratio of current returned to the basal electrode). Experiment 1 tested whether asymmetric spanning with α = 0.5 can create additional channels around standard pTP stimuli. It was found that in general, apical spanning (i.e., returning current to EL6 rather than EL7) elicited a pitch between those of standard pTP stimuli on main electrodes EL8 and EL9, while basal spanning (i.e., returning current to EL10 rather than EL9) elicited a pitch between those of standard pTP stimuli on main electrodes EL7 and EL8. The pitch increase caused by apical spanning was more salient than the pitch decrease caused by basal spanning. To replace the standard pTP channel on the main electrode EL8 when EL7 or EL9 is defective, experiment 2 tested asymmetrically spanned pTP stimuli with various α, and experiment 3 tested symmetrically spanned pTP stimuli with various σ. The results showed that pitch increased with decreasing α in asymmetric spanning, or with increasing σ in symmetric spanning. Apical spanning with α around 0.69 and basal spanning with α around 0.38 may both elicit a similar pitch as the standard pTP stimulus. With the same σ, the symmetrically spanned pTP stimulus was higher in pitch than the standard pTP stimulus. A smaller σ was thus required for symmetric spanning to match the pitch of the standard pTP stimulus. In summary, electrode spanning is an effective field-shaping technique that is useful for adding spectral channels and handling defective electrodes with CIs.

Optogenetic stimulation of the auditory pathway

Auditory prostheses can partially restore speech comprehension when hearing fails. Sound coding with current prostheses is based on electrical stimulation of auditory neurons and has limited frequency resolution due to broad current spread within the cochlea. In contrast, optical stimulation can be spatially confined, which may improve frequency resolution. Here, we used animal models to characterize optogenetic stimulation, which is the optical stimulation of neurons genetically engineered to express the light-gated ion channel channelrhodopsin-2 (ChR2). Optogenetic stimulation of spiral ganglion neurons (SGNs) activated the auditory pathway, as demonstrated by recordings of single neuron and neuronal population responses. Furthermore, optogenetic stimulation of SGNs restored auditory activity in deaf mice. Approximation of the spatial spread of cochlear excitation by recording local field potentials (LFPs) in the inferior colliculus in response to suprathreshold optical, acoustic, and electrical stimuli indicated that optogenetic stimulation achieves better frequency resolution than monopolar electrical stimulation. Virus-mediated expression of a ChR2 variant with greater light sensitivity in SGNs reduced the amount of light required for responses and allowed neuronal spiking following stimulation up to 60 Hz. Our study demonstrates a strategy for optogenetic stimulation of the auditory pathway in rodents and lays the groundwork for future applications of cochlear optogenetics in auditory research and prosthetics.

Improving speech perception in noise with current focusing in cochlear implant users

Cochlear implant (CI) users typically have excellent speech recognition in quiet but struggle with understanding speech in noise. It is thought that broad current spread from stimulating electrodes causes adjacent electrodes to activate overlapping populations of neurons which results in interactions across adjacent channels. Current focusing has been studied as a way to reduce spread of excitation, and therefore, reduce channel interactions. In particular, partial tripolar stimulation has been shown to reduce spread of excitation relative to monopolar stimulation. However, the crucial question is whether this benefit translates to improvements in speech perception. In this study, we compared speech perception in noise with experimental monopolar and partial tripolar speech processing strategies. The two strategies were matched in terms of number of active electrodes, microphone, filterbanks, stimulation rate and loudness (although both strategies used a lower stimulation rate than typical clinical strategies). The results of this study showed a significant improvement in speech perception in noise with partial tripolar stimulation. All subjects benefited from the current focused speech processing strategy. There was a mean improvement in speech recognition threshold of 2.7 dB in a digits in noise task and a mean improvement of 3 dB in a sentences in noise task with partial tripolar stimulation relative to monopolar stimulation. Although the experimental monopolar strategy was worse than the clinical, presumably due to different microphones, frequency allocations and stimulation rates, the experimental partial-tripolar strategy, which had the same changes, showed no acute deficit relative to the clinical.