Biasing the Perception of Spoken Words with Transcranial Alternating Current Stimulation

Neural tracking of continuous acoustics: properties, speech-specificity and open questions

Human speech is a particularly relevant acoustic stimulus for our species, due to its role of information transmission during communication. Speech is inherently a dynamic signal, and a recent line of research focused on neural activity following the temporal structure of speech. We review findings that characterise neural dynamics in the processing of continuous acoustics and that allow us to compare these dynamics with temporal aspects in human speech. We highlight properties and constraints that both neural and speech dynamics have, suggesting that auditory neural systems are optimised to process human speech. We then discuss the speech-specificity of neural dynamics and their potential mechanistic origins and summarise open questions in the field.

Neurocognitive, physiological, and biophysical effects of transcranial alternating current stimulation

Transcranial alternating current stimulation (tACS) can modulate human neural activity and behavior. Accordingly, tACS has vast potential for cognitive research and brain disorder therapies. The stimulation generates oscillating electric fields in the brain that can bias neural spike timing, causing changes in local neural oscillatory power and cross-frequency and cross-area coherence. tACS affects cognitive performance by modulating underlying single or nested brain rhythms, local or distal synchronization, and metabolic activity. Clinically, stimulation tailored to abnormal neural oscillations shows promising results in alleviating psychiatric and neurological symptoms. We summarize the findings of tACS mechanisms, its use for cognitive applications, and novel developments for personalized stimulation.

Speech listening entails neural encoding of invisible articulatory features

Speech processing entails a complex interplay between bottom-up and top-down computations. The former is reflected in the neural entrainment to the quasi-rhythmic properties of speech acoustics while the latter is supposed to guide the selection of the most relevant input subspace. Top-down signals are believed to originate mainly from motor regions, yet similar activities have been shown to tune attentional cycles also for simpler, non-speech stimuli. Here we examined whether, during speech listening, the brain reconstructs articulatory patterns associated to speech production. We measured electroencephalographic (EEG) data while participants listened to sentences during the production of which articulatory kinematics of lips, jaws and tongue were also recorded (via Electro-Magnetic Articulography, EMA). We captured the patterns of articulatory coordination through Principal Component Analysis (PCA) and used Partial Information Decomposition (PID) to identify whether the speech envelope and each of the kinematic components provided unique, synergistic and/or redundant information regarding the EEG signals. Interestingly, tongue movements contain both unique as well as synergistic information with the envelope that are encoded in the listener's brain activity. This demonstrates that during speech listening the brain retrieves highly specific and unique motor information that is never accessible through vision, thus leveraging audio-motor maps that arise most likely from the acquisition of speech production during development.

Reliable estimation of internal oscillator properties from a novel, fast-paced tapping paradigm

Rhythmic structure in speech, music, and other auditory signals helps us track, anticipate, and understand the sounds in our environment. The dynamic attending framework proposes that biological systems possess internal rhythms, generated via oscillatory mechanisms, that synchronize with (entrain to) rhythms in the external world. Here, we focused on two properties of internal oscillators: preferred rate, the default rate of an oscillator in the absence of any input, and flexibility, the oscillator's ability to adapt to changes in external rhythmic context. We aimed to develop methods that can reliably estimate preferred rate and flexibility on an individual basis. The experiment was a synchronization-continuation finger tapping paradigm with a unique design: the stimulus rates were finely sampled over a wide range of rates and were presented only once. Individuals tapped their finger to 5-event isochronous stimulus sequences and continued the rhythm at the same pace. Preferred rate was estimated by assessing the best-performance conditions where the difference between the stimulus rate and continuation tapping rate (tempo-matching error) was minimum. The results revealed harmonically related, multiple preferred rates for each individual. We maximized the differences in stimulus rate between consecutive trials to challenge individuals' flexibility, which was then estimated by how much tempo-matching errors in synchronization tapping increase with this manipulation. Both measures showed test-retest reliability. The findings demonstrate the influence of properties of the auditory context on rhythmic entrainment, and have implications for development of methods that can improve attentional synchronization and hearing.

Encoding speech rate in challenging listening conditions: White noise and reverberation

Temporal contrasts in speech are perceived relative to the speech rate of the surrounding context. That is, following a fast context sentence, listeners interpret a given target sound as longer than following a slow context, and vice versa. This rate effect, often referred to as "rate-dependent speech perception," has been suggested to be the result of a robust, low-level perceptual process, typically examined in quiet laboratory settings. However, speech perception often occurs in more challenging listening conditions. Therefore, we asked whether rate-dependent perception would be (partially) compromised by signal degradation relative to a clear listening condition. Specifically, we tested effects of white noise and reverberation, with the latter specifically distorting temporal information. We hypothesized that signal degradation would reduce the precision of encoding the speech rate in the context and thereby reduce the rate effect relative to a clear context. This prediction was borne out for both types of degradation in Experiment 1, where the context sentences but not the subsequent target words were degraded. However, in Experiment 2, which compared rate effects when contexts and targets were coherent in terms of signal quality, no reduction of the rate effect was found. This suggests that, when confronted with coherently degraded signals, listeners adapt to challenging listening situations, eliminating the difference between rate-dependent perception in clear and degraded conditions. Overall, the present study contributes towards understanding the consequences of different types of listening environments on the functioning of low-level perceptual processes that listeners use during speech perception.

High Gamma and Beta Temporal Interference Stimulation in the Human Motor Cortex Improves Motor Functions

Background: Temporal interference (TI) stimulation is a new technique of non-invasive brain stimulation. Envelope-modulated waveforms with two high-frequency carriers can activate neurons in target brain regions without stimulating the overlying cortex, which has been validated in mouse brains. However, whether TI stimulation can work on the human brain has not been elucidated.

Objective: To assess the effectiveness of the envelope-modulated waveform of TI stimulation on the human primary motor cortex (M1).

Methods: Participants attended three sessions of 30-min TI stimulation during a random reaction time task (RRTT) or a serial reaction time task (SRTT). Motor cortex excitability was measured before and after TI stimulation.

Results: In the RRTT experiment, only 70 Hz TI stimulation had a promoting effect on the reaction time (RT) performance and excitability of the motor cortex compared to sham stimulation. Meanwhile, compared with the sham condition, only 20 Hz TI stimulation significantly facilitated motor learning in the SRTT experiment, which was significantly positively correlated with the increase in motor evoked potential.

Conclusion: These results indicate that the envelope-modulated waveform of TI stimulation has a significant promoting effect on human motor functions, experimentally suggesting the effectiveness of TI stimulation in humans for the first time and paving the way for further explorations.

Effects of Task Demands on Neural Correlates of Acoustic and Semantic Processing in Challenging Listening Conditions

Purpose Listeners shift their listening strategies between lower level acoustic information and higher level semantic information to prioritize maximum speech intelligibility in challenging listening conditions. Although increasing task demands via acoustic degradation modulates lexical-semantic processing, the neural mechanisms underlying different listening strategies are unclear. The current study examined the extent to which encoding of lower level acoustic cues is modulated by task demand and associations with lexical-semantic processes. Method Electroencephalography was acquired while participants listened to sentences in the presence of four-talker babble that contained either higher or lower probability final words. Task difficulty was modulated by time available to process responses. Cortical tracking of speech-neural correlates of acoustic temporal envelope processing-were estimated using temporal response functions. Results Task difficulty did not affect cortical tracking of temporal envelope of speech under challenging listening conditions. Neural indices of lexical-semantic processing (N400 amplitudes) were larger with increased task difficulty. No correlations were observed between the cortical tracking of temporal envelope of speech and lexical-semantic processes, even after controlling for the effect of individualized signal-to-noise ratios. Conclusions Cortical tracking of the temporal envelope of speech and semantic processing are differentially influenced by task difficulty. While increased task demands modulated higher level semantic processing, cortical tracking of the temporal envelope of speech may be influenced by task difficulty primarily when the demand is manipulated in terms of acoustic properties of the stimulus, consistent with an emerging perspective in speech perception.

Rhythmic and speech rate effects in the perception of durational cues

Listeners' perception of temporal contrasts in spoken language is highly sensitive to contextual information, such as variation in speech rate. The present study tests how rate-dependent perception is also mediated by distal (i.e., temporally removed) rhythmic patterns. In four experiments the role of rhythmic alternations and their interaction with speech rate effects are tested. Experiment 1 shows proximal speech rate (contrast) effects obtain based on changes in local context. Experiment 2 shows that these effects disappear with the addition of distal rhythmic alternations, indicating that rhythmic grouping shifts listeners' perception, even when proximal context conflicts. Experiments 3 and 4 explore how orthogonal variation in overall speech rate impacts these effects and finds that trial-to-trial (i.e., global) speech rate variation eliminates rhythmic grouping effects, both with and without variation in proximal (immediately preceding) context. Together, these results suggest a role for rhythmic patterning in listeners' processing of durational cues in speech, which interacts in various ways with proximal, distal, and global rate contexts.