Understanding the neural mechanisms involved in sensory control of voice production

Subjective wet perception assessment of fabrics with different drying time

Wet perception involves a complex neurobiological mechanism and it is a crucial factor affecting the wear comfort in daily life. A subjective wet perception assessment was conducted against wetted fabrics. The assessment method was set to demonstrate the sensation felt by the wearer in recovery period after light activities, and assumes that there is no further sweat secretion. Twenty participants participated in the assessment. Participants were presented with fabrics dried with different duration for simulating garments dry during recovery period. A new fabric driver was built to simulate body movements during wear. The driver drove specimens and reference fabrics on participants' forearms. The two-arm configuration of the fabric driver helps to enhance the reliability of assessment results. The participants were asked to give wetness rating on each sample in ratio scale. We conclude that log₁₀ of subjective wetness rating has linear relationship with drying time of fabric (DToF) and amount of water in fabric. A novel wetness factor (WF) is developed to quantify the effects of wet perception and exposure time induced by a drying fabric. WF is the area under curve of wetness rating against DToF. A smaller WF indicates that a user suffers less from wet sensation.

Brain activity during phonation in healthy female singers with supraglottic compression: an fMRI pilot study

This pilot study evaluated the usability of functional magnetic resonance imaging (fMRI) to detect brain activation during phonation in healthy female singers with supraglottic compression. Four healthy female classical singers (mean age: 26 years) participated in the study. All subjects had normal vocal folds and vocal characteristics and showed supraglottic compression. The fMRI experiment was carried out using a block design paradigm. Brain activation during phonation and exhalation was analyzed using Brain Voyager software (Brain Innovation B.V., Maastricht, The Netherlands). An fMRI data analysis showed a significant effect of phonation control in the bilateral pre/postcentral gyrus, and in the frontal, cingulate, superior and middle temporal gyrus, as well as in the parietal lobe, insula, lingual gyrus, cerebellum, thalamus and brainstem. These activation areas are consistent with previous reports using other fMRI protocols. In addition, a significant effect of phonation compared to exhalation control was found in the bilateral superior temporal gyrus, and the pre/postcentral gyrus. This fMRI pilot study allowed to detect a normal pattern of brain activity during phonation in healthy female singers with supraglottic compression using the proposed protocol. However, the pilot study detected problems with the experimental material/procedures that would necessitate refining the fMRI protocol. The phonation tasks were not capable to show brain activation difference between high-pitched and comfortable phonation. Further fMRI studies manipulating vocal parameters during phonation of the vowels /a/ and /i/ may elicit more distinctive hemodynamic response (HDR) activity patterns relative to voice modulation.

Predicting auditory feedback control of speech production from subregional shape of subcortical structures

Although a growing body of research has focused on the cortical sensorimotor mechanisms that support auditory feedback control of speech production, much less is known about the subcortical contributions to this control process. This study examined whether subregional anatomy of subcortical structures assessed by statistical shape analysis is associated with vocal compensations and cortical event-related potentials in response to pitch feedback errors. The results revealed significant negative correlations between the magnitudes of vocal compensations and subregional shape of the right thalamus, between the latencies of vocal compensations and subregional shape of the left caudate and pallidum, and between the latencies of cortical N1 responses and subregional shape of the left putamen. These associations indicate that smaller local volumes of the basal ganglia and thalamus are predictive of slower and larger neurobehavioral responses to vocal pitch errors. Furthermore, increased local volumes of the left hippocampus and right amygdala were predictive of larger vocal compensations, suggesting that there is an interplay between the memory-related subcortical structures and auditory-vocal integration. These results, for the first time, provide evidence for differential associations of subregional morphology of the basal ganglia, thalamus, hippocampus, and amygdala with neurobehavioral processing of vocal pitch errors, suggesting that subregional shape measures of subcortical structures can predict behavioral outcome of auditory-vocal integration and associated neural features. Hum Brain Mapp 39:459-471, 2018. © 2017 Wiley Periodicals, Inc.

Sensorimotor impairment of speech auditory feedback processing in aphasia

We investigated the brain network involved in speech sensorimotor processing by studying patients with post-stroke aphasia using an altered auditory feedback (AAF) paradigm. We combined lesion-symptom-mapping analysis and behavioral testing to examine the pervasiveness of speech sensorimotor deficits and their relationship with cortical damage. Sixteen participants with aphasia and sixteen neurologically intact individuals completed a speech task under AAF. The task involved producing speech vowel sounds under the real-time pitch-shifted auditory feedback alteration. This task provided an objective measure for each individual's ability to compensate for mismatch (error) in speech auditory feedback. Results indicated that compensatory speech responses to AAF were significantly diminished in participants with aphasia compared with control. We observed that within the aphasic group, subjects with lower scores on the speech repetition task exhibited greater degree of diminished responses. Lesion-symptom-mapping analysis revealed that the onset phase (50-150 ms) of diminished AAF responses were predicted by damage to auditory cortical regions within the superior and middle temporal gyrus, whereas the rising phase (150-250 ms) and the peak (250-350 ms) of diminished AAF responses were predicted with damage to the inferior frontal gyrus and supramarginal gyrus areas, respectively. These findings suggest that damage to the auditory, motor, and auditory-motor integration networks are associated with impaired sensorimotor function for speech error processing. We suggest that a sensorimotor integration network, as revealed by brain regions related to temporal specific components of AAF responses, is related to speech processing and specific aspects of speech impairment, notably repetition deficits, in individuals with aphasia.

Top-Down Modulation of Auditory-Motor Integration during Speech Production: The Role of Working Memory

Although working memory (WM) is considered as an emergent property of the speech perception and production systems, the role of WM in sensorimotor integration during speech processing is largely unknown. We conducted two event-related potential experiments with female and male young adults to investigate the contribution of WM to the neurobehavioural processing of altered auditory feedback during vocal production. A delayed match-to-sample task that required participants to indicate whether the pitch feedback perturbations they heard during vocalizations in test and sample sequences matched, elicited significantly larger vocal compensations, larger N1 responses in the left middle and superior temporal gyrus, and smaller P2 responses in the left middle and superior temporal gyrus, inferior parietal lobule, somatosensory cortex, right inferior frontal gyrus, and insula compared with a control task that did not require memory retention of the sequence of pitch perturbations. On the other hand, participants who underwent extensive auditory WM training produced suppressed vocal compensations that were correlated with improved auditory WM capacity, and enhanced P2 responses in the left middle frontal gyrus, inferior parietal lobule, right inferior frontal gyrus, and insula that were predicted by pretraining auditory WM capacity. These findings indicate that WM can enhance the perception of voice auditory feedback errors while inhibiting compensatory vocal behavior to prevent voice control from being excessively influenced by auditory feedback. This study provides the first evidence that auditory-motor integration for voice control can be modulated by top-down influences arising from WM, rather than modulated exclusively by bottom-up and automatic processes.SIGNIFICANCE STATEMENT One outstanding question that remains unsolved in speech motor control is how the mismatch between predicted and actual voice auditory feedback is detected and corrected. The present study provides two lines of converging evidence, for the first time, that working memory cannot only enhance the perception of vocal feedback errors but also exert inhibitory control over vocal motor behavior. These findings represent a major advance in our understanding of the top-down modulatory mechanisms that support the detection and correction of prediction-feedback mismatches during sensorimotor control of speech production driven by working memory. Rather than being an exclusively bottom-up and automatic process, auditory-motor integration for voice control can be modulated by top-down influences arising from working memory.

Effects of dual tasks and dual-task training on postural stability: a systematic review and meta-analysis

The use of dual-task training paradigm to enhance postural stability in patients with balance impairments is an emerging area of interest. The differential effects of dual tasks and dual-task training on postural stability still remain unclear. A systematic review and meta-analysis were conducted to analyze the effects of dual task and training application on static and dynamic postural stability among various population groups. Systematic identification of published literature was performed adhering to Preferred Reporting Items for Systematic Reviews and Meta-analysis (PRISMA) guidelines, from inception until June 2016, on the online databases Scopus, PEDro, MEDLINE, EMBASE, and SportDiscus. Experimental studies analyzing the effects of dual task and dual-task training on postural stability were extracted, critically appraised using PEDro scale, and then summarized according to modified PEDro level of evidence. Of 1,284 records, 42 studies involving 1,480 participants met the review’s inclusion criteria. Of the studies evaluating the effects of dual-task training on postural stability, 87.5% of the studies reported significant enhancements, whereas 30% of the studies evaluating acute effects of dual tasks on posture reported significant enhancements, 50% reported significant decrements, and 20% reported no effects. Meta-analysis of the pooled studies revealed moderate but significant enhancements of dual-task training in elderly participants (95% CI: 1.16–2.10) and in patients suffering from chronic stroke (−0.22 to 0.86). The adverse effects of complexity of dual tasks on postural stability were also revealed among patients with multiple sclerosis (−0.74 to 0.05). The review also discusses the significance of verbalization in a dual-task setting for increasing cognitive–motor interference. Clinical implications are discussed with respect to practical applications in rehabilitation settings.

Menstrual Cycle Phase Modulates Auditory-Motor Integration for Vocal Pitch Regulation

In adult females, previous work has demonstrated that changes in auditory function and vocal motor behaviors may accompany changes in gonadal steroids. Less is known, however, about the influence of gonadal steroids on auditory-motor integration for voice control in humans. The present event-related potential (ERP) study sought to examine the interaction between gonadal steroids and auditory feedback-based vocal pitch regulation across the menstrual cycle. Participants produced sustained vowels while hearing their voice unexpectedly pitch-shifted during the menstrual, follicular, and luteal phases of the menstrual cycle. Measurement of vocal and cortical responses to pitch feedback perturbations and assessment of estradiol and progesterone levels were performed in all three phases. The behavioral results showed that the menstrual phase (when estradiol levels are low) as associated with larger magnitudes of vocal responses than the follicular and luteal phases (when estradiol levels are high). Furthermore, there was a significant negative correlation between the magnitudes of vocal responses and estradiol levels. At the cortical level, ERP P2 responses were smaller during the luteal phase (when progesterone levels were high) than the menstrual and follicular phases (when progesterone levels were low). These findings show neurobehavioral evidence for the modulation of auditory-motor integration for vocal pitch regulation across the menstrual cycle, and provide important insights into the neural mechanisms and functional outcomes of gonadal steroids' influence on speech motor control in adult women.

Experience-dependent modulation of right anterior insula and sensorimotor regions as a function of noise-masked auditory feedback in singers and nonsingers

Previous studies on vocal motor production in singing suggest that the right anterior insula (AI) plays a role in experience-dependent modulation of feedback integration. Specifically, when somatosensory input was reduced via anesthesia of the vocal fold mucosa, right AI activity was down regulated in trained singers. In the current fMRI study, we examined how masking of auditory feedback affects pitch-matching accuracy and corresponding brain activity in the same participants. We found that pitch-matching accuracy was unaffected by masking in trained singers yet declined in nonsingers. The corresponding brain region with the most differential and interesting activation pattern was the right AI, which was up regulated during masking in singers but down regulated in nonsingers. Likewise, its functional connectivity with inferior parietal, frontal, and voice-relevant sensorimotor areas was increased in singers yet decreased in nonsingers. These results indicate that singers relied more on somatosensory feedback, whereas nonsingers depended more critically on auditory feedback. When comparing auditory vs somatosensory feedback involvement, the right anterior insula emerged as the only region for correcting intended vocal output by modulating what is heard or felt as a function of singing experience. We propose the right anterior insula as a key node in the brain's singing network for the integration of signals of salience across multiple sensory and cognitive domains to guide vocal behavior.

Methylphenidate mediated change in prosody is specific to the performance of a cognitive task in female adult ADHD patients

OBJECTIVES

Prosody production is highly personalized, related to both the emotional and cognitive state of the speaker and to the task being performed. Fundamental frequency (F main) is a central measurable feature of prosody, associated with having an attention deficit hyperactive disorder (ADHD). Since methylphenidate is an effective therapy for ADHD, we hypothesized that it will affect the fundamental frequency of ADHD patients.

METHODS

The answers of 32 adult ADHD patients were recorded while performing two computerized tasks (cognitive and emotional). Evaluations were performed at baseline and an hour after patients received methylphenidate.

RESULTS

A significant effect of methylphenidate was observed on the fundamental frequency, as opposed to other parameters, of prosody. This change was evident while patients performed a cognitive, as opposed to an emotional, task. This change was seen in the 14 female ADHD patients but not in the 18 male ADHD patients. The fundamental frequency while performing a cognitive task without methylphenidate was not different in the female ADHD group, from 22 female controls.

CONCLUSIONS

This pilot study supports prosodic changes as possible objective and accessible dynamic biological marker of treatment responses specifically in female ADHD.

The impact of parkinson's disease on the cortical mechanisms that support auditory-motor integration for voice control

Several studies have shown sensorimotor deficits in speech processing in individuals with idiopathic Parkinson's disease (PD). The underlying neural mechanisms, however, remain poorly understood. In the present event-related potential (ERP) study, 18 individuals with PD and 18 healthy controls were exposed to frequency-altered feedback (FAF) while producing a sustained vowel and listening to the playback of their own voice. Behavioral results revealed that individuals with PD produced significantly larger vocal compensation for pitch feedback errors than healthy controls, and exhibited a significant positive correlation between the magnitude of their vocal responses and the variability of their unaltered vocal pitch. At the cortical level, larger P2 responses were observed for individuals with PD compared with healthy controls during active vocalization due to left-lateralized enhanced activity in the superior and inferior frontal gyrus, premotor cortex, inferior parietal lobule, and superior temporal gyrus. These two groups did not differ, however, when they passively listened to the playback of their own voice. Individuals with PD also exhibited larger P2 responses during active vocalization when compared with passive listening due to enhanced activity in the inferior frontal gyrus, precental gyrus, postcentral gyrus, and middle temporal gyrus. This enhancement effect, however, was not observed for healthy controls. These findings provide neural evidence for the abnormal auditory-vocal integration for voice control in individuals with PD, which may be caused by their deficits in the detection and correction of errors in voice auditory feedback. Hum Brain Mapp 37:4248-4261, 2016. © 2016 Wiley Periodicals, Inc.

Temporal Lobe Epilepsy Alters Auditory-motor Integration For Voice Control

Temporal lobe epilepsy (TLE) is the most common drug-refractory focal epilepsy in adults. Previous research has shown that patients with TLE exhibit decreased performance in listening to speech sounds and deficits in the cortical processing of auditory information. Whether TLE compromises auditory-motor integration for voice control, however, remains largely unknown. To address this question, event-related potentials (ERPs) and vocal responses to vocal pitch errors (1/2 or 2 semitones upward) heard in auditory feedback were compared across 28 patients with TLE and 28 healthy controls. Patients with TLE produced significantly larger vocal responses but smaller P2 responses than healthy controls. Moreover, patients with TLE exhibited a positive correlation between vocal response magnitude and baseline voice variability and a negative correlation between P2 amplitude and disease duration. Graphical network analyses revealed a disrupted neuronal network for patients with TLE with a significant increase of clustering coefficients and path lengths as compared to healthy controls. These findings provide strong evidence that TLE is associated with an atypical integration of the auditory and motor systems for vocal pitch regulation, and that the functional networks that support the auditory-motor processing of pitch feedback errors differ between patients with TLE and healthy controls.

Central Nervous System Control of Voice and Swallowing

This review of the central nervous control systems for voice and swallowing has suggested that the traditional concepts of a separation between cortical and limbic and brain stem control should be refined and be more integrative. For voice production, a separation of the nonhuman vocalization system from the human learned voice production system has been posited based primarily on studies of nonhuman primates. However, recent humans studies of emotionally based vocalizations and human volitional voice production have shown more integration between these two systems than previously proposed. Recent human studies have shown that reflexive vocalization as well as learned voice production not involving speech involve a common integrative system. However, recent studies of nonhuman primates have provided evidence that some cortical activity vocalization and cortical changes occur with training during vocal behavior. For swallowing, evidence from the macaque and functional brain imaging in humans indicates that the control for the pharyngeal phase of swallowing is not primarily under brain stem mechanisms as previously proposed. Studies suggest that the initiation and patterning of swallowing for the pharyngeal phase is also under active cortical control for both spontaneous as well as volitional swallowing in awake humans and nonhuman primates.

Neural activity related to discrimination and vocal production of consonant and dissonant musical intervals

BACKGROUND

Relationships between musical pitches are described as either consonant, when associated with a pleasant and harmonious sensation, or dissonant, when associated with an inharmonious feeling. The accurate singing of musical intervals requires communication between auditory feedback processing and vocal motor control (i.e. audio-vocal integration) to ensure that each note is produced correctly. The objective of this study is to investigate the neural mechanisms through which trained musicians produce consonant and dissonant intervals.

METHODOLOGY

We utilized 4 musical intervals (specifically, an octave, a major seventh, a fifth, and a tritone) as the main stimuli for auditory discrimination testing, and we used the same interval tasks to assess vocal accuracy in a group of musicians (11 subjects, all female vocal students at conservatory level). The intervals were chosen so as to test for differences in recognition and production of consonant and dissonant intervals, as well as narrow and wide intervals. The subjects were studied using fMRI during performance of the interval tasks; the control condition consisted of passive listening.

RESULTS

Singing dissonant intervals as opposed to singing consonant intervals led to an increase in activation in several regions, most notably the primary auditory cortex, the primary somatosensory cortex, the amygdala, the left putamen, and the right insula. Singing wide intervals as opposed to singing narrow intervals resulted in the activation of the right anterior insula. Moreover, we also observed a correlation between singing in tune and brain activity in the premotor cortex, and a positive correlation between training and activation of primary somatosensory cortex, primary motor cortex, and premotor cortex during singing. When singing dissonant intervals, a higher degree of training correlated with the right thalamus and the left putamen.

CONCLUSIONS/SIGNIFICANCE

Our results indicate that singing dissonant intervals requires greater involvement of neural mechanisms associated with integrating external feedback from auditory and sensorimotor systems than singing consonant intervals, and it would then seem likely that dissonant intervals are intoned by adjusting the neural mechanisms used for the production of consonant intervals. Singing wide intervals requires a greater degree of control than singing narrow intervals, as it involves neural mechanisms which again involve the integration of internal and external feedback.

Bihemispheric network dynamics coordinating vocal feedback control

Modulation of vocal pitch is a key speech feature that conveys important linguistic and affective information. Auditory feedback is used to monitor and maintain pitch. We examined induced neural high gamma power (HGP) (65-150 Hz) using magnetoencephalography during pitch feedback control. Participants phonated into a microphone while hearing their auditory feedback through headphones. During each phonation, a single real-time 400 ms pitch shift was applied to the auditory feedback. Participants compensated by rapidly changing their pitch to oppose the pitch shifts. This behavioral change required coordination of the neural speech motor control network, including integration of auditory and somatosensory feedback to initiate change in motor plans. We found increases in HGP across both hemispheres within 200 ms of pitch shifts, covering left sensory and right premotor, parietal, temporal, and frontal regions, involved in sensory detection and processing of the pitch shift. Later responses to pitch shifts (200-300 ms) were right dominant, in parietal, frontal, and temporal regions. Timing of activity in these regions indicates their role in coordinating motor change and detecting and processing of the sensory consequences of this change. Subtracting out cortical responses during passive listening to recordings of the phonations isolated HGP increases specific to speech production, highlighting right parietal and premotor cortex, and left posterior temporal cortex involvement in the motor response. Correlation of HGP with behavioral compensation demonstrated right frontal region involvement in modulating participant's compensatory response. This study highlights the bihemispheric sensorimotor cortical network involvement in auditory feedback-based control of vocal pitch.

A temporal predictive code for voice motor control: Evidence from ERP and behavioral responses to pitch-shifted auditory feedback

The predictive coding model suggests that voice motor control is regulated by a process in which the mismatch (error) between feedforward predictions and sensory feedback is detected and used to correct vocal motor behavior. In this study, we investigated how predictions about timing of pitch perturbations in voice auditory feedback would modulate ERP and behavioral responses during vocal production. We designed six counterbalanced blocks in which a +100 cents pitch-shift stimulus perturbed voice auditory feedback during vowel sound vocalizations. In three blocks, there was a fixed delay (500, 750 or 1000 ms) between voice and pitch-shift stimulus onset (predictable), whereas in the other three blocks, stimulus onset delay was randomized between 500, 750 and 1000 ms (unpredictable). We found that subjects produced compensatory (opposing) vocal responses that started at 80 ms after the onset of the unpredictable stimuli. However, for predictable stimuli, subjects initiated vocal responses at 20 ms before and followed the direction of pitch shifts in voice feedback. Analysis of ERPs showed that the amplitudes of the N1 and P2 components were significantly reduced in response to predictable compared with unpredictable stimuli. These findings indicate that predictions about temporal features of sensory feedback can modulate vocal motor behavior. In the context of the predictive coding model, temporally-predictable stimuli are learned and reinforced by the internal feedforward system, and as indexed by the ERP suppression, the sensory feedback contribution is reduced for their processing. These findings provide new insights into the neural mechanisms of vocal production and motor control.

Training of Working Memory Impacts Neural Processing of Vocal Pitch Regulation

Working memory training can improve the performance of tasks that were not trained. Whether auditory-motor integration for voice control can benefit from working memory training, however, remains unclear. The present event-related potential (ERP) study examined the impact of working memory training on the auditory-motor processing of vocal pitch. Trained participants underwent adaptive working memory training using a digit span backwards paradigm, while control participants did not receive any training. Before and after training, both trained and control participants were exposed to frequency-altered auditory feedback while producing vocalizations. After training, trained participants exhibited significantly decreased N1 amplitudes and increased P2 amplitudes in response to pitch errors in voice auditory feedback. In addition, there was a significant positive correlation between the degree of improvement in working memory capacity and the post-pre difference in P2 amplitudes. Training-related changes in the vocal compensation, however, were not observed. There was no systematic change in either vocal or cortical responses for control participants. These findings provide evidence that working memory training impacts the cortical processing of feedback errors in vocal pitch regulation. This enhanced cortical processing may be the result of increased neural efficiency in the detection of pitch errors between the intended and actual feedback.

The effects of stimulus complexity on the preattentive processing of self-generated and nonself voices: An ERP study

The ability to differentiate one's own voice from the voice of somebody else plays a critical role in successful verbal self-monitoring processes and in communication. However, most of the existing studies have only focused on the sensory correlates of self-generated voice processing, whereas the effects of attentional demands and stimulus complexity on self-generated voice processing remain largely unknown. In this study, we investigated the effects of stimulus complexity on the preattentive processing of self and nonself voice stimuli. Event-related potentials (ERPs) were recorded from 17 healthy males who watched a silent movie while ignoring prerecorded self-generated (SGV) and nonself (NSV) voice stimuli, consisting of a vocalization (vocalization category condition: VCC) or of a disyllabic word (word category condition: WCC). All voice stimuli were presented as standard and deviant events in four distinct oddball sequences. The mismatch negativity (MMN) ERP component peaked earlier for NSV than for SGV stimuli. Moreover, when compared with SGV stimuli, the P3a amplitude was increased for NSV stimuli in the VCC only, whereas in the WCC no significant differences were found between the two voice types. These findings suggest differences in the time course of automatic detection of a change in voice identity. In addition, they suggest that stimulus complexity modulates the magnitude of the orienting response to SGV and NSV stimuli, extending previous findings on self-voice processing.

Transfer Effect of Speech-sound Learning on Auditory-motor Processing of Perceived Vocal Pitch Errors

Speech perception and production are intimately linked. There is evidence that speech motor learning results in changes to auditory processing of speech. Whether speech motor control benefits from perceptual learning in speech, however, remains unclear. This event-related potential study investigated whether speech-sound learning can modulate the processing of feedback errors during vocal pitch regulation. Mandarin speakers were trained to perceive five Thai lexical tones while learning to associate pictures with spoken words over 5 days. Before and after training, participants produced sustained vowel sounds while they heard their vocal pitch feedback unexpectedly perturbed. As compared to the pre-training session, the magnitude of vocal compensation significantly decreased for the control group, but remained consistent for the trained group at the post-training session. However, the trained group had smaller and faster N1 responses to pitch perturbations and exhibited enhanced P2 responses that correlated significantly with their learning performance. These findings indicate that the cortical processing of vocal pitch regulation can be shaped by learning new speech-sound associations, suggesting that perceptual learning in speech can produce transfer effects to facilitating the neural mechanisms underlying the online monitoring of auditory feedback regarding vocal production.

The cortical computations underlying feedback control in vocal production

Recent neurophysiological studies of speaking are beginning to elucidate the neural mechanisms underlying auditory feedback processing during vocalizations. Here we review how research findings impact our state feedback control (SFC) model of speech motor control. We will discuss the evidence for cortical computations that compare incoming feedback with predictions derived from motor efference copy. We will also review observations from auditory feedback perturbation studies that demonstrate clear evidence for a state estimate correction process, which drives compensatory motor behavioral responses. While there is compelling support for cortical computations in the SFC model, there are still several outstanding questions that await resolution by future neural investigations.

The intrinsic resting state voice network in Parkinson's disease

Over 90 percent of patients with Parkinson's disease experience speech-motor impairment, namely, hypokinetic dysarthria characterized by reduced pitch and loudness. Resting-state functional connectivity analysis of blood oxygen level-dependent functional magnetic resonance imaging is a useful measure of intrinsic neural functioning. We utilized resting-state functional connectivity modeling to analyze the intrinsic connectivity in patients with Parkinson's disease within a vocalization network defined by a previous meta-analysis of speech (Brown et al., 2009). Functional connectivity of this network was assessed in 56 patients with Parkinson's disease and 56 gender-, age-, and movement-matched healthy controls. We also had item 5 and 18 of the UPDRS, and the PDQ-39 Communication subscale available for correlation with the voice network connectivity strength in patients. The within-group analyses of connectivity patterns demonstrated a lack of subcortical-cortical connectivity in patients with Parkinson's disease. At the cortical level, we found robust (homotopic) interhemispheric connectivity but only inconsistent evidence for many intrahemispheric connections. When directly contrasted to the control group, we found a significant reduction of connections between the left thalamus and putamen, and cortical motor areas, as well as reduced right superior temporal gyrus connectivity. Furthermore, most symptom measures correlated with right putamen, left cerebellum, left superior temporal gyrus, right premotor, and left Rolandic operculum connectivity in the voice network. The results reflect the importance of (right) subcortical nodes and the superior temporal gyrus in Parkinson's disease, enhancing our understanding of the neurobiological underpinnings of vocalization impairment in Parkinson's disease.

Functional role of delta and theta band oscillations for auditory feedback processing during vocal pitch motor control

The answer to the question of how the brain incorporates sensory feedback and links it with motor function to achieve goal-directed movement during vocalization remains unclear. We investigated the mechanisms of voice pitch motor control by examining the spectro-temporal dynamics of EEG signals when non-musicians (NM), relative pitch (RP), and absolute pitch (AP) musicians maintained vocalizations of a vowel sound and received randomized ± 100 cents pitch-shift stimuli in their auditory feedback. We identified a phase-synchronized (evoked) fronto-central activation within the theta band (5–8 Hz) that temporally overlapped with compensatory vocal responses to pitch-shifted auditory feedback and was significantly stronger in RP and AP musicians compared with non-musicians. A second component involved a non-phase-synchronized (induced) frontal activation within the delta band (1–4 Hz) that emerged at approximately 1 s after the stimulus onset. The delta activation was significantly stronger in the NM compared with RP and AP groups and correlated with the pitch rebound error (PRE), indicating the degree to which subjects failed to re-adjust their voice pitch to baseline after the stimulus offset. We propose that the evoked theta is a neurophysiological marker of enhanced pitch processing in musicians and reflects mechanisms by which humans incorporate auditory feedback to control their voice pitch. We also suggest that the delta activation reflects adaptive neural processes by which vocal production errors are monitored and used to update the state of sensory-motor networks for driving subsequent vocal behaviors. This notion is corroborated by our findings showing that larger PREs were associated with greater delta band activity in the NM compared with RP and AP groups. These findings provide new insights into the neural mechanisms of auditory feedback processing for vocal pitch motor control.

Sensory-motor networks involved in speech production and motor control: an fMRI study

Speaking is one of the most complex motor behaviors developed to facilitate human communication. The underlying neural mechanisms of speech involve sensory-motor interactions that incorporate feedback information for online monitoring and control of produced speech sounds. In the present study, we adopted an auditory feedback pitch perturbation paradigm and combined it with functional magnetic resonance imaging (fMRI) recordings in order to identify brain areas involved in speech production and motor control. Subjects underwent fMRI scanning while they produced a steady vowel sound /a/ (speaking) or listened to the playback of their own vowel production (playback). During each condition, the auditory feedback from vowel production was either normal (no perturbation) or perturbed by an upward (+600 cents) pitch-shift stimulus randomly. Analysis of BOLD responses during speaking (with and without shift) vs. rest revealed activation of a complex network including bilateral superior temporal gyrus (STG), Heschl's gyrus, precentral gyrus, supplementary motor area (SMA), Rolandic operculum, postcentral gyrus and right inferior frontal gyrus (IFG). Performance correlation analysis showed that the subjects produced compensatory vocal responses that significantly correlated with BOLD response increases in bilateral STG and left precentral gyrus. However, during playback, the activation network was limited to cortical auditory areas including bilateral STG and Heschl's gyrus. Moreover, the contrast between speaking vs. playback highlighted a distinct functional network that included bilateral precentral gyrus, SMA, IFG, postcentral gyrus and insula. These findings suggest that speech motor control involves feedback error detection in sensory (e.g. auditory) cortices that subsequently activate motor-related areas for the adjustment of speech parameters during speaking.

Attention modulates cortical processing of pitch feedback errors in voice control

Considerable evidence has shown that unexpected alterations in auditory feedback elicit fast compensatory adjustments in vocal production. Although generally thought to be involuntary in nature, whether these adjustments can be influenced by attention remains unknown. The present event-related potential (ERP) study aimed to examine whether neurobehavioral processing of auditory-vocal integration can be affected by attention. While sustaining a vowel phonation and hearing pitch-shifted feedback, participants were required to either ignore the pitch perturbations, or attend to them with low (counting the number of perturbations) or high attentional load (counting the type of perturbations). Behavioral results revealed no systematic change of vocal response to pitch perturbations irrespective of whether they were attended or not. At the level of cortex, there was an enhancement of P2 response to attended pitch perturbations in the low-load condition as compared to when they were ignored. In the high-load condition, however, P2 response did not differ from that in the ignored condition. These findings provide the first neurophysiological evidence that auditory-motor integration in voice control can be modulated as a function of attention at the level of cortex. Furthermore, this modulatory effect does not lead to a general enhancement but is subject to attentional load.

Mothers' multimodal information processing is modulated by multimodal interactions with their infants

Social learning in infancy is known to be facilitated by multimodal (e.g., visual, tactile, and verbal) cues provided by caregivers. In parallel with infants' development, recent research has revealed that maternal neural activity is altered through interaction with infants, for instance, to be sensitive to infant-directed speech (IDS). The present study investigated the effect of mother- infant multimodal interaction on maternal neural activity. Event-related potentials (ERPs) of mothers were compared to non-mothers during perception of tactile-related words primed by tactile cues. Only mothers showed ERP modulation when tactile cues were incongruent with the subsequent words, and only when the words were delivered with IDS prosody. Furthermore, the frequency of mothers' use of those words was correlated with the magnitude of ERP differentiation between congruent and incongruent stimuli presentations. These results suggest that mother-infant daily interactions enhance multimodal integration of the maternal brain in parenting contexts.

Understanding the mechanisms underlying voluntary responses to pitch-shifted auditory feedback

Previous research has shown that vocal errors can be simulated using a pitch perturbation technique. Two types of responses are observed when subjects are asked to ignore changes in pitch during a steady vowel production, a compensatory response countering the direction of the perceived change in pitch and a following response in the same direction as the pitch perturbation. The present study investigated the nature of these responses by asking subjects to volitionally change their voice fundamental frequency either in the opposite direction ("opposing" group) or the same direction ("following" group) as the pitch shifts (±100 cents, 1000 ms) presented during the speaker's production of an /a/ vowel. Results showed that voluntary responses that followed the stimulus directions had significantly shorter latencies (150 ms) than opposing responses (360 ms). In addition, prior to the slower voluntary opposing responses, there were short latency involuntary responses that followed the stimulus direction. These following responses may involve mechanisms of imitation or vocal shadowing of acoustical stimuli when subjects are predisposed to respond to a change in frequency of a sound. The slower opposing responses may represent a control strategy that requires monitoring and correcting for errors between the feedback signal and the intended vocal goal.

The neural changes in connectivity of the voice network during voice pitch perturbation

Voice control is critical to communication. To date, studies have used behavioral, electrophysiological and functional data to investigate the neural correlates of voice control using perturbation tasks, but have yet to examine the interactions of these neural regions. The goal of this study was to use structural equation modeling of functional neuroimaging data to examine network properties of voice with and without perturbation. Results showed that the presence of a pitch shift, which was processed as an error in vocalization, altered connections between right STG and left STG. Other regions that revealed differences in connectivity during error detection and correction included bilateral inferior frontal gyrus, and the primary and pre motor cortices. Results indicated that STG plays a critical role in voice control, specifically, during error detection and correction. Additionally, pitch perturbation elicits changes in the voice network that suggest the right hemisphere is critical to pitch modulation.

Effective connectivity associated with auditory error detection in musicians with absolute pitch

It is advantageous to study a wide range of vocal abilities in order to fully understand how vocal control measures vary across the full spectrum. Individuals with absolute pitch (AP) are able to assign a verbal label to musical notes and have enhanced abilities in pitch identification without reliance on an external referent. In this study we used dynamic causal modeling (DCM) to model effective connectivity of ERP responses to pitch perturbation in voice auditory feedback in musicians with relative pitch (RP), AP, and non-musician controls. We identified a network compromising left and right hemisphere superior temporal gyrus (STG), primary motor cortex (M1), and premotor cortex (PM). We specified nine models and compared two main factors examining various combinations of STG involvement in feedback pitch error detection/correction process. Our results suggest that modulation of left to right STG connections are important in the identification of self-voice error and sensory motor integration in AP musicians. We also identify reduced connectivity of left hemisphere PM to STG connections in AP and RP groups during the error detection and corrections process relative to non-musicians. We suggest that this suppression may allow for enhanced connectivity relating to pitch identification in the right hemisphere in those with more precise pitch matching abilities. Musicians with enhanced pitch identification abilities likely have an improved auditory error detection and correction system involving connectivity of STG regions. Our findings here also suggest that individuals with AP are more adept at using feedback related to pitch from the right hemisphere.

Left-hemisphere activation is associated with enhanced vocal pitch error detection in musicians with absolute pitch

The ability to process auditory feedback for vocal pitch control is crucial during speaking and singing. Previous studies have suggested that musicians with absolute pitch (AP) develop specialized left-hemisphere mechanisms for pitch processing. The present study adopted an auditory feedback pitch perturbation paradigm combined with ERP recordings to test the hypothesis whether the neural mechanisms of the left-hemisphere enhance vocal pitch error detection and control in AP musicians compared with relative pitch (RP) musicians and non-musicians (NM). Results showed a stronger N1 response to pitch-shifted voice feedback in the right-hemisphere for both AP and RP musicians compared with the NM group. However, the left-hemisphere P2 component activation was greater in AP and RP musicians compared with NMs and also for the AP compared with RP musicians. The NM group was slower in generating compensatory vocal reactions to feedback pitch perturbation compared with musicians, and they failed to re-adjust their vocal pitch after the feedback perturbation was removed. These findings suggest that in the earlier stages of cortical neural processing, the right hemisphere is more active in musicians for detecting pitch changes in voice feedback. In the later stages, the left-hemisphere is more active during the processing of auditory feedback for vocal motor control and seems to involve specialized mechanisms that facilitate pitch processing in the AP compared with RP musicians. These findings indicate that the left hemisphere mechanisms of AP ability are associated with improved auditory feedback pitch processing during vocal pitch control in tasks such as speaking or singing.

Voice-related modulation of mechanosensory detection thresholds in the human larynx

Rapidly adapting mechanoreceptors within the laryngeal mucosa provide the central nervous system with perceptual and proprioceptive afference for a variety of essential yet diverse human functions including voice sound production and airway protection. It is unknown why mechanosensory information that yields a defensive response when an individual breathes may go largely unnoticed when the individual voices. Therefore, a central question is whether there is voice-related modulation of laryngeal mechanosensory detection. Such modulation would be consistent with current models of afferent laryngeal control, and may be important to maintain fluent voice in the presence of potentially distracting sensory input. Therefore, we employed endoscopic assessment of laryngeal mechanosensory detection thresholds in ten healthy adults during tidal breathing and a voice task. We tested the hypothesis that laryngeal mechanosensory detection thresholds would be higher during the voice task. We found that thresholds were significantly higher for all participants during the voice task and that these changes were significantly more modest in women. Our findings suggest that the laryngeal sensorium may modulate mechanosensory afference to attenuate the potentially distracting influence of sensory input during voice. The finding that women maintain a greater sensitivity during the voice task than men (lower thresholds) may have important implications for the higher prevalence of sensorimotor voice disturbances in women. Our results are consistent with the presence of mechanosensory modulation in other motor systems and with observed sensory differences between women and men. Such modulation has important implications for understanding the underlying neural mechanisms of laryngeal control and how these mechanisms may operate in individuals with laryngeal disturbances.

A bilateral cortical network responds to pitch perturbations in speech feedback

Auditory feedback is used to monitor and correct for errors in speech production, and one of the clearest demonstrations of this is the pitch perturbation reflex. During ongoing phonation, speakers respond rapidly to shifts of the pitch of their auditory feedback, altering their pitch production to oppose the direction of the applied pitch shift. In this study, we examine the timing of activity within a network of brain regions thought to be involved in mediating this behavior. To isolate auditory feedback processing relevant for motor control of speech, we used magnetoencephalography (MEG) to compare neural responses to speech onset and to transient (400ms) pitch feedback perturbations during speaking with responses to identical acoustic stimuli during passive listening. We found overlapping, but distinct bilateral cortical networks involved in monitoring speech onset and feedback alterations in ongoing speech. Responses to speech onset during speaking were suppressed in bilateral auditory and left ventral supramarginal gyrus/posterior superior temporal sulcus (vSMG/pSTS). In contrast, during pitch perturbations, activity was enhanced in bilateral vSMG/pSTS, bilateral premotor cortex, right primary auditory cortex, and left higher order auditory cortex. We also found speaking-induced delays in responses to both unaltered and altered speech in bilateral primary and secondary auditory regions, left vSMG/pSTS and right premotor cortex. The network dynamics reveal the cortical processing involved in both detecting the speech error and updating the motor plan to create the new pitch output. These results implicate vSMG/pSTS as critical in both monitoring auditory feedback and initiating rapid compensation to feedback errors.

Experience-dependent modulation of feedback integration during singing: role of the right anterior insula

Somatosensation plays an important role in the motor control of vocal functions, yet its neural correlate and relation to vocal learning is not well understood. We used fMRI in 17 trained singers and 12 nonsingers to study the effects of vocal-fold anesthesia on the vocal-motor singing network as a function of singing expertise. Tasks required participants to sing musical target intervals under normal conditions and after anesthesia. At the behavioral level, anesthesia altered pitch accuracy in both groups, but singers were less affected than nonsingers, indicating an experience-dependent effect of the intervention. At the neural level, this difference was accompanied by distinct patterns of decreased activation in singers (cortical and subcortical sensory and motor areas) and nonsingers (subcortical motor areas only) respectively, suggesting that anesthesia affected the higher-level voluntary (explicit) motor and sensorimotor integration network more in experienced singers, and the lower-level (implicit) subcortical motor loops in nonsingers. The right anterior insular cortex (AIC) was identified as the principal area dissociating the effect of expertise as a function of anesthesia by three separate sources of evidence. First, it responded differently to anesthesia in singers (decreased activation) and nonsingers (increased activation). Second, functional connectivity between AIC and bilateral A1, M1, and S1 was reduced in singers but augmented in nonsingers. Third, increased BOLD activity in right AIC in singers was correlated with larger pitch deviation under anesthesia. We conclude that the right AIC and sensory-motor areas play a role in experience-dependent modulation of feedback integration for vocal motor control during singing.

Modulation of effective connectivity during vocalization with perturbed auditory feedback

The integration of auditory feedback with vocal motor output is important for the control of voice fundamental frequency (F0). We used a pitch-shift paradigm where subjects respond to an alteration, or shift, of voice pitch auditory feedback with a reflexive change in F0. We presented varying magnitudes of pitch shifted auditory feedback to subjects during vocalization and passive listening and measured event related potentials (ERPs) to the feedback shifts. Shifts were delivered at +100 and +400 cents (200 ms duration). The ERP data were modeled with dynamic causal modeling (DCM) techniques where the effective connectivity between the superior temporal gyrus (STG), inferior frontal gyrus and premotor areas were tested. We compared three main factors: the effect of intrinsic STG connectivity, STG modulation across hemispheres and the specific effect of hemisphere. A Bayesian model selection procedure was used to make inference about model families. Results suggest that both intrinsic STG and left to right STG connections are important in the identification of self-voice error and sensory motor integration. We identified differences in left-to-right STG connections between 100 cent and 400 cent shift conditions suggesting that self- and non-self-voice error are processed differently in the left and right hemisphere. These results also highlight the potential of DCM modeling of ERP responses to characterize specific network properties of forward models of voice control.

Sensory-motor interactions for vocal pitch monitoring in non-primary human auditory cortex

The neural mechanisms underlying processing of auditory feedback during self-vocalization are poorly understood. One technique used to study the role of auditory feedback involves shifting the pitch of the feedback that a speaker receives, known as pitch-shifted feedback. We utilized a pitch shift self-vocalization and playback paradigm to investigate the underlying neural mechanisms of audio-vocal interaction. High-resolution electrocorticography (ECoG) signals were recorded directly from auditory cortex of 10 human subjects while they vocalized and received brief downward (-100 cents) pitch perturbations in their voice auditory feedback (speaking task). ECoG was also recorded when subjects passively listened to playback of their own pitch-shifted vocalizations. Feedback pitch perturbations elicited average evoked potential (AEP) and event-related band power (ERBP) responses, primarily in the high gamma (70-150 Hz) range, in focal areas of non-primary auditory cortex on superior temporal gyrus (STG). The AEPs and high gamma responses were both modulated by speaking compared with playback in a subset of STG contacts. From these contacts, a majority showed significant enhancement of high gamma power and AEP responses during speaking while the remaining contacts showed attenuated response amplitudes. The speaking-induced enhancement effect suggests that engaging the vocal motor system can modulate auditory cortical processing of self-produced sounds in such a way as to increase neural sensitivity for feedback pitch error detection. It is likely that mechanisms such as efference copies may be involved in this process, and modulation of AEP and high gamma responses imply that such modulatory effects may affect different cortical generators within distinctive functional networks that drive voice production and control.

Auditory-motor interactions for the production of native and non-native speech

During speech production, auditory processing of self-generated speech is used to adjust subsequent articulations. The current study investigated how the proposed auditory-motor interactions are manifest at the neural level in native and non-native speakers of English who were overtly naming pictures of objects and reading their written names. Data were acquired with functional magnetic resonance imaging and analyzed with dynamic causal modeling. We found that (1) higher activity in articulatory regions caused activity in auditory regions to decrease (i.e., auditory suppression), and (2) higher activity in auditory regions caused activity in articulatory regions to increase (i.e., auditory feedback). In addition, we were able to demonstrate that (3) speaking in a non-native language involves more auditory feedback and less auditory suppression than speaking in a native language. The difference between native and non-native speakers was further supported by finding that, within non-native speakers, there was less auditory feedback for those with better verbal fluency. Consequently, the networks of more fluent non-native speakers looked more like those of native speakers. Together, these findings provide a foundation on which to explore auditory-motor interactions during speech production in other human populations, particularly those with speech difficulties.