Modeling the Role of Sensory Feedback in Speech Motor Control and Learning

A systematic review of the relationships amongst older adults' cognitive and motor speech abilities

Age-related differences in motor speech performance may be only partially explained by physiological factors. In this systematic review we investigated the extent to which cognition is related to older adults' motor speech production. PsycInfo, PubMed, Web of Science, and the Cochrane Library were last searched on 1st October 2024. Eligible studies involved healthy older adults, and/or those with mild cognitive impairment (MCI), with an average age of 60 or above. Study quality was formally evaluated and results presented via a narrative synthesis. In total, there were 22 eligible studies identified including 747 older adults. Ten of eighteen studies investigating attention/executive abilities reported significant relationships with motor speech subprocesses in 571 of 661 participants. Relationships between other cognitive abilities and motor speech outcomes were also reported, however, there were significant gaps in the literature and heterogeneity in the measurements used. In addition, only five studies contained the highest quality evidence. Cognition, and potentially executive abilities specifically, may affect speech articulation in healthy aging and in MCI. Further research implementing a range of tasks is required to better understand the trajectory of age-related changes to cognition and motor speech production.

Sensorimotor learning during synchronous speech is modulated by the acoustics of the other voice

This study tested the hypothesis that speaking with other voices can influence sensorimotor predictions of one's own voice. Real-time manipulations of auditory feedback were used to drive sensorimotor adaptation in speech, while participants spoke sentences in synchrony with another voice, a task known to induce implicit imitation (phonetic convergence). The acoustic-phonetic properties of the other voice were manipulated between groups, such that convergence with it would either oppose (incongruent group, n = 15) or align with (congruent group, n = 16) speech motor adaptation. As predicted, significantly greater adaptation was seen in the congruent compared to the incongruent group. This suggests the use of shared sensory targets in speech for predicting the sensory outcomes of both the actions of others (speech perception) and the actions of the self (speech production). This finding has important implications for wider theories of shared predictive mechanisms across perception and action, such as active inference.

A collicular map for touch-guided tongue control

Accurate goal-directed behaviour requires the sense of touch to be integrated with information about body position and ongoing motion1,2. Behaviours such as chewing, swallowing and speech critically depend on precise tactile events on a rapidly moving tongue3, but neural circuits for dynamic touch-guided tongue control are unknown. Here, using high-speed videography, we examined three-dimensional lingual kinematics as mice drank from a water spout that unexpectedly changed position during licking, requiring re-aiming in response to subtle contact events on the left, centre or right surface of the tongue. Mice integrated information about both precise touch events and tongue position to re-aim ensuing licks. Touch-guided re-aiming was unaffected by photoinactivation of tongue sensory, premotor and motor cortices, but was impaired by photoinactivation of the lateral superior colliculus (latSC). Electrophysiological recordings identified latSC neurons with mechanosensory receptive fields for precise touch events that were anchored in tongue-centred, head-centred or conjunctive reference frames. Notably, latSC neurons also encoded tongue position before contact, information that is important for tongue-to-head-based coordinate transformations underlying accurate touch-guided aiming. Viral tracing revealed tongue sensory inputs to the latSC from the lingual trigeminal nucleus, and optical microstimulation in the latSC revealed a topographic map for aiming licks. These findings demonstrate that touch-guided tongue control relies on a collicular mechanosensorimotor map, analogous to collicular visuomotor maps associated with visually guided orienting across many species.

Mirrors and toothaches: commonplace manipulations of non-auditory feedback availability change perceived speech intelligibility

This paper investigates the impact of two non-technical speech feedback perturbations outside the auditory modality: topical application of commercially-available benzocaine to reduce somatosensory feedback from speakers' lips and tongue tip, and the presence of a mirror to provide fully-detailed visual self-feedback. In experiment 1, speakers were recorded under normal quiet conditions (i.e., baseline), then again with benzocaine application plus auditory degradation, and finally with the addition of mirror feedback. Speech produced under normal and both feedback-altered conditions was assessed via naïve listeners' intelligibility discrimination judgments. Listeners judged speech produced under bisensory degradation to be less intelligible than speech from the un-degraded baseline, and with a greater degree of difference than previously observed with auditory-only degradation. The introduction of mirror feedback, however, did not result in relative improvements in intelligibility. Experiment 2, therefore, assessed the effect of a mirror on speech intelligibility in isolation with no other sensory feedback manipulations. Speech was recorded at baseline and then again in front of a mirror, and relative intelligibility was discriminated by naïve listeners. Speech produced with mirror feedback was judged as less intelligible than baseline tokens, indicating a negative impact of visual self-feedback in the absence of other sensory manipulations. The results of both experiments demonstrate that relatively accessible manipulations of non-auditory sensory feedback can produce speech-relevant effects, and that those effects are perceptible to naïve listeners.

Divided Attention Has Limited Effects on Speech Sensorimotor Control

PURPOSE

When vowel formants are externally perturbed, speakers change their production to oppose that perturbation both during the ongoing production (compensation) and in future productions (adaptation). To date, attempts to explain the large variability across individuals in these responses have focused on trait-based characteristics such as auditory acuity, but evidence from other motor domains suggests that attention may modulate the motor response to sensory perturbations. Here, we test the extent to which divided attention impacts sensorimotor control for supralaryngeal articulation.

METHOD

Neurobiologically healthy speakers were exposed to random (Experiment 1) or consistent (Experiment 2) real-time auditory perturbation of vowel formants to measure online compensation and trial-to-trial adaptation, respectively. In both experiments, participants completed two conditions: one with a simultaneous visual distractor task to divide attention and one without this secondary task.

RESULTS

Divided visual attention slightly reduced online compensation, but only starting > 300 ms after vowel onset, well beyond the typical duration of vowels in speech. Divided attention had no effect on adaptation.

CONCLUSIONS

The results from both experiments suggest that the use of sensory feedback in typical speech motor control is a largely automatic process unaffected by divided visual attention, suggesting that the source of cross-speaker variability in response to formant perturbations likely lies within the speech production system rather than in higher-level cognitive processes. Methodologically, these results suggest that compensation for formant perturbations should be measured prior to 300 ms after vowel onset to avoid any potential impact of attention or other higher-order cognitive factors.

Considerations for identifying subtypes of speech sound disorder

BACKGROUND

Speech sound disorders (SSDs) in children are heterogeneous. Differentiating children with SSDs into distinct subtypes is important so that each child receives a treatment approach well suited to the particular difficulties they are experiencing.

AIMS

To study the distinct underlying processes that differentiate phonological processing, phonological planning or motor planning deficits.

METHOD

The literature on the nature of SSDs is reviewed to reveal diagnostic signs at the level of distal causes, proximal factors and surface characteristics.

MAIN CONTRIBUTION

Subtypes of SSDs may be identified by linking the surface characteristics of the children's speech to underlying explanatory proximal factors. The proximal factors may be revealed by measures of speech perception skills, phonological memory and speech-motor control. The evidence suggests that consistent phonological disorder (CPD) can be identified by predictable patterns of speech error associated with speech perception errors. Inconsistent phonological disorder (IPD) is associated with a deficit in the selection and sequencing of phonemes, that is, revealed as within-word inconsistency and poor phonological memory. The motor planning deficit that is specific to childhood apraxia of speech (CAS) is revealed by transcoding errors on the syllable repetition task and an inability to produce [pətəkə] accurately and rapidly.

CONCLUSIONS & IMPLICATIONS

Children with SSDs form a heterogeneous population. Surface characteristics overlap considerably among those with severe disorders, but certain signs are unique to particular subtypes. Careful attention to underlying causal factors will support the accurate diagnosis and selection of personalized treatment options.

WHAT THIS PAPER ADDS

What is already known on the subject SSD in children are heterogenous, with numerous subtypes of primary SSD proposed. Diagnosing the specific subtype of SSD is important in order to assign the most efficacious treatment approach for each child. Identifying the distinct subtype for each child is difficult because the surface characteristics of certain subtypes overlap among categories (e.g., CPD or IPD; CAS). What this paper adds to the existing knowledge The diagnostic challenge might be eased by systematic attention to explanatory factors in relation to the surface characteristics, using specific tests for this purpose. Word identification tasks tap speech perception skills; repetition of short versus long strings of nonsense syllables permits observation of phonological memory and phonological planning skills; and standard maximum performance tests provide considerable information about speech motor control. What are the potential or actual clinical implications of this work? Children with SSDs should receive comprehensive assessments of their phonological processing, phonological planning and motor planning skills frequently, alongside examinations of their error patterns in connected speech. Such assessments will serve to identify the child's primary challenges currently and as they change over developmental time.

Vocal control and speech production in cochlear implant listeners: A review within auditory-motor processing framework

A comprehensive literature review is conducted to summarize and discuss prior findings on how cochlear implants (CI) affect the users' abilities to produce and control vocal and articulatory movements within the auditory-motor integration framework of speech. Patterns of speech production pre- versus post-implantation, post-implantation adjustments, deviations from the typical ranges of speakers with normal hearing (NH), the effects of switching the CI on and off, as well as the impact of altered auditory feedback on vocal and articulatory speech control are discussed. Overall, findings indicate that CIs enhance the vocal and articulatory control aspects of speech production at both segmental and suprasegmental levels. While many CI users achieve speech quality comparable to NH individuals, some features still deviate in a group of CI users even years post-implantation. More specifically, contracted vowel space, increased vocal jitter and shimmer, longer phoneme and utterance durations, shorter voice onset time, decreased contrast in fricative production, limited prosodic patterns, and reduced intelligibility have been reported in subgroups of CI users compared to NH individuals. Significant individual variations among CI users have been observed in both the pace of speech production adjustments and long-term speech outcomes. Few controlled studies have explored how the implantation age and the duration of CI use influence speech features, leaving substantial gaps in our understanding about the effects of spectral resolution, auditory rehabilitation, and individual auditory-motor processing abilities on vocal and articulatory speech outcomes in CI users. Future studies under the auditory-motor integration framework are warranted to determine how suboptimal CI auditory feedback impacts auditory-motor processing and precise vocal and articulatory control in CI users.

Toward Process-Oriented, Dimensional Approaches for Diagnosis and Treatment of Speech Sound Disorders in Children: Position Statement and Future Perspectives

BACKGROUND

Children with speech sound disorders (SSD) form a heterogeneous group, with respect to severity, etiology, proximal causes, speech error characteristics, and response to treatment. Infants develop speech and language in interaction with neurological maturation and general perceptual, motoric, and cognitive skills in a social-emotional context.

PURPOSE

After a brief introduction into psycholinguistic models of speech production and levels of causation, in this review article, we present an in-depth overview of mechanisms and processes, and the dynamics thereof, which are crucial in typical speech development. These basic mechanisms and processes are: (a) neurophysiological motor refinement, that is, the maturational articulatory mechanisms that drive babbling and the more differentiated production of larger speech patterns; (b) sensorimotor integration, which forms the steering function from phonetics to phonology; and (c) motor hierarchy and articulatory phonology describing the gestural organization of syllables, which underlie fluent speech production. These dynamics have consequences for the diagnosis and further analysis of SSD in children. We argue that current diagnostic classification systems do not do justice to the multilevel, multifactorial, and interactive character of the underlying mechanisms and processes. This is illustrated by a recent Dutch study yielding distinct performance profiles among children with SSD, which allows for a dimensional interpretation of underlying processing deficits.

CONCLUSIONS

Analyses of mainstream treatments with respect to the treatment goals and the speech mechanisms addressed show that treatment programs are quite transparent in their aims and approach and how they contribute to remediating specific deficits or mechanisms. Recent studies into clinical reasoning reveal that the clinical challenge for speech-language pathologists is how to select the most appropriate treatment at the most appropriate time for each individual child with SSD. We argue that a process-oriented approach has merits as compared to categorical diagnostics as a toolbox to aid in the interpretation of the speech profile in terms of underlying deficits and to connect these to a specific intervention approach and treatment target.

Task-dependent coarticulation of movement sequences

Combining individual actions into sequences is a hallmark of everyday activities. Classical theories propose that the motor system forms a single specification of the sequence as a whole, leading to the coarticulation of the different elements. In contrast, recent neural recordings challenge this idea and suggest independent execution of each element specified separately. Here, we show that separate or coarticulated sequences can result from the same task-dependent controller, without implying different representations in the brain. Simulations show that planning for multiple reaches simultaneously allows separate or coarticulated sequences depending on instructions about intermediate goals. Human experiments in a two-reach sequence task validated this model. Furthermore, in co-articulated sequences, the second goal influenced long-latency stretch responses to external loads applied during the first reach, demonstrating the involvement of the sensorimotor network supporting fast feedback control. Overall, our study establishes a computational framework for sequence production that highlights the importance of feedback control in this essential motor skill.

Temporal acoustic properties of the sibilant fricative /s/ for the differential diagnosis of dysarthria and apraxia of speech in Spanish speakers

Dysarthria and Apraxia of Speech (AoS) are motor speech disorders in which neurological lesions differentially affect motor control, possibly leading to noticeable differences in articulation and consequently sound production. Among the sounds requiring greater motor capacity because of its articulatory complexity is the voiceless alveolar sibilant fricative /s/. The aim of this study was to identify acoustic variables able to distinguish between dysarthria and AoS, and between these disorders and normal speech in Spanish speakers. The production of this fricative was acoustically examined in 28 individuals with motor neurological disorders (20 with dysarthria, 8 with AoS) and in 28 neurologically healthy persons. Participants repeated 12 monosyllabic words containing the fricative plus one of the five Spanish vowels. The variables measured were absolute durations of the fricative, vowel, and fricative+vowel sequence, along with the vowel-to-fricative duration ratio. Findings indicate that duration of the fricative can distinguish between controls and speakers with dysarthria, but not between controls and speakers with AoS. Measures related to vowel duration served to distinguish between speakers with dysarthria and speakers with AoS and between each of them and controls. Further, speakers with dysarthria and those with AoS differed from each other and from controls in terms of articulatory variability; speakers with dysarthria showing most variability. In the latter participants, articulatory variability was higher for unrounded segments, vowels and fricatives, while in speakers with AoS this variability was higher for rounded segments. These observations are discussed within a framework of motor control models.

Sensorimotor Adaptation to Formant-Shifted Auditory Feedback Is Predicted by Language-Specific Factors in L1 and L2 Speech Production

Auditory feedback plays an important role in the long-term updating and maintenance of speech motor control; thus, the current study explored the unresolved question of how sensorimotor adaptation is predicted by language-specific and domain-general factors in first-language (L1) and second-language (L2) production. Eighteen English-L1 speakers and 22 English-L2 speakers performed the same sensorimotor adaptation experiments and tasks, which measured language-specific and domain-general abilities. The experiment manipulated the language groups (English-L1 and English-L2) and experimental conditions (baseline, early adaptation, late adaptation, and end). Linear mixed-effects model analyses indicated that auditory acuity was significantly associated with sensorimotor adaptation in L1 and L2 speakers. Analysis of vocal responses showed that L1 speakers exhibited significant sensorimotor adaptation under the early adaptation, late adaptation, and end conditions, whereas L2 speakers exhibited significant sensorimotor adaptation only under the late adaptation condition. Furthermore, the domain-general factors of working memory and executive control were not associated with adaptation/aftereffects in either L1 or L2 production, except for the role of working memory in aftereffects in L2 production. Overall, the study empirically supported the hypothesis that sensorimotor adaptation is predicted by language-specific factors such as auditory acuity and language experience, whereas general cognitive abilities do not play a major role in this process.

The speech neuroprosthesis

Loss of speech after paralysis is devastating, but circumventing motor-pathway injury by directly decoding speech from intact cortical activity has the potential to restore natural communication and self-expression. Recent discoveries have defined how key features of speech production are facilitated by the coordinated activity of vocal-tract articulatory and motor-planning cortical representations. In this Review, we highlight such progress and how it has led to successful speech decoding, first in individuals implanted with intracranial electrodes for clinical epilepsy monitoring and subsequently in individuals with paralysis as part of early feasibility clinical trials to restore speech. We discuss high-spatiotemporal-resolution neural interfaces and the adaptation of state-of-the-art speech computational algorithms that have driven rapid and substantial progress in decoding neural activity into text, audible speech, and facial movements. Although restoring natural speech is a long-term goal, speech neuroprostheses already have performance levels that surpass communication rates offered by current assistive-communication technology. Given this accelerated rate of progress in the field, we propose key evaluation metrics for speed and accuracy, among others, to help standardize across studies. We finish by highlighting several directions to more fully explore the multidimensional feature space of speech and language, which will continue to accelerate progress towards a clinically viable speech neuroprosthesis.

Sensorimotor Integration in Patients with Voice Disorders: A Scoping Review of Behavioral Research

BACKGROUND

In recent years, research has determined that impaired sensorimotor integration is a contributor to the formation of voice symptoms and voice disorders. A scoping review is undertaken to explore the current state of scientific research regarding behavioral examinations of sensorimotor integration impairments in patients.

SUMMARY

Following the guidelines of the PRISMA Extension for Scoping Reviews, five online databases identified papers published between 2000 and 2023, from which 17 publications were selected that used sensorimotor integration paradigms with voice-related acoustics as an outcome variable in individuals diagnosed with a voice disorder. Across the 17 studies, sensorimotor integration was behaviorally examined via auditory-motor paradigms in 315 patients with voice disorders and 344 controls. Broadly, patients with vocal hyperfunction demonstrated impaired auditory-motor and somatosensory-motor integration. Patients with unilateral vocal fold paralysis demonstrated impaired sensorimotor integration attributed to changes in the primary brain areas of speech motor control. Patients with laryngeal dystonia demonstrated varying results, with no conclusive evidence regarding sensorimotor integration in behavioral voicing tasks. Patients with Parkinson's disease demonstrated varying results as well, with a general trend of increased dependance on the feedback control system of voice production. Patients with ataxic dysarthria demonstrated that auditory feedback control was impaired possibly due to inaccurate error estimation and correction arising from the damage to their cerebellar pathways. Finally, patients with cerebellar degeneration demonstrated disruptions in both feedback and feed-forward control.

KEY MESSAGES

Sensorimotor integration in the context of voice disorders is an important consideration in understanding how different sensory streams operate in healthy voice production, and how sensory feedback can be optimized in clinical treatments of voice disorders. The present scoping review reveals that behavioral research has focused primarily on auditory-motor integration paradigms, and this supports the possibility of a disconnect between these behavioral studies and existing theoretical conceptualizations of vocal motor control.

Instrumental Assessment of Aero-Resistive Expiratory Muscle Strength Rehabilitation Devices

PURPOSE

Expiratory muscle strength training (EMST) is increasingly being used to treat voice, cough, and swallowing deficits in a wide range of conditions. However, a multitude of aero-resistive EMST models are commercially available, and the absence of side-by-side comparative data interferes with clinicians' ability to assess which model is best suited to a particular client's needs. The primary aim of this research was to test and compare the pressure and flow parameters of six currently available EMST models to help inform clinical decision making.

METHOD

We identified and tested five devices of each of six different EMST models to generate benchmark data for minimum trigger pressures across settings. The reliability was tested within each device and between five devices of the same model across settings using coefficient of variation.

RESULTS

All six models required higher pressures to initiate flow at the highest setting compared to the lowest setting, as expected. Detailed descriptive statistics for each model/setting combination include average flow-triggering pressure for each model/setting and the variability across trials within a device and across devices of the same model. From these, ranked order of the least to most stable EMST model was derived.

CONCLUSIONS

Systematic testing of several commercially available expiratory resistance training devices yielded clinical benchmarks and reliability data to aid clinicians in selecting an appropriate therapy device and regimen for a client based on their available airflow and air pressure as well as reliability of the device. These findings allow clinicians to directly compare key parameters across EMST devices.

Acoustic Effects of Vocal Warm-Up: A 7-Week Longitudinal Case Study

OBJECTIVE

A case study was used to determine which acoustic parameters would be sensitive to a SOVT-based vocal warm-up over the duration of a standard voice treatment.

METHODS

The longitudinal research design consisted of repeated voice measures during 7 weeks from a single subject, a 48-year-old male occupational voice user with a history of voice disorders. A steady phonation and running speech tasks were performed before and after an intensive 1-minute water-resistance voice exercise (WRT). Acoustic assessment of the pre-and postrecordings from each session was obtained with freely accessible software (e.g., Audacity, PRAAT) and acoustic measures (e.g., fundamental frequency, jitter, shimmer, alpha ratio, NHR, HNR, L1L0, Cepstral Peak Prominence smoothed).

RESULTS

After WRT, the analysis indicated that jitter, shimmer, and NHR had a small but statistically significant decrease, while alpha ratio, CPPS, and HNR had a statistically significant increase. For the days where there were six repetitions, there was a larger effect in the later repetitions in the day for some metrics (i.e., alpha ratio, shimmer, NHR, CPPS), while others had the biggest effect in the first two repetitions in a day (i.e., jitter, HNR).

CONCLUSIONS

A short vocal water-resistance voice task had a positive effect on the short-term acoustic voice metrics after each repetition of the exercise, independent of the number of repetitions throughout the day. When five repetitions of this exercise routine occurred, there was a more substantial influence on the proportion of acoustic voice changes.

Test-Retest Reliability of Behavioral Assays of Feedforward and Feedback Auditory-Motor Control of Voice and Articulation

PURPOSE

Behavioral assays of feedforward and feedback auditory-motor control of voice and articulation frequently are used to make inferences about underlying neural mechanisms and to study speech development and disorders. However, no studies have examined the test-retest reliability of such measures, which is critical for rigorous study of auditory-motor control. Thus, the purpose of the present study was to assess the reliability of assays of feedforward and feedback control in voice versus articulation domains.

METHOD

Twenty-eight participants (14 cisgender women, 12 cisgender men, one transgender man, one transmasculine/nonbinary) who denied any history of speech, hearing, or neurological impairment were measured for responses to predictable versus unexpected auditory feedback perturbations of vocal (fundamental frequency, fo) and articulatory (first formant, F1) acoustic parameters twice, with 3-6 weeks between sessions. Reliability was measured with intraclass correlations.

RESULTS

Opposite patterns of reliability were observed for fo and F1; fo reflexive responses showed good reliability and fo adaptive responses showed poor reliability, whereas F1 reflexive responses showed poor reliability and F1 adaptive responses showed moderate reliability. However, a criterion-referenced categorical measurement of fo adaptive responses as typical versus atypical showed substantial test-retest agreement.

CONCLUSIONS

Individual responses to some behavioral assays of auditory-motor control of speech should be interpreted with caution, which has implications for several fields of research. Additional research is needed to establish reliable criterion-referenced measures of F1 adaptive responses as well as fo and F1 reflexive responses. Furthermore, the opposite patterns of test-retest reliability observed for voice versus articulation add to growing evidence for differences in underlying neural control mechanisms.

Proprioceptive Acuity Influences Speech Motor Control in Healthy Adult Talkers

PURPOSE

Somatosensory feedback, including proprioception, is important for speech production. This study evaluates proprioceptive acuity of the tongue using a position-matching task and determining if proprioceptive acuity impacts speech motor control in healthy adult talkers.

METHOD

Twenty-five young adults with no history of speech, language, or hearing disorders had their tongue movements recorded with an electromagnetic articulograph while completing a position-matching task. Participants were also asked to repeat two sentences that differed in the somatosensory feedback obtained. One sentence provided both tactile and proprioceptive feedback, whereas the other primarily provided proprioceptive feedback.

RESULTS

Participants ranged in proprioceptive acuity as measured by the position-matching task. Talkers with smaller position-matching errors and, therefore, higher proprioceptive acuity had smaller movements and slower speeds for both sentences. Talkers with lower proprioceptive acuity had reduced speech movement stability for the sentence that primarily provides proprioceptive feedback.

CONCLUSION

Proprioceptive acuity of the tongue can be evaluated using a position-matching task, and acuity is associated with more efficient speech movements and greater speech movement stability, particularly when producing utterances that provide less tactile feedback.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.24293740.

Neural oscillations reveal disrupted functional connectivity associated with impaired speech auditory feedback control in post-stroke aphasia

The oscillatory brain activities reflect neuro-computational processes that are critical for speech production and sensorimotor control. In the present study, we used neural oscillations in left-hemisphere stroke survivors with aphasia as a model to investigate network-level functional connectivity deficits associated with disrupted speech auditory feedback control. Electroencephalography signals were recorded from 40 post-stroke aphasia and 39 neurologically intact control participants while they performed speech vowel production and listening tasks under pitch-shifted altered auditory feedback (AAF) conditions. Using weighted phase-lag index, we calculated broadband (1-70 Hz) functional neural connectivity between electrode pairs covering the frontal, pre- and post-central, and parietal regions. Results revealed reduced fronto-central delta and theta band and centro-parietal low-beta band connectivity in left-hemisphere electrodes associated with diminished speech AAF compensation responses in post-stroke aphasia compared with controls. Lesion-mapping analysis demonstrated that stroke-induced damage to multi-modal brain networks within the inferior frontal gyrus, Rolandic operculum, inferior parietal lobule, angular gyrus, and supramarginal gyrus predicted the reduced functional neural connectivity within the delta and low-beta bands during both tasks in aphasia. These results provide evidence that disrupted neural connectivity due to left-hemisphere brain damage can result in network-wide dysfunctions associated with impaired sensorimotor integration mechanisms for speech auditory feedback control.

Auditory and Somatosensory Development for Speech in Later Childhood

PURPOSE

This study collected measures of auditory-perceptual and oral somatosensory acuity in typically developing children and adolescents aged 9-15 years. We aimed to establish reference data that can be used as a point of comparison for individuals with residual speech sound disorder (RSSD), especially for RSSD affecting American English rhotics. We examined concurrent validity between tasks and hypothesized that performance on at least some tasks would show a significant association with age, reflecting ongoing refinement of sensory function in later childhood. We also tested for an inverse relationship between performance on auditory and somatosensory tasks, which would support the hypothesis of a trade-off between sensory domains.

METHOD

Ninety-eight children completed three auditory-perceptual tasks (identification and discrimination of stimuli from a "rake"-"wake" continuum and category goodness judgment for naturally produced words containing rhotics) and three oral somatosensory tasks (bite block with auditory masking, oral stereognosis, and articulatory awareness, which involved explicit judgments of relative tongue position for different speech sounds). Pairwise associations were examined between tasks within each domain and between task performance and age. Composite measures of auditory-perceptual and somatosensory functions were used to investigate the possibility of a sensory trade-off.

RESULTS

Statistically significant associations were observed between the identification and discrimination tasks and the bite block and articulatory awareness tasks. In addition, significant associations with age were found for the category goodness and bite block tasks. There was no statistically significant evidence of a trade-off between auditory-perceptual and somatosensory domains.

CONCLUSIONS

This study provided a multidimensional characterization of speech-related sensory function in older children/adolescents. Complete materials to administer all experimental tasks have been shared, along with measures of central tendency and dispersion for scores in two subgroups of age. Ultimately, we hope to apply this information to make customized treatment recommendations for children with RSSD based on sensory profiles.

How the conception of control influences our understanding of actions

Wilful movement requires neural control. Commonly, neural computations are thought to generate motor commands that bring the musculoskeletal system - that is, the plant - from its current physical state into a desired physical state. The current state can be estimated from past motor commands and from sensory information. Modelling movement on the basis of this concept of plant control strives to explain behaviour by identifying the computational principles for control signals that can reproduce the observed features of movements. From an alternative perspective, movements emerge in a dynamically coupled agent-environment system from the pursuit of subjective perceptual goals. Modelling movement on the basis of this concept of perceptual control aims to identify the controlled percepts and their coupling rules that can give rise to the observed characteristics of behaviour. In this Perspective, we discuss a broad spectrum of approaches to modelling human motor control and their notions of control signals, internal models, handling of sensory feedback delays and learning. We focus on the influence that the plant control and the perceptual control perspective may have on decisions when modelling empirical data, which may in turn shape our understanding of actions.

Inter-Trial Formant Variability in Speech Production Is Actively Controlled but Does Not Affect Subsequent Adaptation to a Predictable Formant Perturbation

Despite ample evidence that speech production is associated with extensive trial-to-trial variability, it remains unclear whether this variability represents merely unwanted system noise or an actively regulated mechanism that is fundamental for maintaining and adapting accurate speech movements. Recent work on upper limb movements suggest that inter-trial variability may be not only actively regulated based on sensory feedback, but also provide a type of workspace exploration that facilitates sensorimotor learning. We therefore investigated whether experimentally reducing or magnifying inter-trial formant variability in the real-time auditory feedback during speech production (a) leads to adjustments in formant production variability that compensate for the manipulation, (b) changes the temporal structure of formant adjustments across productions, and (c) enhances learning in a subsequent adaptation task in which a predictable formant-shift perturbation is applied to the feedback signal. Results show that subjects gradually increased formant variability in their productions when hearing auditory feedback with reduced variability, but subsequent formant-shift adaptation was not affected by either reducing or magnifying the perceived variability. Thus, findings provide evidence for speakers’ active control of inter-trial formant variability based on auditory feedback from previous trials, but–at least for the current short-term experimental manipulation of feedback variability–not for a role of this variability regulation mechanism in subsequent auditory-motor learning.

Sensory error drives fine motor adjustment

Fine audiovocal control is a hallmark of human speech production and depends on precisely coordinated muscle activity guided by sensory feedback. Little is known about shared audiovocal mechanisms between humans and other mammals. We hypothesized that real-time audiovocal control in bat echolocation uses the same computational principles as human speech. To test the prediction of this hypothesis, we applied state feedback control (SFC) theory to the analysis of call frequency adjustments in the echolocating bat, Hipposideros armiger. This model organism exhibits well-developed audiovocal control to sense its surroundings via echolocation. Our experimental paradigm was analogous to one implemented in human subjects. We measured the bats' vocal responses to spectrally altered echolocation calls. Individual bats exhibited highly distinct patterns of vocal compensation to these altered calls. Our findings mirror typical observations of speech control in humans listening to spectrally altered speech. Using mathematical modeling, we determined that the same computational principles of SFC apply to bat echolocation and human speech, confirming the prediction of our hypothesis.

Temporal specificity of abnormal neural oscillations during phonatory events in laryngeal dystonia

Laryngeal dystonia is a debilitating disorder of voicing in which the laryngeal muscles are intermittently in spasm resulting in involuntary interruptions during speech. The central pathophysiology of laryngeal dystonia, underlying computational impairments in vocal motor control, remains poorly understood. Although prior imaging studies have found aberrant activity in the CNS during phonation in patients with laryngeal dystonia, it is not known at what timepoints during phonation these abnormalities emerge and what function may be impaired. To investigate this question, we recruited 22 adductor laryngeal dystonia patients (15 female, age range = 28.83-72.46 years) and 18 controls (eight female, age range = 27.40-71.34 years). We leveraged the fine temporal resolution of magnetoencephalography to monitor neural activity around glottal movement onset, subsequent voice onset and after the onset of pitch feedback perturbations. We examined event-related beta-band (12-30 Hz) and high-gamma-band (65-150 Hz) neural oscillations. Prior to glottal movement onset, we observed abnormal frontoparietal motor preparatory activity. After glottal movement onset, we observed abnormal activity in the somatosensory cortex persisting through voice onset. Prior to voice onset and continuing after, we also observed abnormal activity in the auditory cortex and the cerebellum. After pitch feedback perturbation onset, we observed no differences between controls and patients in their behavioural responses to the perturbation. But in patients, we did find abnormal activity in brain regions thought to be involved in the auditory feedback control of vocal pitch (premotor, motor, somatosensory and auditory cortices). Our study results confirm the abnormal processing of somatosensory feedback that has been seen in other studies. However, there were several remarkable findings in our study. First, patients have impaired vocal motor activity even before glottal movement onset, suggesting abnormal movement preparation. These results are significant because (i) they occur before movement onset, abnormalities in patients cannot be ascribed to deficits in vocal performance and (ii) they show that neural abnormalities in laryngeal dystonia are more than just abnormal responses to sensory feedback during phonation as has been hypothesized in some previous studies. Second, abnormal auditory cortical activity in patients begins even before voice onset, suggesting abnormalities in setting up auditory predictions before the arrival of auditory feedback at voice onset. Generally, activation abnormalities identified in key brain regions within the speech motor network around various phonation events not only provide temporal specificity to neuroimaging phenotypes in laryngeal dystonia but also may serve as potential therapeutic targets for neuromodulation.

Convergence in voice fundamental frequency during synchronous speech

Joint speech behaviours where speakers produce speech in unison are found in a variety of everyday settings, and have clinical relevance as a temporary fluency-enhancing technique for people who stutter. It is currently unknown whether such synchronisation of speech timing among two speakers is also accompanied by alignment in their vocal characteristics, for example in acoustic measures such as pitch. The current study investigated this by testing whether convergence in voice fundamental frequency (F0) between speakers could be demonstrated during synchronous speech. Sixty participants across two online experiments were audio recorded whilst reading a series of sentences, first on their own, and then in synchrony with another speaker (the accompanist) in a number of between-subject conditions. Experiment 1 demonstrated significant convergence in participants' F0 to a pre-recorded accompanist voice, in the form of both upward (high F0 accompanist condition) and downward (low and extra-low F0 accompanist conditions) changes in F0. Experiment 2 demonstrated that such convergence was not seen during a visual synchronous speech condition, in which participants spoke in synchrony with silent video recordings of the accompanist. An audiovisual condition in which participants were able to both see and hear the accompanist in pre-recorded videos did not result in greater convergence in F0 compared to synchronisation with the pre-recorded voice alone. These findings suggest the need for models of speech motor control to incorporate interactions between self- and other-speech feedback during speech production, and suggest a novel hypothesis for the mechanisms underlying the fluency-enhancing effects of synchronous speech in people who stutter.

Intact Correction for Self-Produced Vowel Formant Variability in Individuals With Cerebellar Ataxia Regardless of Auditory Feedback Availability

Purpose Individuals with cerebellar ataxia (CA) caused by cerebellar degeneration exhibit larger reactive compensatory responses to unexpected auditory feedback perturbations than neurobiologically typical speakers, suggesting they may rely more on feedback control during speech. We test this hypothesis by examining variability in unaltered speech. Previous studies of typical speakers have demonstrated a reduction in formant variability (centering) observed during the initial phase of vowel production from vowel onset to vowel midpoint. Centering is hypothesized to reflect feedback-based corrections for self-produced variability and thus may provide a behavioral assay of feedback control in unperturbed speech in the same manner as the compensatory response does for feedback perturbations. Method To comprehensively compare centering in individuals with CA and controls, we examine centering in two vowels (/i/ and /ɛ/) under two contexts (isolated words and connected speech). As a control, we examine speech produced both with and without noise to mask auditory feedback. Results Individuals with CA do not show increased centering compared to age-matched controls, regardless of vowel, context, or masking. Contrary to previous results in neurobiologically typical speakers, centering was not affected by the presence of masking noise in either group. Conclusions The similar magnitude of centering seen with and without masking noise questions whether centering is driven by auditory feedback. However, if centering is at least partially driven by auditory/somatosensory feedback, these results indicate that the larger compensatory response to altered auditory feedback observed in individuals with CA may not reflect typical motor control processes during normal, unaltered speech production.

The Role of Sensory Feedback in Developmental Stuttering: A Review

Developmental stuttering is a neurodevelopmental disorder that severely affects speech fluency. Multiple lines of evidence point to a role of sensory feedback in the disorder; this has led to a number of theories proposing different disruptions to the use of sensory feedback during speech motor control in people who stutter. The purpose of this review was to bring together evidence from studies using altered auditory feedback paradigms with people who stutter, in order to evaluate the predictions of these different theories. This review highlights converging evidence for particular patterns of differences in the responses of people who stutter to feedback perturbations. The implications for hypotheses on the nature of the disruption to sensorimotor control of speech in the disorder are discussed, with reference to neurocomputational models of speech control (predominantly, the DIVA model; Guenther et al., 2006; Tourville et al., 2008). While some consistent patterns are emerging from this evidence, it is clear that more work in this area is needed with developmental samples in particular, in order to tease apart differences related to symptom onset from those related to compensatory strategies that develop with experience of stuttering.

A Computational Model for Estimating the Speech Motor System's Sensitivity to Auditory Prediction Errors

Purpose The speech motor system uses feedforward and feedback control mechanisms that are both reliant on prediction errors. Here, we developed a state-space model to estimate the error sensitivity of the control systems. We examined (a) whether the model accounts for the error sensitivity of the control systems and (b) whether the two systems have similar error sensitivity. Method Participants (N = 50) completed an adaptation paradigm, in which their first and second formants were perturbed such that a participant's /ε/ would sound like her /ӕ/. We measured adaptive responses to the perturbations at early (0-80 ms) and late (220-300 ms) time points relative to the onset of the perturbations. As data-driven correlates of the error sensitivity of the feedforward and feedback systems, we used the average early responses and difference responses (i.e., late minus early responses), respectively. We fitted the state-space model to participants' adaptive responses and used the model's parameters as model-based estimates of error sensitivity. Results We found that the late responses were larger than the early responses. Additionally, the model-based estimates of error sensitivity strongly correlated with the data-driven estimates. However, the data-driven and model-based estimates of error sensitivity of the feedforward system did not correlate with those of the feedback system. Conclusions Overall, our results suggested that the dynamics of adaptive responses as well as error sensitivity of the control systems can be accurately predicted by the model. Furthermore, our results suggested that the feedforward and feedback control systems function independently. Supplemental Material https://doi.org/10.23641/asha.14669808.

Changes in Spoken and Sung Productions Following Adaptation to Pitch-shifted Auditory Feedback

OBJECTIVE

Using voice to speak or to sing is made possible by remarkably complex sensorimotor processes. Like any other sensorimotor system, the speech motor controller guides its actions with maximum performance at minimum cost, using available sources of information, among which, auditory feedback plays a major role. Manipulation of this feedback forces the speech monitoring system to refine its expectations for further actions. The present study hypothesizes that the duration of this refinement and the weight applied on different feedbacks loops would depend on the intended sounds to be produced, namely reading aloud versus singing.

MATERIAL AND METHODS

We asked participants to sing "Happy Birthday" and read a paragraph of Harry Potter before and after experiencing pitch-shifted feedback. A detailed fundamental frequency (F0) analysis was conducted for each note in the song and each segment in the paragraph (at the level of a sentence, a word, or a vowel) to determine whether some aspects of F0 production changed in response to the pitch perturbations experienced during the adaptation paradigm.

RESULTS

Our results showed that changes in the degree of F0-drift across the song or the paragraph was the metric that was the most consistent with a carry-over effect of adaptation, and in this regard, reading new material was more influenced by recent remapping than singing.

CONCLUSION

The motor commands used by (normally-hearing) speakers are malleable via altered-feedback paradigms, perhaps more so when reading aloud than when singing. But these effects are not revealed through simple indicators such as an overall change in mean F0 or F0 range, but rather through subtle metrics, such as a drift of the voice pitch across the recordings.

Speech compensation responses and sensorimotor adaptation to formant feedback perturbations

Control of speech formants is important for the production of distinguishable speech sounds and is achieved with both feedback and learned feedforward control. However, it is unclear whether the learning of feedforward control involves the mechanisms of feedback control. Speakers have been shown to compensate for unpredictable transient mid-utterance perturbations of pitch and loudness feedback, demonstrating online feedback control of these speech features. To determine whether similar feedback control mechanisms exist in the production of formants, responses to unpredictable vowel formant feedback perturbations were examined. Results showed similar within-trial compensatory responses to formant perturbations that were presented at utterance onset and mid-utterance. The relationship between online feedback compensation to unpredictable formant perturbations and sensorimotor adaptation to consistent formant perturbations was further examined. Within-trial online compensation responses were not correlated with across-trial sensorimotor adaptation. A detailed analysis of within-trial time course dynamics across trials during sensorimotor adaptation revealed that across-trial sensorimotor adaptation responses did not result from an incorporation of within-trial compensation response. These findings suggest that online feedback compensation and sensorimotor adaptation are governed by distinct neural mechanisms. These findings have important implications for models of speech motor control in terms of how feedback and feedforward control mechanisms are implemented.

Hierarchical Sequencing and Feedforward and Feedback Control Mechanisms in Speech Production: A Preliminary Approach for Modeling Normal and Disordered Speech

Our understanding of the neurofunctional mechanisms of speech production and their pathologies is still incomplete. In this paper, a comprehensive model of speech production based on the Neural Engineering Framework (NEF) is presented. This model is able to activate sensorimotor plans based on cognitive-functional processes (i.e., generation of the intention of an utterance, selection of words and syntactic frames, generation of the phonological form and motor plan; feedforward mechanism). Since the generation of different states of the utterance are tied to different levels in the speech production hierarchy, it is shown that different forms of speech errors as well as speech disorders can arise at different levels in the production hierarchy or are linked to different levels and different modules in the speech production model. In addition, the influence of the inner feedback mechanisms on normal as well as on disordered speech is examined in terms of the model. The model uses a small number of core concepts provided by the NEF, and we show that these are sufficient to create this neurobiologically detailed model of the complex process of speech production in a manner that is, we believe, clear, efficient, and understandable.

Adaptation to pitch-altered feedback is independent of one's own voice pitch sensitivity

Monitoring voice pitch is a fine-tuned process in daily conversations as conveying accurately the linguistic and affective cues in a given utterance depends on the precise control of phonation and intonation. This monitoring is thought to depend on whether the error is treated as self-generated or externally-generated, resulting in either a correction or inflation of errors. The present study reports on two separate paradigms of adaptation to altered feedback to explore whether participants could behave in a more cohesive manner once the error is of comparable size perceptually. The vocal behavior of normal-hearing and fluent speakers was recorded in response to a personalized size of pitch shift versus a non-specific size, one semitone. The personalized size of shift was determined based on the just-noticeable difference in fundamental frequency (F0) of each participant’s voice. Here we show that both tasks successfully demonstrated opposing responses to a constant and predictable F0 perturbation (on from the production onset) but these effects barely carried over once the feedback was back to normal, depicting a pattern that bears some resemblance to compensatory responses. Experiencing a F0 shift that is perceived as self-generated (because it was precisely just-noticeable) is not enough to force speakers to behave more consistently and more homogeneously in an opposing manner. On the contrary, our results suggest that the type of the response as well as the magnitude of the response do not depend in any trivial way on the sensitivity of participants to their own voice pitch. Based on this finding, we speculate that error correction could possibly occur even with a bionic ear, typically even when F0 cues are too subtle for cochlear implant users to detect accurately.

Coarticulatory Aspects of the Fluent Speech of French and Italian People Who Stutter Under Altered Auditory Feedback

A number of studies have shown that phonetic peculiarities, especially at the coarticulation level, exist in the disfluent as well as in the perceptively fluent speech of people who stutter (PWS). However, results from fluent speech are very disparate and not easily interpretable. Are the coarticulatory features observed in fluent speech of PWS a manifestation of the disorder, or rather a compensation for the disorder itself? The purpose of the present study is to investigate the coarticulatory behavior in the fluent speech of PWS in the attempt to answer the question on its symptomatic or adaptive nature. In order to achieve this, we have studied the speech of 21 adult PWS (10 French and 11 Italian) compared to that of 20 fluent adults (10 French and 10 Italian). The participants had to repeat simple CV syllables in short carrier sentences, where C = /b, d, g/ and V = /a, i, u/. Crucially, this repetition task was performed in order to compare fluent speech coarticulation of PWS to that of PWNS, and to compare the coarticulation of PWS under a condition with normal auditory feedback (NAF) and under a fluency-enhancing condition due to an altered auditory feedback (AAF). This is the first study, to our knowledge, to investigate the coarticulation behavior under AAF. The degree of coarticulation was measured by means of the Locus Equations (LE). The coarticulation degree observed in fluent PWS speech is lower than that of the PWNS, and, more importantly, in AAF condition, PWS coarticulation appears even weaker than in the NAF condition. The results allow to interpret the lower degree of coarticulation found in fluent speech of PWS under NAF condition as a compensation for the disorder, based on the fact that PWS’s coarticulation is weakening in fluency-enhancing conditions, further away from the degree of coarticulation observed in PWNS. Since a lower degree of coarticulation is associated to a greater separation between the places of articulation of the consonant and the vowel, these results are compatible with the hypothesis that larger articulatory movements could be responsible for the stabilization of the PWS speech motor system, increasing the kinesthetic feedback from the effector system. This interpretation shares with a number of relatively recent proposal the idea that stuttering derives from an impaired feedforward (open-loop) control system, which makes PWS rely more heavily on a feedback-based (closed loop) motor control strategy.