Enabling New Articulatory Gestures in Children With Persistent Speech Sound Disorders Using Ultrasound Visual Biofeedback

Usability of Two Ultrasound Tongue Imaging Devices in Speech-Language Pathology

PURPOSE

Ultrasound tongue imaging is a promising tool in speech-language pathology; however, little is known about the usability of ultrasound scanners for speech-language pathologists (SLPs), who typically have low familiarity with ultrasound imaging. This study looks at the usability of two ultrasound scanner models for SLPs: a Sonosite all-in-one scanner with a wired probe, and a Clarius wireless probe scanner, used with a tablet app.

METHOD

Twelve SLPs and phonetics experts (all female) participated in two filmed sessions in our lab where they learned to use the two models of scanners with custom-written manuals. Each scanner was used in each session to complete a simple task including recording videos of their or the experimenter's tongue. After each use of a scanner, participants completed a modified and translated version of the System Usability Scale. The time required to complete the task was measured. Two expert judges rated the quality of the video recordings.

RESULTS

Participants took less time to complete the task and improved their choice of settings from the first to the second session, regardless of the scanner being used. In the usability scale, SLPs showed a higher satisfaction with the wireless tablet interface than with the all-in-one ultrasound interface. The tablet interface with the wireless scanner also allowed better choices of settings. However, in the second session, positioning of the probe was better with the all-in-one scanner, which has a smaller and lighter probe.

CONCLUSIONS

For SLPs, the usability of a wireless ultrasound scanner with a mobile application seems better than that of an all-in-one scanner. However, its cumbersome probe seems to hamper probe positioning. Future studies should include a lightweight ultrasound scanner that connects via USB to a laptop or tablet and provide image interpretation training for the SLPs.

Ultrasound Tongue Imaging in Research and Practice with People with Cleft Palate ± Cleft Lip

Ultrasound tongue imaging is becoming popular as a tool for both phonetic research and biofeedback for treating speech sound disorders. Despite this, it has not yet been adopted into cleft palate ± cleft lip care. This paper explores why this might be the case by highlighting recent research in this area and exploring the advantages and disadvantages of using ultrasound in cleft palate ± cleft lip care. Research suggests that technological advances have largely overcome some of the difficulties of employing ultrasound with this population and we predict a future increase in the clinical application of the tool.

Feasibility of using ultrasound visual biofeedback to treat persistent speech sound disorders in children with cleft palate- a case series

The current study aimed to assess the effectiveness of incorporating ultrasound visual biofeedback (UVB) into a treatment programme addressing persistent speech sound disorders linked to cleft palate in children who have been unresponsive to traditional therapy approaches. Materials and Methods. A single-subject multiple baseline experiment was conducted with five children aged 6:5-13:5 over a period of 16 therapy sessions. Treatment focused on providing cues from real-time ultrasound images to assist children in modifying their tongue movements. Probe data were collected before, mid, and post-treatment to assess target consonant accuracy for 50 untreated words. The results of the statistical analysis suggested participants showed a significant increase in percent target consonant accuracy as a result of intervention using UVB. Although most of the participants exhibited progress in generalising learned phonemes to untreated words, some did not show improvement in gaining generalisation from treated phonemic contexts to those untreated ones. When traditional methods fail to yield significant progress, incorporating ultrasound biofeedback into the treatment programme emerges as a viable option to enhance sound accuracy in children with persistent speech sound disorders resulting from cleft palate.

A Randomized Controlled Trial of Treatment Distribution and Biofeedback Effects on Speech Production in School-Age Children With Apraxia of Speech

PURPOSE

This study examines how ultrasound biofeedback and intensive treatment distribution affect speech sound generalization during an evidence-based treatment, Speech Motor Chaining, for children with persisting speech errors associated with childhood apraxia of speech (CAS).

METHOD

In a 2 × 2 factorial randomized controlled trial, children ages 9-17 years meeting CAS criteria were randomized to receive (a) a distributed treatment (20 sessions twice weekly over 10 weeks) or intensive treatment (20 hr in 5 weeks, with 10 hr in Week 1) and (b) treatment with or without biofeedback. Due to the COVID pandemic, some participants were randomized to distributed/intensive telepractice treatment only. The primary outcome was percent target sounds correct on untreated phrases (i.e., generalization) at the 10-week time point. More than 50,000 narrow phonetic transcriptions were analyzed.

RESULTS

Forty-eight participants completed treatment. Intensive treatment significantly increased generalization at all time points. The effect of biofeedback was significant at 5 weeks from the start of treatment but not significant at the primary 10-week time point. However, when comparing each group immediately after their 20 hr of treatment finished, generalization was significantly greater in intensive over distributed treatment and greater in ultrasound over no-ultrasound treatment (with a significant interaction favoring intensive treatment with ultrasound). Only the advantage of intensive treatment remained significant 5 weeks after groups finished treatment. There was no significant difference between face-to-face and telepractice modalities.

CONCLUSIONS

When the number of treatment hours is fixed, an intensive schedule of Speech Motor Chaining facilitated greater improvement than a distributed schedule. Ultrasound biofeedback initially accelerated learning, but the benefits may dissipate as treatment continues or after it ends.

Masked Modeling-Based Ultrasound Image Classification via Self-Supervised Learning

Recently, deep learning-based methods have emerged as the preferred approach for ultrasound data analysis. However, these methods often require large-scale annotated datasets for training deep models, which are not readily available in practical scenarios. Additionally, the presence of speckle noise and other imaging artifacts can introduce numerous hard examples for ultrasound data classification. In this paper, drawing inspiration from self-supervised learning techniques, we present a pre-training method based on mask modeling specifically designed for ultrasound data. Our study investigates three different mask modeling strategies: random masking, vertical masking, and horizontal masking. By employing these strategies, our pre-training approach aims to predict the masked portion of the ultrasound images. Notably, our method does not rely on externally labeled data, allowing us to extract representative features without the need for human annotation. Consequently, we can leverage unlabeled datasets for pre-training. Furthermore, to address the challenges posed by hard samples in ultrasound data, we propose a novel hard sample mining strategy. To evaluate the effectiveness of our proposed method, we conduct experiments on two datasets. The experimental results demonstrate that our approach outperforms other state-of-the-art methods in ultrasound image classification. This indicates the superiority of our pre-training method and its ability to extract discriminative features from ultrasound data, even in the presence of hard examples.

Intervention for residual speech errors in adolescents and adults: A systematised review

When speech sound errors persist beyond childhood they are classified as residual speech errors (RSE) and may have detrimental impacts on an individual's social, educational and employment participation. Despite this, individuals who present with RSE are usually not prioritised on large caseloads. The aim of this literature review was to examine what intervention approaches are available in remediating RSE, and how effective are they for adolescents and adults? A systematised review was undertaken. Comprehensive and systematic searching included search of terms across seven databases, forward and reverse citation searching, and key author contact. Thirty articles underwent critical appraisal before data extraction. Inductive thematic analysis was done before completion of a narrative review. Twenty-three (76.6%) of the articles were from the US and most studies involved intervention for 'r' (90%). Intervention approaches for RSE involved traditional articulation therapy, auditory perceptual training, instrumental approaches, and approaches based on principles of motor learning. Twenty-one studies (70%) investigated the use of more than one intervention approach. Measures of intervention efficacy varied between studies; however, any intervention approach tended to be more successful if delivered in a more intensive schedule. A variety of approaches can be used for RSE, but a combination of high intensity, traditional therapy with adjunctive instrumental biofeedback may be most effective, especially with highly motivated individuals. Unfortunately, this usually requires costly equipment and training to implement. More information about the best dosage and intensity intervention for RSE, evaluated for a larger number of phonemes across other languages and dialects is required.

Auditory-perceptual evaluation with visual analogue scale: feasibility and preliminary evidence of ultrasound visual feedback treatment of Finnish [r]

Accumulating evidence suggests that ultrasound visual feedback increases the treatment efficacy for persistent speech sound errors. However, the available evidence is mostly from English. This is a feasibility study of ultrasound visual feedback for treating distortion of Finnish [r]. We developed a web-based application for auditory-perceptual judgement. We investigated the impact of listener's experience on perceptual judgement and the intra-rater reliability of listeners. Four boys (10-11 years) with distortion of [r], otherwise typical development, partook in eight ultrasound treatment sessions. In total, 117 [r] samples collected at pre- and post-intervention were judged with visual analogue scale (VAS) by two listener groups: five speech and language therapists (SLTs) and six SLT students. We constructed a linear mixed-effects model with fixed effects for time and listener group and several random effects. Our findings indicate that measurement time had a significant main effect on judgement results, χ² = 78.82, p < 0.001. Effect of listener group was non-significant, but a significant main effect of interaction of group × time, χ² = 6.33, p < 0.012 was observed. We further explored the effect of group with nested models, and results revealed a non-significant effect of group. The average intra-rater correlation of the 11 listeners was 0.83 for the pre-intervention samples and 0.92 for post-intervention showing a good or excellent degree of agreement. Finnish [r] sound can be evaluated with VAS and ultrasound visual feedback is a feasible and promising method in treatment for distortion of [r], and its efficacy should be further assessed.

A Qualitative Analysis of Clinician Perspectives of Ultrasound Biofeedback for Speech Sound Disorders

PURPOSE

Ultrasound biofeedback therapy (UBT) is a relatively new type of technology-assisted speech-language therapy and has shown promise in remediating speech sound disorders. However, there is a current lack of understanding of the barriers and benefits that may influence the usage behavior and clinical decision making for the implementation of UBT from a clinician perspective. In this qualitative study, we explore the perspectives of speech-language pathologists (SLPs) who have used ultrasound biofeedback in programs of speech sound therapy using the unified theory of acceptance and use of technology (UTAUT) model.

METHOD

Seven SLPs who had clinical experience treating speech sound disorders with UBT participated. Semistructured in-depth interviews were conducted and video-recorded. Two coders coded and categorized the transcribed data, with consensus established with a third coder. Using thematic analysis, the data were exploratorily grouped into themes along components of the UTAUT model.

RESULTS

The highest number of codes was sorted into the "effort expectancy" theme, followed by "performance expectancy," "social influence," and "facilitating conditions" themes of the UTAUT model. Clinicians identified multiple perceived barriers and benefits to the use of ultrasound technology. The top identified barrier was limited accessibility, and the top benefit was the ability to visualize a client's articulatory response to cues on a display.

CONCLUSIONS

Clinicians prioritized "effort expectancy" and "performance expectancy" when reflecting on the use of ultrasound biofeedback for speech sound disorders. Clinicians spoke favorably about using UBT for speech sound disorder treatment but acknowledged institutional barriers and limitations at organizational and social levels.

Clinicians' Perspectives of Treatment for Lateralization Errors: A Quantitative and Qualitative Study

PURPOSE

This mixed-methods study aimed to obtain information regarding speech-language pathologists' (SLPs) perspectives about treatment of lateralization errors (LEs), challenges to implementing evidence-based LE treatment practice, and the sources SLPs' use to find evidence to treat LEs. This information can assist our understanding of ways to facilitate the uptake of evidence-based practice into the everyday treatment of clients with this disorder.

METHOD

A convergent parallel mixed-methods design was used to collect data from SLPs (N = 214) using 24 questions from an online survey distributed through electronic mailing lists and Speech and Hearing State Associations. Quantitative data were analyzed using frequencies and averages; themes and subthemes of qualitative data were analyzed using a content analysis approach with no a priori codes. Quantitative and qualitative results were compared and integrated.

RESULTS

Participants believed that LEs required individualized treatment before the age of 5 years, were largely caused by structural and neuromuscular factors, and required an understanding of orofacial and dental structure and function. Challenges to implementing LE treatment included a lack of skills and knowledge specific to LEs, competing demands on clinicians' time and resources, and a research-practice gap. Sources of evidence frequently used to obtain information about LE treatment were colleagues, trainings, workshops, and American Speech-Language-Hearing Association journals.

CONCLUSIONS

Clinicians believe that LE treatment is challenging and requires skill training. Future research in LEs will need to consider the real-world decisions clinicians must make when treating this disorder as well as clinicians' everyday constraints and challenges.

Protocol for SonoSpeech Cleft Pilot: a mixed-methods pilot randomized control trial of ultrasound visual biofeedback versus standard intervention for children with cleft lip and palate

Background

Children with cleft lip and palate can continue to have problems producing clear speech after surgery. This can lead to social, emotional, and educational challenges. Typical treatment involves teaching children the correct tongue movements to produce speech sounds. This is known as articulation intervention. However, this intervention is challenging because the tongue is hidden from view and movements are difficult to see and describe. This pilot randomized control trial will try a new treatment, ultrasound visual biofeedback (U-VBF) versus standard articulatory intervention for children with cleft lip and palate, as comparison. Feasibility outcomes will be determined.

Methods/design

The Sonospeech project will enroll up to 40 children with cleft lip and palate aged 4;6 to 16 in a mixed-methods randomized controlled trial with blinded assessors. Children will receive either six sessions of U-VBF or articulation intervention. The primary goals of this pilot are to assess the feasibility and inform the design of a full-scale RCT of U-VBF for children with cleft speech characteristics. This will be achieved by determining the following outcome measures: recruitment/attrition rates; measures of pre-post follow-up completion; and acceptability of the randomization and interventions to families.

Discussion

Larger trials of speech interventions for children with cleft lip and palate are needed. This pilot/feasibility study will determine whether a larger randomized control trial comparing ultrasound and articulation interventions is feasible.

Trial registration

ISRCTN, ISRCTN17441953. Registered 22 March 2021. See Table 2 in Appendix 1 for all items.

An Examination of Articulatory Precision in Autistic Children and Adults

PURPOSE

According to the speech attunement framework, autistic individuals lack the ability and/or motivation to "tune up" their speech to the same level of precision as their neurotypical peers. However, previous studies exploring the articulatory patterns of autistic individuals have yielded disparate findings. One reason contrasting conclusions exist may be because studies have relied on perceptual measures of articulation. Here, we use an objective acoustic measure of articulatory precision to explore the articulatory patterns of autistic children and adults.

METHOD

This was a retrospective analysis of an existing corpus of 900 recorded speech samples taken from 30 adult and 30 child participants across two different population groups: autistic individuals (autism spectrum disorder [ASD] group) and neurotypical individuals (neurotypical [NT] group). Articulatory precision scores were calculated using an automated metric that compares observed acoustics to the expected acoustics for each phoneme production. Linear mixed-effects models were used to compare the articulatory precision scores across population group (i.e., ASD group vs. NT group) and to see if these differences were moderated by age group (i.e., children vs. adult).

RESULTS

The speech of autistic individuals was characterized by reduced articulatory precision relative to their neurotypical peers. This pattern was not significantly moderated by age, indicating it occurred in both the children and adult groups.

CONCLUSIONS

Our preliminary findings indicate that imprecise articulation may be a characteristic of the speech of autistic individuals in both childhood and adulthood. These findings are in line with predictions posited by the speech attunement framework. Given the current lack of speech markers for this clinical population and the importance of speech quality in the social integration of autistic individuals, our results advance articulatory precision as a viable and important target for future research.

Visual feedback of the tongue influences speech adaptation to a physical modification of the oral cavity

Studies examining sensorimotor adaptation of speech to changing sensory conditions have demonstrated a central role for both auditory and somatosensory feedback in speech motor learning. The potential influence of visual feedback of oral articulators, which is not typically available during speech production but may nonetheless enhance oral motor control, remains poorly understood. The present study explores the influence of ultrasound visual feedback of the tongue on adaptation of speech production (focusing on the sound /s/) to a physical perturbation of the oral articulators (prosthesis altering the shape of the hard palate). Two visual feedback groups were tested that differed in the two-dimensional plane being imaged (coronal or sagittal) during practice producing /s/ words, along with a no-visual-feedback control group. Participants in the coronal condition were found to adapt their speech production across a broader range of acoustic spectral moments and syllable contexts than the no-feedback controls. In contrast, the sagittal group showed reduced adaptation compared to no-feedback controls. The results indicate that real-time visual feedback of the tongue is spontaneously integrated during speech motor adaptation, with effects that can enhance or interfere with oral motor learning depending on compatibility of the visual articulatory information with requirements of the speaking task.

The Dorsal Differentiation of Velar From Alveolar Stops in Typically Developing Children and Children With Persistent Velar Fronting

Purpose This study has two key aims: first, to provide developmental articulatory norms for the alveolar-velar distinction in 30 English-speaking typically developing (TD) children; second, to illustrate the utility of the reported measures for classifying and quantifying the speech of children with a history of persistent velar fronting as they develop the contrast longitudinally. Method This study involved secondary data analysis of the UltraSuite corpus comprising ultrasound tongue imaging recordings of speech materials from 30 typical children and longitudinal data from five children with persistent velar fronting undergoing ultrasound visual biofeedback intervention. We present two new measures of coronal dorsal differentiation: KTMax and KT crescent area. These measures distinguish /k/ and /t/ by quantifying the magnitude of this distinction in absolute spatial terms (mm of linear dorsal difference). For the typical children, we report these measures in corner vowel contexts. We then compare these to dorsal productions by the children with speech disorders, before, during, and after intervention. Results Both measures reliably distinguished /k/ and /t/ in TD children. There was an effect of vowel, with larger KTmax and KT crescent area in /a/ and /o/ vowel contexts than in an /i/ context. The children with persistent velar fronting showed KTmax values near zero before intervention, showing a complete merger between /k/ and /t/. During intervention, they showed variable KTmax values. Post intervention, they showed values within the range of typical children. Conclusions This study provides articulatory norms derived from ultrasound tongue imaging for the dorsal differentiation in alveolar and velar stops in TD children. By applying these norms to children with persistent velar fronting as they acquire this contrast, we see that /k/ is acquired in an articulatorily gradient manner.

Use of ultrasound visual feedback in speech intervention for children with cochlear implants

The purpose of the present study was to evaluate the efficacy of ultrasound visual feedback in speech intervention for young children with cochlear implants. Although ultrasound technology has been used for intervention in children with speech sound disorders, there is little systematic evidence regarding relative efficacy of ultrasound visual feedback for young children with cochlear implants. Two children with cochlear implants participated in this study. The children's articulation was tested using Goldman-Fristoe Test of Articulation-2 and probes. Therapy was provided semi-weekly for 30-minute sessions over the course of nine to 10 weeks. Visual inspection showed an increasing trend in production accuracy to the criterion accuracy of 80% for target sounds. Maintenance of skills were observed at two weeks and two months post-intervention. The results of this study indicated that ultrasound visual feedback is likely an effective intervention tool for treating speech sound disorders in children with cochlear implants. Future studies including a larger sample size should be conducted to verify these findings.

Auditory Perception and Ultrasound Biofeedback Treatment Outcomes for Children With Residual /ɹ/ Distortions: A Randomized Controlled Trial

Purpose This study evaluated whether outcomes from treatment, which includes ultrasound visual feedback (UVF), would be more or less effective when combined with auditory perception training for children with residual /ɹ/ errors. Method Children ages 8-16 years with /ɹ/ distortions participated in speech therapy that included real-time UVF of the tongue. Thirty-eight participants were randomized to speech therapy conditions that included a primary focus on articulation using UVF or a condition that included auditory perceptual training plus UVF (incorporating category goodness judgments and self-monitoring). Generalization of /ɹ/ production accuracy to untrained words was assessed before and after 14 hr of therapy. Additionally, the role of auditory perceptual acuity was explored using a synthetic /ɹ/-/w/ continuum. Results There was no difference between the treatment groups in rate of improvement of /ɹ/ accuracy (increase of 34% for each group; p = .95, ηp2 = .00). However, pretreatment auditory acuity was associated with treatment progress in both groups, with finer perceptual acuity corresponding to greater progress (p = .015, ηp2 = .182). Conclusion Similar gains in speech sound accuracy can be made with treatment that includes UVF with or without auditory perceptual training. Fine-grained perceptual acuity may be a prognostic indicator with treatment. Supplemental Material https://doi.org/10.23641/asha.11886219.

Three-/Four-Dimensional Ultrasound Technology in Speech Research

Purpose

Speech production is a complex 3-dimensional (3D) process, and yet most of what is known about it is derived from 2D midsagittal data. The relatively recent development of safe 3D imaging technologies (including magnetic resonance imaging and ultrasound) provide new opportunities to revisit and reformulate what is already known and to push the boundaries of current knowledge still further. A particularly useful imaging modality for this purpose is 3D/4D ultrasound, which until very recently was not well suited for studies in speech research. This technical report presents an overview of what 3D/4D ultrasound can contribute to speech research, with a focus on 2 demonstrations.

Conclusion

The 1st demonstration illustrates how 3D/4D ultrasound makes it possible to image certain vocal tract anatomical structures and planes that conventional 2D ultrasound is not capable of imaging. The 2nd demonstration illustrates how 3D/4D ultrasound can be combined with static 3D magnetic resonance imaging to provide new insight into the temporal pervasiveness and spatial extensiveness of lateral contact between the tongue and palate–teeth during speech production.

The Impact of Real-Time Articulatory Information on Phonetic Transcription: Ultrasound-Aided Transcription in Cleft Lip and Palate Speech

OBJECTIVE

This study investigated whether adding an additional modality, namely ultrasound tongue imaging (UTI), to perception-based phonetic transcription impacted on the identification of compensatory articulations and on interrater reliability.

PATIENTS AND METHODS

Thirty-nine English-speaking children aged 3-12 years with cleft lip and palate (CLP) were recorded producing repetitions of /aCa/ for all places of articulation with simultaneous audio recording and probe-stabilized ultrasound (US). Three types of transcriptions were performed: (1) descriptive observations from the live US by the clinician recording the data, (2) US-aided transcription (UA) by two US-trained clinicians, and (3) traditional phonetic transcription by two CLP specialists from audio recording. We compared the number of consonants identified as in error by each transcriber and then classified errors into eight different subcategories.

RESULTS

Both UA and traditional transcription yielded similar error detection rates; however, these were significantly higher than the observations recorded live in the clinic. Interrater reliability for the US transcribers was substantial (κ = 0.65) compared to moderate (κ = 0.47) for the traditional transcribers. US transcribers were more likely to identify covert errors such as double articulations and retroflexion than the audio-only transcribers.

CONCLUSION

UTI is a useful complement to traditional phonetic transcription for CLP speech.