1
|
Talaat M, Barari K, Si XA, Xi J. Schlieren imaging and video classification of alphabet pronunciations: exploiting phonetic flows for speech recognition and speech therapy. Vis Comput Ind Biomed Art 2024; 7:12. [PMID: 38772963 PMCID: PMC11109036 DOI: 10.1186/s42492-024-00163-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2024] [Accepted: 04/29/2024] [Indexed: 05/23/2024] Open
Abstract
Speech is a highly coordinated process that requires precise control over vocal tract morphology/motion to produce intelligible sounds while simultaneously generating unique exhaled flow patterns. The schlieren imaging technique visualizes airflows with subtle density variations. It is hypothesized that speech flows captured by schlieren, when analyzed using a hybrid of convolutional neural network (CNN) and long short-term memory (LSTM) network, can recognize alphabet pronunciations, thus facilitating automatic speech recognition and speech disorder therapy. This study evaluates the feasibility of using a CNN-based video classification network to differentiate speech flows corresponding to the first four alphabets: /A/, /B/, /C/, and /D/. A schlieren optical system was developed, and the speech flows of alphabet pronunciations were recorded for two participants at an acquisition rate of 60 frames per second. A total of 640 video clips, each lasting 1 s, were utilized to train and test a hybrid CNN-LSTM network. Acoustic analyses of the recorded sounds were conducted to understand the phonetic differences among the four alphabets. The hybrid CNN-LSTM network was trained separately on four datasets of varying sizes (i.e., 20, 30, 40, 50 videos per alphabet), all achieving over 95% accuracy in classifying videos of the same participant. However, the network's performance declined when tested on speech flows from a different participant, with accuracy dropping to around 44%, indicating significant inter-participant variability in alphabet pronunciation. Retraining the network with videos from both participants improved accuracy to 93% on the second participant. Analysis of misclassified videos indicated that factors such as low video quality and disproportional head size affected accuracy. These results highlight the potential of CNN-assisted speech recognition and speech therapy using articulation flows, although challenges remain in expanding the alphabet set and participant cohort.
Collapse
Affiliation(s)
- Mohamed Talaat
- Department of Biomedical Engineering, University of Massachusetts, Lowell, MA, 01854, USA
| | - Kian Barari
- Department of Biomedical Engineering, University of Massachusetts, Lowell, MA, 01854, USA
| | - Xiuhua April Si
- Department of Aerospace, Industrial, and Mechanical Engineering, California Baptist University, Riverside, CA, 92504, USA
| | - Jinxiang Xi
- Department of Biomedical Engineering, University of Massachusetts, Lowell, MA, 01854, USA.
| |
Collapse
|
2
|
Nicoll A, Roulstone S, Williams B, Maxwell M. Understanding capacity for implementing new interventions: A qualitative study of speech and language therapy services for children with speech sound disorder. INTERNATIONAL JOURNAL OF LANGUAGE & COMMUNICATION DISORDERS 2024; 59:1002-1017. [PMID: 37929610 DOI: 10.1111/1460-6984.12979] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/21/2023] [Accepted: 10/18/2023] [Indexed: 11/07/2023]
Abstract
BACKGROUND Many speech sound disorder (SSD) interventions with a long-term evidence base are 'new' to clinical practice, and the role of services in supporting or constraining capacity for practice change is underexplored. Innovations from implementation science may offer solutions to this research-practice gap but have not previously been applied to SSD. AIM To explain variation in speech and language therapy service capacity to implement new SSD interventions. METHODS & PROCEDURES We conducted an intensive, case-based qualitative study with 42 speech and language therapists (SLTs) in three NHS services (n = 39) and private practice (n = 3) in Scotland. We explored therapists' diverse experiences of SSD practice change through individual interviews (n = 28) or self-generated paired (n = 2) or focus groups (n = 3). A theoretical framework (Normalization Process Theory) helped us understand how the service context contributed to the way therapists engaged with different practice changes. OUTCOMES & RESULTS We identified six types ('cases') of practice change, two of which involved the new SSD interventions. We focus on these two cases ('Transforming' and 'Venturing') and use Normalization Process Theory's Cognitive participation construct to explain implementation (or not) of new SSD interventions in routine practice. Therapists were becoming aware of the new interventions through knowledge brokers, professional networks and an intervention database. In the Transforming case, new SSD interventions for selected children were becoming part of local routine practice. Transforming was the result of a favourable service structure, a sustained and supported 'push' that made implementation of the new interventions a service priority, and considerable collective time to think about doing it. 'Venturing' happened where the new SSD interventions were not a service priority. It involved individual or informal groups of therapists trying out or using one or more of the new interventions with selected children within the constraints of their service context. CONCLUSIONS & IMPLICATIONS New, evidence-based SSD interventions may be challenging to implement in routine practice because they have in common a need for therapists who understand applied linguistics and can be flexible with service delivery. Appreciating what it really takes to do routine intervention differently is vital for managers and services who have to make decisions about priorities for implementation, along with realistic plans for resourcing and supporting it. WHAT THIS PAPER ADDS What is already known on the subject Many SSD interventions have an evidence base but are not widely adopted into routine clinical practice. Addressing this is not just about individual therapists or education/training, as workplace pressures and service delivery models make it difficult to change practice. What this paper adds to the existing knowledge This paper applies innovations from implementation science to help explain how what is going on in services can support or constrain capacity for implementing evidence-based SSD interventions. What are the potential or actual clinical implications of this work? Service managers and therapists will have a clearer idea of the time and support they may realistically have to invest for new SSD interventions to be used routinely.
Collapse
Affiliation(s)
- Avril Nicoll
- Aberdeen Centre for Women's Health Research, University of Aberdeen, Foresterhill, Aberdeen, UK
| | - Sue Roulstone
- Bristol Speech & Language Therapy Research Unit, Southmead Hospital, Bristol, UK
| | - Brian Williams
- UHI Institute of Health Research and Innovation, Centre for Health Science, Inverness, UK
| | - Margaret Maxwell
- NMAHP-RU, Pathfoot Building, University of Stirling, Stirling, UK
| |
Collapse
|
3
|
Rodgers L, Botting N, Cartwright M, Harding S, Herman R. Shared characteristics of intervention techniques for oral vocabulary and speech comprehensibility in preschool children with co-occurring features of developmental language disorder and a phonological speech sound disorder: protocol for a systematic review with narrative synthesis. BMJ Open 2023; 13:e071262. [PMID: 37263699 DOI: 10.1136/bmjopen-2022-071262] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 06/03/2023] Open
Abstract
INTRODUCTION Evidence suggests that over one-third of young children with developmental language disorder (DLD) or speech sound disorder (SSD) have co-occurring features of both. A co-occurring DLD and SSD profile is associated with negative long-term outcomes relating to communication, literacy and emotional well-being. However, the best treatment approach for young children with this profile is not understood. The aim of the proposed review is to identify intervention techniques for both DLD and SSD, along with their shared characteristics. The findings will then be analysed in the context of relevant theory. This will inform the content for a new or adapted intervention for these children. METHODS AND ANALYSIS This search will build on a previous systematic review by Roulstone et al (2015) but with a specific focus on oral vocabulary (DLD outcome) and speech comprehensibility (SSD outcome). These outcomes were identified by parents and speech and language therapists within the prestudy stakeholder engagement work. The following databases will be searched for articles from January 2012 onwards: Ovid Emcare, MEDLINE Complete, CINAHL, APA PsycINFO, Communication Source and ERIC. Two reviewers will independently perform the title/abstract screening and the full-text screening with the exclusion criteria document being revised in an iterative process. Articles written in languages other than English will be excluded. Data will be extracted regarding key participant and intervention criteria, including technique dosage and delivery details. This information will then be pooled into a structured narrative synthesis. ETHICS AND DISSEMINATION Ethical approval is not needed for a systematic review protocol. Dissemination of findings will be through peer-reviewed publications, social media, and project steering group networks. PROSPERO REGISTRATION NUMBER CRD4202237393.
Collapse
Affiliation(s)
- Lucy Rodgers
- Children's Speech and Language Therapy, Sussex Community NHS Foundation Trust, Brighton, UK
- Department of Language and Communication Science, City University of London, London, UK
| | - Nicola Botting
- Department of Language and Communication Science, City University of London, London, UK
| | - Martin Cartwright
- Department of Health Services Research and Management, City University of London, London, UK
| | - Sam Harding
- Bristol Speech and Language Therapy Research Unit, North Bristol NHS Trust, Westbury on Trym, UK
| | - Rosalind Herman
- Department of Language and Communication Science, City University of London, London, UK
| |
Collapse
|
4
|
McKean C, Watson R, Charlton J, Roulstone S, Holme C, Gilroy V, Law J. ‘Making the most of together time’: development of a Health Visitor–led intervention to support children’s early language and communication development at the 2–2½-year-old review. Pilot Feasibility Stud 2022; 8:35. [PMID: 35135632 PMCID: PMC8822642 DOI: 10.1186/s40814-022-00978-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2021] [Accepted: 01/11/2022] [Indexed: 11/10/2022] Open
Abstract
Background Early interventions to support young children’s language development through responsive parent–child interaction have proven efficacy but are not currently delivered universally. A potential universal delivery platform is the Health Visitor (HV)–led 2–2½-year-old review in England’s Healthy Child Programme. It is unclear if it is feasible to offer such interventions through this platform. We report an intervention development process, including extensive stakeholder consultation and co-design which aimed to develop an acceptable, feasible and equitable early language intervention for delivery in this context. Methods The study involved five phases including 13 stakeholder co-design workshops with 7 parents and 39 practitioners (HVs, early years practitioners and speech and language therapists): (1) Identification of existing intervention evidence, (2) qualitative review of intervention studies extracting candidate target behaviours for intervention and intervention techniques, (3) co-design workshops with parents and practitioners examining acceptability, barriers and enablers to those behaviours and techniques (particular attention was paid to diverse family circumstances and the range of barriers which might exist), (4) findings were analysed using COM-B and theoretical domains frameworks and a prototype intervention model designed, and (5) co-design workshops iteratively refined the proposed model. Results Practitioners were committed to offering language intervention at the 2–2½-year-old review but were not sure precisely how to do so. Parents/caregivers wanted to be proactive and to have agency in supporting their own children and to do this as soon as possible. For equitable intervention, it must be proportionate, with higher ‘intensity’ for higher levels of disadvantage, and tailored, offering differing approaches considering the specific barriers and enablers, assets and challenges in each family. The importance and potential fragility of alliances between parent/caregiver and practitioner were identified as key, and so, strategies to engender successful collaborative partnership are also embedded in intervention design. Conclusion It is possible to develop a universal intervention which parents and practitioners judge would be acceptable, feasible and equitable for use at the 2–2½-year review to promote children’s language development. The result is one of the most explicitly developed universal interventions to promote children’s language development. Further development and piloting is required to develop materials to support successful widespread implementation. Supplementary Information The online version contains supplementary material available at 10.1186/s40814-022-00978-5.
Collapse
|
5
|
Rezaeerezvan S, Kareshki H, Pakdaman M. The Effect of Cognitive-Behavioral Play Therapy on Improvements in Expressive Linguistic Disorders of Bilingual Children. Front Psychol 2022; 12:626422. [PMID: 35069301 PMCID: PMC8770813 DOI: 10.3389/fpsyg.2021.626422] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2020] [Accepted: 10/22/2021] [Indexed: 12/02/2022] Open
Abstract
The present study attempted to investigate the effect of cognitive-behavioral play therapy (CBPT) on the improvements in the expressive linguistic disorders of bilingual children. The population consists of all bilingual children with expressive linguistic disorders studying in preschools. Considering the study’s objectives, a sample of 60 people, in three groups (experimental, control, and pseudo-control), were selected using WISC, TOLD, and clinical interviews. The experimental group members participated in CBPT training sessions. The training consisted of twelve 90-min sessions, three times per week programs held every other day. The pseudo-control group received training different from play therapy. The experimental group members were subjected to the follow-up test 2 months after the end of the intervention. All three groups sat the TOLD3 test before and after the experiment. Data analysis was carried out using ANCOVA. The results of data analysis suggested that CBPT can improve the expressive language disorders of bilingual children.
Collapse
Affiliation(s)
| | - Hossein Kareshki
- Department of Psychology, Faculty of Psychology & Educational Sciences, Ferdowsi University of Mashhad, Mashhad, Iran
| | - Majid Pakdaman
- Department of Psychology, Qaenat Branch, Islamic Azad University, Qaenat, Iran
| |
Collapse
|
6
|
Nicoll A, Maxwell M, Williams B. Achieving 'coherence' in routine practice: a qualitative case-based study to describe speech and language therapy interventions with implementation in mind. Implement Sci Commun 2021; 2:56. [PMID: 34039444 PMCID: PMC8157687 DOI: 10.1186/s43058-021-00159-0] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2020] [Accepted: 05/13/2021] [Indexed: 11/16/2022] Open
Abstract
Background Implementation depends on healthcare professionals being able to make sense of a new intervention in relation to their routine practice. Normalisation Process Theory refers to this as coherence work. However, specifying what it takes to achieve coherence is challenging because of variations in new interventions, routine practices and the relationship between them. Frameworks for intervention description may offer a way forward, as they provide broad descriptive categories for comparing complex interventions. To date such frameworks have not been informed by implementation theory, so do not account for the coherence work involved in holding aspects of routine practice constant while doing other aspects differently. Using speech and language therapy as an empirical exemplar, we explored therapists’ experiences of practice change and developed a framework to show how coherence of child speech interventions is achieved. Methods We conducted a retrospective case-based qualitative study of how interventions for child speech problems had changed across three NHS speech and language therapy services and private practice in Scotland. A coherence framework was derived through interplay between empirical work with 42 therapists (using in-depth interviews, or self-organised pairs or small focus groups) and Normalisation Process Theory’s construct of coherence. Findings Therapists reported a range of practice changes, which had demanded different types of coherence work. Non-traditional interventions had featured for many years in the profession’s research literature but not in clinical practice. Achieving coherence with these interventions was intellectually demanding because they challenged the traditional linguistic assumptions underpinning routine practice. Implementation was also logistically demanding, and therapists felt they had little agency to vary what was locally conventional for their service. In addition, achieving coherence took considerable relational work. Non-traditional interventions were often difficult to explain to children and parents, involved culturally uncomfortable repetitive drills and required therapists to do more tailoring of intervention for individual children. Conclusions The intervention coherence framework has practical and theoretical applications. It is designed to help therapists, services and researchers anticipate and address barriers to achieving coherence when implementing non-routine interventions. It also represents a worked example of using theory to make intervention description both user-focused and implementation-friendly. Supplementary Information The online version contains supplementary material available at 10.1186/s43058-021-00159-0.
Collapse
Affiliation(s)
- Avril Nicoll
- Nursing, Midwifery and Allied Health Professions Research Unit, University of Stirling, Stirling, UK. .,Health Services Research Unit, University of Aberdeen, Aberdeen, UK.
| | - Margaret Maxwell
- Nursing, Midwifery and Allied Health Professions Research Unit, University of Stirling, Stirling, UK
| | - Brian Williams
- School of Health and Social Care, Edinburgh Napier University, Edinburgh, UK
| |
Collapse
|
7
|
Wood S, Standen P. Is speech and language therapy effective at improving the communication of adults with intellectual disabilities?: A systematic review. INTERNATIONAL JOURNAL OF LANGUAGE & COMMUNICATION DISORDERS 2021; 56:435-450. [PMID: 33624400 DOI: 10.1111/1460-6984.12601] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/15/2020] [Revised: 11/30/2020] [Accepted: 01/08/2021] [Indexed: 06/12/2023]
Abstract
BACKGROUND A significant proportion of adults with intellectual disabilities (ID) experience speech, language and communication difficulties which are associated with poor physical and mental health outcomes. Speech and language therapy (SLT) interventions are an important way to address these communication difficulties, yet there is limited available evidence to provide information about the effectiveness of the different approaches used for this heterogeneous group. AIMS To review the evidence available for the effectiveness of SLT interventions aimed at improving communication for adults with ID. METHODS & PROCEDURES A systematic search across relevant databases was performed. Information on methodological details of each relevant study, along with descriptions of the SLT interventions employed, were extracted and the Crowe Critical Appraisal Tool (CCAT) was used to assess quality. Findings were discussed in a narrative synthesis grouped by target communication skill. OUTCOMES & RESULTS A total of 10 relevant studies met the inclusion criteria. These were predominantly interventions aimed directly at adults with ID to improve speech, increase augmentative and alternative communication (AAC) use and develop interaction skills, with one study addressing work with carers. The included studies were all rated as low quality. There is weak preliminary evidence that SLT input can improve the communication skills of adults with ID. CONCLUSIONS & IMPLICATIONS There is insufficient evidence to draw strong conclusions about the effectiveness of SLT in this population. Further high-level evidence across speech, language and communication domains is urgently needed. What this paper adds What is already known on the subject There is limited evidence for community health interventions used with adults with ID. Previous reviews of SLT interventions found a lack of evidence base for this population. Some areas of SLT practice such as AAC have demonstrated potential benefits and other areas including speech work, social communication skills and training for communication partners have some evidence base for children with ID but there is currently insufficient evidence for adults with ID. What this paper adds to existing knowledge The study systematically reviews the current evidence base available when considering the effectiveness of SLT intervention for adults with ID. It provides weak evidence to suggest SLT intervention can improve communication in this population and highlights the need for clinically relevant, robustly designed studies to be undertaken in this field. What are the potential or actual clinical implications of this work? The lack of high-quality studies with sufficient power to draw conclusions about effectiveness means SLTs are not able to base their intervention choices on firm evidence. There is an urgent need to conduct robust research into the effectiveness of SLT interventions for adults with ID.
Collapse
Affiliation(s)
- Siȃn Wood
- Nottinghamshire Healthcare NHS Foundation Trust, Nottingham, UK
| | - Penny Standen
- Division of Rehabilitation and Ageing, University of Nottingham, Nottingham, UK
| |
Collapse
|
8
|
Mills MT, Moore LC, Chang R, Kim S, Frick B. Perceptions of Black Children's Narrative Language: A Mixed-Methods Study. Lang Speech Hear Serv Sch 2021; 52:84-99. [PMID: 33464984 DOI: 10.1044/2020_lshss-20-00014] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
Abstract
Purpose In this mixed-methods study, we address two aims. First, we examine the impact of language variation on the ratings of children's narrative language. Second, we identify participants' ideologies related to narrative language and language variation. Method Forty adults listened to and rated six Black second-grade children on the quality of 12 narratives (six fictional, six personal). Adults then completed a quantitative survey and participated in a qualitative interview. Results Findings indicated that adults rated students with less variation from mainstream American English (MAE) more highly than students with greater variation from MAE for fictional narratives, but not for personal narratives. Personal narratives tended to be evaluated more favorably by parents than teachers. Black raters tended to assign higher ratings of narrative quality than did White raters. Thematic analysis and conversation analysis of qualitative interviews supported quantitative findings and provided pertinent information about participants' beliefs. Conclusion Taken together, quantitative and qualitative results point to a shared language ideology among adult raters of variation from MAE being more acceptable in informal contexts, such as telling a story of personal experience, and less acceptable in more formal contexts, such as narrating a fictional story prompted by a picture sequence.
Collapse
|