Beyond static assessment of children's receptive vocabulary: the dynamic assessment of word learning (DAWL)

Assessing children's vocabulary: An exploratory cross-sectional survey of speech-language pathologists

PURPOSE

Past research highlights the importance of evaluating word learning abilities to build understanding of an individual's language-learning capacity and make evidence-informed decisions in speech-language pathology practice. However, little research has explored vocabulary and word learning assessment practices among speech-language pathologists (SLPs). This pilot, exploratory study aimed to explore current assessment practices and guide translation of research to practice among SLPs who work with children of all ages.

METHOD

SLPs (N = 127) from three predominantly English-speaking countries (Australia, USA, and UK) completed an online survey. The survey explored methods and purposes for assessing vocabulary knowledge and word learning skills via binary and multiple-choice questions. Responses to three open-ended questions were analysed using conventional content analysis. The survey also asked about perspectives regarding assessment practices with individuals from culturally and linguistically diverse (CALD) backgrounds.

RESULT

Of the surveyed SLPs, 118 (92%) reported using norm-referenced measures of vocabulary, with 27 reporting additional use of non-normed measures. Seventy-seven SLPs (61%) reported that they measure word learning skills, and 20 of these SLPs used dynamic assessment procedures to evaluate word learning. Responding SLPs across all three countries reported using vocabulary and word learning assessment data in a variety of ways (e.g. to support diagnostic decision-making). Regarding the use of standardised, norm-referenced vocabulary assessments with individuals from CALD backgrounds, SLPs reported concerns regarding poor cultural sensitivity and limited access to alternative methods.

CONCLUSION

The findings highlight the need for further development and dissemination of accessible resources to support SLPs' implementation of word learning assessment, including resources for dynamic assessment. This is especially critical considering the established limitations associated with using standardised, norm-referenced tests with minority groups who are underrepresented in standardisation samples.

Early Identification of Children at Risk of Communication Disorders: Introducing a Novel Battery of Dynamic Assessments for Infants

PURPOSE

Many children with communication disorders (CDs) experience lengthy gaps between parental reporting of concerns and formal identification by professionals. This means that children with CDs are denied access to early interventions that may help support the development of communication skills and prevent possible negative sequelae associated with long-term outcomes. This may be due, in part, to the lack of assessment instruments available for children younger than 3 years of age. This study therefore reports on promising preliminary data from a novel set of valid dynamic assessment (DA) measures designed for infants.

METHOD

We recruited 53 low-risk children and two groups of children considered to be at high risk for CDs (n = 17, social high risk, and n = 22, language high risk) due to family members with language and social communication difficulties. The children were between 1 and 2 years of age and were assessed using a battery of five DA tasks related to receptive vocabulary, motor imitation, response to joint attention, turn taking, and social requesting. A set of standardized measures were also used.

RESULTS

The DA tasks showed high levels of interrater reliability and relationships with age across a cross-sectional sample of children from the low-risk group. Three tasks showed moderate to strong correlations with standardized measures taken at the same age, with particularly strong correlations between the DA of receptive vocabulary and other receptive language measures. The DA of receptive vocabulary was also the only task to discriminate between the three risk groups, with the social high risk group scoring lower.

CONCLUSIONS

These results provide preliminary information about early DA tasks, forming the basis for further research into their utility. DA tasks might eventually facilitate the development of new methods for detecting CDs in very young children, allowing earlier intervention and support.

A new dynamic word learning task to diagnose language disorder in French-speaking monolingual and bilingual children

Tools to effectively assess the language performance of bilingual children are lacking. Static tests assessing vocabulary knowledge (e.g., naming task) are not appropriate for testing bilingual children due to different types of bias. Alternative methods have been developed to diagnose bilingual children, including measuring language learning (e.g., word learning) through dynamic assessment. Research conducted with English-speaking children indicates that DA of word learning is effective in diagnosing language disorders in bilingual children. In this study, we examine whether a dynamic word learning task, using shared-storybook reading, can differentiate French-speaking (monolingual and bilingual) children with developmental language disorder (DLD) from those with typical development (TD). Sixty children (4-8 years), 43 with TD and 17 with DLD, participated: 30 were monolinguals and 25 were bilinguals. The dynamic word-learning task used a shared-storybook reading context. The children had to learn four non-words, paired with novel objects, as well as their semantic characteristics (a category and a definition) during the reading of a story. Post-tests assessed the recall of the phonological form and the semantic features of the objects. Phonological and semantic prompts were given if the child was unable to name or describe the objects. Results indicated that children with DLD performed less well than those with TD on phonological recall, leading to fair sensitivity and good specificity at delayed post-test for young children (4-6 years). Semantic production did not differentiate the two groups: all children performed well at this task. In sum, children with DLD have more difficulties encoding the phonological form of the word. Our findings suggest that a dynamic word learning task using shared-storybook reading is a promising approach for diagnosing lexical difficulties in young French-speaking, monolingual and bilingual, children.

Dynamic Assessment for Children With Communication Disorders: A Systematic Scoping Review and Framework

PURPOSE

The aim of this systematic scoping review was to identify the elements that exist in dynamic assessments of communication in children, synthesize and arrange them into a framework, and investigate how these elements have been used in published literature.

METHOD

Seven databases were searched using clusters of keywords themed around "dynamic assessment," "communication," and "children." Papers were reviewed against eligibility criteria by two independent reviewers at both title/abstract and full-text screening stages. Data charting included information about study design and the methodological characteristics of identified dynamic assessments.

RESULTS

Sixty-five papers met inclusion criteria. Dynamic assessments were used in a range of areas of communication and used diverse methodologies. A total of 23 elements were identified and formulated into a Dynamic Assessment Framework, arranged into eight categories within two broad domains. A majority of assessments utilized prompting or cueing as instruction (54%), provided a predetermined amount of instruction (55%), measured child performance (63%), and were prescripted (60%).

CONCLUSIONS

Dynamic assessments are complex. Utilizing a dynamic assessment in clinical practice or research requires a deep understanding of the purpose, clinical population, implementation, and data collection and measurement requirements. From our review of research involving dynamic assessments of communication in children, there is a need for greater transparency of reporting of the elements comprising dynamic assessments. The Dynamic Assessment Framework presented in this review article offers researchers and clinicians a way to have transparent discussions and extend our collective insights into the value of dynamic assessment of children's communication skills.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.20151830.

Can Dynamic Assessment Identify Language Disorder in Multilingual Children? Clinical Applications From a Systematic Review

PURPOSE

Multilingual children are disproportionately represented on speech pathology caseloads, in part due to the limited ability of traditional language assessments to accurately capture multilingual children's language abilities. This systematic review evaluates the evidence for identification of language disorder in multilingual children using dynamic assessment and considers clinical applications of the evidence.

METHOD

A systematic search of the Cumulative Index to Nursing and Allied Health Literature, Education Resources Information Centre, Education Source, Google Scholar, Linguistics, Medline, and PsycINFO databases produced 10 articles that met the inclusion criteria: between-groups comparison studies that used dynamic assessment to identify language disorder in children under 12 years old that spoke a different language at home to the majority society language. Articles were critically appraised using the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) protocol.

RESULTS

Nine of the 10 studies reported that their dynamic assessment identified language disorder in multilingual children. However, small sample sizes, limited language pairs, variability in the reference standard, and design deficiencies resulted in poor ratings for all studies on QUADAS-2.

CONCLUSIONS

The studies in this review reflected an emergent area of research. Preliminary guidelines for clinical application indicate that dynamic assessment may be a suitable and time-efficient complementary method of diagnosis of language disorder in multilingual children. Further recommendations about age of use, language of instruction, and relevant scores are included.

Working Memory Predicts New Word Learning Over and Above Existing Vocabulary and Nonverbal IQ

PURPOSE

The purpose of this study was to use an established model of working memory in children to predict an established model of word learning to determine whether working memory explained word learning variance over and above the contributions of expressive vocabulary and nonverbal IQ.

METHOD

One hundred sixty-seven English-speaking second graders (7- to 8-year-olds) with typical development from two states participated. They completed a comprehensive battery of working memory assessments and six word learning tasks that assessed the creation, storage, retrieval, and production of phonological and semantic representations of novel nouns and verbs and the ability to link those representations.

RESULTS

A structural equation model with expressive vocabulary, nonverbal IQ, and three working memory factors predicting two word learning factors fit the data well. When working memory factors were entered as predictors after expressive vocabulary and nonverbal IQ, they explained 45% of the variance in the phonological word learning factor and 17% of the variance in the semantic word learning factor. Thus, working memory explained a significant amount of word learning variance over and above expressive vocabulary and nonverbal IQ.

CONCLUSION

Results show that working memory is a significant predictor of dynamic word learning over and above the contributions of expressive vocabulary and nonverbal IQ, suggesting that a comprehensive working memory assessment has the potential to identify sources of word learning difficulties and to tailor word learning interventions to a child's working memory strengths and weaknesses.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.19125911.

The Classification Accuracy of a Dynamic Assessment of Inferential Word Learning for Bilingual English/Spanish-Speaking School-Age Children

Purpose

Educators often use results from static norm-referenced vocabulary assessments to aid in the diagnosis of school-age children with a language disorder. However, research has indicated that many of these vocabulary assessments yield inaccurate, biased results, especially with culturally and linguistically diverse children. This study examined whether the use of a dynamic assessment of inferential word learning was more accurate at identifying bilingual (English/Spanish-speaking) children with a language disorder when compared to static measures of vocabulary.

Method

Thirty-one bilingual Spanish/English school-age children—21 children with typical language and 10 children with a language disorder—ages 5;9–9;7 (years;months) were administered traditional static vocabulary assessments and a dynamic assessment of inferential word learning that used a test–teach–test design.

Results

Discriminant analysis and logistic regression indicated that the combined posttest scores and modifiability ratings from the dynamic assessment generated 90%–100% sensitivity and 90.5%–95.2% specificity, which were superior to the static vocabulary tests.

Conclusion

These preliminary findings suggest that dynamic assessment of inferential word learning may be an effective method for accurately identifying diverse children with a language disorder.

Measuring Explicit Word Learning of Preschool Children: A Development Study

PURPOSE

The purpose of this article is to present preliminary results related to the development of a new measure of explicit word learning. The measure incorporated elements of explicit vocabulary instruction and dynamic assessment and was designed to be sensitive to differences in word learning skill and to be feasible for use in clinical settings.

METHOD

The explicit word learning measure included brief teaching trials and repeated fine-grained measurement of semantic knowledge and production of 3 novel words (2 verbs and 1 adjective). Preschool children (N = 23) completed the measure of explicit word learning; standardized, norm-referenced measures of expressive and receptive vocabulary; and an incidental word learning task.

RESULTS

The measure of explicit word learning provided meaningful information about word learning. Performance on the explicit measure was related to existing vocabulary knowledge and incidental word learning.

CONCLUSIONS

Findings from this development study indicate that further examination of the measure of explicit word learning is warranted. The measure may have the potential to identify children who are poor word learners.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.5170738.

Measurement Issues: Assessing language skills in young children

BACKGROUND

Language and communication skills are central to children's ability to engage in social relationships and access learning experiences. This paper identifies issues which practitioners and researchers should consider when assessing language skills. A range of current language assessments is reviewed.

KEY FINDINGS

Current screening measures do not meet psychometric prerequisites to identify language problems. There are significant challenges in the interpretation of language assessments, where socioeconomic status, language status and dialect, hearing impairment and test characteristics impact results.

CONCLUSIONS

Psychometrically sound assessments of language are an essential component of developing effective and efficient interventions. The language trajectories of preschool children vary substantially; current screening measures have significant limitations. Composite measures of language performance are better indicators of language problems and disorders than single measures of component skills.

Dynamic Assessment of Morphological Awareness and Third-Grade Literacy Success

Purpose

The purpose of this study was to examine a dynamic assessment with graduated prompts to assess morphological awareness and determine whether such a task was related to third-grade literacy success.

Method

A dynamic assessment of morphological awareness was adapted and administered to 54 third-grade students in addition to a norm-referenced language and literacy battery.

Results

A dynamic assessment of morphological awareness measured a range of performance including that of emerging morphological awareness abilities and provided rich linguistic insights for how best to scaffold and prompt for such a skill. In addition, the dynamic morphological awareness measure was found to be significantly related to, and to contribute unique variance to, reading comprehension abilities.

Conclusions

These results suggest that morphological awareness is an important factor to consider when addressing students' literacy performance in early elementary school and that dynamic assessment appears to be a clinically valuable tool when examining early morphological awareness abilities.

Assessment and management of the communication difficulties of children with cerebral palsy: a UK survey of SLT practice

BACKGROUND

Communication difficulties are common in cerebral palsy (CP) and are frequently associated with motor, intellectual and sensory impairments. Speech and language therapy research comprises single-case experimental design and small group studies, limiting evidence-based intervention and possibly exacerbating variation in practice.

AIMS

To describe the assessment and intervention practices of speech-language therapist (SLTs) in the UK in their management of communication difficulties associated with CP in childhood.

METHODS & PROCEDURES

An online survey of the assessments and interventions employed by UK SLTs working with children and young people with CP was conducted. The survey was publicized via NHS trusts, the Royal College of Speech and Language Therapists (RCSLT) and private practice associations using a variety of social media. The survey was open from 5 December 2011 to 30 January 2012.

OUTCOMES & RESULTS

Two hundred and sixty-five UK SLTs who worked with children and young people with CP in England (n = 199), Wales (n = 13), Scotland (n = 36) and Northern Ireland (n = 17) completed the survey. SLTs reported using a wide variety of published, standardized tests, but most commonly reported assessing oromotor function, speech, receptive and expressive language, and communication skills by observation or using assessment schedules they had developed themselves. The most highly prioritized areas for intervention were: dysphagia, alternative and augmentative (AAC)/interaction and receptive language. SLTs reported using a wide variety of techniques to address difficulties in speech, language and communication. Some interventions used have no supporting evidence. Many SLTs felt unable to estimate the hours of therapy per year children and young people with CP and communication disorders received from their service.

CONCLUSIONS & IMPLICATIONS

The assessment and management of communication difficulties associated with CP in childhood varies widely in the UK. Lack of standard assessment practices prevents comparisons across time or services. The adoption of a standard set of agreed clinical measures would enable benchmarking of service provision, permit the development of large-scale research studies using routine clinical data and facilitate the identification of potential participants for research studies in the UK. Some interventions provided lack evidence. Recent systematic reviews could guide intervention, but robust evidence is needed in most areas addressed in clinical practice.