Measuring word learning: dynamic versus static assessment of kindergarten vocabulary

The word learning dynamic assessment protocol (WorLDAP): Exploring speech-language pathologists' perceptions of the acceptability of a novel assessment tool

PURPOSE

Few resources are available to support speech-language pathologists (SLPs') dynamic assessment of vocabulary with school-aged children. We developed the Word Learning Dynamic Assessment Protocol (currently undergoing pilot testing). Framed by implementation science, in the current study we worked with speech-language pathologists to explore their perspectives on the acceptability of the Word Learning Dynamic Assessment Protocol.

METHOD

Eight speech-language pathologists who work with school-aged children watched a video demonstration of the Word Learning Dynamic Assessment Protocol being administered with a 6-year-old child and were then interviewed to share their thoughts on the Word Learning Dynamic Assessment Protocol's acceptability.

RESULT

Six themes were generated using reflexive thematic analysis: 1) Structure, scripting, and resourcing builds confidence in speech-language pathologists, 2) gaining important insight into the learning process, 3) flexible assessment supports child engagement and diversity, 4) family buy-in is created with clear communication, 5) a worthwhile investment of time?, and 6) building a more tailored assessment.

CONCLUSION

The speech-language pathologists who took part in this study valued the structure and resourcing of the Word Learning Dynamic Assessment Protocol as a way of supporting their ability to evaluate a child's strengths and challenges in vocabulary development in an engaging and individually tailored manner. Suggestions for further development will guide task refinement to meet the needs of speech-language pathologists.

Dynamic assessment of word learning as a predictor of response to vocabulary intervention

INTRODUCTION

The current study examined the extent to which static and dynamic measures of vocabulary and word learning predicted response and identified poor responders to a vocabulary intervention.

METHODS

Participants were 46 preschool children in classrooms randomly assigned to complete the Story Friends intervention in two cluster-randomized efficacy trials. Children were administered a static measure of vocabulary knowledge and a dynamic assessment of explicit word learning prior to intervention. Vocabulary learning in response to intervention was assessed using a curriculum-based definitional task.

RESULTS

Both the static and dynamic measures were significant predictors of vocabulary learning in response to intervention. The dynamic assessment alone predicted 25 % of variance in vocabulary learning; the static and dynamic measures in combination predicted 42 %. In the responsivity analysis, the dynamic measure provided the best accuracy for a single measure (76 %), but the most accurate classification was provided by a combination of static and dynamic measures (79. The static measure accurately identified 93 % of poor responders, whereas the dynamic measure accurately identified 88 %.

CONCLUSIONS

In this study, both static and dynamic measures predicted preschool children's response to vocabulary intervention and provided a mostly accurate classification of good and poor responders. Additional research can inform the use of dynamic assessment to predict response to intervention and to match children with intense interventions.

Assessing children's vocabulary: An exploratory cross-sectional survey of speech-language pathologists

PURPOSE

Past research highlights the importance of evaluating word learning abilities to build understanding of an individual's language-learning capacity and make evidence-informed decisions in speech-language pathology practice. However, little research has explored vocabulary and word learning assessment practices among speech-language pathologists (SLPs). This pilot, exploratory study aimed to explore current assessment practices and guide translation of research to practice among SLPs who work with children of all ages.

METHOD

SLPs (N = 127) from three predominantly English-speaking countries (Australia, USA, and UK) completed an online survey. The survey explored methods and purposes for assessing vocabulary knowledge and word learning skills via binary and multiple-choice questions. Responses to three open-ended questions were analysed using conventional content analysis. The survey also asked about perspectives regarding assessment practices with individuals from culturally and linguistically diverse (CALD) backgrounds.

RESULT

Of the surveyed SLPs, 118 (92%) reported using norm-referenced measures of vocabulary, with 27 reporting additional use of non-normed measures. Seventy-seven SLPs (61%) reported that they measure word learning skills, and 20 of these SLPs used dynamic assessment procedures to evaluate word learning. Responding SLPs across all three countries reported using vocabulary and word learning assessment data in a variety of ways (e.g. to support diagnostic decision-making). Regarding the use of standardised, norm-referenced vocabulary assessments with individuals from CALD backgrounds, SLPs reported concerns regarding poor cultural sensitivity and limited access to alternative methods.

CONCLUSION

The findings highlight the need for further development and dissemination of accessible resources to support SLPs' implementation of word learning assessment, including resources for dynamic assessment. This is especially critical considering the established limitations associated with using standardised, norm-referenced tests with minority groups who are underrepresented in standardisation samples.

A new dynamic word learning task to diagnose language disorder in French-speaking monolingual and bilingual children

Tools to effectively assess the language performance of bilingual children are lacking. Static tests assessing vocabulary knowledge (e.g., naming task) are not appropriate for testing bilingual children due to different types of bias. Alternative methods have been developed to diagnose bilingual children, including measuring language learning (e.g., word learning) through dynamic assessment. Research conducted with English-speaking children indicates that DA of word learning is effective in diagnosing language disorders in bilingual children. In this study, we examine whether a dynamic word learning task, using shared-storybook reading, can differentiate French-speaking (monolingual and bilingual) children with developmental language disorder (DLD) from those with typical development (TD). Sixty children (4-8 years), 43 with TD and 17 with DLD, participated: 30 were monolinguals and 25 were bilinguals. The dynamic word-learning task used a shared-storybook reading context. The children had to learn four non-words, paired with novel objects, as well as their semantic characteristics (a category and a definition) during the reading of a story. Post-tests assessed the recall of the phonological form and the semantic features of the objects. Phonological and semantic prompts were given if the child was unable to name or describe the objects. Results indicated that children with DLD performed less well than those with TD on phonological recall, leading to fair sensitivity and good specificity at delayed post-test for young children (4-6 years). Semantic production did not differentiate the two groups: all children performed well at this task. In sum, children with DLD have more difficulties encoding the phonological form of the word. Our findings suggest that a dynamic word learning task using shared-storybook reading is a promising approach for diagnosing lexical difficulties in young French-speaking, monolingual and bilingual, children.

The Impact of SES on Language Domain in Kindergartners' Quick Interactive Language Screener (QUILS) Performance

METHOD

To explore the relationship between SES and language domain (vocabulary, syntax, process), the QUILS was administered to 212 kindergartners.

RESULTS

Children from very-high poverty schools performed significantly below children from high poverty and mid-low poverty schools.

IMPLICATIONS

SES impacts language-learning processes (i.e., fast mapping) in addition to language products (i.e., vocabulary, syntax).

Dynamic Assessment Language Tasks and the Prediction of Performance on Year-End Language Skills in Preschool Dual Language Learners

Purpose Early identification is a key element for accessing appropriate services for preschool children with language impairment. However, there is a high risk of misidentifying typically developing dual language learners as having language impairment if inappropriate tools designed for monolingual children are used. In this study of children with bilingual exposure, we explored performance on brief dynamic assessment (DA) language tasks using graduated prompting because this approach has potential applications for screening. We asked if children's performance on DA language tasks earlier in the year was related to their performance on a year-end language achievement measure. Method Twenty 4-year-old children from Spanish-speaking homes attending Head Start preschools in the southwestern United States completed three DA graduated prompting language tasks 3-6 months prior to the Head Start preschools' year-end achievement testing. The DA tasks, Novel Adjective Learning, Similarities in Function, and Prediction, were administered in Spanish, but correct responses in English or Spanish were accepted. The year-end achievement measure, the Learning Accomplishment Profile-Third Edition (LAP3), was administered by the children's Head Start teachers, who also credited correct responses in either language. Results Children's performance on two of the three DA language tasks was significantly and positively related to year-end LAP3 language scores, and there was a moderate and significant relationship for one of the DA tasks, even when controlling for age and initial LAP3 scores. Conclusions Although the relationship of performance on DA with year-end performance varies across tasks, the findings indicate potential for using a graduated prompting approach to language screening with young dual language learners. Further research is needed to select the best tasks for administration in a graduated prompting framework and determine accuracy of identification of language impairment.

Measuring Explicit Word Learning of Preschool Children: A Development Study

PURPOSE

The purpose of this article is to present preliminary results related to the development of a new measure of explicit word learning. The measure incorporated elements of explicit vocabulary instruction and dynamic assessment and was designed to be sensitive to differences in word learning skill and to be feasible for use in clinical settings.

METHOD

The explicit word learning measure included brief teaching trials and repeated fine-grained measurement of semantic knowledge and production of 3 novel words (2 verbs and 1 adjective). Preschool children (N = 23) completed the measure of explicit word learning; standardized, norm-referenced measures of expressive and receptive vocabulary; and an incidental word learning task.

RESULTS

The measure of explicit word learning provided meaningful information about word learning. Performance on the explicit measure was related to existing vocabulary knowledge and incidental word learning.

CONCLUSIONS

Findings from this development study indicate that further examination of the measure of explicit word learning is warranted. The measure may have the potential to identify children who are poor word learners.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.5170738.

Dynamic assessment of narrative ability in English accurately identifies language impairment in English language learners

PURPOSE

To assess the identification accuracy of dynamic assessment (DA) of narrative ability in English for children learning English as a 2nd language.

METHOD

A DA task was administered to 54 children: 18 Spanish-English-speaking children with language impairment (LI); 18 age-, sex-, IQ- and language experience-matched typical control children; and an additional 18 age- and language experience-matched comparison children. A variety of quantitative and qualitative measures were collected in the pretest phase, the mediation phase, and the posttest phase of the study. Exploratory discriminant analysis was used to determine the set of measures that best differentiated among this group of children with and without LI.

RESULTS

A combination of examiner ratings of modifiability (compliance, metacognition, and task orientation), DA story scores (setting, dialogue, and complexity of vocabulary), and ungrammaticality (derived from the posttest narrative sample) classified children with 80.6% to 97.2% accuracy.

CONCLUSION

DA conducted in English provides a systematic means for measuring learning processes and learning outcomes, resulting in a clinically useful procedure for identifying LIs in bilingual children who are in the process of learning English as a second language.

Novel-word learning deficits in Mandarin-speaking preschool children with specific language impairments

Children with SLI exhibit overall deficits in novel word learning compared to their age-matched peers. However, the manifestation of the word learning difficulty in SLI was not consistent across tasks and the factors affecting the learning performance were not yet determined. Our aim is to examine the extent of word learning difficulties in Mandarin-speaking preschool children with SLI, and to explore the potent influence of existing lexical knowledge on to the word learning process. Preschool children with SLI (n=37) and typical language development (n=33) were exposed to novel words for unfamiliar objects embedded in stories. Word learning tasks including the initial mapping and short-term repetitive learning were designed. Results revealed that Mandarin-speaking preschool children with SLI performed as well as their age-peers in the initial form-meaning mapping task. Their word learning difficulty was only evidently shown in the short-term repetitive learning task under a production demand, and their learning speed was slower than the control group. Children with SLI learned the novel words with a semantic head better in both the initial mapping and repetitive learning tasks. Moderate correlations between stand word learning performances and scores on standardized vocabulary were found after controlling for children's age and nonverbal IQ. The results suggested that the word learning difficulty in children with SLI occurred in the process of establishing a robust phonological representation at the beginning stage of word learning. Also, implicit compound knowledge is applied to aid word learning process for children with and without SLI. We also provide the empirical data to validate the relationship between preschool children's word learning performance and their existing receptive vocabulary ability.

Response to dynamic language tasks among typically developing Latino preschool children with bilingual experience

PURPOSE

The purpose of this study was to determine whether typically developing preschool children with bilingual experience show evidence of learning within brief dynamic assessment language tasks administered in a graduated prompting framework. Dynamic assessment has shown promise for accurate identification of language impairment in bilingual children, and a graduated prompting approach may be well-suited to screening for language impairment.

METHOD

Three dynamic language tasks with graduated prompting were presented to 32 typically developing 4-year-olds in the language to which the child had the most exposure (16 Spanish, 16 English). The tasks were a novel word learning task, a semantic task, and a phonological awareness task.

RESULTS

Children's performance was significantly higher on the last 2 items compared with the first 2 items for the semantic and the novel word learning tasks among children who required a prompt on the 1st item. There was no significant difference between the 1st and last items on the phonological awareness task.

CONCLUSIONS

Within-task improvements in children's performance for some tasks administered within a brief, graduated prompting framework were observed. Thus, children's responses to graduated prompting may be an indicator of modifiability, depending on the task type and level of difficulty.

Dynamic Assessment of Word Learning Skills: Identifying Language Impairment in Bilingual Children

Purpose

Bilingual children are often diagnosed with language impairment, although they may simply have fewer opportunities to learn English than English-speaking monolingual children. This study examined whether dynamic assessment (DA) of word learning skills is an effective method for identifying bilingual children with primary language impairment (PLI).

Method

Fifteen 4- and 5-year-old predominantly Spanish-speaking children with typical language development (TLD) and 13 with PLI each participated in a 30- to 40-min session of DA of word learning skills following a pretest–teach–posttest design.

Results

Results indicated that TLD children made associations between the phonological and semantic representations of the new words faster than children with PLI did, showing greater modifiability. Further, a combination of word learning in the receptive modality and the Learning Strategies Checklist (Lidz, 1991; Peña, 1993) provided the best accuracy in identifying PLI in these children.

Conclusion

Findings suggest that a brief DA is a promising method for accurately differentiating children with TLD from children with PLI.