Automated Proposition Density Analysis for Discourse in Aphasia

Discourse- and lesion-based aphasia quotient estimation using machine learning

Discourse is a fundamentally important aspect of communication, and discourse production provides a wealth of information about linguistic ability. Aphasia commonly affects, in multiple ways, the ability to produce discourse. Comprehensive aphasia assessments such as the Western Aphasia Battery-Revised (WAB-R) are time- and resource-intensive. We examined whether discourse measures can be used to estimate WAB-R Aphasia Quotient (AQ), and whether this can serve as an ecologically valid, less resource-intensive measure. We used features extracted from discourse tasks using three AphasiaBank prompts involving expositional (picture description), story narrative, and procedural discourse. These features were used to train a machine learning model to predict the WAB-R AQ. We also compared and supplemented the model with lesion location information from structural neuroimaging. We found that discourse-based models could estimate AQ well, and that they outperformed models based on lesion features. Addition of lesion features to the discourse features did not improve the performance of the discourse model substantially. Inspection of the most informative discourse features revealed that different prompt types taxed different aspects of language. These findings suggest that discourse can be used to estimate aphasia severity, and provide insight into the linguistic content elicited by different types of discourse prompts.

Discourse Task Type-Specific Linguistic Characteristics in Anomic Aphasia and Healthy Controls: Evidence From Mandarin-Chinese AphasiaBank

PURPOSE

This study was designed to examine the hypothesis that discourse task types influence language performance in Mandarin Chinese-speaking people and to reveal the discourse task-specific linguistic properties of persons with anomic aphasia compared to neurotypical controls.

METHOD

Language samples from persons with aphasia (n = 31) and age- and education-matched controls (n = 31) across four discourse tasks (sequential-picture description, single-picture description, story narrative, and procedural discourse) were collected from Mandarin AphasiaBank. Task-specific distributions of parts of speech were analyzed using mosaic plots. The main effects of tasks in each group and the between-group differences within each task for several typical linguistic variables were evaluated, including the mean length of utterance, tokens, moving-average type-token ratio, words per minute, propositional density, noun-verb ratio, noun percentage, and verb percentage.

RESULTS

The results revealed an impact of discourse tasks on most language variables in both groups. In the healthy controls, story narratives yielded the highest total words and lowest verb percentage. In the aphasia group, procedural discourse elicited the fewest total words and densest expressions, whereas their single-picture descriptions had the highest noun-verb ratio. For all tasks, the aphasia group performed worse than the control group in the mean length of utterance, tokens, moving-average type-token ratio, and words per minute. For noun-verb ratio, noun percentage, and verb percentage, only one task (i.e., single-picture description) showed significant between-group differences.

CONCLUSION

The selection of discourse tasks should be addressed in assessments and interventions for Mandarin Chinese-speaking individuals with aphasia to obtain more accurate and feasible outcomes.

Adaptation and Reliability of the Cinderella Story Retell Task in Canadian French Persons Without Brain Injury

PURPOSE

Main concept (MC) analysis is a well-documented method of discourse analysis in adults with and without brain injury. This study aims to develop a MC checklist that is culturally and linguistically adapted for Canadian French speakers and examine its reliability. We also documented microstructural properties and provide a normative reference in persons not brain injured (PNBIs).

METHOD

Discourse samples from 43 PNBIs were collected. All participants completed the Cinderella story retell task twice. Manual transcription was performed for all samples. The 34 MCs for the Cinderella story retell task were adapted into Canadian French and used to score all transcripts. In addition, microstructural variables were extracted using Computerized Language Analysis (CLAN). Intraclass correlation coefficients were computed to assess interrater reliability for MC codes and microstructural variables. Test-retest reliability was assessed using intraclass correlations, Spearman's rho correlations, and the Wilcoxon signed-ranks test. Bland-Altman plots were used to examine the agreement of the discourse measures between the two sessions.

RESULTS

The MC checklist for the Cinderella story retell task adapted for Canadian French speakers is provided. Good-to-excellent interrater reliability was obtained for most MC codes; however, reliability ranged from poor to excellent for the "inaccurate and incomplete" code. Microstructural variables demonstrated excellent interrater reliability. Test-retest reliability ranged from poor to excellent for all variables, with the majority falling between moderate and excellent. Bland-Altman plots illustrated the limits of agreement between test and retest.

CONCLUSIONS

This study provides the MC checklist for clinicians and researchers working with Canadian French speakers when assessing discourse with the Cinderella story retell task. It also addresses the gap in available psychometric data regarding test-retest reliability in PNBIs.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.24171087.

Effects of bilingualism on autobiographical memory: variation in idea density and retrieval speed

Prior work on bilingual memory has largely focused on working memory and less on autobiographical memory. In the present study, we tested the effect of bilingualism on autobiographical memory and examined whether an effect would be moderated or mediated by working memory. Spanish-English bilingual and English-only monolingual adults completed an autobiographical cued-recall task, as well as a working memory measure. Memories were coded for retrieval speed and propositional idea density. Bilingual status was associated with faster memory retrieval but did not affect propositional idea density. Better working memory was associated with slower memory retrieval but did not affect propositional idea density, nor did working memory moderate or mediate the effect of bilingualism. Together, these results indicate an effect of bilingualism on the speed of autobiographical memory retrieval that does not extend to autobiographical memory content and suggest that the effect of bilingualism is independent of the effect of working memory.

Validation of Videoconference Administration of Picture Description From the Western Aphasia Battery-Revised in Neurotypical Canadian French Speakers

PURPOSE

During the COVID-19 pandemic, clinicians and researchers have increasingly used remote online assessments to pursue their activities, but mostly with tests not validated for videoconference administration. This study aims to validate the remote online administration of picture description in Canadian French neurotypical speakers and to explore the thematic unit (TU) checklist recently developed.

METHOD

Spoken discourse elicited through the picture description task of the Western Aphasia Battery-Revised (WAB-R) was collected from Canadian French neurotypical speakers from Québec aged between 50 and 79 years old. Forty-seven participants completed the task in person, and 49 participants completed the task by videoconference. Videos of each discourse sample were transcribed using CHAT conventions. Microstructural variables were extracted using the CLAN (Computerized Language ANalysis) program, whereas thematic informativeness was scored for each sample using TUs. Chi-square tests were conducted to compare both groups on each TU; t tests were also performed on the total score of TUs and microstructural variables.

RESULTS

Groups were matched on sex, age, and education variables. The t tests revealed no intergroup difference for the total TU score and for the microstructural variables (e.g., mean length of utterances and number of words per minute). Chi-square tests showed no significant intergroup difference for all 16 TUs.

CONCLUSIONS

These findings support remote online assessment of the picnic scene of the WAB-R picture description in Canadian French neurotypical speakers. These results also validate the 16 TUs most consistently produced. The use of videoconference could promote and improve the recruitment of participants who are usually less accessible, such as people using assistive mobility technologies.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.21476961.

Preliminary assessment of connected speech and language as marker for cognitive change in late middle-aged Black/African American adults at risk for Alzheimer's disease

Background

Connected speech-language (CSL) has been a promising measure of assessing cognitive decline in populations at-risk for Alzheimer's disease and related dementias (ADRD) populations. A common way to obtain CSL is through using picture description tasks such as the most frequently used image Cookie Theft (CT). However, questions have been raised about using CT for diverse communities. Little is known about the CSL produced in response to this task in Black/African American (BAA) adults aged 48-74.

Goals

The present study's goals were to characterize CSL in BAA adults by sex and APOE-ε4 status from Milwaukee in the Wisconsin Registry for Alzheimer's Prevention (WRAP) study when presented with the CT picture description task and to identify differences in CSL output between BAAs and non-Hispanic Whites (NHW).

Methods and Procedures

We collected CSL samples from the CT picture from 48 BAA participants and 30 NHW participants from the WRAP participants in Milwaukee, WI group. CSL was analyzed using chi-square tests, T-tests, and ANCOVA. Linear mixed effect regression models were used to determine the association between cognitive status and longitudinal CSL in BAA participants with more than 1 timepoint.

Outcomes and Results

Declines in CSL of BAA participants were associated with subtle declines in cognition. Among BAA participants, we found no significant differences in speech measures in terms of sex and APOE-ε4 status. Our results showed no significant differences in speech measures between BAA and NHW groups.

Conclusions

CSL analysis provides an inexpensive way to evaluate preclinical changes in cognitive status that may not be as affected by other factors, such as ethnocultural background. Future studies with larger sample sizes and participants from other geographic locations can clarify these findings.

Communicative Informativeness in Aphasia: Investigating the Relationship Between Linguistic and Perceptual Measures

Purpose Informativeness refers to how successfully a person is able to convey their intended message. This study explores the relationship between perceptual ratings of informativeness and selected linguistic measures of lexical and structural content. It considers which linguistic measures have ecological validity in terms of what listeners view as important. Method Two complex picture description samples from 20 people with aphasia were analyzed. Linguistic measures included number of correct information units (NCIU), percentage of correct information units, number of propositions (NP), propositional idea density (PID), and mean length of utterance in words (MLU-w). Eleven naïve listeners produced direct magnitude estimation (DME) ratings of informativeness. A correlational design was used to investigate the relationship between mean DME informativeness ratings and each of the linguistic measures. Results The 2 picture description samples elicited similar informativeness ratings. Positive significant correlations were identified between mean DME informativeness ratings and NCIU, percentage of correct information units, NP, and MLU-w; the strength of correlation differed across variables. No significant correlation was found between mean DME informativeness ratings and PID. Significant correlations were also seen between the linguistic variables, particularly between NP and PID as well as NP and MLU-w. Conclusions Overall, the linguistic measures corresponded to rated informativeness, highlighting their ecological validity. The strongest relationship was between NCIU and rated informativeness, emphasizing the importance of complete and accurate production of lexical information, particularly nouns. Less strong, but still significant, relationships were seen with variables looking at the efficiency of information giving and the connection of ideas within sentences. The importance of different types of informative measures is considered in relation to the elicitation stimuli.

A Comparison of Three Discourse Elicitation Methods in Aphasia and Age-Matched Adults: Implications for Language Assessment and Outcome

Purpose Discourse analysis is commonly used to assess language ability and to evaluate language change following intervention in aphasia. The purpose of this study was to identify differences in language produced during different discourse tasks in a large aphasia group and an age- and education-matched control group. Method Four structured discourse tasks across 3 discourse types (expositional, narrative, and procedural) were evaluated in a group of adults with aphasia (n = 90) and an age-matched control group (n = 84) drawn from AphasiaBank. CLAN software was used to extract primary linguistic variables (mean length of utterance, propositional density, type-token ratio, words per minute, open-closed class word ratio, noun-verb ratio, and tokens), which served as proxies for various language abilities. Using a series of repeated-measures analyses of covariance, with significantly correlated demographic and descriptive variables as covariates, main effects of discourse type were evaluated. Results Despite an impoverished output from the aphasia group (i.e., the control group produced significantly more overall output), there was a main effect of discourse type on most primary linguistic variables in both groups, suggesting that, in adults with and without language impairments, each discourse type taxed components of the spoken language system to varying extents. Post hoc tests fleshed out these results, demonstrating that, for example, narrative discourse produced speech highest in propositional density. Conclusion Each discourse type taxes the language system in different ways, verifying the importance of using several discourse tasks and selecting the most sensitive discourse tasks when evaluating specific language abilities and outcomes.