1
|
Wong R, Veldre A. Anticipatory prediction in older readers. Mem Cognit 2025:10.3758/s13421-025-01712-1. [PMID: 40329134 DOI: 10.3758/s13421-025-01712-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/20/2025] [Indexed: 05/08/2025]
Abstract
It is well-established that skilled, young-adult readers rely on predictive processing during online language comprehension; however, fewer studies have investigated whether this extends to healthy, older adults (60 + years). The aim of the present research was to assess whether older readers make use of lexical prediction by investigating whether they demonstrate processing costs for incorrect predictions in a controlled experimental design. The eye movements of a sample of older adults (60-86 years) were recorded as they read strongly and weakly constraining sentences containing a predictable word or an unpredictable alternative that was either semantically related or unrelated. To determine whether predictive processing depends on the stimuli presentation format, a second experiment presented the same materials in a self-paced reading task in which each word of a sentence appears one at a time at the readers' own pace. Older adults showed processing benefits for expected input on eye-movement measures of reading. They also showed processing costs for unexpected input across both methodologies, but only when semantically unrelated to the best completion. Taken together, the results suggest that the use of predictive processes remains relatively preserved with age. The implications of these findings for understanding whether prediction is a fundamental component of online language comprehension are discussed.
Collapse
Affiliation(s)
- Roslyn Wong
- School of Psychology, The University of Sydney, Sydney, Australia.
- School of Psychological Sciences, Macquarie University, Sydney, Australia.
| | - Aaron Veldre
- Graduate School of Health, University of Technology Sydney, Sydney, Australia
| |
Collapse
|
2
|
Hsin CH, Lee CY, Tsao Y. Exploring N400 Predictability Effects During Sustained Speech Comprehension: From Listening-Related Fatigue to Speech Enhancement Evaluation. Ear Hear 2025:00003446-990000000-00401. [PMID: 39967000 DOI: 10.1097/aud.0000000000001635] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/20/2025]
Abstract
OBJECTIVES This study investigated the predictability effect on the N400 as an objective measure of listening-related fatigue during speech comprehension by: (1) examining how its characteristics (amplitude, latency, and topographic distribution) changed over time under clear versus noisy conditions to assess its utility as a marker for listening-related fatigue, and (2) evaluating whether these N400 parameters could assess the effectiveness of speech enhancement (SE) systems. DESIGN Two event-related potential experiments were conducted on 140 young adults (aged 20 to 30) assigned to four age-matched groups. Using a between-subjects design for listening conditions, participants comprehended spoken sentences ending in high- or low-predictability words while their brain activity was recorded using electroencephalography. Experiment 1 compared the predictability effect on the N400 in clear and noise-masked conditions, while experiment 2 examined this effect under two enhanced conditions (denoised using the transformer- and minimum mean square error-based SE models). Electroencephalography data were divided into two blocks to analyze the changes in the predictability effect on the N400 over time, including amplitude, latency, and topographic distributions. RESULTS Experiment 1 compared N400 effects across blocks under different clarity conditions. Clear speech in block 2 elicited a more anteriorly distributed N400 effect without reduction or delay compared with block 1. Noisy speech in block 2 showed a reduced, delayed, and posteriorly distributed effect compared with block 1. Experiment 2 examined N400 effects during enhanced speech processing. Transformer-enhanced speech in block 1 demonstrated significantly increased N400 effect amplitude compared to noisy speech. However, both enhancement methods showed delayed N400 effects in block 2. CONCLUSIONS This study suggests that temporal changes in the N400 predictability effect might serve as objective markers of sustained speech processing under different clarity conditions. During clear speech comprehension, listeners appear to maintain efficient semantic processing through additional resource recruitment over time, while noisy speech leads to reduced processing efficiency. When applied to enhanced speech, these N400 patterns reveal both the immediate benefits of SE for semantic processing and potential limitations in supporting sustained listening. These findings demonstrate the potential utility of the N400 predictability effect for understanding sustained listening demands and evaluating SE effectiveness.
Collapse
Affiliation(s)
- Cheng-Hung Hsin
- Biomedical Acoustic Signal Processing Lab, Research Center for Information Technology Innovation, Academia Sinica, Taipei, Taiwan
| | - Chia-Ying Lee
- Brain and Language Laboratory, Institute of Linguistics, Academia Sinica, Taipei, Taiwan
- Institute of Cognitive Neuroscience, National Central University, Taoyuan, Taiwan
- Research Center for Mind, Brain, and Learning, National Chengchi University, Taipei, Taiwan
| | - Yu Tsao
- Biomedical Acoustic Signal Processing Lab, Research Center for Information Technology Innovation, Academia Sinica, Taipei, Taiwan
- Department of Electrical Engineering, Chung Yuan Christian University, Taoyuan, Taiwan
| |
Collapse
|
3
|
Pagán A, Degno F, Milledge SV, Kirkden RD, White SJ, Liversedge SP, Paterson KB. Aging and word predictability during reading: Evidence from eye movements and fixation-related potentials. Atten Percept Psychophys 2025; 87:50-75. [PMID: 39875679 PMCID: PMC11845442 DOI: 10.3758/s13414-024-02981-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/16/2024] [Indexed: 01/30/2025]
Abstract
The use of context to facilitate the processing of words is recognized as a hallmark of skilled reading. This capability is also hypothesized to change with older age because of cognitive changes across the lifespan. However, research investigating this issue using eye movements or event-related potentials (ERPs) has produced conflicting findings. Specifically, whereas eye-movement studies report larger context effects for older than younger adults, ERP findings suggest that context effects are diminished or delayed for older readers. Crucially, these contrary findings may reflect methodological differences, including use of unnatural sentence displays in ERP research. To address these limitations, we used a coregistration technique to record eye movements (EMs) and fixation-related potentials (FRPs) simultaneously while 44 young adults (18-30 years) and 30 older adults (65+ years) read sentences containing a target word that was strongly or weakly predicted by prior context. Eye-movement analyses were conducted over all data (full EM dataset) and only data matching FRPs. FRPs were analysed to capture early and later components 70-900 ms following fixation-onset on target words. Both eye-movement datasets and early FRPs showed main effects of age group and context, while the full EM dataset and later FRPs revealed larger context effects for older adults. We argue that, by using coregistration methods to address limitations of earlier ERP research, our experiment provides compelling complementary evidence from eye movements and FRPs that older adults rely more on context to integrate words during reading.
Collapse
Affiliation(s)
- Ascensión Pagán
- School of Psychology and Vision Sciences, George Davies Centre for Medicine, University of Leicester, University Road, Leicester, LE1 7RH, UK.
| | - Federica Degno
- Department of Psychology, Bournemouth University, Poole, UK
| | - Sara V Milledge
- School of Psychology, University of Central Lancashire, Preston, UK
| | - Richard D Kirkden
- School of Psychology and Vision Sciences, George Davies Centre for Medicine, University of Leicester, University Road, Leicester, LE1 7RH, UK
| | - Sarah J White
- School of Psychology and Vision Sciences, George Davies Centre for Medicine, University of Leicester, University Road, Leicester, LE1 7RH, UK
| | | | - Kevin B Paterson
- School of Psychology and Vision Sciences, George Davies Centre for Medicine, University of Leicester, University Road, Leicester, LE1 7RH, UK
| |
Collapse
|
4
|
Wong R, Reichle ED, Veldre A. Prediction in reading: A review of predictability effects, their theoretical implications, and beyond. Psychon Bull Rev 2024:10.3758/s13423-024-02588-z. [PMID: 39482486 DOI: 10.3758/s13423-024-02588-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/13/2024] [Indexed: 11/03/2024]
Abstract
Historically, prediction during reading has been considered an inefficient and cognitively expensive processing mechanism given the inherently generative nature of language, which allows upcoming text to unfold in an infinite number of possible ways. This article provides an accessible and comprehensive review of the psycholinguistic research that, over the past 40 or so years, has investigated whether readers are capable of generating predictions during reading, typically via experiments on the effects of predictability (i.e., how well a word can be predicted from its prior context). Five theoretically important issues are addressed: What is the best measure of predictability? What is the functional relationship between predictability and processing difficulty? What stage(s) of processing does predictability affect? Are predictability effects ubiquitous? What processes do predictability effects actually reflect? Insights from computational models of reading about how predictability manifests itself to facilitate the reading of text are also discussed. This review concludes by arguing that effects of predictability can, to a certain extent, be taken as demonstrating evidence that prediction is an important but flexible component of real-time language comprehension, in line with broader predictive accounts of cognitive functioning. However, converging evidence, especially from concurrent eye-tracking and brain-imaging methods, is necessary to refine theories of prediction.
Collapse
Affiliation(s)
- Roslyn Wong
- School of Psychological Sciences, Macquarie University, Sydney, Australia.
| | - Erik D Reichle
- School of Psychological Sciences, Macquarie University, Sydney, Australia
| | - Aaron Veldre
- School of Psychological Sciences, Macquarie University, Sydney, Australia
- Graduate School of Health, University of Technology Sydney, Sydney, Australia
| |
Collapse
|
5
|
Fernandez LB, Pickering MJ, Naylor G, Hadley LV. Uses of Linguistic Context in Speech Listening: Does Acquired Hearing Loss Lead to Reduced Engagement of Prediction? Ear Hear 2024; 45:1107-1114. [PMID: 38880953 PMCID: PMC11325976 DOI: 10.1097/aud.0000000000001515] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2022] [Accepted: 04/01/2024] [Indexed: 06/18/2024]
Abstract
Research investigating the complex interplay of cognitive mechanisms involved in speech listening for people with hearing loss has been gaining prominence. In particular, linguistic context allows the use of several cognitive mechanisms that are not well distinguished in hearing science, namely those relating to "postdiction", "integration", and "prediction". We offer the perspective that an unacknowledged impact of hearing loss is the differential use of predictive mechanisms relative to age-matched individuals with normal hearing. As evidence, we first review how degraded auditory input leads to reduced prediction in people with normal hearing, then consider the literature exploring context use in people with acquired postlingual hearing loss. We argue that no research on hearing loss has directly assessed prediction. Because current interventions for hearing do not fully alleviate difficulty in conversation, and avoidance of spoken social interaction may be a mediator between hearing loss and cognitive decline, this perspective could lead to greater understanding of cognitive effects of hearing loss and provide insight regarding new targets for intervention.
Collapse
Affiliation(s)
- Leigh B. Fernandez
- Department of Social Sciences, Psycholinguistics Group, University of Kaiserslautern-Landau, Kaiserslautern, Germany
| | - Martin J. Pickering
- Department of Psychology, University of Edinburgh, Edinburgh, United Kingdom
| | - Graham Naylor
- Hearing Sciences—Scottish Section, School of Medicine, University of Nottingham, Glasgow, United Kingdom
| | - Lauren V. Hadley
- Hearing Sciences—Scottish Section, School of Medicine, University of Nottingham, Glasgow, United Kingdom
| |
Collapse
|
6
|
Silcox JW, Bennett K, Copeland A, Ferguson SH, Payne BR. The Costs (and Benefits?) of Effortful Listening for Older Adults: Insights from Simultaneous Electrophysiology, Pupillometry, and Memory. J Cogn Neurosci 2024; 36:997-1020. [PMID: 38579256 DOI: 10.1162/jocn_a_02161] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/07/2024]
Abstract
Although the impact of acoustic challenge on speech processing and memory increases as a person ages, older adults may engage in strategies that help them compensate for these demands. In the current preregistered study, older adults (n = 48) listened to sentences-presented in quiet or in noise-that were high constraint with either expected or unexpected endings or were low constraint with unexpected endings. Pupillometry and EEG were simultaneously recorded, and subsequent sentence recognition and word recall were measured. Like young adults in prior work, we found that noise led to increases in pupil size, delayed and reduced ERP responses, and decreased recall for unexpected words. However, in contrast to prior work in young adults where a larger pupillary response predicted a recovery of the N400 at the cost of poorer memory performance in noise, older adults did not show an associated recovery of the N400 despite decreased memory performance. Instead, we found that in quiet, increases in pupil size were associated with delays in N400 onset latencies and increased recognition memory performance. In conclusion, we found that transient variation in pupil-linked arousal predicted trade-offs between real-time lexical processing and memory that emerged at lower levels of task demand in aging. Moreover, with increased acoustic challenge, older adults still exhibited costs associated with transient increases in arousal without the corresponding benefits.
Collapse
|
7
|
Cutter MG, Paterson KB, Filik R. Syntactic prediction during self-paced reading is age invariant. Br J Psychol 2023; 114:39-53. [PMID: 36102378 PMCID: PMC10087647 DOI: 10.1111/bjop.12594] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2021] [Revised: 06/10/2022] [Accepted: 08/15/2022] [Indexed: 01/11/2023]
Abstract
Controversy exists as to whether, compared to young adults, older adults are more, equally or less likely to make linguistic predictions while reading. While previous studies have examined age effects on the prediction of upcoming words, the prediction of upcoming syntactic structures has been largely unexplored. We compared the benefit that young and older readers gain when the syntactic structure is made predictable, as well as potential age differences in the costs involved in making predictions. In a self-paced reading study, 60 young and 60 older adults read sentences in which noun-phrase coordination (e.g. large pizza or tasty calzone) is made predictable through the inclusion of the word either earlier in the sentence. Results showed a benefit of the presence of either in the second half of the coordination phrase, and a cost of the presence of either in the first half. We observed no age differences in the benefit or costs of making these predictions; Bayes factor analyses offered strong evidence that these effects are age invariant. Together, these findings suggest that both older and younger adults make similar strength syntactic predictions with a similar level of difficulty. We relate this age invariance in syntactic prediction to specific aspects of the ageing process.
Collapse
Affiliation(s)
| | | | - Ruth Filik
- University of Nottingham, Nottingham, UK
| |
Collapse
|
8
|
Haigh P, Hanif N, de Bruin A. Diving into a pool or volcano? Examining the influence of sentence context and task demands on sentence reading in younger and older adults. PLoS One 2022; 17:e0279555. [PMID: 36584104 PMCID: PMC9803221 DOI: 10.1371/journal.pone.0279555] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2022] [Accepted: 12/09/2022] [Indexed: 12/31/2022] Open
Abstract
Cognitive ageing is often associated with slower lexical processing, which might influence both language production and comprehension. Words are typically used in context, which can further influence word processing and potential age differences. However, it remains unclear how older adults are affected by context during reading. Older adults are reported to have in-tact semantic knowledge, which could potentially help them to process words predicted by semantic information in the preceding context. However, potential difficulties with semantic control might mean older adults have greater difficulty suppressing interfering information from mismatching contexts. In this study we examined the influence of contexts that either predicted a specific target word ("matched", e.g., "The man watched the lava erupt from the volcano") or predicted another word than the target ("mismatched", e.g., "The swimmer dived into the volcano") as compared to neutral contexts (e.g., "They went to see the volcano"). We also examined the potential role of task demands by asking participants to either just read the sentences for comprehension or to answer questions. Forty younger adults (18-35 years old) and forty older adults (65-80 years old) completed a self-paced reading task in which we measured reading times for the target words. Older adults showed slower reading times overall. Matched sentence contexts facilitated reading times in both age groups. Surprisingly, mismatched sentence contexts did not hinder reading times in either age group. Furthermore, reading times were not influenced by task demands. Together, this shows the importance of studying language in context. While interference from mismatching sentence contexts might have not been substantial enough to delay reading, reading was faster when processing expected words. This suggests older adults can indeed benefit from semantic knowledge to facilitate word processing during comprehension. This occurred even when no additional task was presented and people were purely reading for comprehension.
Collapse
Affiliation(s)
- Pennie Haigh
- Department of Psychology, University of York, York, United Kingdom
| | - Naveen Hanif
- Department of Psychology, University of York, York, United Kingdom
| | - Angela de Bruin
- Department of Psychology, University of York, York, United Kingdom
- * E-mail:
| |
Collapse
|
9
|
Crandell HA, Silcox JW, Ferguson SH, Lohani M, Payne BR. The Effects of Captioning Errors, Background Noise, and Hearing Loss on Memory for Text-Captioned Speech. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2022; 65:2364-2390. [PMID: 35623337 DOI: 10.1044/2022_jslhr-21-00416] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
PURPOSE Previous studies have suggested that the negative effects of acoustic challenge on speech memory can be attenuated with assistive text captions, particularly among older adults with hearing impairment. However, no studies have systematically examined the effects of text-captioning errors, which are common in automated speech recognition (ASR) systems. METHOD In two experiments, we examined memory for text-captioned speech (with and without background noise) when captions had no errors (control) or had one of three common ASR errors: substitution, deletion, or insertion errors. RESULTS In both Experiment 1 (young adults with normal hearing) and Experiment 2 (older adults with varying hearing acuity), we observed similar additive effects of caption errors and background noise, such that increased background noise and the presence of captioning errors negatively impacted memory outcomes. Notably, the negative effects of captioning errors were largest among older adults with increased hearing thresholds, suggesting that older adults with hearing loss may show an increased reliance on text captions compared to adults with normal hearing. CONCLUSION Our findings show that even a single-word error can be deleterious to memory for text-captioned speech, especially in older adults with hearing loss. Therefore, to produce the greatest benefit to memory, it is crucial that text captions are accurate.
Collapse
Affiliation(s)
| | - Jack W Silcox
- Department of Psychology, The University of Utah, Salt Lake City
| | - Sarah H Ferguson
- Department of Communication Sciences and Disorders, The University of Utah, Salt Lake City
| | - Monika Lohani
- Department of Educational Psychology, The University of Utah, Salt Lake City
| | - Brennan R Payne
- Department of Psychology, The University of Utah, Salt Lake City
- Department of Communication Sciences and Disorders, The University of Utah, Salt Lake City
| |
Collapse
|
10
|
Jongman SR, Federmeier KD. Age-related Changes in the Structure and Dynamics of the Semantic Network. LANGUAGE, COGNITION AND NEUROSCIENCE 2022; 37:805-819. [PMID: 36262380 PMCID: PMC9576195 DOI: 10.1080/23273798.2021.2019286] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/09/2021] [Accepted: 12/08/2021] [Indexed: 06/16/2023]
Abstract
Normal aging has variable effects on language comprehension, perhaps because comprehension mechanisms vary in their dependence on network structure versus network dynamics. To test claims that processing dynamics are more affected by age than structure, we used EEG to measure and compare the impact of neighborhood size, a core measure of the structure of the lexico-semantic network, and repetition, a simple measure of processing dynamics, on single word processing. Older adults showed robust effects of neighborhood size on the N400, comparable to those elicited by young adults, but reduced effects of repetition. Furthermore, older adults with greater verbal fluency, print exposure, and reading comprehension showed greater repetition effects, suggesting some older adults can maintain processing dynamics that are similar to those of young adults. Thus, the organizational structure of the semantic network seems stable across normal aging, but (some) older adults may struggle to adjust activation states within that network.
Collapse
Affiliation(s)
- Suzanne R. Jongman
- Department of Psychology, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
| | - Kara D. Federmeier
- Department of Psychology, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
- Program in Neuroscience, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
- The Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
| |
Collapse
|
11
|
Dikker S, Mech EN, Gwilliams L, West T, Dumas G, Federmeier KD. Exploring age-related changes in inter-brain synchrony during verbal communication. PSYCHOLOGY OF LEARNING AND MOTIVATION 2022. [DOI: 10.1016/bs.plm.2022.08.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
12
|
Dave S, Brothers T, Hoversten LJ, Traxler MJ, Swaab TY. Cognitive control mediates age-related changes in flexible anticipatory processing during listening comprehension. Brain Res 2021; 1768:147573. [PMID: 34216583 PMCID: PMC8403152 DOI: 10.1016/j.brainres.2021.147573] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2020] [Revised: 05/16/2021] [Accepted: 06/25/2021] [Indexed: 11/21/2022]
Abstract
Effective listening comprehension not only requires processing local linguistic input, but also necessitates incorporating contextual cues available in the global communicative environment. Local sentence processing can be facilitated by pre-activation of likely upcoming input, or predictive processing. Recent evidence suggests that young adults can flexibly adapt local predictive processes based on cues provided by the global communicative environment, such as the reliability of specific speakers. Whether older comprehenders can also flexibly adapt to global contextual cues is currently unknown. Moreover, it is unclear whether the underlying mechanisms supporting local predictive processing differ from those supporting adaptation to global contextual cues. Critically, it is unclear whether these mechanisms change as a function of typical aging. We examined the flexibility of prediction in young and older adults by presenting sentences from speakers whose utterances were typically more or less predictable (i.e., reliable speakers who produced expected words 80% of the time, versus unreliable speakers who produced expected words 20% of the time). For young listeners, global speaker reliability cues modulated neural effects of local predictability on the N400. In contrast, older adults, on average, did not show global modulation of local processing. Importantly, however, cognitive control (i.e., Stroop interference effects) mediated age-related reductions in sensitivity to the reliability of the speaker. Both young and older adults with high cognitive control showed greater N400 effects of predictability during sentences produced by a reliable speaker, suggesting that cognitive control is required to regulate the strength of top-down predictions based on global contextual information. Critically, cognitive control predicted sensitivity to global speaker-specific information but not local predictability cues, suggesting that predictive processing in local sentence contexts may be supported by separable neural mechanisms from adaptation of prediction as a function of global context. These results have important implications for interpreting age-related change in predictive processing, and for drawing more generalized conclusions regarding domain-general versus language-specific accounts of prediction.
Collapse
Affiliation(s)
- Shruti Dave
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.
| | | | - Liv J Hoversten
- Department of Psychology, University of California Santa Cruz, Santa Cruz, CA, USA
| | - Matthew J Traxler
- Department of Psychology and Center for Mind and Brain, University of California Davis, Davis, CA, USA
| | - Tamara Y Swaab
- Department of Psychology and Center for Mind and Brain, University of California Davis, Davis, CA, USA
| |
Collapse
|
13
|
Text Captioning Buffers Against the Effects of Background Noise and Hearing Loss on Memory for Speech. Ear Hear 2021; 43:115-127. [PMID: 34260436 DOI: 10.1097/aud.0000000000001079] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
OBJECTIVE Everyday speech understanding frequently occurs in perceptually demanding environments, for example, due to background noise and normal age-related hearing loss. The resulting degraded speech signals increase listening effort, which gives rise to negative downstream effects on subsequent memory and comprehension, even when speech is intelligible. In two experiments, we explored whether the presentation of realistic assistive text captioned speech offsets the negative effects of background noise and hearing impairment on multiple measures of speech memory. DESIGN In Experiment 1, young normal-hearing adults (N = 48) listened to sentences for immediate recall and delayed recognition memory. Speech was presented in quiet or in two levels of background noise. Sentences were either presented as speech only or as text captioned speech. Thus, the experiment followed a 2 (caption vs no caption) × 3 (no noise, +7 dB signal-to-noise ratio, +3 dB signal-to-noise ratio) within-subjects design. In Experiment 2, a group of older adults (age range: 61 to 80, N = 31), with varying levels of hearing acuity completed the same experimental task as in Experiment 1. For both experiments, immediate recall, recognition memory accuracy, and recognition memory confidence were analyzed via general(ized) linear mixed-effects models. In addition, we examined individual differences as a function of hearing acuity in Experiment 2. RESULTS In Experiment 1, we found that the presentation of realistic text-captioned speech in young normal-hearing listeners showed improved immediate recall and delayed recognition memory accuracy and confidence compared with speech alone. Moreover, text captions attenuated the negative effects of background noise on all speech memory outcomes. In Experiment 2, we replicated the same pattern of results in a sample of older adults with varying levels of hearing acuity. Moreover, we showed that the negative effects of hearing loss on speech memory in older adulthood were attenuated by the presentation of text captions. CONCLUSIONS Collectively, these findings strongly suggest that the simultaneous presentation of text can offset the negative effects of effortful listening on speech memory. Critically, captioning benefits extended from immediate word recall to long-term sentence recognition memory, a benefit that was observed not only for older adults with hearing loss but also young normal-hearing listeners. These findings suggest that the text captioning benefit to memory is robust and has potentially wide applications for supporting speech listening in acoustically challenging environments.
Collapse
|
14
|
León-Cabrera P, Pagonabarraga J, Morís J, Martínez-Horta S, Marín-Lahoz J, Horta-Barba A, Bejr-Kasem H, Kulisevsky J, Rodríguez-Fornells A. Neural signatures of predictive language processing in Parkinson's disease with and without mild cognitive impairment. Cortex 2021; 141:112-127. [PMID: 34049254 DOI: 10.1016/j.cortex.2021.03.032] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2020] [Revised: 03/04/2021] [Accepted: 03/31/2021] [Indexed: 11/19/2022]
Abstract
Cognitive deficits are common in Parkinson's disease (PD), with some PD patients meeting criteria for mild cognitive impairment (MCI). An unaddressed question is whether linguistic prediction is preserved in PD. This ability is nowadays deemed crucial for achieving fast and efficient comprehension, and it may be negatively impacted by cognitive deterioration in PD. To fill this gap of knowledge, we used event-related potentials (ERPs) to evaluate mechanisms of linguistic prediction in a sample of PD patients (on dopamine compensation) with and without MCI. To this end, participants read sentence contexts that were predictive or not about a sentence-final word. The final word appeared after one sec, matching or mismatching the prediction. The introduction of the interval allowed to capture neural responses both before and after sentence-final words, reflecting semantic anticipation and semantic processing. PD patients with normal cognition (N = 58) showed ERP responses comparable to those of matched controls. Specifically, in predictive contexts, a slow negative potential developed prior to sentence-final words, reflecting semantic anticipation. Later, expected words elicited reduced N400 responses (compared to unexpected words), indicating facilitated semantic processing. PD patients with MCI (N = 20) showed, in addition, a prolongation of the N400 congruency effect (compared to matched PD patients without MCI), indicating that further cognitive decline impacts semantic processing. Finally, lower verbal fluency scores correlated with prolonged N400 congruency effects and with reduced pre-word differences in all PD patients (N = 78). This relevantly points to a role of deficits in temporal-dependent mechanisms in PD, besides prototypical frontal dysfunction, in altered semantic anticipation and semantic processing during sentence comprehension.
Collapse
Affiliation(s)
- Patricia León-Cabrera
- Cognition and Brain Plasticity Unit (CBPU), Department of Cognition, Development and Educational Psychology, Institute of Neuroscience, University of Barcelona and Bellvitge Biomedical Research Institute (IDIBELL), Barcelona, Spain
| | - Javier Pagonabarraga
- Movement Disorders Unit, Neurology Department, Hospital de la Santa Creu i Sant Pau, Barcelona, Spain; Biomedical Research Institute (IIB-Sant Pau), Barcelona, Spain; Universitat Autònoma de Barcelona (UAB), Spain; Centro de Investigación en Red-Enfermedades Neurodegenerativas (CIBERNED), Spain.
| | - Joaquín Morís
- Department of Educational and Evolutive Psychology, University of Granada, Granada, Spain
| | - Saül Martínez-Horta
- Movement Disorders Unit, Neurology Department, Hospital de la Santa Creu i Sant Pau, Barcelona, Spain; Biomedical Research Institute (IIB-Sant Pau), Barcelona, Spain; Universitat Autònoma de Barcelona (UAB), Spain; Centro de Investigación en Red-Enfermedades Neurodegenerativas (CIBERNED), Spain
| | - Juan Marín-Lahoz
- Movement Disorders Unit, Neurology Department, Hospital de la Santa Creu i Sant Pau, Barcelona, Spain; Biomedical Research Institute (IIB-Sant Pau), Barcelona, Spain; Universitat Autònoma de Barcelona (UAB), Spain; Centro de Investigación en Red-Enfermedades Neurodegenerativas (CIBERNED), Spain
| | - Andrea Horta-Barba
- Movement Disorders Unit, Neurology Department, Hospital de la Santa Creu i Sant Pau, Barcelona, Spain; Biomedical Research Institute (IIB-Sant Pau), Barcelona, Spain; Universitat Autònoma de Barcelona (UAB), Spain; Centro de Investigación en Red-Enfermedades Neurodegenerativas (CIBERNED), Spain
| | - Helena Bejr-Kasem
- Movement Disorders Unit, Neurology Department, Hospital de la Santa Creu i Sant Pau, Barcelona, Spain; Biomedical Research Institute (IIB-Sant Pau), Barcelona, Spain; Universitat Autònoma de Barcelona (UAB), Spain; Centro de Investigación en Red-Enfermedades Neurodegenerativas (CIBERNED), Spain
| | - Jaime Kulisevsky
- Movement Disorders Unit, Neurology Department, Hospital de la Santa Creu i Sant Pau, Barcelona, Spain; Biomedical Research Institute (IIB-Sant Pau), Barcelona, Spain; Universitat Autònoma de Barcelona (UAB), Spain; Centro de Investigación en Red-Enfermedades Neurodegenerativas (CIBERNED), Spain
| | - Antoni Rodríguez-Fornells
- Cognition and Brain Plasticity Unit (CBPU), Department of Cognition, Development and Educational Psychology, Institute of Neuroscience, University of Barcelona and Bellvitge Biomedical Research Institute (IDIBELL), Barcelona, Spain; Catalan Institution for Research and Advanced Studies (ICREA), Barcelona, Spain.
| |
Collapse
|
15
|
The many timescales of context in language processing. PSYCHOLOGY OF LEARNING AND MOTIVATION 2021. [DOI: 10.1016/bs.plm.2021.08.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
16
|
Payne BR, Federmeier KD, Stine-Morrow EA. Literacy skill and intra-individual variability in eye-fixation durations during reading: Evidence from a diverse community-based adult sample. Q J Exp Psychol (Hove) 2020; 73:1841-1861. [PMID: 32484390 DOI: 10.1177/1747021820935457] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/03/2023]
Abstract
To understand the effects of literacy on fundamental processes involved in reading, we report a secondary data analysis examining individual differences in global eye-movement measures and first-pass eye-movement distributions in a diverse sample of community-dwelling adults aged 16 to 64. Participants (n = 80) completed an assessment battery probing verbal and non-verbal cognitive abilities and read simple two-sentence passages while their eye movements were recorded. Analyses were focused on characterising the effects of literacy skill on both global indices of eye-fixation distributions and distributional differences in the sensitivity to lexical features. Global reading measures showed that lower literate adults read more slowly on average. However, distributional analyses of fixation durations revealed that the first-pass fixation durations of adults with lower literacy skill were not slower in general (i.e., there was no shift in the fixation duration distribution among lower literate adults). Instead, lower literacy was associated with greater intra-individual variability in first-pass fixation durations, including an increased proportion of extremely long fixations, differentially skewing the distribution of both first-fixation and gaze durations. Exploratory repeated-measures quantile regression analyses of gaze duration revealed differentially greater influences of word length among lower literate readers and greater activation of phonological and orthographic neighbours among higher literate readers, particularly in the tail of the distribution. Collectively, these findings suggest that literacy skill in adulthood is associated with systematic differences in both global and lexically driven eye-movement control during reading.
Collapse
Affiliation(s)
- Brennan R Payne
- Department of Psychology, The University of Utah, Salt Lake City, UT, USA
| | - Kara D Federmeier
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Champaign, IL, USA.,Department of Psychology, University of Illinois at Urbana-Champaign, Champaign, IL, USA
| | - Elizabeth Al Stine-Morrow
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Champaign, IL, USA.,Department of Educational Psychology, University of Illinois at Urbana-Champaign, Champaign, IL, USA
| |
Collapse
|
17
|
Payne B, Federmeier KD. Individual Differences in Reading Speed are Linked to Variability in the Processing of Lexical and Contextual Information: Evidence from Single-trial Event-related Brain Potentials. WORD (NEW YORK, N.Y. : 1945) 2019; 65:252-272. [PMID: 33692598 PMCID: PMC7943043 DOI: 10.1080/00437956.2019.1678826] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
In the current paper, we examined the effects of lexical (e.g. word frequency, orthographic neighborhood density) and contextual (e.g. word predictability in the form of cloze probability) features on single-trial event-related brain potentials in a self-paced reading paradigm. Critically, we examined whether individual differences in reading speed modulated single-trial effects on the N400, an ERP component linked to semantic memory access. Consistent with past work, we found that word frequency effects on the N400 were attenuated with increasing predictability. However, effects of orthographic neighborhood density were robust across all levels of predictability. Importantly, individual differences in reading speed moderated the influence of both frequency and predictability (but not orthographic neighborhood density) on the N400, such that slower readers showed reduced effects compared to faster readers. These data show that different lexical factors influence word processing through dissociable mechanisms. Our findings support a dynamic semantic-memory access model of the N400, in which information at multiple levels (lexical, sentential, individual) simultaneously contributes to the unfolding neural dynamics of comprehension.
Collapse
Affiliation(s)
- Brennan Payne
- Department of Psychology, University of Utah, Salt Lake City, UT, USA
| | - Kara D. Federmeier
- Department of Psychology, Neuroscience Program, and Beckman Institute, University of Illinois at Urbana-Champaign, Urbana, IL, USA
| |
Collapse
|