1
|
Li AY, Yuan JY, Pun C, Barense MD. The effect of memory load on object reconstruction: Insights from an online mouse-tracking task. Atten Percept Psychophys 2023; 85:1612-1630. [PMID: 36600154 DOI: 10.3758/s13414-022-02650-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/20/2022] [Indexed: 01/05/2023]
Abstract
Why can't we remember everything that we experience? Previous work in the domain of object memory has suggested that our ability to resolve interference between relevant and irrelevant object features may limit how much we can remember at any given moment. Here, we developed an online mouse-tracking task to study how memory load influences object reconstruction, testing participants synchronously over virtual conference calls. We first tested up to 18 participants concurrently, replicating memory findings from a condition where participants were tested individually. Next, we examined how memory load influenced mouse trajectories as participants reconstructed target objects. We found interference between the contents of working memory and what was perceived during object reconstruction, an effect that interacted with visual similarity and memory load. Furthermore, we found interference from previously studied but currently irrelevant objects, providing evidence of object-to-location binding errors. At the greatest memory load, participants were nearly three times more likely to move their mouse cursor over previously studied nontarget objects, an effect observed primarily during object reconstruction rather than in the period before the final response. As evidence of the dynamic interplay between working memory and perception, these results show that object reconstruction behavior may be altered by (i) interference between what is represented in mind and what is currently being viewed, and (ii) interference from previously studied but currently irrelevant information. Finally, we discuss how mouse tracking can provide a rich characterization of participant behavior at millisecond temporal resolution, enormously increasing power in cognitive psychology experiments.
Collapse
Affiliation(s)
- Aedan Y Li
- Department of Psychology, University of Toronto, 100 St. George Street, Toronto, ON, M5S 3G3, Canada.
| | - James Y Yuan
- Department of Psychology, University of Toronto, 100 St. George Street, Toronto, ON, M5S 3G3, Canada.
| | - Carson Pun
- Department of Psychology, University of Toronto, 100 St. George Street, Toronto, ON, M5S 3G3, Canada
| | - Morgan D Barense
- Department of Psychology, University of Toronto, 100 St. George Street, Toronto, ON, M5S 3G3, Canada
| |
Collapse
|
2
|
Memory and Proactive Interference for spatially distributed items. Mem Cognit 2022; 50:782-816. [PMID: 35119628 PMCID: PMC9018653 DOI: 10.3758/s13421-021-01239-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/06/2021] [Indexed: 11/08/2022]
Abstract
Our ability to briefly retain information is often limited. Proactive Interference (PI) might contribute to these limitations (e.g., when items in recognition tests are difficult to reject after having appeared recently). In visual Working Memory (WM), spatial information might protect WM against PI, especially if encoding items together with their spatial locations makes item-location combinations less confusable than simple items without a spatial component. Here, I ask (1) if PI is observed for spatially distributed items, (2) if it arises among simple items or among item-location combinations, and (3) if spatial information affects PI at all. I show that, contrary to views that spatial information protects against PI, PI is reliably observed for spatially distributed items except when it is weak. PI mostly reflects items that appear recently or frequently as memory items, while occurrences as test items play a smaller role, presumably because their temporal context is easier to encode. Through mathematical modeling, I then show that interference occurs among simple items rather than item-location combinations. Finally, to understand the effects of spatial information, I separate the effects of (a) the presence and (b) the predictiveness of spatial information on memory and its susceptibility to PI. Memory is impaired when items are spatially distributed, but, depending on the analysis, unaffected by the predictiveness of spatial information. In contrast, the susceptibility to PI is unaffected by either manipulation. Visual memory is thus impaired by PI for spatially distributed items due to interference from recent memory items (rather than test items or item-location combinations).
Collapse
|
3
|
Zanto TP, Liu H, Pan P, Gazzaley A. Temporal attention is not affected by working memory load. Cortex 2020; 130:351-361. [PMID: 32738582 DOI: 10.1016/j.cortex.2020.06.008] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2020] [Revised: 05/12/2020] [Accepted: 06/09/2020] [Indexed: 10/23/2022]
Abstract
Temporal attention refers to the ability to orient attention in time, which serves to enhance performance such as target detection and discrimination and is a fundamental component of cognitive function. Although some research indicates that temporal attention ability is affected by working memory updating, it is unclear whether temporal attention is also affected by the availability of working memory stores. To address this, participants were presented a dual-task paradigm requiring zero, three, or six digits to be held in working memory while engaged in a temporally cued visual discrimination task. Results show that working memory load did not differentially affect the ability to benefit from predictive temporal cues during the visual discrimination task. This indicates that temporal attention is not affected by available working memory stores. Interestingly, posterior beta band (12-30 Hz) activity was differentially modulated by temporal attention and working memory load, such that it decreased prior to expected targets and increased with load. Analysis across participants indicated that those individuals who exhibited greater temporal attention-based modulation of beta activity (i.e., predictive < neutrally cued) displayed improved discrimination performance, but also yielded lowered working memory accuracy. Thus, the ability to benefit from temporal attention processes while multitasking comes at the cost of lowered secondary task performance. Together, these results indicate that available working memory stores do not affect temporal attention ability. Rather, limitations in divided attention ability result in a performance cost that prioritizes one task over another, which may be indexed by beta band activity.
Collapse
Affiliation(s)
- Theodore P Zanto
- Department of Neurology, University of California San Francisco, San Francisco, CA, USA; Neuroscape, University of California San Francisco, San Francisco, CA, USA.
| | - Helen Liu
- Department of Neurology, University of California San Francisco, San Francisco, CA, USA
| | - Peter Pan
- Department of Neurology, University of California San Francisco, San Francisco, CA, USA
| | - Adam Gazzaley
- Department of Neurology, University of California San Francisco, San Francisco, CA, USA; Neuroscape, University of California San Francisco, San Francisco, CA, USA; Departments of Physiology and Psychiatry, University of California San Francisco, San Francisco, CA, USA
| |
Collapse
|
4
|
Endress AD, Slone LK, Johnson SP. Statistical learning and memory. Cognition 2020; 204:104346. [PMID: 32615468 DOI: 10.1016/j.cognition.2020.104346] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2019] [Revised: 05/12/2020] [Accepted: 05/30/2020] [Indexed: 01/01/2023]
Abstract
Learners often need to identify and remember recurring units in continuous sequences, but the underlying mechanisms are debated. A particularly prominent candidate mechanism relies on distributional statistics such as Transitional Probabilities (TPs). However, it is unclear what the outputs of statistical segmentation mechanisms are, and if learners store these outputs as discrete chunks in memory. We critically review the evidence for the possibility that statistically coherent items are stored in memory and outline difficulties in interpreting past research. We use Slone and Johnson's (2018) experiments as a case study to show that it is difficult to delineate the different mechanisms learners might use to solve a learning problem. Slone and Johnson (2018) reported that 8-month-old infants learned coherent chunks of shapes in visual sequences. Here, we describe an alternate interpretation of their findings based on a multiple-cue integration perspective. First, when multiple cues to statistical structure were available, infants' looking behavior seemed to track with the strength of the strongest one - backward TPs, suggesting that infants process multiple cues simultaneously and select the strongest one. Second, like adults, infants are exquisitely sensitive to chunks, but may require multiple cues to extract them. In Slone and Johnson's (2018) experiments, these cues were provided by immediate chunk repetitions during familiarization. Accordingly, infants showed strongest evidence of chunking following familiarization sequences in which immediate repetitions were more frequent. These interpretations provide a strong argument for infants' processing of multiple cues and the potential importance of multiple cues for chunk recognition in infancy.
Collapse
Affiliation(s)
- Ansgar D Endress
- Department of Psychology, City, University of London, United Kingdom.
| | - Lauren K Slone
- Department of Psychological and Brain Sciences, Indiana University, Bloomington, United States; Department of Psychology, Hope College, Holland, United States
| | - Scott P Johnson
- Department of Psychology, University of California, Los Angeles, United States
| |
Collapse
|
5
|
Endress AD, Szabó S. Sequential Presentation Protects Working Memory From Catastrophic Interference. Cogn Sci 2020; 44:e12828. [PMID: 32368830 DOI: 10.1111/cogs.12828] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2017] [Revised: 01/09/2020] [Accepted: 02/13/2020] [Indexed: 01/29/2023]
Abstract
Neural network models of memory are notorious for catastrophic interference: Old items are forgotten as new items are memorized (French, 1999; McCloskey & Cohen, 1989). While working memory (WM) in human adults shows severe capacity limitations, these capacity limitations do not reflect neural network style catastrophic interference. However, our ability to quickly apprehend the numerosity of small sets of objects (i.e., subitizing) does show catastrophic capacity limitations, and this subitizing capacity and WM might reflect a common capacity. Accordingly, computational investigations (Knops, Piazza, Sengupta, Eger & Melcher, 2014; Sengupta, Surampudi & Melcher, 2014) suggest that mutual inhibition among neurons can explain both kinds of capacity limitations as well as why our ability to estimate the numerosity of larger sets is limited according to a Weber ratio signature. Based on simulations with a saliency map-like network and mathematical proofs, we provide three results. First, mutual inhibition among neurons leads to catastrophic interference when items are presented simultaneously. The network can remember a limited number of items, but when more items are presented, the network forgets all of them. Second, if memory items are presented sequentially rather than simultaneously, the network remembers the most recent items rather than forgetting all of them. Hence, the tendency in WM tasks to sequentially attend even to simultaneously presented items might not only reflect attentional limitations, but also an adaptive strategy to avoid catastrophic interference. Third, the mean activation level in the network can be used to estimate the number of items in small sets, but it does not accurately reflect the number of items in larger sets. Rather, we suggest that the Weber ratio signature of large number discrimination emerges naturally from the interaction between the limited precision of a numeric estimation system and a multiplicative gain control mechanism.
Collapse
Affiliation(s)
| | - Szilárd Szabó
- Department of Mathematics, Budapest University of Technology and Economics
| |
Collapse
|
6
|
Crawford L, Loprinzi PD. Effects of Exercise on Memory Interference in Neuropsychiatric Disorders. ADVANCES IN EXPERIMENTAL MEDICINE AND BIOLOGY 2020; 1228:425-438. [PMID: 32342475 DOI: 10.1007/978-981-15-1792-1_29] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/13/2023]
Abstract
There are several mechanisms that cause memory impairment, including motivated forgetting, active forgetting, natural decay, and memory interference. Interference occurs when one is attempting to recall something specific, but there is conflicting information making it more difficult to recall the target stimuli. In laboratory settings, it is common to measure memory interference with paired associate tasks-usually utilizing the AB-CD, AB-AC, AB-ABr, or AB-DE AC-FG method. Memory impairments are frequent among those with neuropsychiatric disorders such as depression, schizophrenia, and multiple sclerosis. The memory effects of each condition differ, but are all related to alterations in brain physiology and general memory deterioration. Exercise, or physical activity, has been demonstrated to attenuate memory interference in some cases, but the mechanisms are still being determined. Further research is needed on memory interference, in regard to exercise and neuropsychiatric disorders.
Collapse
Affiliation(s)
- Lindsay Crawford
- Department of Health, Exercise Science, and Recreation Management, Exercise and Memory Laboratory, The University of Mississippi, MS, Oxford, USA
| | - Paul D Loprinzi
- Department of Health, Exercise Science, and Recreation Management, Exercise and Memory Laboratory, The University of Mississippi, MS, Oxford, USA.
| |
Collapse
|
7
|
Gross S. Perceptual consciousness and cognitive access from the perspective of capacity-unlimited working memory. Philos Trans R Soc Lond B Biol Sci 2019; 373:rstb.2017.0343. [PMID: 30061457 DOI: 10.1098/rstb.2017.0343] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/21/2018] [Indexed: 01/23/2023] Open
Abstract
Theories of consciousness divide over whether perceptual consciousness is rich or sparse in specific representational content and whether it requires cognitive access. These two issues are often treated in tandem because of a shared assumption that the representational capacity of cognitive access is fairly limited. Recent research on working memory challenges this shared assumption. This paper argues that abandoning the assumption undermines post-cue-based 'overflow' arguments, according to which perceptual consciousness is rich and does not require cognitive access. Abandoning it also dissociates the rich/sparse debate from the access question. The paper then explores attempts to reformulate overflow theses in ways that do not require the assumption of limited capacity. Finally, it discusses the problem of relating seemingly non-probabilistic perceptual consciousness to the probabilistic representations posited by the models that challenge conceptions of cognitive access as capacity-limited.This article is part of the theme issue 'Perceptual consciousness and cognitive access'.
Collapse
Affiliation(s)
- Steven Gross
- Department of Philosophy, Johns Hopkins University, 3400 N. Charles St., Baltimore, MD 21218, USA
| |
Collapse
|
8
|
Speeded multielement decision-making as diffusion in a hypersphere: Theory and application to double-target detection. Psychon Bull Rev 2019; 26:127-162. [PMID: 29968205 DOI: 10.3758/s13423-018-1491-0] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
We generalize the circular 2D diffusion model of Smith (Psychological Review, 123, 425-451: 2016) to provide a new model of speeded decision-making in multielement visual displays. We model decision-making in tasks with multielement displays as evidence accumulation by a vector-valued diffusion process in a hypersphere, whose radius represents the decision criterion for the task. We show that the methods used to derive response time and accuracy predictions for the 2D model can be applied, with only minor changes, to predict performance in higher-dimensional spaces as well. We apply the model to the double-target deficit paradigm of Duncan (Psychological Review, 87, 272-300: 1980) in which participants judge whether briefly presented four-element displays contain one- or two-digit targets among letter distractors. A 4D version of the hyperspherical diffusion model correctly predicted distributions of response times and response accuracy as a function of task difficulty in single-target and double-target versions of the task. The estimated drift rate parameters from the model imply that the mental representation of the decision alternatives, which we term the "decision template" for the task, encodes configural stimulus properties that reflect the number of targets in the display. Along with its application to multielement decision-making, the model has the potential to characterize the speed and accuracy of multiattribute decisions in studies of cognitive categorization, visual attention, and other areas.
Collapse
|
9
|
Endress AD, Korjoukov I, Bonatti LL. Category-based grouping in working memory and multiple object tracking. VISUAL COGNITION 2017. [DOI: 10.1080/13506285.2017.1349229] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Affiliation(s)
| | | | - Luca L. Bonatti
- Universitat Pompeu Fabra, Barcelona, Spain
- ICREA, Pg. Lluís Companys 23, 08010 Barcelona, Spain
| |
Collapse
|