1
|
Ye C, Guo L, Wang N, Liu Q, Xie W. Perceptual encoding benefit of visual memorability on visual memory formation. Cognition 2024; 248:105810. [PMID: 38733867 DOI: 10.1016/j.cognition.2024.105810] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2023] [Revised: 03/31/2024] [Accepted: 04/29/2024] [Indexed: 05/13/2024]
Abstract
Human observers often exhibit remarkable consistency in remembering specific visual details, such as certain face images. This phenomenon is commonly attributed to visual memorability, a collection of stimulus attributes that enhance the long-term retention of visual information. However, the exact contributions of visual memorability to visual memory formation remain elusive as these effects could emerge anywhere from early perceptual encoding to post-perceptual memory consolidation processes. To clarify this, we tested three key predictions from the hypothesis that visual memorability facilitates early perceptual encoding that supports the formation of visual short-term memory (VSTM) and the retention of visual long-term memory (VLTM). First, we examined whether memorability benefits in VSTM encoding manifest early, even within the constraints of a brief stimulus presentation (100-200 ms; Experiment 1). We achieved this by manipulating stimulus presentation duration in a VSTM change detection task using face images with high- or low-memorability while ensuring they were equally familiar to the participants. Second, we assessed whether this early memorability benefit increases the likelihood of VSTM retention, even with post-stimulus masking designed to interrupt post-perceptual VSTM consolidation processes (Experiment 2). Last, we investigated the durability of memorability benefits by manipulating memory retention intervals from seconds to 24 h (Experiment 3). Across experiments, our data suggest that visual memorability has an early impact on VSTM formation, persisting across variable retention intervals and predicting subsequent VLTM overnight. Combined, these findings highlight that visual memorability enhances visual memory within 100-200 ms following stimulus onset, resulting in robust memory traces resistant to post-perceptual interruption and long-term forgetting.
Collapse
Affiliation(s)
- Chaoxiong Ye
- Institute of Brain and Psychological Sciences, Sichuan Normal University, Chengdu 610066, China; Department of Psychology, University of Jyväskylä, Jyväskylä 40014, Finland; School of Education, Anyang Normal University, Anyang 455000, China.
| | - Lijing Guo
- Institute of Brain and Psychological Sciences, Sichuan Normal University, Chengdu 610066, China; Department of Psychology, University of Jyväskylä, Jyväskylä 40014, Finland.
| | - Nathan Wang
- Johns Hopkins University, Baltimore, MD 21218, United States of America.
| | - Qiang Liu
- Institute of Brain and Psychological Sciences, Sichuan Normal University, Chengdu 610066, China; Department of Psychology, University of Jyväskylä, Jyväskylä 40014, Finland.
| | - Weizhen Xie
- Department of Psychology, University of Maryland, College Park, MD 20742, United States of America.
| |
Collapse
|
2
|
Huang J, Wang T, Dai W, Li Y, Yang Y, Zhang Y, Wu Y, Zhou T, Xing D. Neuronal representation of visual working memory content in the primate primary visual cortex. SCIENCE ADVANCES 2024; 10:eadk3953. [PMID: 38875332 DOI: 10.1126/sciadv.adk3953] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/19/2023] [Accepted: 05/10/2024] [Indexed: 06/16/2024]
Abstract
The human ability to perceive vivid memories as if they "float" before our eyes, even in the absence of actual visual stimuli, captivates the imagination. To determine the neural substrates underlying visual memories, we investigated the neuronal representation of working memory content in the primary visual cortex of monkeys. Our study revealed that neurons exhibit unique responses to different memory contents, using firing patterns distinct from those observed during the perception of external visual stimuli. Moreover, this neuronal representation evolves with alterations in the recalled content and extends beyond the retinotopic areas typically reserved for processing external visual input. These discoveries shed light on the visual encoding of memories and indicate avenues for understanding the remarkable power of the mind's eye.
Collapse
Affiliation(s)
- Jiancao Huang
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, China
| | - Tian Wang
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, China
- College of Life Sciences, Beijing Normal University, Beijing 100875, China
| | - Weifeng Dai
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, China
| | - Yang Li
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, China
| | - Yi Yang
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, China
| | - Yange Zhang
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, China
| | - Yujie Wu
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, China
| | - Tingting Zhou
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, China
| | - Dajun Xing
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, China
| |
Collapse
|
3
|
Bays PM, Schneegans S, Ma WJ, Brady TF. Representation and computation in visual working memory. Nat Hum Behav 2024:10.1038/s41562-024-01871-2. [PMID: 38849647 DOI: 10.1038/s41562-024-01871-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2022] [Accepted: 03/22/2024] [Indexed: 06/09/2024]
Abstract
The ability to sustain internal representations of the sensory environment beyond immediate perception is a fundamental requirement of cognitive processing. In recent years, debates regarding the capacity and fidelity of the working memory (WM) system have advanced our understanding of the nature of these representations. In particular, there is growing recognition that WM representations are not merely imperfect copies of a perceived object or event. New experimental tools have revealed that observers possess richer information about the uncertainty in their memories and take advantage of environmental regularities to use limited memory resources optimally. Meanwhile, computational models of visuospatial WM formulated at different levels of implementation have converged on common principles relating capacity to variability and uncertainty. Here we review recent research on human WM from a computational perspective, including the neural mechanisms that support it.
Collapse
Affiliation(s)
- Paul M Bays
- Department of Psychology, University of Cambridge, Cambridge, UK
| | | | - Wei Ji Ma
- Center for Neural Science and Department of Psychology, New York University, New York, NY, USA
| | - Timothy F Brady
- Department of Psychology, University of California, San Diego, La Jolla, CA, USA.
| |
Collapse
|
4
|
Malleret G, Salin P, Mazza S, Plancher G. Working memory forgetting: Bridging gaps between human and animal studies. Neurosci Biobehav Rev 2024; 163:105742. [PMID: 38830561 DOI: 10.1016/j.neubiorev.2024.105742] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2024] [Revised: 04/16/2024] [Accepted: 05/28/2024] [Indexed: 06/05/2024]
Abstract
The causes of forgetting in working memory (WM) remain a source of debate in cognitive psychology, partly because it has always been challenging to probe the complex neural mechanisms that govern rapid cognitive processes in humans. In this review, we argue that neural, and more precisely animal models, provide valuable tools for exploring the precise mechanisms of WM forgetting. First, we discuss theoretical perspectives concerning WM forgetting in humans. Then, we present neuronal correlates of WM in animals, starting from the initial evidence of delay activity observed in the prefrontal cortex to the later synaptic theory of WM. In the third part, specific theories of WM are discussed, including the notion that silent versus non-silent activity is more consistent with the processes of refreshing and decay proposed in human cognitive models. The review concludes with an exploration of the relationship between long-term memory and WM, revealing connections between these two forms of memory through the long-term synaptic hypothesis, which suggests that long-term storage of interference can potentially disrupt WM.
Collapse
Affiliation(s)
- Gaël Malleret
- Centre de Recherche en Neurosciences de Lyon, Centre National de la Recherche Scientifique Unité Mixte de Recherche 5292, Institut National de la Santé et de la Recherche Médicale U1028, University Claude Bernard Lyon 1, Bron F-69500, France
| | - Paul Salin
- Centre de Recherche en Neurosciences de Lyon, Centre National de la Recherche Scientifique Unité Mixte de Recherche 5292, Institut National de la Santé et de la Recherche Médicale U1028, University Claude Bernard Lyon 1, Bron F-69500, France
| | - Stéphanie Mazza
- Centre de Recherche en Neurosciences de Lyon, Centre National de la Recherche Scientifique Unité Mixte de Recherche 5292, Institut National de la Santé et de la Recherche Médicale U1028, University Claude Bernard Lyon 1, Bron F-69500, France
| | - Gaën Plancher
- Université Lumière Lyon 2, Laboratoire d'Etude des Mécanismes Cognitifs, Bron, France; Institut Universitaire de France (IUF), France.
| |
Collapse
|
5
|
Busch A, Roussy M, Luna R, Leavitt ML, Mofrad MH, Gulli RA, Corrigan B, Mináč J, Sachs AJ, Palaniyappan L, Muller L, Martinez-Trujillo JC. Neuronal activation sequences in lateral prefrontal cortex encode visuospatial working memory during virtual navigation. Nat Commun 2024; 15:4471. [PMID: 38796480 PMCID: PMC11127969 DOI: 10.1038/s41467-024-48664-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2023] [Accepted: 05/01/2024] [Indexed: 05/28/2024] Open
Abstract
Working memory (WM) is the ability to maintain and manipulate information 'in mind'. The neural codes underlying WM have been a matter of debate. We simultaneously recorded the activity of hundreds of neurons in the lateral prefrontal cortex of male macaque monkeys during a visuospatial WM task that required navigation in a virtual 3D environment. Here, we demonstrate distinct neuronal activation sequences (NASs) that encode remembered target locations in the virtual environment. This NAS code outperformed the persistent firing code for remembered locations during the virtual reality task, but not during a classical WM task using stationary stimuli and constraining eye movements. Finally, blocking NMDA receptors using low doses of ketamine deteriorated the NAS code and behavioral performance selectively during the WM task. These results reveal the versatility and adaptability of neural codes supporting working memory function in the primate lateral prefrontal cortex.
Collapse
Affiliation(s)
- Alexandra Busch
- Robarts Research Institute, University of Western Ontario, London, ON, Canada
- Brain and Mind Institute, University of Western Ontario, London, ON, Canada
- Department of Mathematics, University of Western Ontario, London, ON, Canada
| | - Megan Roussy
- Robarts Research Institute, University of Western Ontario, London, ON, Canada
- Brain and Mind Institute, University of Western Ontario, London, ON, Canada
- Department of Physiology and Pharmacology, University of Western Ontario, London, ON, Canada
| | - Rogelio Luna
- Robarts Research Institute, University of Western Ontario, London, ON, Canada
- Brain and Mind Institute, University of Western Ontario, London, ON, Canada
- Department of Physiology and Pharmacology, University of Western Ontario, London, ON, Canada
| | | | - Maryam H Mofrad
- Brain and Mind Institute, University of Western Ontario, London, ON, Canada
- Department of Mathematics, University of Western Ontario, London, ON, Canada
| | - Roberto A Gulli
- Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY, USA
| | - Benjamin Corrigan
- Robarts Research Institute, University of Western Ontario, London, ON, Canada
- Brain and Mind Institute, University of Western Ontario, London, ON, Canada
- Department of Physiology and Pharmacology, University of Western Ontario, London, ON, Canada
| | - Ján Mináč
- Department of Mathematics, University of Western Ontario, London, ON, Canada
| | - Adam J Sachs
- The Ottawa Hospital, University of Ottawa, Ottawa, ON, Canada
| | - Lena Palaniyappan
- Robarts Research Institute, University of Western Ontario, London, ON, Canada
- Department of Psychiatry, University of Western Ontario, London, ON, Canada
- Lawson Health Research Institute, London, ON, Canada
| | - Lyle Muller
- Robarts Research Institute, University of Western Ontario, London, ON, Canada.
- Brain and Mind Institute, University of Western Ontario, London, ON, Canada.
- Department of Mathematics, University of Western Ontario, London, ON, Canada.
| | - Julio C Martinez-Trujillo
- Robarts Research Institute, University of Western Ontario, London, ON, Canada.
- Brain and Mind Institute, University of Western Ontario, London, ON, Canada.
- Department of Physiology and Pharmacology, University of Western Ontario, London, ON, Canada.
- Lawson Health Research Institute, London, ON, Canada.
| |
Collapse
|
6
|
Bellafard A, Namvar G, Kao JC, Vaziri A, Golshani P. Volatile working memory representations crystallize with practice. Nature 2024; 629:1109-1117. [PMID: 38750359 PMCID: PMC11136659 DOI: 10.1038/s41586-024-07425-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2022] [Accepted: 04/15/2024] [Indexed: 05/31/2024]
Abstract
Working memory, the process through which information is transiently maintained and manipulated over a brief period, is essential for most cognitive functions1-4. However, the mechanisms underlying the generation and evolution of working-memory neuronal representations at the population level over long timescales remain unclear. Here, to identify these mechanisms, we trained head-fixed mice to perform an olfactory delayed-association task in which the mice made decisions depending on the sequential identity of two odours separated by a 5 s delay. Optogenetic inhibition of secondary motor neurons during the late-delay and choice epochs strongly impaired the task performance of the mice. Mesoscopic calcium imaging of large neuronal populations of the secondary motor cortex (M2), retrosplenial cortex (RSA) and primary motor cortex (M1) showed that many late-delay-epoch-selective neurons emerged in M2 as the mice learned the task. Working-memory late-delay decoding accuracy substantially improved in the M2, but not in the M1 or RSA, as the mice became experts. During the early expert phase, working-memory representations during the late-delay epoch drifted across days, while the stimulus and choice representations stabilized. In contrast to single-plane layer 2/3 (L2/3) imaging, simultaneous volumetric calcium imaging of up to 73,307 M2 neurons, which included superficial L5 neurons, also revealed stabilization of late-delay working-memory representations with continued practice. Thus, delay- and choice-related activities that are essential for working-memory performance drift during learning and stabilize only after several days of expert performance.
Collapse
Affiliation(s)
- Arash Bellafard
- Department of Neurology, David Geffen School of Medicine, University of California, Los Angeles, CA, USA.
| | - Ghazal Namvar
- Department of Neurology, David Geffen School of Medicine, University of California, Los Angeles, CA, USA
| | - Jonathan C Kao
- Department of Electrical and Computer Engineering, Henry Samueli School of Engineering, University of California, Los Angeles, CA, USA
| | - Alipasha Vaziri
- Laboratory of Neurotechnology and Biophysics, The Rockefeller University, New York, NY, USA
- The Kavli Neural Systems Institute, The Rockefeller University, New York, NY, USA
| | - Peyman Golshani
- Department of Neurology, David Geffen School of Medicine, University of California, Los Angeles, CA, USA.
- Greater Los Angeles VA Medical Center, Los Angeles, CA, USA.
- Semel Institute for Neuroscience and Human Behavior, University of California, Los Angeles, CA, USA.
- Integrative Center for Learning and Memory, University of California, Los Angeles, CA, USA.
- Intellectual and Developmental Disability Research Center, University of California, Los Angeles, CA, USA.
| |
Collapse
|
7
|
Kandemir G, Wilhelm SA, Axmacher N, Akyürek EG. Maintenance of color memoranda in activity-quiescent working memory states: Evidence from impulse perturbation. iScience 2024; 27:109565. [PMID: 38617556 PMCID: PMC11015458 DOI: 10.1016/j.isci.2024.109565] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2023] [Revised: 01/22/2024] [Accepted: 03/22/2024] [Indexed: 04/16/2024] Open
Abstract
In the present study, we used an impulse perturbation method to probe working memory maintenance of colors in neurally active and activity-quiescent states, focusing on a set of pre-registered analyses. We analyzed the electroencephalograph (EEG) data of 30 participants who completed a delayed match-to-sample working memory task, in which one of the two items that were presented was retro-cued as task relevant. The analyses revealed that both cued and uncued colors were decodable from impulse-evoked activity, the latter in contrast to previous reports of working memory for orientation gratings. Decoding of colors from oscillations in the alpha band showed that cued items could be decoded therein whereas uncued items could not. Overall, the outcomes suggest that subtle differences exist between the representation of colors, and that of stimuli with spatial properties, but the present results also demonstrate that regardless of their specific neural state, both are accessible through visual impulse perturbation.
Collapse
Affiliation(s)
- Güven Kandemir
- Department of Experimental Psychology, University of Groningen, Groningen 9712 TS, the Netherlands
- Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam 1081 BT, the Netherlands
| | - Sophia A. Wilhelm
- Department of Experimental Psychology, University of Groningen, Groningen 9712 TS, the Netherlands
| | - Nikolai Axmacher
- Department of Neuropsychology, Faculty of Psychology, Ruhr University Bochum, 44780 Bochum, Germany
| | - Elkan G. Akyürek
- Department of Experimental Psychology, University of Groningen, Groningen 9712 TS, the Netherlands
| |
Collapse
|
8
|
Lundqvist M, Miller EK, Nordmark J, Liljefors J, Herman P. Beta: bursts of cognition. Trends Cogn Sci 2024:S1364-6613(24)00077-9. [PMID: 38658218 DOI: 10.1016/j.tics.2024.03.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2023] [Revised: 03/11/2024] [Accepted: 03/20/2024] [Indexed: 04/26/2024]
Abstract
Beta oscillations are linked to the control of goal-directed processing of sensory information and the timing of motor output. Recent evidence demonstrates they are not sustained but organized into intermittent high-power bursts mediating timely functional inhibition. This implies there is a considerable moment-to-moment variation in the neural dynamics supporting cognition. Beta bursts thus offer new opportunities for studying how sensory inputs are selectively processed, reshaped by inhibitory cognitive operations and ultimately result in motor actions. Recent method advances reveal diversity in beta bursts that provide deeper insights into their function and the underlying neural circuit activity motifs. We propose that brain-wide, spatiotemporal patterns of beta bursting reflect various cognitive operations and that their dynamics reveal nonlinear aspects of cortical processing.
Collapse
Affiliation(s)
- Mikael Lundqvist
- Division of Psychology, Department of Clinical Neuroscience, Karolinska Institutet, Solna, Sweden; The Picower Institute for Learning & Memory, Massachusetts Institute of Technology, Cambridge, MA 02139, USA; Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139, USA.
| | - Earl K Miller
- The Picower Institute for Learning & Memory, Massachusetts Institute of Technology, Cambridge, MA 02139, USA; Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139, USA
| | - Jonatan Nordmark
- Division of Psychology, Department of Clinical Neuroscience, Karolinska Institutet, Solna, Sweden
| | - Johan Liljefors
- Division of Psychology, Department of Clinical Neuroscience, Karolinska Institutet, Solna, Sweden
| | - Pawel Herman
- School of Electrical Engineering and Computer Science, KTH Royal Institute of Technology, Stockholm, Sweden; Digital Futures, KTH Royal Institute of Technology, Stockholm, Sweden
| |
Collapse
|
9
|
Stroud JP, Duncan J, Lengyel M. The computational foundations of dynamic coding in working memory. Trends Cogn Sci 2024:S1364-6613(24)00053-6. [PMID: 38580528 DOI: 10.1016/j.tics.2024.02.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2023] [Revised: 02/29/2024] [Accepted: 02/29/2024] [Indexed: 04/07/2024]
Abstract
Working memory (WM) is a fundamental aspect of cognition. WM maintenance is classically thought to rely on stable patterns of neural activities. However, recent evidence shows that neural population activities during WM maintenance undergo dynamic variations before settling into a stable pattern. Although this has been difficult to explain theoretically, neural network models optimized for WM typically also exhibit such dynamics. Here, we examine stable versus dynamic coding in neural data, classical models, and task-optimized networks. We review principled mathematical reasons for why classical models do not, while task-optimized models naturally do exhibit dynamic coding. We suggest an update to our understanding of WM maintenance, in which dynamic coding is a fundamental computational feature rather than an epiphenomenon.
Collapse
Affiliation(s)
- Jake P Stroud
- Computational and Biological Learning Lab, Department of Engineering, University of Cambridge, Cambridge, UK.
| | - John Duncan
- MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, UK
| | - Máté Lengyel
- Computational and Biological Learning Lab, Department of Engineering, University of Cambridge, Cambridge, UK; Center for Cognitive Computation, Department of Cognitive Science, Central European University, Budapest, Hungary
| |
Collapse
|
10
|
Heinen R, Bierbrauer A, Wolf OT, Axmacher N. Representational formats of human memory traces. Brain Struct Funct 2024; 229:513-529. [PMID: 37022435 PMCID: PMC10978732 DOI: 10.1007/s00429-023-02636-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2022] [Accepted: 03/28/2023] [Indexed: 04/07/2023]
Abstract
Neural representations are internal brain states that constitute the brain's model of the external world or some of its features. In the presence of sensory input, a representation may reflect various properties of this input. When perceptual information is no longer available, the brain can still activate representations of previously experienced episodes due to the formation of memory traces. In this review, we aim at characterizing the nature of neural memory representations and how they can be assessed with cognitive neuroscience methods, mainly focusing on neuroimaging. We discuss how multivariate analysis techniques such as representational similarity analysis (RSA) and deep neural networks (DNNs) can be leveraged to gain insights into the structure of neural representations and their different representational formats. We provide several examples of recent studies which demonstrate that we are able to not only measure memory representations using RSA but are also able to investigate their multiple formats using DNNs. We demonstrate that in addition to slow generalization during consolidation, memory representations are subject to semantization already during short-term memory, by revealing a shift from visual to semantic format. In addition to perceptual and conceptual formats, we describe the impact of affective evaluations as an additional dimension of episodic memories. Overall, these studies illustrate how the analysis of neural representations may help us gain a deeper understanding of the nature of human memory.
Collapse
Affiliation(s)
- Rebekka Heinen
- Department of Neuropsychology, Institute of Cognitive Neuroscience, Faculty of Psychology, Ruhr University Bochum, Universitätsstraße 150, 44801, Bochum, Germany.
| | - Anne Bierbrauer
- Department of Neuropsychology, Institute of Cognitive Neuroscience, Faculty of Psychology, Ruhr University Bochum, Universitätsstraße 150, 44801, Bochum, Germany
- Institute for Systems Neuroscience, Medical Center Hamburg-Eppendorf, Martinistraße 52, 20251, Hamburg, Germany
| | - Oliver T Wolf
- Department of Cognitive Psychology, Institute of Cognitive Neuroscience, Faculty of Psychology, Ruhr University Bochum, Universitätsstraße 150, 44801, Bochum, Germany
| | - Nikolai Axmacher
- Department of Neuropsychology, Institute of Cognitive Neuroscience, Faculty of Psychology, Ruhr University Bochum, Universitätsstraße 150, 44801, Bochum, Germany
| |
Collapse
|
11
|
Wang L, Brothers T, Jensen O, Kuperberg GR. Dissociating the pre-activation of word meaning and form during sentence comprehension: Evidence from EEG representational similarity analysis. Psychon Bull Rev 2024; 31:862-873. [PMID: 37783897 PMCID: PMC10985416 DOI: 10.3758/s13423-023-02385-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/10/2023] [Indexed: 10/04/2023]
Abstract
During language comprehension, the processing of each incoming word is facilitated in proportion to its predictability. Here, we asked whether anticipated upcoming linguistic information is actually pre-activated before new bottom-up input becomes available, and if so, whether this pre-activation is limited to the level of semantic features, or whether extends to representations of individual word-forms (orthography/phonology). We carried out Representational Similarity Analysis on EEG data while participants read highly constraining sentences. Prior to the onset of the expected target words, sentence pairs predicting semantically related words (financial "bank" - "loan") and form-related words (financial "bank" - river "bank") produced more similar neural patterns than pairs predicting unrelated words ("bank" - "lesson"). This provides direct neural evidence for item-specific semantic and form predictive pre-activation. Moreover, the semantic pre-activation effect preceded the form pre-activation effect, suggesting that top-down pre-activation is propagated from higher to lower levels of the linguistic hierarchy over time.
Collapse
Affiliation(s)
- Lin Wang
- Department of Psychiatry and the Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School, Charlestown, MA, 02129, USA.
- Department of Psychology, Tufts University, Medford, MA, USA.
| | - Trevor Brothers
- Department of Psychiatry and the Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School, Charlestown, MA, 02129, USA
- Department of Psychology, Tufts University, Medford, MA, USA
| | - Ole Jensen
- Centre for Human Brain Health, School of Psychology, University of Birmingham, Birmingham, UK
| | - Gina R Kuperberg
- Department of Psychiatry and the Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School, Charlestown, MA, 02129, USA
- Department of Psychology, Tufts University, Medford, MA, USA
| |
Collapse
|
12
|
Elmers J, Colzato LS, Ziemssen F, Ziemssen T, Beste C. Optical coherence tomography as a potential surrogate marker of dopaminergic modulation across the life span. Ageing Res Rev 2024; 96:102280. [PMID: 38518921 DOI: 10.1016/j.arr.2024.102280] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2023] [Revised: 02/02/2024] [Accepted: 03/18/2024] [Indexed: 03/24/2024]
Abstract
The retina has been considered a "window to the brain" and shares similar innervation by the dopaminergic system with the cortex in terms of an unequal distribution of D1 and D2 receptors. Here, we provide a comprehensive overview that Optical Coherence Tomography (OCT), a non-invasive imaging technique, which provides an "in vivo" representation of the retina, shows promise to be used as a surrogate marker of dopaminergic neuromodulation in cognition. Overall, most evidence supports reduced retinal thickness in individuals with dopaminergic dysregulation (e.g., patients with Parkinson's Disease, non-demented older adults) and with poor cognitive functioning. By using the theoretical framework of metacontrol, we derive hypotheses that retinal thinning associated to decreased dopamine (DA) levels affecting D1 families, might lead to a decrease in the signal-to-noise ratio (SNR) affecting cognitive persistence (depending on D1-modulated DA activity) but not cognitive flexibility (depending on D2-modulated DA activity). We argue that the use of OCT parameters might not only be an insightful for cognitive neuroscience research, but also a potentially effective tool for individualized medicine with a focus on cognition. As our society progressively ages in the forthcoming years and decades, the preservation of cognitive abilities and promoting healthy aging will hold of crucial significance. OCT has the potential to function as a swift, non-invasive, and economical method for promptly recognizing individuals with a heightened vulnerability to cognitive deterioration throughout all stages of life.
Collapse
Affiliation(s)
- Julia Elmers
- Cognitive Neurophysiology, Department of Child and Adolescent Psychiatry, Faculty of Medicine, TU Dresden, Germany; Center of Clinical Neuroscience, Department of Neurology, University Hospital Carl Gustav Carus, TU Dresden, Germany
| | - Lorenza S Colzato
- Cognitive Psychology, Faculty of Psychology, Shandong Normal University, Jinan, China
| | - Focke Ziemssen
- Ophthalmological Clinic, University Clinic Leipzig, Germany
| | - Tjalf Ziemssen
- Center of Clinical Neuroscience, Department of Neurology, University Hospital Carl Gustav Carus, TU Dresden, Germany
| | - Christian Beste
- Cognitive Neurophysiology, Department of Child and Adolescent Psychiatry, Faculty of Medicine, TU Dresden, Germany; Cognitive Psychology, Faculty of Psychology, Shandong Normal University, Jinan, China.
| |
Collapse
|
13
|
Desbordes T, King JR, Dehaene S. Tracking the neural codes for words and phrases during semantic composition, working-memory storage, and retrieval. Cell Rep 2024; 43:113847. [PMID: 38412098 DOI: 10.1016/j.celrep.2024.113847] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2023] [Revised: 11/02/2023] [Accepted: 02/07/2024] [Indexed: 02/29/2024] Open
Abstract
The ability to compose successive words into a meaningful phrase is a characteristic feature of human cognition, yet its neural mechanisms remain incompletely understood. Here, we analyze the cortical mechanisms of semantic composition using magnetoencephalography (MEG) while participants read one-word, two-word, and five-word noun phrases and compared them with a subsequent image. Decoding of MEG signals revealed three processing stages. During phrase comprehension, the representation of individual words was sustained for a variable duration depending on phrasal context. During the delay period, the word code was replaced by a working-memory code whose activation increased with semantic complexity. Finally, the speed and accuracy of retrieval depended on semantic complexity and was faster for surface than for deep semantic properties. In conclusion, we propose that the brain initially encodes phrases using factorized dimensions for successive words but later compresses them in working memory and requires a period of decompression to access them.
Collapse
Affiliation(s)
- Théo Desbordes
- Meta AI, Paris, France; Cognitive Neuroimaging Unit, NeuroSpin Center, 91191 Gif-sur-Yvette, France.
| | - Jean-Rémi King
- Meta AI, Paris, France; École Normale Supérieure, PSL University, Paris, France
| | - Stanislas Dehaene
- Université Paris Saclay, INSERM, CEA, Cognitive Neuroimaging Unit, NeuroSpin Center, 91191 Gif-sur-Yvette, France; Collège de France, PSL University, Paris, France
| |
Collapse
|
14
|
Zheng Q, Xu Y, Shen J. Hamiltonian energy in a modified Hindmarsh-Rose model. FRONTIERS IN NETWORK PHYSIOLOGY 2024; 4:1362778. [PMID: 38595864 PMCID: PMC11002134 DOI: 10.3389/fnetp.2024.1362778] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/29/2023] [Accepted: 03/04/2024] [Indexed: 04/11/2024]
Abstract
This paper investigates the Hamiltonian energy of a modified Hindmarsh-Rose (HR) model to observe its effect on short-term memory. A Hamiltonian energy function and its variable function are given in the reduced system with a single node according to Helmholtz's theorem. We consider the role of the coupling strength and the links between neurons in the pattern formation to show that the coupling and cooperative neurons are necessary for generating the fire or a clear short-term memory when all the neurons are in sync. Then, we consider the effect of the degree and external stimulus from other neurons on the emergence and disappearance of short-term memory, which illustrates that generating short-term memory requires much energy, and the coupling strength could further reduce energy consumption. Finally, the dynamical mechanisms of the generation of short-term memory are concluded.
Collapse
Affiliation(s)
- Qianqian Zheng
- School of Science, Xuchang University, Xuchang, Henan, China
| | - Yong Xu
- School of Mathematics and Statistics, Northwestern Polytechnical University, Xi’an, Shaanxi, China
| | - Jianwei Shen
- School of Mathematics and Statistics, North China University of Water Resources and Electric Power, Zhengzhou, Henan, China
| |
Collapse
|
15
|
Mozumder R, Chung S, Li S, Constantinidis C. Contributions of narrow- and broad-spiking prefrontal and parietal neurons on working memory tasks. Front Syst Neurosci 2024; 18:1365622. [PMID: 38577690 PMCID: PMC10991738 DOI: 10.3389/fnsys.2024.1365622] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2024] [Accepted: 03/11/2024] [Indexed: 04/06/2024] Open
Abstract
Neurons that generate persistent activity in the primate dorsolateral prefrontal and posterior parietal cortex have been shown to be predictive of behavior in working memory tasks, though subtle differences between them have been observed in how information is represented. The role of different neuron types in each of these areas has not been investigated at depth. We thus compared the activity of neurons classified as narrow-spiking, putative interneurons, and broad-spiking, putative pyramidal neurons, recorded from the dorsolateral prefrontal and posterior parietal cortex of male monkeys, to analyze their role in the maintenance of working memory. Our results demonstrate that narrow-spiking neurons are active during a range of tasks and generate persistent activity during the delay period over which stimuli need to be maintained in memory. Furthermore, the activity of narrow-spiking neurons was predictive of the subject's recall no less than that of broad-spiking neurons, which are exclusively projection neurons in the cortex. Our results show that putative interneurons play an active role during the maintenance of working memory and shed light onto the fundamental neural circuits that determine subjects' memories and judgments.
Collapse
Affiliation(s)
- Rana Mozumder
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, United States
| | - Sophia Chung
- Neuroscience Program, Vanderbilt University, Nashville, TN, United States
| | - Sihai Li
- Department of Neurobiology, The University of Chicago, Chicago, IL, United States
| | - Christos Constantinidis
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, United States
- Neuroscience Program, Vanderbilt University, Nashville, TN, United States
- Department of Ophthalmology and Visual Sciences, Vanderbilt University Medical Center, Nashville, TN, United States
| |
Collapse
|
16
|
Glykos V, Fujisawa S. Memory-specific encoding activities of the ventral tegmental area dopamine and GABA neurons. eLife 2024; 12:RP89743. [PMID: 38512339 PMCID: PMC10957172 DOI: 10.7554/elife.89743] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/22/2024] Open
Abstract
Although the midbrain dopamine (DA) system plays a crucial role in higher cognitive functions, including updating and maintaining short-term memory, the encoding properties of the somatic spiking activity of ventral tegmental area (VTA) DA neurons for short-term memory computations have not yet been identified. Here, we probed and analyzed the activity of optogenetically identified DA and GABA neurons while mice engaged in short-term memory-dependent behavior in a T-maze task. Single-neuron analysis revealed that significant subpopulations of DA and GABA neurons responded differently between left and right trials in the memory delay. With a series of control behavioral tasks and regression analysis tools, we show that firing rate differences are linked to short-term memory-dependent decisions and cannot be explained by reward-related processes, motivated behavior, or motor-related activities. This evidence provides novel insights into the mnemonic encoding activities of midbrain DA and GABA neurons.
Collapse
Affiliation(s)
- Vasileios Glykos
- Laboratory for Systems Neurophysiology, RIKEN Center for Brain Science, Wako, Japan
- Synapse Biology Unit, Okinawa Institute of Science and Technology, Okinawa, Japan
| | - Shigeyoshi Fujisawa
- Laboratory for Systems Neurophysiology, RIKEN Center for Brain Science, Wako, Japan
| |
Collapse
|
17
|
Schneider P, Vergauwe E, Camos V. The visual familiarity effect on attentional working memory maintenance. Mem Cognit 2024:10.3758/s13421-024-01548-1. [PMID: 38503983 DOI: 10.3758/s13421-024-01548-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/04/2024] [Indexed: 03/21/2024]
Abstract
Attentional refreshing has been described as an attention-based, domain-general maintenance mechanism in working memory. It is thought to operate via focusing executive attention on information held in working memory, protecting it from temporal decay and interference. Although attentional refreshing has attracted a lot of research, its functioning is still debated. At least one conception of refreshing supposes that it relies on semantic long-term memory representations to reconstruct working memory traces. Although investigations in the verbal domain found evidence against this hypothesis, a different pattern could emerge in visuospatial working memory in which absence of refreshing evidence has been observed for stimuli with minimal associated long-term knowledge. In a series of four experiments, the current study investigated the hypothesis of an involvement of semantic long-term representations in the functioning of attentional refreshing in the visuospatial domain. Both cognitive and memory load effects have been proposed as indexes of attentional refreshing. Therefore, we investigated the interaction between the effects of visual familiarity (a long-term memory effect) and cognitive load on recall performance (Experiments 1A and 1B), as well as the interaction between the effects of visual familiarity and memory load on the response times in a concurrent processing task (Experiments 2A and 2B). Results were consistent across experiments and go against the hypothesis of the involvement of semantic long-term memory in the functioning of attentional refreshing in visuospatial working memory. As such, this study corroborates the results found in the verbal domain. Implications for attentional refreshing and working memory are discussed.
Collapse
|
18
|
Singh B, Wang Z, Madiah LM, Gatti SE, Fulton JN, Johnson GW, Li R, Dawant BM, Englot DJ, Bick SK, Roberson SW, Constantinidis C. Brain-wide human oscillatory local field potential activity during visual working memory. iScience 2024; 27:109130. [PMID: 38380249 PMCID: PMC10877957 DOI: 10.1016/j.isci.2024.109130] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2022] [Revised: 01/10/2024] [Accepted: 02/01/2024] [Indexed: 02/22/2024] Open
Abstract
Oscillatory activity in the local field potential (LFP) is thought to be a marker of cognitive processes. To understand how it differentiates tasks and brain areas in humans, we recorded LFPs in 15 adults with intracranial depth electrodes, as they performed visual-spatial and shape working memory tasks. Stimulus appearance produced widespread, broad-band activation, including in occipital, parietal, temporal, insular, and prefrontal cortex, and the amygdala and hippocampus. Occipital cortex was characterized by most elevated power in the high-gamma (100-150 Hz) range during the visual stimulus presentation. The most consistent feature of the delay period was a systematic pattern of modulation in the beta frequency (16-40 Hz), which included a decrease in power of variable timing across areas, and rebound during the delay period. These results reveal the widespread nature of oscillatory activity across a broad brain network and region-specific signatures of oscillatory processes associated with visual working memory.
Collapse
Affiliation(s)
- Balbir Singh
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, USA
| | - Zhengyang Wang
- Neuroscience Program, Vanderbilt University, Nashville, TN, USA
| | - Leen M. Madiah
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, USA
| | - S. Elizabeth Gatti
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, USA
| | - Jenna N. Fulton
- Department of Neurology, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Graham W. Johnson
- Department of Neurological Surgery, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Rui Li
- Department of Electrical and Computer Engineering, Vanderbilt University, Nashville, TN, USA
| | - Benoit M. Dawant
- Department of Electrical and Computer Engineering, Vanderbilt University, Nashville, TN, USA
| | - Dario J. Englot
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, USA
- Department of Neurological Surgery, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Sarah K. Bick
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, USA
- Department of Neurological Surgery, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Shawniqua Williams Roberson
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, USA
- Department of Neurology, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Christos Constantinidis
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, USA
- Neuroscience Program, Vanderbilt University, Nashville, TN, USA
- Department of Ophthalmology and Visual Sciences, Vanderbilt University Medical Center, Nashville, TN, USA
| |
Collapse
|
19
|
Ma F, Zhang L, Zhou J. Event-specific and persistent representations for contextual states in orbitofrontal neurons. Curr Biol 2024; 34:1023-1033.e5. [PMID: 38366594 DOI: 10.1016/j.cub.2024.01.060] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2023] [Revised: 12/13/2023] [Accepted: 01/24/2024] [Indexed: 02/18/2024]
Abstract
Flexible and context-dependent behaviors require animals, including humans, to identify their current contextual state for proper rules to apply, especially when information that defines these states is partially observable. Depending on behavioral needs, contextual states usually persist for prolonged periods and across other events, including sensory stimuli, actions, and rewards, highlighting prominent challenges of holding a reliable state representation. The orbitofrontal cortex (OFC) is crucial in behaviors requiring the identification of the current context (e.g., reversal learning); however, how single units in the OFC accomplish this function has not been assessed. Do they maintain such information persistently, in separate populations from those responding phasically to events within a task, or is contextual information dynamic and embedded in these phasic responses? Here, we investigated this question by recording single units from OFC in rats performing a task that required them to identify the current contextual state related to estimated proximity to future reward with distracting olfactory cues. We found that while some OFC neurons encode contextual states, most change their selectivity upon the transition of task events. Nevertheless, despite dynamic activities in single neurons, the neural populations maintain persistent representations regarding current contextual states within particular neural subspaces.
Collapse
Affiliation(s)
- Fengjun Ma
- College of Biological Sciences, China Agricultural University, Beijing 100193, China; Chinese Institute for Brain Research, Beijing 102206, China
| | - Lingwei Zhang
- Chinese Institute for Brain Research, Beijing 102206, China
| | - Jingfeng Zhou
- Chinese Institute for Brain Research, Beijing 102206, China.
| |
Collapse
|
20
|
Mendoza-Halliday D, Xu H, Azevedo FAC, Desimone R. Dissociable neuronal substrates of visual feature attention and working memory. Neuron 2024; 112:850-863.e6. [PMID: 38228138 PMCID: PMC10939754 DOI: 10.1016/j.neuron.2023.12.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2023] [Revised: 10/10/2023] [Accepted: 12/12/2023] [Indexed: 01/18/2024]
Abstract
Attention and working memory (WM) are distinct cognitive functions, yet given their close interactions, it is often assumed that they share the same neuronal mechanisms. We show that in macaques performing a WM-guided feature attention task, the activity of most neurons in areas middle temporal (MT), medial superior temporal (MST), lateral intraparietal (LIP), and posterior lateral prefrontal cortex (LPFC-p) displays attentional modulation or WM coding and not both. One area thought to play a role in both functions is LPFC-p. To test this, we optogenetically inactivated LPFC-p bilaterally during different task periods. Attention period inactivation reduced attentional modulation in LPFC-p, MST, and LIP neurons and impaired task performance. In contrast, WM period inactivation did not affect attentional modulation or performance and minimally affected WM coding. Our results suggest that feature attention and WM have dissociable neuronal substrates and that LPFC-p plays a critical role in feature attention, but not in WM.
Collapse
Affiliation(s)
- Diego Mendoza-Halliday
- Department of Brain and Cognitive Sciences, McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA.
| | - Haoran Xu
- Department of Brain and Cognitive Sciences, McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Frederico A C Azevedo
- Department of Brain and Cognitive Sciences, McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Robert Desimone
- Department of Brain and Cognitive Sciences, McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
| |
Collapse
|
21
|
Yonelinas AP. The role of recollection and familiarity in visual working memory: A mixture of threshold and signal detection processes. Psychol Rev 2024; 131:321-348. [PMID: 37326544 PMCID: PMC11089539 DOI: 10.1037/rev0000432] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/17/2023]
Abstract
Whether working memory reflects a thresholded recollection process whereby only a limited number of items are maintained in memory, or a signal detection process in which each studied item is increased in familiarity strength, is a topic of considerable debate. A review of visual working memory studies that have examined receiver operating characteristics (ROCs) across a broad set of materials and test conditions indicates that both signal detection and threshold processes contribute to working memory. In addition, the role that these two processes play varies systematically across conditions, such that a threshold process plays a particularly critical role when binary old/new judgments are required, when changes are relatively discrete, and when the hippocampus does not contribute to performance. In contrast, a signal detection process plays a greater role when confidence judgments are required, when the materials or the changes are global in nature, and when the hippocampus contributes to performance. In addition, the ROC results indicate that in standard single-probe tests of working memory, items that are maintained in an active recollected state support both recall-to-accept and recall-to-reject responses; whereas in complex-probe tests, recollection preferentially supports recall-to-reject; and in item-recognition tests it preferentially supports recall-to-accept. Moreover, there is growing evidence that these threshold and strength-based processes are related to distinct states of conscious awareness whereby they support perceiving- and sensing-based responses, respectively. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Collapse
|
22
|
Koevoet D, Strauch C, Van der Stigchel S, Mathôt S, Naber M. Revealing visual working memory operations with pupillometry: Encoding, maintenance, and prioritization. WILEY INTERDISCIPLINARY REVIEWS. COGNITIVE SCIENCE 2024; 15:e1668. [PMID: 37933423 DOI: 10.1002/wcs.1668] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/16/2023] [Revised: 09/22/2023] [Accepted: 09/25/2023] [Indexed: 11/08/2023]
Abstract
Pupillary dynamics reflect effects of distinct and important operations of visual working memory: encoding, maintenance, and prioritization. Here, we review how pupil size predicts memory performance and how it provides novel insights into the mechanisms of each operation. Visual information must first be encoded into working memory with sufficient precision. The depth of this encoding process couples to arousal-linked baseline pupil size as well as a pupil constriction response before and after stimulus onset, respectively. Subsequently, the encoded information is maintained over time to ensure it is not lost. Pupil dilation reflects the effortful maintenance of information, wherein storing more items is accompanied by larger dilations. Lastly, the most task-relevant information is prioritized to guide upcoming behavior, which is reflected in yet another dilatory component. Moreover, activated content in memory can be pupillometrically probed directly by tagging visual information with distinct luminance levels. Through this luminance-tagging mechanism, pupil light responses reveal whether dark or bright items receive more attention during encoding and prioritization. Together, conceptualizing pupil responses as a sum of distinct components over time reveals insights into operations of visual working memory. From this viewpoint, pupillometry is a promising avenue to study the most vital operations through which visual working memory works. This article is categorized under: Psychology > Attention Psychology > Memory Psychology > Theory and Methods.
Collapse
Affiliation(s)
- Damian Koevoet
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, The Netherlands
| | - Christoph Strauch
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, The Netherlands
| | | | - Sebastiaan Mathôt
- Department of Psychology, University of Groningen, Groningen, The Netherlands
| | - Marnix Naber
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, The Netherlands
| |
Collapse
|
23
|
Che X, Lian H, Zhang F, Li S, Zheng Y. The Reactivation of working memory representations affects attentional guidance. Psychophysiology 2024; 61:e14514. [PMID: 38183326 DOI: 10.1111/psyp.14514] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2022] [Revised: 11/19/2023] [Accepted: 12/19/2023] [Indexed: 01/08/2024]
Abstract
Recent studies have suggested that the neural activity that supported working memory (WM) storage is dynamic over time and this dynamic storage decides memory performance. Does the temporal dynamic of the WM representation also affect visual search, and how does it interact with distractor suppression over time? To address these issues, we tracked the time course of the reactivation of WM representations during visual search by analyzing the electroencephalogram (EEG) and event-related optical signals (EROS) in Experiments 1 and 2, respectively, and investigated the interaction between the representation reactivation and distractor suppression in Experiment 3. Participants had to maintain a color in WM under high- or low-precision requirement and perform a subsequent search task. The reactivation of WM representations was defined by the above-chance decoding accuracy. The EEG results showed that compared with the low-precision requirement, WM-matching distractors captured more attention and the WM representation were reactivated more frequently under high-precision requirement. The EROS results showed that compared with the low-precision requirement, the increased activity in occipital cortex in the WM-matching versus WM-mismatching conditions was observed at 224 ms during visual search under high-precision requirement. Regression analysis showed that the representation reactivation during visual search directly predicted the behavioral WM-based attentional capture effect, while the representation reactivation before visual search impacted the WM-based attentional capture effect through the mediation of distractor suppression during visual search. These results suggest that the reactivation of WM representations and distractor suppression collectively determine WM-based attentional capture.
Collapse
Affiliation(s)
- Xiaowei Che
- Department of Psychology, Shandong Normal University, Jinan, P. R. China
- School of Information Science and Engineering, Shandong Normal University, Jinan, P. R. China
| | - Haomin Lian
- Department of Psychology, Shandong Normal University, Jinan, P. R. China
| | - Feiyan Zhang
- School of Information Science and Engineering, Shandong Normal University, Jinan, P. R. China
| | - Shouxin Li
- Department of Psychology, Shandong Normal University, Jinan, P. R. China
| | - Yuanjie Zheng
- School of Information Science and Engineering, Shandong Normal University, Jinan, P. R. China
| |
Collapse
|
24
|
Levy R. The prefrontal cortex: from monkey to man. Brain 2024; 147:794-815. [PMID: 37972282 PMCID: PMC10907097 DOI: 10.1093/brain/awad389] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2023] [Revised: 10/01/2023] [Accepted: 11/02/2023] [Indexed: 11/19/2023] Open
Abstract
The prefrontal cortex is so important to human beings that, if deprived of it, our behaviour is reduced to action-reactions and automatisms, with no ability to make deliberate decisions. Why does the prefrontal cortex hold such importance in humans? In answer, this review draws on the proximity between humans and other primates, which enables us, through comparative anatomical-functional analysis, to understand the cognitive functions we have in common and specify those that distinguish humans from their closest cousins. First, a focus on the lateral region of the prefrontal cortex illustrates the existence of a continuum between rhesus monkeys (the most studied primates in neuroscience) and humans for most of the major cognitive functions in which this region of the brain plays a central role. This continuum involves the presence of elementary mental operations in the rhesus monkey (e.g. working memory or response inhibition) that are constitutive of 'macro-functions' such as planning, problem-solving and even language production. Second, the human prefrontal cortex has developed dramatically compared to that of other primates. This increase seems to concern the most anterior part (the frontopolar cortex). In humans, the development of the most anterior prefrontal cortex is associated with three major and interrelated cognitive changes: (i) a greater working memory capacity, allowing for greater integration of past experiences and prospective futures; (ii) a greater capacity to link discontinuous or distant data, whether temporal or semantic; and (iii) a greater capacity for abstraction, allowing humans to classify knowledge in different ways, to engage in analogical reasoning or to acquire abstract values that give rise to our beliefs and morals. Together, these new skills enable us, among other things, to develop highly sophisticated social interactions based on language, enabling us to conceive beliefs and moral judgements and to conceptualize, create and extend our vision of our environment beyond what we can physically grasp. Finally, a model of the transition of prefrontal functions between humans and non-human primates concludes this review.
Collapse
Affiliation(s)
- Richard Levy
- AP–HP, Groupe Hospitalier Pitié-Salpêtrière, Department of Neurology, Sorbonne Université, Institute of Memory and Alzheimer’s Disease, 75013 Paris, France
- Sorbonne Université, INSERM U1127, CNRS 7225, Paris Brain Institute- ICM, 75013 Paris, France
| |
Collapse
|
25
|
Yao J, Hou R, Fan H, Liu J, Chen Z, Hou J, Cheng Q, Li CT. Prefrontal projections modulate recurrent circuitry in the insular cortex to support short-term memory. Cell Rep 2024; 43:113756. [PMID: 38358886 DOI: 10.1016/j.celrep.2024.113756] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2023] [Revised: 11/30/2023] [Accepted: 01/23/2024] [Indexed: 02/17/2024] Open
Abstract
Short-term memory (STM) maintains information during a short delay period. How long-range and local connections interact to support STM encoding remains elusive. Here, we tackle the problem focusing on long-range projections from the medial prefrontal cortex (mPFC) to the anterior agranular insular cortex (aAIC) in head-fixed mice performing an olfactory delayed-response task. Optogenetic and electrophysiological experiments reveal the behavioral importance of the two regions in encoding STM information. Spike-correlogram analysis reveals strong local and cross-region functional coupling (FC) between memory neurons encoding the same information. Optogenetic suppression of mPFC-aAIC projections during the delay period reduces behavioral performance, the proportion of memory neurons, and memory-specific FC within the aAIC, whereas optogenetic excitation enhances all of them. mPFC-aAIC projections also bidirectionally modulate the efficacy of STM-information transfer, measured by the contribution of FC spiking pairs to the memory-coding ability of following neurons. Thus, prefrontal projections modulate insular neurons' functional connectivity and memory-coding ability to support STM.
Collapse
Affiliation(s)
- Jian Yao
- Institute of Neuroscience, State Key Laboratory of Neuroscience, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China; Lingang Laboratory, Shanghai 200031, China
| | - Ruiqing Hou
- Institute of Neuroscience, State Key Laboratory of Neuroscience, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China
| | - Hongmei Fan
- Institute of Neuroscience, State Key Laboratory of Neuroscience, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China
| | - Jiawei Liu
- Institute of Neuroscience, State Key Laboratory of Neuroscience, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China; University of Chinese Academy of Sciences, Beijing 100049, China
| | - Zhaoqin Chen
- Shanghai Center for Brain Science and Brain-Inspired Technology, Shanghai 200031, China
| | - Jincan Hou
- Institute of Neuroscience, State Key Laboratory of Neuroscience, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China; Lingang Laboratory, Shanghai 200031, China
| | - Qi Cheng
- Institute of Neuroscience, State Key Laboratory of Neuroscience, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China; Lingang Laboratory, Shanghai 200031, China
| | - Chengyu T Li
- Institute of Neuroscience, State Key Laboratory of Neuroscience, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China; Lingang Laboratory, Shanghai 200031, China; Shanghai Center for Brain Science and Brain-Inspired Technology, Shanghai 200031, China.
| |
Collapse
|
26
|
Yiling Y, Klon-Lipok J, Shapcott K, Lazar A, Singer W. Dynamic fading memory and expectancy effects in the monkey primary visual cortex. Proc Natl Acad Sci U S A 2024; 121:e2314855121. [PMID: 38354261 PMCID: PMC10895277 DOI: 10.1073/pnas.2314855121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2023] [Accepted: 01/10/2024] [Indexed: 02/16/2024] Open
Abstract
In order to investigate the involvement of the primary visual cortex (V1) in working memory (WM), parallel, multisite recordings of multi-unit activity were obtained from monkey V1 while the animals performed a delayed match-to-sample (DMS) task. During the delay period, V1 population firing rate vectors maintained a lingering trace of the sample stimulus that could be reactivated by intervening impulse stimuli that enhanced neuronal firing. This fading trace of the sample did not require active engagement of the monkeys in the DMS task and likely reflects the intrinsic dynamics of recurrent cortical networks in lower visual areas. This renders an active, attention-dependent involvement of V1 in the maintenance of WM contents unlikely. By contrast, population responses to the test stimulus depended on the probabilistic contingencies between sample and test stimuli. Responses to tests that matched expectations were reduced which agrees with concepts of predictive coding.
Collapse
Affiliation(s)
- Yang Yiling
- Ernst Strüngmann Institute for Neuroscience in Cooperation with Max Planck Society, Frankfurt am Main60528, Germany
| | - Johanna Klon-Lipok
- Max Planck Institute for Brain Research, Frankfurt am Main60438, Germany
| | - Katharine Shapcott
- Ernst Strüngmann Institute for Neuroscience in Cooperation with Max Planck Society, Frankfurt am Main60528, Germany
| | - Andreea Lazar
- Ernst Strüngmann Institute for Neuroscience in Cooperation with Max Planck Society, Frankfurt am Main60528, Germany
| | - Wolf Singer
- Ernst Strüngmann Institute for Neuroscience in Cooperation with Max Planck Society, Frankfurt am Main60528, Germany
- Max Planck Institute for Brain Research, Frankfurt am Main60438, Germany
- Frankfurt Institute for Advanced Studies, Frankfurt am Main60438, Germany
| |
Collapse
|
27
|
Linde-Domingo J, Spitzer B. Geometry of visuospatial working memory information in miniature gaze patterns. Nat Hum Behav 2024; 8:336-348. [PMID: 38110511 PMCID: PMC10896725 DOI: 10.1038/s41562-023-01737-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2023] [Accepted: 09/25/2023] [Indexed: 12/20/2023]
Abstract
Stimulus-dependent eye movements have been recognized as a potential confound in decoding visual working memory information from neural signals. Here we combined eye-tracking with representational geometry analyses to uncover the information in miniature gaze patterns while participants (n = 41) were cued to maintain visual object orientations. Although participants were discouraged from breaking fixation by means of real-time feedback, small gaze shifts (<1°) robustly encoded the to-be-maintained stimulus orientation, with evidence for encoding two sequentially presented orientations at the same time. The orientation encoding on stimulus presentation was object-specific, but it changed to a more object-independent format during cued maintenance, particularly when attention had been temporarily withdrawn from the memorandum. Finally, categorical reporting biases increased after unattended storage, with indications of biased gaze geometries already emerging during the maintenance periods before behavioural reporting. These findings disclose a wealth of information in gaze patterns during visuospatial working memory and indicate systematic changes in representational format when memory contents have been unattended.
Collapse
Affiliation(s)
- Juan Linde-Domingo
- Research Group Adaptive Memory and Decision Making, Max Planck Institute for Human Development, Berlin, Germany.
- Center for Adaptive Rationality, Max Planck Institute for Human Development, Berlin, Germany.
- Mind, Brain and Behavior Research Center, University of Granada, Granada, Spain.
- Department of Experimental Psychology, University of Granada, Granada, Spain.
| | - Bernhard Spitzer
- Research Group Adaptive Memory and Decision Making, Max Planck Institute for Human Development, Berlin, Germany.
- Center for Adaptive Rationality, Max Planck Institute for Human Development, Berlin, Germany.
| |
Collapse
|
28
|
Yu X, Li J, Zhu H, Tian X, Lau E. Electrophysiological hallmarks for event relations and event roles in working memory. Front Neurosci 2024; 17:1282869. [PMID: 38328555 PMCID: PMC10847304 DOI: 10.3389/fnins.2023.1282869] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2023] [Accepted: 12/22/2023] [Indexed: 02/09/2024] Open
Abstract
The ability to maintain events (i.e., interactions between/among objects) in working memory is crucial for our everyday cognition, yet the format of this representation is poorly understood. The current ERP study was designed to answer two questions: How is maintaining events (e.g., the tiger hit the lion) neurally different from maintaining item coordinations (e.g., the tiger and the lion)? That is, how is the event relation (present in events but not coordinations) represented? And how is the agent, or initiator of the event encoded differently from the patient, or receiver of the event during maintenance? We used a novel picture-sentence match-across-delay approach in which the working memory representation was "pinged" during the delay, replicated across two ERP experiments with Chinese and English materials. We found that maintenance of events elicited a long-lasting late sustained difference in posterior-occipital electrodes relative to non-events. This effect resembled the negative slow wave reported in previous studies of working memory, suggesting that the maintenance of events in working memory may impose a higher cost compared to coordinations. Although we did not observe significant ERP differences associated with pinging the agent vs. the patient during the delay, we did find that the ping appeared to dampen the ongoing sustained difference, suggesting a shift from sustained activity to activity silent mechanisms. These results suggest a new method by which ERPs can be used to elucidate the format of neural representation for events in working memory.
Collapse
Affiliation(s)
- Xinchi Yu
- Program of Neuroscience and Cognitive Science, University of Maryland, College Park, MD, United States
- Department of Linguistics, University of Maryland, College Park, MD, United States
| | - Jialu Li
- Division of Arts and Sciences, New York University Shanghai, Shanghai, China
- Shanghai Key Laboratory of Brain Functional Genomics (Ministry of Education), School of Psychology and Cognitive Science, East China Normal University, Shanghai, China
- NYU-ECNU Institute of Brain and Cognitive Science at NYU Shanghai, Shanghai, China
| | - Hao Zhu
- Division of Arts and Sciences, New York University Shanghai, Shanghai, China
- Shanghai Key Laboratory of Brain Functional Genomics (Ministry of Education), School of Psychology and Cognitive Science, East China Normal University, Shanghai, China
- NYU-ECNU Institute of Brain and Cognitive Science at NYU Shanghai, Shanghai, China
| | - Xing Tian
- Division of Arts and Sciences, New York University Shanghai, Shanghai, China
- Shanghai Key Laboratory of Brain Functional Genomics (Ministry of Education), School of Psychology and Cognitive Science, East China Normal University, Shanghai, China
- NYU-ECNU Institute of Brain and Cognitive Science at NYU Shanghai, Shanghai, China
| | - Ellen Lau
- Program of Neuroscience and Cognitive Science, University of Maryland, College Park, MD, United States
- Department of Linguistics, University of Maryland, College Park, MD, United States
| |
Collapse
|
29
|
Liesefeld HR, Lamy D, Gaspelin N, Geng JJ, Kerzel D, Schall JD, Allen HA, Anderson BA, Boettcher S, Busch NA, Carlisle NB, Colonius H, Draschkow D, Egeth H, Leber AB, Müller HJ, Röer JP, Schubö A, Slagter HA, Theeuwes J, Wolfe J. Terms of debate: Consensus definitions to guide the scientific discourse on visual distraction. Atten Percept Psychophys 2024:10.3758/s13414-023-02820-3. [PMID: 38177944 DOI: 10.3758/s13414-023-02820-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/15/2023] [Indexed: 01/06/2024]
Abstract
Hypothesis-driven research rests on clearly articulated scientific theories. The building blocks for communicating these theories are scientific terms. Obviously, communication - and thus, scientific progress - is hampered if the meaning of these terms varies idiosyncratically across (sub)fields and even across individual researchers within the same subfield. We have formed an international group of experts representing various theoretical stances with the goal to homogenize the use of the terms that are most relevant to fundamental research on visual distraction in visual search. Our discussions revealed striking heterogeneity and we had to invest much time and effort to increase our mutual understanding of each other's use of central terms, which turned out to be strongly related to our respective theoretical positions. We present the outcomes of these discussions in a glossary and provide some context in several essays. Specifically, we explicate how central terms are used in the distraction literature and consensually sharpen their definitions in order to enable communication across theoretical standpoints. Where applicable, we also explain how the respective constructs can be measured. We believe that this novel type of adversarial collaboration can serve as a model for other fields of psychological research that strive to build a solid groundwork for theorizing and communicating by establishing a common language. For the field of visual distraction, the present paper should facilitate communication across theoretical standpoints and may serve as an introduction and reference text for newcomers.
Collapse
Affiliation(s)
- Heinrich R Liesefeld
- Department of Psychology, University of Bremen, Hochschulring 18, D-28359, Bremen, Germany.
| | - Dominique Lamy
- The School of Psychology Sciences and The Sagol School of Neuroscience, Tel Aviv University, Ramat Aviv 69978, POB 39040, Tel Aviv, Israel.
| | | | - Joy J Geng
- University of California Davis, Daivs, CA, USA
| | | | | | | | | | | | | | | | - Hans Colonius
- Carl von Ossietzky Universität Oldenburg, Oldenburg, Germany
| | | | | | | | | | | | - Anna Schubö
- Philipps University Marburg, Marburg, Germany
| | | | | | - Jeremy Wolfe
- Harvard Medical School, Boston, MA, USA
- Brigham & Women's Hospital, Boston, MA, USA
| |
Collapse
|
30
|
Nikolaev AR, Meghanathan RN, van Leeuwen C. Refixation behavior in naturalistic viewing: Methods, mechanisms, and neural correlates. Atten Percept Psychophys 2024:10.3758/s13414-023-02836-9. [PMID: 38169029 DOI: 10.3758/s13414-023-02836-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/17/2023] [Indexed: 01/05/2024]
Abstract
When freely viewing a scene, the eyes often return to previously visited locations. By tracking eye movements and coregistering eye movements and EEG, such refixations are shown to have multiple roles: repairing insufficient encoding from precursor fixations, supporting ongoing viewing by resampling relevant locations prioritized by precursor fixations, and aiding the construction of memory representations. All these functions of refixation behavior are understood to be underpinned by three oculomotor and cognitive systems and their associated brain structures. First, immediate saccade planning prior to refixations involves attentional selection of candidate locations to revisit. This process is likely supported by the dorsal attentional network. Second, visual working memory, involved in maintaining task-related information, is likely supported by the visual cortex. Third, higher-order relevance of scene locations, which depends on general knowledge and understanding of scene meaning, is likely supported by the hippocampal memory system. Working together, these structures bring about viewing behavior that balances exploring previously unvisited areas of a scene with exploiting visited areas through refixations.
Collapse
Affiliation(s)
- Andrey R Nikolaev
- Department of Psychology, Lund University, Box 213, 22100, Lund, Sweden.
- Brain & Cognition Research Unit, KU Leuven-University of Leuven, Leuven, Belgium.
| | | | - Cees van Leeuwen
- Brain & Cognition Research Unit, KU Leuven-University of Leuven, Leuven, Belgium
- Center for Cognitive Science, Rheinland-Pfälzische Technische Universität Kaiserslautern-Landau, Kaiserslautern, Germany
| |
Collapse
|
31
|
Marshall TR, Ruesseler M, Hunt LT, O’Reilly JX. The representation of priors and decisions in the human parietal cortex. PLoS Biol 2024; 22:e3002383. [PMID: 38285671 PMCID: PMC10824454 DOI: 10.1371/journal.pbio.3002383] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2022] [Accepted: 12/11/2023] [Indexed: 01/31/2024] Open
Abstract
Animals actively sample their environment through orienting actions such as saccadic eye movements. Saccadic targets are selected based both on sensory evidence immediately preceding the saccade, and a "salience map" or prior built-up over multiple saccades. In the primate cortex, the selection of each individual saccade depends on competition between target-selective cells that ramp up their firing rate to saccade release. However, it is less clear how a cross-saccade prior might be implemented, either in neural firing or through an activity-silent mechanism such as modification of synaptic weights on sensory inputs. Here, we present evidence from magnetoencephalography for 2 distinct processes underlying the selection of the current saccade, and the representation of the prior, in human parietal cortex. While the classic ramping decision process for each saccade was reflected in neural firing rates (measured in the event-related field), a prior built-up over multiple saccades was implemented via modulation of the gain on sensory inputs from the preferred target, as evidenced by rapid frequency tagging. A cascade of computations over time (initial representation of the prior, followed by evidence accumulation and then an integration of prior and evidence) provides a mechanism by which a salience map may be built up across saccades in parietal cortex. It also provides insight into the apparent contradiction that inactivation of parietal cortex has been shown not to affect performance on single-trials, despite the presence of clear evidence accumulation signals in this region.
Collapse
Affiliation(s)
- Tom R. Marshall
- Centre for Human Brain Health, School of Psychology, University of Birmingham, Birmingham, United Kingdom
- Wellcome Centre for Integrative Neuroimaging, Department of Experimental Psychology, Oxford University, Oxford, United Kingdom
| | - Maria Ruesseler
- Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, Oxford University, Oxford, United Kingdom
| | - Laurence T. Hunt
- Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, Oxford University, Oxford, United Kingdom
| | - Jill X. O’Reilly
- Wellcome Centre for Integrative Neuroimaging, Department of Experimental Psychology, Oxford University, Oxford, United Kingdom
- Wellcome Centre for Integrative Neuroimaging, Nuffield Department for Clinical Neurosciences, Oxford University, Oxford, United Kingdom
| |
Collapse
|
32
|
de Vries E, van Ede F. Microsaccades Track Location-Based Object Rehearsal in Visual Working Memory. eNeuro 2024; 11:ENEURO.0276-23.2023. [PMID: 38176905 PMCID: PMC10849020 DOI: 10.1523/eneuro.0276-23.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2023] [Revised: 12/05/2023] [Accepted: 12/09/2023] [Indexed: 01/06/2024] Open
Abstract
Besides controlling eye movements, the brain's oculomotor system has been implicated in the control of covert spatial attention and the rehearsal of spatial information in working memory. We investigated whether the oculomotor system also contributes to rehearsing visual objects in working memory when object location is never asked about. To address this, we tracked the incidental use of locations for mnemonic rehearsal via directional biases in microsaccades while participants maintained two visual objects (colored oriented gratings) in working memory. By varying the stimulus configuration (horizontal, diagonal, and vertical) at encoding, we could quantify whether microsaccades were more aligned with the configurational axis of the memory contents, as opposed to the orthogonal axis. Experiment 1 revealed that microsaccades continued to be biased along the axis of the memory content several seconds into the working memory delay. In Experiment 2, we confirmed that this directional microsaccade bias was specific to memory demands, ruling out lingering effects from passive and attentive encoding of the same visual objects in the same configurations. Thus, by studying microsaccade directions, we uncover oculomotor-driven rehearsal of visual objects in working memory through their associated locations.
Collapse
Affiliation(s)
- Eelke de Vries
- Department of Experimental and Applied Psychology, Institute for Brain and Behavior Amsterdam, Vrije Universiteit Amsterdam, Amsterdam 1081 HV, The Netherlands
| | - Freek van Ede
- Department of Experimental and Applied Psychology, Institute for Brain and Behavior Amsterdam, Vrije Universiteit Amsterdam, Amsterdam 1081 HV, The Netherlands
| |
Collapse
|
33
|
Fazekas P, Cleeremans A, Overgaard M. A construct-first approach to consciousness science. Neurosci Biobehav Rev 2024; 156:105480. [PMID: 38008237 DOI: 10.1016/j.neubiorev.2023.105480] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2023] [Revised: 10/26/2023] [Accepted: 11/20/2023] [Indexed: 11/28/2023]
Abstract
We propose a new approach to consciousness science that instead of comparing complex theoretical positions deconstructs existing theories, takes their central assumptions while disregarding their auxiliary hypotheses, and focuses its investigations on the main constructs that these central assumptions rely on (like global workspace, recurrent processing, metarepresentation). Studying how these main constructs are anchored in lower-level constructs characterizing underlying neural processing will not just offer an alternative to theory comparisons but will also take us one step closer to empirical resolutions. Moreover, exploring the compatibility and possible combinations of the lower-level constructs will allow for new theoretical syntheses. This construct-first approach will improve our ability to understand the commitments of existing theories and pave the way for moving beyond them.
Collapse
Affiliation(s)
- Peter Fazekas
- Aarhus Institute of Advanced Studies, Aarhus University, Høegh-Guldbergs Gade 6B, 8000 Aarhus, Denmark; Center of Functionally Integrative Neuroscience, Aarhus University, Universitetsbyen 3, 8000 Aarhus, Denmark.
| | - Axel Cleeremans
- Center for Research in Cognition & Neurosciences, Université Libre De Bruxelles, 50 avenue F.D. Roosevelt CP191, 1050 Bruxelles, Belgium
| | - Morten Overgaard
- Center of Functionally Integrative Neuroscience, Aarhus University, Universitetsbyen 3, 8000 Aarhus, Denmark
| |
Collapse
|
34
|
Mao Chao C, Xu C, Loaiza V, Rose NS. Are latent working memory items retrieved from long-term memory? Q J Exp Psychol (Hove) 2023:17470218231217723. [PMID: 37981748 DOI: 10.1177/17470218231217723] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2023]
Abstract
Switching one's focus of attention between to-be-remembered items in working memory (WM) is critical for cognition, but the mechanisms by which this is accomplished are unclear. A long-term memory (LTM) account suggests that switching attention away from an item, and passively retaining and reactivating such "latent" items back into the focus of attention involves episodic LTM retrieval processes, even for delays of only a few seconds. We tested this hypothesis using a two-item, double-retrocue WM task that requires participants to switch attention away from and reactivate items followed by subsequent LTM tests for reactivated items from the initial WM task (vs. continuously retained or untested control items). We compared performance on these tests between older adults (a population with LTM deficits) and young adults with either full (Experiment 1) or divided (Experiment 2) attention during the WM delay periods. The effects of reactivating latent items, as well as ageing and divided attention, had significant effects on WM performance, but did not interact with or systematically affect subsequent LTM for reactivated versus control items on item-, location-, or associative-recognition memory judgements made with either high or low confidence. Experiment 3 confirmed that these effects did not depend on whether or not young participants were warned about the subsequent LTM tests before performing the WM task. These dissociations between WM and LTM are inconsistent with the LTM account of latent WM; they are more consistent with the dynamic processing model of WM (Current Directions in Psychological Science).
Collapse
|
35
|
Ceccarelli F, Ferrucci L, Londei F, Ramawat S, Brunamonti E, Genovesio A. Static and dynamic coding in distinct cell types during associative learning in the prefrontal cortex. Nat Commun 2023; 14:8325. [PMID: 38097560 PMCID: PMC10721651 DOI: 10.1038/s41467-023-43712-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2023] [Accepted: 11/17/2023] [Indexed: 12/17/2023] Open
Abstract
The prefrontal cortex maintains information in memory through static or dynamic population codes depending on task demands, but whether the population coding schemes used are learning-dependent and differ between cell types is currently unknown. We investigate the population coding properties and temporal stability of neurons recorded from male macaques in two mapping tasks during and after stimulus-response associative learning, and then we use a Strategy task with the same stimuli and responses as control. We identify a heterogeneous population coding for stimuli, responses, and novel associations: static for putative pyramidal cells and dynamic for putative interneurons that show the strongest selectivity for all the variables. The population coding of learned associations shows overall the highest stability driven by cell types, with interneurons changing from dynamic to static coding after successful learning. The results support that prefrontal microcircuitry expresses mixed population coding governed by cell types and changes its stability during associative learning.
Collapse
Affiliation(s)
- Francesco Ceccarelli
- Department of Physiology and Pharmacology, Sapienza University, 00185, Rome, Italy
| | - Lorenzo Ferrucci
- Department of Physiology and Pharmacology, Sapienza University, 00185, Rome, Italy
| | - Fabrizio Londei
- Department of Physiology and Pharmacology, Sapienza University, 00185, Rome, Italy
- PhD program in Behavioral Neuroscience, Sapienza University, Rome, Italy
| | - Surabhi Ramawat
- Department of Physiology and Pharmacology, Sapienza University, 00185, Rome, Italy
| | - Emiliano Brunamonti
- Department of Physiology and Pharmacology, Sapienza University, 00185, Rome, Italy
| | - Aldo Genovesio
- Department of Physiology and Pharmacology, Sapienza University, 00185, Rome, Italy.
| |
Collapse
|
36
|
Thrower L, Dang W, Jaffe RG, Sun JD, Constantinidis C. Decoding working memory information from neurons with and without persistent activity in the primate prefrontal cortex. J Neurophysiol 2023; 130:1392-1402. [PMID: 37910532 PMCID: PMC11068397 DOI: 10.1152/jn.00290.2023] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2023] [Revised: 10/24/2023] [Accepted: 10/24/2023] [Indexed: 11/03/2023] Open
Abstract
Persistent activity of neurons in the prefrontal cortex has been thought to represent the information maintained in working memory, though alternative models have challenged this idea. Theories that depend on the dynamic representation of information posit that stimulus information may be maintained by the activity pattern of neurons whose firing rate is not significantly elevated above their baseline during the delay period of working memory tasks. We thus tested the ability of neurons that do and do not generate persistent activity in the prefrontal cortex of monkeys to represent spatial and object information in working memory. Neurons that generated persistent activity represented more information about the stimuli in both spatial and object working memory tasks. The amount of information that could be decoded from neural activity depended on the choice of decoder and parameters used but neurons with persistent activity outperformed non-persistent neurons consistently. Averaged across all neurons and stimuli, the firing rate did not appear clearly elevated above baseline during the maintenance of neural activity particularly for object working memory; however, this grand average masked neurons that generated persistent activity selective for their preferred stimuli, which carried the majority of stimulus information. These results reveal that prefrontal neurons that generate persistent activity maintain information more reliably during working memory.NEW & NOTEWORTHY Competing theories suggest that neurons that generate persistent activity or do not are primarily responsible for the maintenance of information, particularly regarding object working memory. Although the two models have been debated on theoretical terms, direct comparison of empirical results has been lacking. Analysis of neural activity in a large database of prefrontal recordings revealed that neurons that generate persistent activity were primarily responsible for the maintenance of both spatial and object working memory.
Collapse
Affiliation(s)
- Lilianna Thrower
- Department of Biomedical Engineering, Vanderbilt University, Nashville, Tennessee, United States
| | - Wenhao Dang
- Department of Biomedical Engineering, Vanderbilt University, Nashville, Tennessee, United States
| | - Rye G Jaffe
- Department of Biomedical Engineering, Vanderbilt University, Nashville, Tennessee, United States
| | - Jasmine D Sun
- Department of Biomedical Engineering, Vanderbilt University, Nashville, Tennessee, United States
| | - Christos Constantinidis
- Department of Biomedical Engineering, Vanderbilt University, Nashville, Tennessee, United States
- Neuroscience Program, Vanderbilt University, Nashville, Tennessee, United States
- Department of Ophthalmology and Visual Sciences, Vanderbilt University Medical Center, Nashville, Tennessee, United States
| |
Collapse
|
37
|
Lansner A, Fiebig F, Herman P. Fast Hebbian plasticity and working memory. Curr Opin Neurobiol 2023; 83:102809. [PMID: 37980802 DOI: 10.1016/j.conb.2023.102809] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2023] [Revised: 10/10/2023] [Accepted: 10/19/2023] [Indexed: 11/21/2023]
Abstract
Theories and models of working memory (WM) were at least since the mid-1990s dominated by the persistent activity hypothesis. The past decade has seen rising concerns about the shortcomings of sustained activity as the mechanism for short-term maintenance of WM information in the light of accumulating experimental evidence for so-called activity-silent WM and the fundamental difficulty in explaining robust multi-item WM. In consequence, alternative theories are now explored mostly in the direction of fast synaptic plasticity as the underlying mechanism. The question of non-Hebbian vs Hebbian synaptic plasticity emerges naturally in this context. In this review, we focus on fast Hebbian plasticity and trace the origins of WM theories and models building on this form of associative learning.
Collapse
Affiliation(s)
- Anders Lansner
- Stockholm University, Department of Mathematics, SE-106 91 Stockholm, Sweden; KTH Royal Institute of Technology, Dept of Computational Science and Technology, 100 44 Stockholm, Sweden; SeRC (Swedish e-Science Research Center), Sweden.
| | - Florian Fiebig
- KTH Royal Institute of Technology, Dept of Computational Science and Technology, 100 44 Stockholm, Sweden.
| | - Pawel Herman
- KTH Royal Institute of Technology, Dept of Computational Science and Technology, 100 44 Stockholm, Sweden; Digital Futures, KTH Royal Institute of Technology, Stockholm, Sweden; SeRC (Swedish e-Science Research Center), Sweden. https://twitter.com/PHermanKTHbrain
| |
Collapse
|
38
|
Ester E, Weese R. Temporally Dissociable Mechanisms of Spatial, Feature, and Motor Selection during Working Memory-guided Behavior. J Cogn Neurosci 2023; 35:2014-2027. [PMID: 37788302 DOI: 10.1162/jocn_a_02061] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/05/2023]
Abstract
Working memory (WM) is a capacity- and duration-limited system that forms a temporal bridge between fleeting sensory phenomena and possible actions. But how are the contents of WM used to guide behavior? A recent high-profile study reported evidence for simultaneous access to WM content and linked motor plans during WM-guided behavior, challenging serial models where task-relevant WM content is first selected and then mapped on to a task-relevant motor response. However, the task used in that study was not optimized to distinguish the selection of spatial versus nonspatial visual information stored in memory, nor to distinguish whether or how the chronometry of selecting nonspatial visual information stored in memory might differ from the selection of linked motor plans. Here, we revisited the chronometry of spatial, feature, and motor selection during WM-guided behavior using a task optimized to disentangle these processes. Concurrent EEG and eye position recordings revealed clear evidence for temporally dissociable spatial, feature, and motor selection during this task. Thus, our data reveal the existence of multiple WM selection mechanisms that belie conceptualizations of WM-guided behavior based on purely serial or parallel visuomotor processing.
Collapse
|
39
|
Stroud JP, Watanabe K, Suzuki T, Stokes MG, Lengyel M. Optimal information loading into working memory explains dynamic coding in the prefrontal cortex. Proc Natl Acad Sci U S A 2023; 120:e2307991120. [PMID: 37983510 PMCID: PMC10691340 DOI: 10.1073/pnas.2307991120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2023] [Accepted: 09/29/2023] [Indexed: 11/22/2023] Open
Abstract
Working memory involves the short-term maintenance of information and is critical in many tasks. The neural circuit dynamics underlying working memory remain poorly understood, with different aspects of prefrontal cortical (PFC) responses explained by different putative mechanisms. By mathematical analysis, numerical simulations, and using recordings from monkey PFC, we investigate a critical but hitherto ignored aspect of working memory dynamics: information loading. We find that, contrary to common assumptions, optimal loading of information into working memory involves inputs that are largely orthogonal, rather than similar, to the late delay activities observed during memory maintenance, naturally leading to the widely observed phenomenon of dynamic coding in PFC. Using a theoretically principled metric, we show that PFC exhibits the hallmarks of optimal information loading. We also find that optimal information loading emerges as a general dynamical strategy in task-optimized recurrent neural networks. Our theory unifies previous, seemingly conflicting theories of memory maintenance based on attractor or purely sequential dynamics and reveals a normative principle underlying dynamic coding.
Collapse
Affiliation(s)
- Jake P. Stroud
- Computational and Biological Learning Lab, Department of Engineering, University of Cambridge, CambridgeCB2 1PZ, United Kingdom
| | - Kei Watanabe
- Graduate School of Frontier Biosciences, Osaka University, Osaka565-0871, Japan
| | - Takafumi Suzuki
- Center for Information and Neural Networks, National Institute of Communication and Information Technology, Osaka565-0871, Japan
| | - Mark G. Stokes
- Department of Experimental Psychology, University of Oxford, OxfordOX2 6GG, United Kingdom
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, OxfordOX3 9DU, United Kingdom
| | - Máté Lengyel
- Computational and Biological Learning Lab, Department of Engineering, University of Cambridge, CambridgeCB2 1PZ, United Kingdom
- Center for Cognitive Computation, Department of Cognitive Science, Central European University, BudapestH-1051, Hungary
| |
Collapse
|
40
|
Buonomano DV, Buzsáki G, Davachi L, Nobre AC. Time for Memories. J Neurosci 2023; 43:7565-7574. [PMID: 37940593 PMCID: PMC10634580 DOI: 10.1523/jneurosci.1430-23.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Revised: 08/22/2023] [Accepted: 08/25/2023] [Indexed: 11/10/2023] Open
Abstract
The ability to store information about the past to dynamically predict and prepare for the future is among the most fundamental tasks the brain performs. To date, the problems of understanding how the brain stores and organizes information about the past (memory) and how the brain represents and processes temporal information for adaptive behavior have generally been studied as distinct cognitive functions. This Symposium explores the inherent link between memory and temporal cognition, as well as the potential shared neural mechanisms between them. We suggest that working memory and implicit timing are interconnected and may share overlapping neural mechanisms. Additionally, we explore how temporal structure is encoded in associative and episodic memory and, conversely, the influences of episodic memory on subsequent temporal anticipation and the perception of time. We suggest that neural sequences provide a general computational motif that contributes to timing and working memory, as well as the spatiotemporal coding and recall of episodes.
Collapse
Affiliation(s)
- Dean V Buonomano
- Department of Neurobiology, University of California, Los Angeles, California 90095
- Department of Psychology, University of California, Los Angeles, Los Angeles, California 90095
- Integrative Center for Learning and Memory, UCLA, Los Angeles, California 90025
| | - György Buzsáki
- Neuroscience Institute and Department of Neurology, NYU Grossman School of Medicine, New York University, New York, New York 10016
- Center for Neural Science, New York University, New York, New York 10003
| | - Lila Davachi
- Department of Psychology, Columbia University, New York, New York 10027
- Center for Clinical Research, Nathan S. Kline Institute for Psychiatric Research, Orangeburg, New York 10962
| | - Anna C Nobre
- Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, United Kingdom
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford OX3 7JX, United Kingdom
- Department of Psychology, Yale University, New Haven, Connecticut 06510
- Wu Tsai Center for Neurocognition and Behavior, Wu Tsai Institute, Yale University, New Haven, Connecticut 06510
| |
Collapse
|
41
|
Han S, Zhou H, Tian Y, Ku Y. Early top-down control of internal selection induced by retrospective cues in visual working memory: advantage of peripheral over central cues. Prog Neurobiol 2023; 230:102521. [PMID: 37673370 DOI: 10.1016/j.pneurobio.2023.102521] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2023] [Revised: 08/17/2023] [Accepted: 08/28/2023] [Indexed: 09/08/2023]
Abstract
Attention can be deployed among external sensory stimuli or internal working memory (WM) representations, and recent primate studies have revealed that these external and internal selections share a common neural basis in the prefrontal cortex (PFC). However, it remains to be elucidated how PFC implements these selections, especially in humans. The present study aimed to further investigate whether PFC responded differentially to the peripheral and central retrospective cues (retro-cues) that induced attention selection among WM representations. To achieve this, we combined magnetoencephalography (MEG, Experiment 1) and transcranial magnetic stimulation (TMS, Experiment 2) with an orientation-recall paradigm. Experiment 1 found that a peripheral retro-cue with 100% reliability had a greater benefit on WM performance than a central retro-cue, while this advantage of peripheral over central cues vanished when the cue reliability dropped to 50% (non-informative). MEG source analysis indicated that the 100% peripheral retro-cue elicited earlier (∼125 ms) PFC responses than the central retro-cue (∼275 ms). Meanwhile, Granger causality analysis showed that PFC had earlier (0-200 ms) top-down signals projecting to the superior parietal lobule (SPL) and the lateral occipital cortex (LOC) after the onset of peripheral retro-cues, while these top-down signals appeared later (300-500 ms) after the onset of central retro-cues. Importantly, PFC activity within this period of 300-500 ms correlated with the peripheral advantage in behavior. Moreover, Experiment 2 applied TMS at different time points to test the causal influence of brain activity on behavior and found that stimulating PFC at 100 ms abolished the behavioral benefit of the peripheral retro-cue, as well as its advantage over the central retro-cue. Taken together, our results suggested that the advantage of peripheral over central retro-cues in the mnemonic domain is realized through faster top-down control from PFC, which challenged traditional opinions that the top-down control of attention on WM required at least 300 ms to appear. The present study highlighted that in addition to the causal role of PFC in attention selection of WM representations, timing was critical as well and faster was better.
Collapse
Affiliation(s)
- Sizhu Han
- Guangdong Provincial Key Laboratory of Brain Function and Disease, Center for Brain and Mental Well-being, Department of Psychology, Sun Yat-sen University, Guangzhou, China; Peng Cheng Laboratory, Shenzhen, China; School of Psychology and Cognitive Science, East China Normal University, Shanghai, China
| | | | - Yonghong Tian
- Peng Cheng Laboratory, Shenzhen, China; School of Computer Science, School of Electronic and Computer Engineering, Peking University, Beijing, China
| | - Yixuan Ku
- Guangdong Provincial Key Laboratory of Brain Function and Disease, Center for Brain and Mental Well-being, Department of Psychology, Sun Yat-sen University, Guangzhou, China; Peng Cheng Laboratory, Shenzhen, China.
| |
Collapse
|
42
|
Li S, Rosen MC, Chang S, David S, Freedman DJ. Alterations of neural activity in the prefrontal cortex associated with deficits in working memory performance. Front Behav Neurosci 2023; 17:1213435. [PMID: 37915531 PMCID: PMC10616307 DOI: 10.3389/fnbeh.2023.1213435] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2023] [Accepted: 08/31/2023] [Indexed: 11/03/2023] Open
Abstract
Working memory (WM), a core cognitive function, enables the temporary holding and manipulation of information in mind to support ongoing behavior. Neurophysiological recordings conducted in nonhuman primates have revealed neural correlates of this process in a network of higher-order cortical regions, particularly the prefrontal cortex (PFC). Here, we review the circuit mechanisms and functional importance of WM-related activity in these areas. Recent neurophysiological data indicates that the absence of these neural correlates at different stages of WM is accompanied by distinct behavioral deficits, which are characteristic of various disease states/normal aging and which we review here. Finally, we discuss emerging evidence of electrical stimulation ameliorating these WM deficits in both humans and non-human primates. These results are important for a basic understanding of the neural mechanisms supporting WM, as well as for translational efforts to developing therapies capable of enhancing healthy WM ability or restoring WM from dysfunction.
Collapse
Affiliation(s)
- Sihai Li
- Department of Neurobiology, The University of Chicago, Chicago, IL, United States
| | - Matthew C. Rosen
- Department of Neurobiology, The University of Chicago, Chicago, IL, United States
| | - Suha Chang
- Department of Neurobiology, The University of Chicago, Chicago, IL, United States
| | - Samuel David
- Department of Neurobiology, The University of Chicago, Chicago, IL, United States
| | - David J. Freedman
- Department of Neurobiology, The University of Chicago, Chicago, IL, United States
- Neuroscience Institute, The University of Chicago, Chicago, IL, United States
| |
Collapse
|
43
|
Yue Q. Maintaining Auditory Working Memory Representations beyond Sensory Cortices Makes Working Memory Work. J Neurosci 2023; 43:6714-6716. [PMID: 37793814 PMCID: PMC10552936 DOI: 10.1523/jneurosci.0879-23.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2023] [Revised: 07/27/2023] [Accepted: 08/05/2023] [Indexed: 10/06/2023] Open
Affiliation(s)
- Qiuhai Yue
- School of Psychology, Shenzhen University, Shenzhen, China 518060
| |
Collapse
|
44
|
Zhang Z, Lewis-Peacock JA. Bend but don't break: Prioritization protects working memory from displacement but leaves it vulnerable to distortion from distraction. Cognition 2023; 239:105574. [PMID: 37541028 PMCID: PMC11122694 DOI: 10.1016/j.cognition.2023.105574] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2023] [Revised: 07/19/2023] [Accepted: 07/21/2023] [Indexed: 08/06/2023]
Abstract
Perceptual distraction distorts visual working memory representations. Previous research has shown that memory responses are systematically biased towards passively viewed visual distractors that are similar to the memoranda. However, it remains unclear whether the prioritization of one working memory representation over another reduces the impact of perceptual distractors. We designed a study with five different types of visual distraction that varied in engagement and found evidence for both subtle distortions and catastrophic failures of memory. Importantly, prioritization protected working memories from catastrophic loss (fewer "swap errors") but rendered them more vulnerable to distortion (greater attractive "biases" towards the distractor). Our findings demonstrate that prioritization does not simply protect working memory from any and all interference, but rather it reduces the likelihood of catastrophic disruption from perceptual distraction at the cost of an increased likelihood of distortion.
Collapse
Affiliation(s)
- Ziyao Zhang
- Department of Psychology, University of Texas at Austin, USA.
| | | |
Collapse
|
45
|
Funahashi S, Gao B, Takeda K, Watanabe Y, Wu J, Yan T. Individual prefrontal neurons contribute to sensory-to-motor information transformation by rotating reference frames during spatial working memory performance. Cereb Cortex 2023; 33:10258-10271. [PMID: 37557911 DOI: 10.1093/cercor/bhad280] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2023] [Revised: 07/12/2023] [Accepted: 07/13/2023] [Indexed: 08/11/2023] Open
Abstract
Performing working memory tasks correctly requires not only the temporary maintenance of information but also the visual-to-motor transformation of information. Although sustained delay-period activity is known to be a mechanism for temporarily maintaining information, the mechanism for information transformation is not well known. An analysis using a population of delay-period activities recorded from prefrontal neurons visualized a gradual change of maintained information from sensory to motor as the delay period progressed. However, the contributions of individual prefrontal neurons to this process are not known. In the present study, we used a version of the delayed-response task, in which monkeys needed to make a saccade 90o clockwise from a visual cue after a 3-s delay, and examined the temporal change in the preferred directions of delay-period activity during the delay period for individual neurons. One group of prefrontal neurons encoded the cue direction by a retinotopic reference frame and either maintained it throughout the delay period or rotated it 90o counterclockwise to adjust visual information to saccade information, whereas other groups of neurons encoded the cue direction by a saccade-based reference frame and rotated it 90o clockwise. The results indicate that visual-to-motor information transformation is achieved by manipulating the reference frame to adjust visual coordinates to motor coordinates.
Collapse
Affiliation(s)
- Shintaro Funahashi
- Advanced Research Institute for Multidisciplinary Science, Beijing Institute of Technology, Haidian District, Beijing 100018, People's Republic of China
- School of Life Science, Beijing Institute of Technology, Haidian District, Beijing 100018, People's Republic of China
- Department of Cognitive and Behavioral Sciences, Graduate School of Human and Environmental Studies, Kyoto University, Yoshida, Sakyo-ku, Kyoto 606-8501, Japan
- Kokoro Research Center, Kyoto University, Yoshida, Sakyo-ku, Kyoto 606-8501, Japan
| | - Binbin Gao
- School of Life Science, Beijing Institute of Technology, Haidian District, Beijing 100018, People's Republic of China
| | - Kazuyoshi Takeda
- Department of Cognitive and Behavioral Sciences, Graduate School of Human and Environmental Studies, Kyoto University, Yoshida, Sakyo-ku, Kyoto 606-8501, Japan
| | - Yumiko Watanabe
- Department of Cognitive and Behavioral Sciences, Graduate School of Human and Environmental Studies, Kyoto University, Yoshida, Sakyo-ku, Kyoto 606-8501, Japan
| | - Jinglong Wu
- School of Medical Technology, Beijing Institute of Technology, Haidian District, Beijing 100018, People's Republic of China
| | - Tianyi Yan
- School of Life Science, Beijing Institute of Technology, Haidian District, Beijing 100018, People's Republic of China
| |
Collapse
|
46
|
Nolan SO, Melugin PR, Erickson KR, Adams WR, Farahbakhsh ZZ, Mcgonigle CE, Kwon MH, Costa VD, Lapish CC, Hackett TA, Cuzon Carlson VC, Constantinidis C, Grant KA, Siciliano CA. Recurrent activity within microcircuits of macaque dorsolateral prefrontal cortex tracks cognitive flexibility. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.09.23.559125. [PMID: 38529503 PMCID: PMC10962741 DOI: 10.1101/2023.09.23.559125] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/27/2024]
Abstract
Human and non-human primate data clearly implicate the dorsolateral prefrontal cortex (dlPFC) as critical for advanced cognitive functions 1,2 . It is thought that intracortical synaptic architectures within dlPFC are the integral neurobiological substrate that gives rise to these processes, including working memory, inferential reasoning, and decision-making 3-7 . In the prevailing model, each cortical column makes up one fundamental processing unit composed of dense intrinsic connectivity, conceptualized as the 'canonical' cortical microcircuit 3,8 . Each cortical microcircuit receives sensory and cognitive information from a variety of sources which are represented by sustained activity within the microcircuit, referred to as persistent or recurrent activity 4,9 . Via recurrent connections within the microcircuit, activity can propagate for a variable length of time, thereby allowing temporary storage and computations to occur locally before ultimately passing a transformed representation to a downstream output 4,5,10 . Competing theories regarding how microcircuit activity is coordinated have proven difficult to reconcile in vivo where intercortical and intracortical computations cannot be fully dissociated 5,9,11,12 . Here, we interrogated the intrinsic features of isolated microcircuit networks using high-density calcium imaging of macaque dlPFC ex vivo . We found that spontaneous activity is intrinsically maintained by microcircuit architecture, persisting at a high rate in the absence of extrinsic connections. Further, using perisulcal stimulation to evoke persistent activity in deep layers, we found that activity propagates through stochastically assembled intracortical networks, creating predictable population-level events from largely non-overlapping ensembles. Microcircuit excitability covaried with individual cognitive performance, thus anchoring heuristic models of abstract cortical functions within quantifiable constraints imposed by the underlying synaptic architecture.
Collapse
|
47
|
Borst JP, Aubin S, Stewart TC. A whole-task brain model of associative recognition that accounts for human behavior and neuroimaging data. PLoS Comput Biol 2023; 19:e1011427. [PMID: 37682986 PMCID: PMC10511112 DOI: 10.1371/journal.pcbi.1011427] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2023] [Revised: 09/20/2023] [Accepted: 08/10/2023] [Indexed: 09/10/2023] Open
Abstract
Brain models typically focus either on low-level biological detail or on qualitative behavioral effects. In contrast, we present a biologically-plausible spiking-neuron model of associative learning and recognition that accounts for both human behavior and low-level brain activity across the whole task. Based on cognitive theories and insights from machine-learning analyses of M/EEG data, the model proceeds through five processing stages: stimulus encoding, familiarity judgement, associative retrieval, decision making, and motor response. The results matched human response times and source-localized MEG data in occipital, temporal, prefrontal, and precentral brain regions; as well as a classic fMRI effect in prefrontal cortex. This required two main conceptual advances: a basal-ganglia-thalamus action-selection system that relies on brief thalamic pulses to change the functional connectivity of the cortex, and a new unsupervised learning rule that causes very strong pattern separation in the hippocampus. The resulting model shows how low-level brain activity can result in goal-directed cognitive behavior in humans.
Collapse
Affiliation(s)
- Jelmer P. Borst
- Bernoulli Institute, University of Groningen; Groningen, The Netherlands
| | - Sean Aubin
- Centre for Theoretical Neuroscience, University of Waterloo; Waterloo, Ontario, Canada
| | - Terrence C. Stewart
- National Research Council Canada, University of Waterloo Collaboration Centre; Waterloo, Ontario, Canada
| |
Collapse
|
48
|
Mozumder R, Constantinidis C. Single-neuron and population measures of neuronal activity in working memory tasks. J Neurophysiol 2023; 130:694-705. [PMID: 37609703 PMCID: PMC10649843 DOI: 10.1152/jn.00245.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2023] [Revised: 08/17/2023] [Accepted: 08/17/2023] [Indexed: 08/24/2023] Open
Abstract
Information represented in working memory is reflected in the firing rate of neurons in the prefrontal cortex and brain areas connected to it. In recent years, there has been an increased realization that population measures capture more accurately neural correlates of cognitive functions. We examined how single neuron firing in the prefrontal and posterior parietal cortex of two male monkeys compared with population measures in spatial working memory tasks. Persistent activity was observed in the dorsolateral prefrontal and posterior parietal cortex and firing rate predicted working memory behavior, particularly in the prefrontal cortex. These findings had equivalents in population measures, including trajectories in state space that became less separated in error trials. We additionally observed rotations of stimulus representations in the neuronal state space for different task conditions, which were not obvious in firing rate measures. These results suggest that population measures provide a richer view of how neuronal activity is associated with behavior, largely confirming that persistent activity is the core phenomenon that maintains visual-spatial information in working memory.NEW & NOTEWORTHY Recordings from large numbers of neurons led to a reevaluation of neural correlates of cognitive functions, which traditionally were defined based on responses of single neurons or averages of firing rates. Analysis of neuronal recordings from the dorsolateral prefrontal and posterior parietal cortex revealed that properties of neuronal firing captured in classical studies of persistent activity can account for population representations, though some population characteristics did not have clear correlates in single neuron activity.
Collapse
Affiliation(s)
- Rana Mozumder
- Department of Biomedical Engineering, Vanderbilt University, Nashville, Tennessee, United States
| | - Christos Constantinidis
- Department of Biomedical Engineering, Vanderbilt University, Nashville, Tennessee, United States
- Program in Neuroscience, Vanderbilt University, Nashville, Tennessee, United States
- Department of Ophthalmology and Visual Sciences, Vanderbilt University Medical Center, Nashville, Tennessee, United States
| |
Collapse
|
49
|
Chen Z, Sun Q, Li X. Differences of resource allocation to active and passive states in visual working memory. PSYCHOLOGICAL RESEARCH 2023; 87:1761-1767. [PMID: 36436109 DOI: 10.1007/s00426-022-01772-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2022] [Accepted: 11/10/2022] [Indexed: 11/28/2022]
Abstract
Scholars have long sought to understand the separation between the active and passive states in visual working memory. Results of recent behavioral studies have provided insight into the independence of storage resources in these two states. To explore how humans distribute these resources in the active and passive states in visual working memory, we adopted the classic double-retro-cue paradigm combined with a continuous reported color wheel to ascertain whether the precision of representations maintained in active and passive states are adjustable according to the frequency of spatial cues. The results showed that two distinct resource allocation mechanisms exist in these two states beyond traditional visual working memory theory and provide further support for the separation hypothesis.
Collapse
Affiliation(s)
- Zhen Chen
- Department of Psychology, Zhejiang Normal University, 688 Yingbin Road, Jinhua, China
| | - Qi Sun
- Department of Psychology, Zhejiang Normal University, 688 Yingbin Road, Jinhua, China.
- Key Laboratory of Intelligent Education Technology and Application of Zhejiang Province, Zhejiang Normal University, Zhejiang, China.
| | - Xinyu Li
- Department of Psychology, Zhejiang Normal University, 688 Yingbin Road, Jinhua, China.
- Key Laboratory of Intelligent Education Technology and Application of Zhejiang Province, Zhejiang Normal University, Zhejiang, China.
| |
Collapse
|
50
|
Watanabe K, Kadohisa M, Kusunoki M, Buckley MJ, Duncan J. Cycles of goal silencing and reactivation underlie complex problem-solving in primate frontal and parietal cortex. Nat Commun 2023; 14:5054. [PMID: 37598206 PMCID: PMC10439911 DOI: 10.1038/s41467-023-40676-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2022] [Accepted: 08/03/2023] [Indexed: 08/21/2023] Open
Abstract
While classic views proposed that working memory (WM) is mediated by sustained firing, recent evidence suggests a contribution of activity-silent states. Within WM, human neuroimaging studies suggest a switch between attentional foreground and background, with only the foregrounded item represented in active neural firing. To address this process at the cellular level, we recorded prefrontal (PFC) and posterior parietal (PPC) neurons in a complex problem-solving task, with monkeys searching for one or two target locations in a first cycle of trials, and retaining them for memory-guided revisits on subsequent cycles. When target locations were discovered, neither frontal nor parietal neurons showed sustained goal-location codes continuing into subsequent trials and cycles. Instead there were sequences of timely goal silencing and reactivation, and following reactivation, sustained states until behavioral response. With two target locations, goal representations in both regions showed evidence of transitions between foreground and background, but the PFC representation was more complete, extending beyond the current trial to include both past and future selections. In the absence of unbroken sustained codes, different neuronal states interact to support maintenance and retrieval of WM representations across successive trials.
Collapse
Affiliation(s)
- Kei Watanabe
- Department of Experimental Psychology, University of Oxford, OX1 3SR, Oxford, UK.
- Graduate School of Frontier Biosciences, Osaka University, Osaka, 565-0871, Japan.
- Graduate School of Medicine, Osaka University, Osaka, 565-0871, Japan.
| | - Mikiko Kadohisa
- Department of Experimental Psychology, University of Oxford, OX1 3SR, Oxford, UK
- MRC Cognition and Brain Sciences Unit, University of Cambridge, CB2 7EF, Cambridge, UK
| | - Makoto Kusunoki
- Department of Experimental Psychology, University of Oxford, OX1 3SR, Oxford, UK
- MRC Cognition and Brain Sciences Unit, University of Cambridge, CB2 7EF, Cambridge, UK
| | - Mark J Buckley
- Department of Experimental Psychology, University of Oxford, OX1 3SR, Oxford, UK
| | - John Duncan
- Department of Experimental Psychology, University of Oxford, OX1 3SR, Oxford, UK
- MRC Cognition and Brain Sciences Unit, University of Cambridge, CB2 7EF, Cambridge, UK
| |
Collapse
|