1
|
Jensen KT, Hennequin G, Mattar MG. A recurrent network model of planning explains hippocampal replay and human behavior. Nat Neurosci 2024:10.1038/s41593-024-01675-7. [PMID: 38849521 DOI: 10.1038/s41593-024-01675-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2023] [Accepted: 05/07/2024] [Indexed: 06/09/2024]
Abstract
When faced with a novel situation, people often spend substantial periods of time contemplating possible futures. For such planning to be rational, the benefits to behavior must compensate for the time spent thinking. Here, we capture these features of behavior by developing a neural network model where planning itself is controlled by the prefrontal cortex. This model consists of a meta-reinforcement learning agent augmented with the ability to plan by sampling imagined action sequences from its own policy, which we call 'rollouts'. In a spatial navigation task, the agent learns to plan when it is beneficial, which provides a normative explanation for empirical variability in human thinking times. Additionally, the patterns of policy rollouts used by the artificial agent closely resemble patterns of rodent hippocampal replays. Our work provides a theory of how the brain could implement planning through prefrontal-hippocampal interactions, where hippocampal replays are triggered by-and adaptively affect-prefrontal dynamics.
Collapse
Affiliation(s)
- Kristopher T Jensen
- Computational and Biological Learning Lab, Department of Engineering, University of Cambridge, Cambridge, UK.
- Sainsbury Wellcome Centre, University College London, London, UK.
| | - Guillaume Hennequin
- Computational and Biological Learning Lab, Department of Engineering, University of Cambridge, Cambridge, UK
| | - Marcelo G Mattar
- Department of Cognitive Science, University of California, San Diego, CA, USA
- Department of Psychology, New York University, New York, NY, USA
| |
Collapse
|
2
|
Chen HT, van der Meer MAA. Paradoxical replay can protect contextual task representations from destructive interference when experience is unbalanced. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.05.09.593332. [PMID: 38766204 PMCID: PMC11100794 DOI: 10.1101/2024.05.09.593332] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/22/2024]
Abstract
Experience replay is a powerful mechanism to learn efficiently from limited experience. Despite several decades of compelling experimental results, the factors that determine which experiences are selected for replay remain unclear. A particular challenge for current theories is that on tasks that feature unbalanced experience, rats paradoxically replay the less-experienced trajectory. To understand why, we simulated a feedforward neural network with two regimes: rich learning (structured representations tailored to task demands) and lazy learning (unstructured, task-agnostic representations). Rich, but not lazy, representations degraded following unbalanced experience, an effect that could be reversed with paradoxical replay. To test if this computational principle can account for the experimental data, we examined the relationship between paradoxical replay and learned task representations in the rat hippocampus. Strikingly, we found a strong association between the richness of learned task representations and the paradoxicality of replay. Taken together, these results suggest that paradoxical replay specifically serves to protect rich representations from the destructive effects of unbalanced experience, and more generally demonstrate a novel interaction between the nature of task representations and the function of replay in artificial and biological systems.
Collapse
Affiliation(s)
- Hung-Tu Chen
- Department of Psychological & Brain Sciences, Dartmouth College, Hanover, NH 03755
| | | |
Collapse
|
3
|
Coulter ME, Gillespie AK, Chu J, Denovellis EL, Nguyen TTK, Liu DF, Wadhwani K, Sharma B, Wang K, Deng X, Eden UT, Kemere C, Frank LM. Closed-loop modulation of remote hippocampal representations with neurofeedback. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.05.08.593085. [PMID: 38766135 PMCID: PMC11100667 DOI: 10.1101/2024.05.08.593085] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/22/2024]
Abstract
Humans can remember specific events without acting on them and can influence which memories are retrieved based on internal goals. However, current animal models of memory typically present sensory cues to trigger retrieval and assess retrieval based on action 1-5 . As a result, it is difficult to determine whether measured patterns of neural activity relate to the cue(s), the retrieved memory, or the behavior. We therefore asked whether we could develop a paradigm to isolate retrieval-related neural activity in animals without retrieval cues or the requirement of a behavioral report. To do this, we focused on hippocampal "place cells." These cells primarily emit spiking patterns that represent the animal's current location (local representations), but they can also generate representations of previously visited locations distant from the animal's current location (remote representations) 6-13 . It is not known whether animals can deliberately engage specific remote representations, and if so, whether this engagement would occur during specific brain states. So, we used a closed-loop neurofeedback system to reward expression of remote representations that corresponded to uncued, experimenter-selected locations, and found that rats could increase the prevalence of these specific remote representations over time; thus, demonstrating memory retrieval modulated by internal goals in an animal model. These representations occurred predominately during periods of immobility but outside of hippocampal sharp-wave ripple (SWR) 13-15 events. This paradigm enables future direct studies of memory retrieval mechanisms in the healthy brain and in models of neurological disorders.
Collapse
|
4
|
McNamee DC. The generative neural microdynamics of cognitive processing. Curr Opin Neurobiol 2024; 85:102855. [PMID: 38428170 DOI: 10.1016/j.conb.2024.102855] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2023] [Revised: 02/06/2024] [Accepted: 02/07/2024] [Indexed: 03/03/2024]
Abstract
The entorhinal cortex and hippocampus form a recurrent network that informs many cognitive processes, including memory, planning, navigation, and imagination. Neural recordings from these regions reveal spatially organized population codes corresponding to external environments and abstract spaces. Aligning the former cognitive functionalities with the latter neural phenomena is a central challenge in understanding the entorhinal-hippocampal circuit (EHC). Disparate experiments demonstrate a surprising level of complexity and apparent disorder in the intricate spatiotemporal dynamics of sequential non-local hippocampal reactivations, which occur particularly, though not exclusively, during immobile pauses and rest. We review these phenomena with a particular focus on their apparent lack of physical simulative realism. These observations are then integrated within a theoretical framework and proposed neural circuit mechanisms that normatively characterize this neural complexity by conceiving different regimes of hippocampal microdynamics as neuromarkers of diverse cognitive computations.
Collapse
|
5
|
Deceuninck L, Kloosterman F. Disruption of awake sharp-wave ripples does not affect memorization of locations in repeated-acquisition spatial memory tasks. eLife 2024; 13:e84004. [PMID: 38530125 PMCID: PMC11018343 DOI: 10.7554/elife.84004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2022] [Accepted: 03/25/2024] [Indexed: 03/27/2024] Open
Abstract
Storing and accessing memories is required to successfully perform day-to-day tasks, for example for engaging in a meaningful conversation. Previous studies in both rodents and primates have correlated hippocampal cellular activity with behavioral expression of memory. A key role has been attributed to awake hippocampal replay - a sequential reactivation of neurons representing a trajectory through space. However, it is unclear if awake replay impacts immediate future behavior, gradually creates and stabilizes long-term memories over a long period of time (hours and longer), or enables the temporary memorization of relevant events at an intermediate time scale (seconds to minutes). In this study, we aimed to address the uncertainty around the timeframe of impact of awake replay by collecting causal evidence from behaving rats. We detected and disrupted sharp wave ripples (SWRs) - signatures of putative replay events - using electrical stimulation of the ventral hippocampal commissure in rats that were trained on three different spatial memory tasks. In each task, rats were required to memorize a new set of locations in each trial or each daily session. Interestingly, the rats performed equally well with or without SWR disruptions. These data suggest that awake SWRs - and potentially replay - does not affect the immediate behavior nor the temporary memorization of relevant events at a short timescale that are required to successfully perform the spatial tasks. Based on these results, we hypothesize that the impact of awake replay on memory and behavior is long-term and cumulative over time.
Collapse
Affiliation(s)
- Lies Deceuninck
- KU Leuven, Department of Physics and Astronomy, Soft Matter and BiophysicsHeverleeBelgium
- NERF-NeuroElectronics Research Flanders, Kloosterman LabHeverleeBelgium
| | - Fabian Kloosterman
- NERF-NeuroElectronics Research Flanders, Kloosterman LabHeverleeBelgium
- KU Leuven, Faculty of Psychology & Educational SciencesLeuvenBelgium
| |
Collapse
|
6
|
Calvin OL, Erickson MT, Walters CJ, Redish AD. Dorsal hippocampus represents locations to avoid as well as locations to approach during approach-avoidance conflict. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.03.10.584295. [PMID: 38559154 PMCID: PMC10979882 DOI: 10.1101/2024.03.10.584295] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/04/2024]
Abstract
Worrying about perceived threats is a hallmark of multiple psychological disorders including anxiety. This concern about future events is particularly important when an individual is faced with an approach-avoidance conflict. Potential goals to approach are known to be represented in the dorsal hippocampus during theta sweeps. Similarly, important non-local information is represented during hippocampal high synchrony events (HSEs), which are correlated with sharp-wave ripples (SWRs). It is likely that potential future threats may be similarly represented. We examined how threats and rewards were represented within the hippocampus during approach-avoidance conflicts in rats faced with a predator-like robot guarding a food reward. We found representations of the pseudo-predator during HSEs when hesitating in the nest, and during theta prior to retreating as the rats approached the pseudo-predator. After the first attack, we observed new place fields appearing at the location of the robot (not the location the rat was when attacked). The anxiolytic diazepam reduced anxiety-like behavior and altered hippocampal local field potentials, including reducing SWRs, suggesting that one potential mechanism of diazepam's actions may be through altered representations of imagined threat. These results suggest that hippocampal representation of potential threats could be an important mechanism that underlies worry and a potential target for anxiolytics.
Collapse
Affiliation(s)
- Olivia L. Calvin
- Department of Neuroscience, University of Minnesota, Minneapolis MN 55455
| | | | | | - A. David Redish
- Department of Neuroscience, University of Minnesota, Minneapolis MN 55455
| |
Collapse
|
7
|
Sagiv Y, Akam T, Witten IB, Daw ND. Prioritizing replay when future goals are unknown. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.02.29.582822. [PMID: 38496674 PMCID: PMC10942393 DOI: 10.1101/2024.02.29.582822] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/19/2024]
Abstract
Although hippocampal place cells replay nonlocal trajectories, the computational function of these events remains controversial. One hypothesis, formalized in a prominent reinforcement learning account, holds that replay plans routes to current goals. However, recent puzzling data appear to contradict this perspective by showing that replayed destinations lag current goals. These results may support an alternative hypothesis that replay updates route information to build a "cognitive map." Yet no similar theory exists to formalize this view, and it is unclear how such a map is represented or what role replay plays in computing it. We address these gaps by introducing a theory of replay that learns a map of routes to candidate goals, before reward is available or when its location may change. Our work extends the planning account to capture a general map-building function for replay, reconciling it with data, and revealing an unexpected relationship between the seemingly distinct hypotheses.
Collapse
Affiliation(s)
- Yotam Sagiv
- Princeton Neuroscience Institute, Princeton University, Princeton, New Jersey, USA
| | - Thomas Akam
- Department of Experimental Psychology, Oxford University, Oxford, UK
| | - Ilana B Witten
- Princeton Neuroscience Institute, Princeton University, Princeton, New Jersey, USA
| | - Nathaniel D Daw
- Princeton Neuroscience Institute, Princeton University, Princeton, New Jersey, USA
| |
Collapse
|
8
|
Lai AT, Espinosa G, Wink GE, Angeloni CF, Dombeck DA, MacIver MA. A robot-rodent interaction arena with adjustable spatial complexity for ethologically relevant behavioral studies. Cell Rep 2024; 43:113671. [PMID: 38280195 DOI: 10.1016/j.celrep.2023.113671] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2023] [Revised: 10/19/2023] [Accepted: 12/26/2023] [Indexed: 01/29/2024] Open
Abstract
Outside of the laboratory, animals behave in spaces where they can transition between open areas and coverage as they interact with others. Replicating these conditions in the laboratory can be difficult to control and record. This has led to a dominance of relatively simple, static behavioral paradigms that reduce the ethological relevance of behaviors and may alter the engagement of cognitive processes such as planning and decision-making. Therefore, we developed a method for controllable, repeatable interactions with others in a reconfigurable space. Mice navigate a large honeycomb lattice of adjustable obstacles as they interact with an autonomous robot coupled to their actions. We illustrate the system using the robot as a pseudo-predator, delivering airpuffs to the mice. The combination of obstacles and a mobile threat elicits a diverse set of behaviors, such as increased path diversity, peeking, and baiting, providing a method to explore ethologically relevant behaviors in the laboratory.
Collapse
Affiliation(s)
- Alexander T Lai
- Department of Biomedical Engineering, Technological Institute E311, Northwestern University, 2145 Sheridan Road, Evanston, IL 60208, USA
| | - German Espinosa
- Department of Computer Science, Northwestern University, Seeley Mudd 3219, 2233 Tech Drive, Evanston, IL 60208, USA
| | - Gabrielle E Wink
- Department of Mechanical Engineering, Technological Institute B224, Northwestern University, 2145 Sheridan Road, Evanston, IL 60208, USA
| | - Christopher F Angeloni
- Department of Neurobiology, Northwestern University, Hogan 2-160, 2205 Tech Drive, Evanston, IL 60208, USA
| | - Daniel A Dombeck
- Department of Neurobiology, Northwestern University, Hogan 2-160, 2205 Tech Drive, Evanston, IL 60208, USA.
| | - Malcolm A MacIver
- Department of Biomedical Engineering, Technological Institute E311, Northwestern University, 2145 Sheridan Road, Evanston, IL 60208, USA; Department of Computer Science, Northwestern University, Seeley Mudd 3219, 2233 Tech Drive, Evanston, IL 60208, USA; Department of Mechanical Engineering, Technological Institute B224, Northwestern University, 2145 Sheridan Road, Evanston, IL 60208, USA; Department of Neurobiology, Northwestern University, Hogan 2-160, 2205 Tech Drive, Evanston, IL 60208, USA.
| |
Collapse
|
9
|
Ahuja A, Rodriguez NY, Ashok AK, Serre T, Desrochers T, Sheinberg D. Monkeys engage in visual simulation to solve complex problems. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.02.21.581495. [PMID: 38464308 PMCID: PMC10925096 DOI: 10.1101/2024.02.21.581495] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/12/2024]
Abstract
Visual simulation - i.e., using internal reconstructions of the world to experience potential future versions of events that are not currently happening - is among the most sophisticated capacities of the human mind. But is this ability in fact uniquely human? To answer this question, we tested monkeys on a series of experiments involving the 'Planko' game, which we have previously used to evoke visual simulation in human participants. We found that monkeys were able to successfully play the game using a simulation strategy, predicting the trajectory of a ball through a field of planks while demonstrating a level of accuracy and behavioral signatures comparable to humans. Computational analyses further revealed that the monkeys' strategy while playing Planko aligned with a recurrent neural network (RNN) that approached the task using a spontaneously learned simulation strategy. Finally, we carried out awake functional magnetic resonance imaging while monkeys played Planko. We found activity in motion-sensitive regions of the monkey brain during hypothesized simulation periods, even without any perceived visual motion cues. This neural result closely mirrors previous findings from human research, suggesting a shared mechanism of visual simulation across species. In all, these findings challenge traditional views of animal cognition, proposing that nonhuman primates possess a complex cognitive landscape, capable of invoking imaginative and predictive mental experiences to solve complex everyday problems.
Collapse
Affiliation(s)
- Aarit Ahuja
- Department of Neuroscience, Brown University, Providence, RI, USA
- Exponent, Natick, MA, USA
| | | | - Alekh Karkada Ashok
- Department of Cognitive, Linguistic, and Psychological Science, Brown University, Providence, RI, USA
| | - Thomas Serre
- Department of Cognitive, Linguistic, and Psychological Science, Brown University, Providence, RI, USA
- Robert J. and Nancy D. Carney Institute for Brain Sciences, Brown University, Providence, RI, USA
| | - Theresa Desrochers
- Department of Neuroscience, Brown University, Providence, RI, USA
- Robert J. and Nancy D. Carney Institute for Brain Sciences, Brown University, Providence, RI, USA
- Department of Psychiatry and Human Behavior, Brown University, Providence, RI, USA
| | - David Sheinberg
- Department of Neuroscience, Brown University, Providence, RI, USA
- Robert J. and Nancy D. Carney Institute for Brain Sciences, Brown University, Providence, RI, USA
| |
Collapse
|
10
|
Sheridan CL, Lang S, Knappenberger M, Albers C, Loper R, Tillett B, Sanchez J, Wilcox A, Harrison T, Panoz-Brown D, Crystal JD. Replay of incidentally encoded episodic memories in the rat. Curr Biol 2024; 34:641-647.e5. [PMID: 38218186 DOI: 10.1016/j.cub.2023.12.043] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2023] [Revised: 04/03/2023] [Accepted: 12/13/2023] [Indexed: 01/15/2024]
Abstract
Although events are not always known to be important when they occur, people can remember details about such incidentally encoded information using episodic memory. Importantly, when information is explicitly encoded for use in an expected test of retention (as in most assessments in animals), it is possible that it is used to generate a planned action1,2,3; thus, the remembered action can occur without remembering the earlier episode. By contrast, when a test is unexpected, transforming information into an action plan is unlikely because the importance of the information and the nature of the test are not yet known. Thus, accurate performance in an unexpected test after incidental encoding documents episodic memory.1,2,3,4,5,6,7,8 Here, we present evidence that rats replay episodic memories of incidentally encoded information in an unexpected assessment of memory. In one task,9 rats reported the third-last item in an explicitly encoded list of trial-unique odors. In a second task,10 rats foraged in a radial maze in the absence of odors. On a critical test, rats foraged in the radial maze, but scented lids covered the food. Next, memory of the third-last odor was assessed. All participating rats correctly answered the unexpected question. These results suggest that rats encoded multiple pieces of putatively unimportant information, and later they replayed a stream of episodic memories when that information was needed to solve an unexpected problem. We propose that rats replay episodic memories of incidentally encoded information, which documents a critical aspect of human episodic memory in a non-human animal.
Collapse
Affiliation(s)
- Cassandra L Sheridan
- Department of Psychological and Brain Sciences, Indiana University, 1101 E 10(TH) ST, Bloomington, IN 47405-7007, USA
| | - Stephen Lang
- Department of Psychological and Brain Sciences, Indiana University, 1101 E 10(TH) ST, Bloomington, IN 47405-7007, USA
| | - Mya Knappenberger
- Department of Psychological and Brain Sciences, Indiana University, 1101 E 10(TH) ST, Bloomington, IN 47405-7007, USA
| | - Cami Albers
- Department of Psychological and Brain Sciences, Indiana University, 1101 E 10(TH) ST, Bloomington, IN 47405-7007, USA
| | - Ryleigh Loper
- Department of Psychological and Brain Sciences, Indiana University, 1101 E 10(TH) ST, Bloomington, IN 47405-7007, USA
| | - Baily Tillett
- Department of Psychological and Brain Sciences, Indiana University, 1101 E 10(TH) ST, Bloomington, IN 47405-7007, USA
| | - Jonah Sanchez
- Department of Psychological and Brain Sciences, Indiana University, 1101 E 10(TH) ST, Bloomington, IN 47405-7007, USA
| | - Alyssa Wilcox
- Department of Psychological and Brain Sciences, Indiana University, 1101 E 10(TH) ST, Bloomington, IN 47405-7007, USA
| | - Tess Harrison
- Department of Psychological and Brain Sciences, Indiana University, 1101 E 10(TH) ST, Bloomington, IN 47405-7007, USA
| | - Danielle Panoz-Brown
- Department of Psychological and Brain Sciences, Indiana University, 1101 E 10(TH) ST, Bloomington, IN 47405-7007, USA
| | - Jonathon D Crystal
- Department of Psychological and Brain Sciences, Indiana University, 1101 E 10(TH) ST, Bloomington, IN 47405-7007, USA.
| |
Collapse
|
11
|
Crombie KM, Azar A, Botsford C, Heilicher M, Jaeb M, Gruichich TS, Schomaker CM, Williams R, Stowe ZN, Dunsmoor JE, Cisler JM. Decoding context memories for threat in large-scale neural networks. Cereb Cortex 2024; 34:bhae018. [PMID: 38300181 PMCID: PMC10839849 DOI: 10.1093/cercor/bhae018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2023] [Revised: 01/08/2024] [Accepted: 01/10/2024] [Indexed: 02/02/2024] Open
Abstract
Humans are often tasked with determining the degree to which a given situation poses threat. Salient cues present during prior events help bring online memories for context, which plays an informative role in this process. However, it is relatively unknown whether and how individuals use features of the environment to retrieve context memories for threat, enabling accurate inferences about the current level of danger/threat (i.e. retrieve appropriate memory) when there is a degree of ambiguity surrounding the present context. We leveraged computational neuroscience approaches (i.e. independent component analysis and multivariate pattern analyses) to decode large-scale neural network activity patterns engaged during learning and inferring threat context during a novel functional magnetic resonance imaging task. Here, we report that individuals accurately infer threat contexts under ambiguous conditions through neural reinstatement of large-scale network activity patterns (specifically striatum, salience, and frontoparietal networks) that track the signal value of environmental cues, which, in turn, allows reinstatement of a mental representation, primarily within a ventral visual network, of the previously learned threat context. These results provide novel insight into distinct, but overlapping, neural mechanisms by which individuals may utilize prior learning to effectively make decisions about ambiguous threat-related contexts as they navigate the environment.
Collapse
Affiliation(s)
- Kevin M Crombie
- Department of Psychiatry and Behavioral Sciences, The University of Texas at Austin, 1601 Trinity Street, Building B, Austin, TX 78712, United States
- Department of Kinesiology, The University of Alabama, 620 Judy Bonner Drive, Box 870312, Tuscaloosa, AL 35487, United States
| | - Ameera Azar
- Department of Psychiatry and Behavioral Sciences, The University of Texas at Austin, 1601 Trinity Street, Building B, Austin, TX 78712, United States
| | - Chloe Botsford
- Department of Psychiatry, University of Wisconsin—Madison, 6001 Research Park Boulevard, Madison, WI 53719, United States
| | - Mickela Heilicher
- Department of Psychiatry, University of Wisconsin—Madison, 6001 Research Park Boulevard, Madison, WI 53719, United States
| | - Michael Jaeb
- Department of Psychiatry, University of Wisconsin—Madison, 6001 Research Park Boulevard, Madison, WI 53719, United States
| | - Tijana Sagorac Gruichich
- Department of Psychiatry, University of Wisconsin—Madison, 6001 Research Park Boulevard, Madison, WI 53719, United States
| | - Chloe M Schomaker
- Department of Psychiatry and Behavioral Sciences, The University of Texas at Austin, 1601 Trinity Street, Building B, Austin, TX 78712, United States
| | - Rachel Williams
- Department of Psychiatry, University of Wisconsin—Madison, 6001 Research Park Boulevard, Madison, WI 53719, United States
| | - Zachary N Stowe
- Department of Psychiatry, University of Wisconsin—Madison, 6001 Research Park Boulevard, Madison, WI 53719, United States
| | - Joseph E Dunsmoor
- Department of Psychiatry and Behavioral Sciences, The University of Texas at Austin, 1601 Trinity Street, Building B, Austin, TX 78712, United States
- Institute for Neuroscience, The University of Texas at Austin, Austin, TX 78712, United States
- Department of Neuroscience, The University of Texas at Austin, 1 University Station, Stop C7000, Austin, TX 78712, United States
| | - Josh M Cisler
- Department of Psychiatry and Behavioral Sciences, The University of Texas at Austin, 1601 Trinity Street, Building B, Austin, TX 78712, United States
- Institute for Early Life Adversity Research, The University of Texas at Austin Dell Medical School, 1601 Trinity Street, Building B, Austin, TX 78712, United States
| |
Collapse
|
12
|
Pochinok I, Stöber TM, Triesch J, Chini M, Hanganu-Opatz IL. A developmental increase of inhibition promotes the emergence of hippocampal ripples. Nat Commun 2024; 15:738. [PMID: 38272901 PMCID: PMC10810866 DOI: 10.1038/s41467-024-44983-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2023] [Accepted: 01/10/2024] [Indexed: 01/27/2024] Open
Abstract
Sharp wave-ripples (SPW-Rs) are a hippocampal network phenomenon critical for memory consolidation and planning. SPW-Rs have been extensively studied in the adult brain, yet their developmental trajectory is poorly understood. While SPWs have been recorded in rodents shortly after birth, the time point and mechanisms of ripple emergence are still unclear. Here, we combine in vivo electrophysiology with optogenetics and chemogenetics in 4 to 12-day-old mice to address this knowledge gap. We show that ripples are robustly detected and induced by light stimulation of channelrhodopsin-2-transfected CA1 pyramidal neurons only from postnatal day 10 onwards. Leveraging a spiking neural network model, we mechanistically link the maturation of inhibition and ripple emergence. We corroborate these findings by reducing ripple rate upon chemogenetic silencing of CA1 interneurons. Finally, we show that early SPW-Rs elicit a more robust prefrontal cortex response than SPWs lacking ripples. Thus, development of inhibition promotes ripples emergence.
Collapse
Affiliation(s)
- Irina Pochinok
- Institute of Developmental Neurophysiology, Center for Molecular Neurobiology (ZMNH), Hamburg Center of Neuroscience (HCNS), University Medical Center Hamburg-Eppendorf, 20251, Hamburg, Germany
| | - Tristan M Stöber
- Frankfurt Institute for Advanced Studies, 60438, Frankfurt am Main, Germany
| | - Jochen Triesch
- Frankfurt Institute for Advanced Studies, 60438, Frankfurt am Main, Germany
| | - Mattia Chini
- Institute of Developmental Neurophysiology, Center for Molecular Neurobiology (ZMNH), Hamburg Center of Neuroscience (HCNS), University Medical Center Hamburg-Eppendorf, 20251, Hamburg, Germany.
| | - Ileana L Hanganu-Opatz
- Institute of Developmental Neurophysiology, Center for Molecular Neurobiology (ZMNH), Hamburg Center of Neuroscience (HCNS), University Medical Center Hamburg-Eppendorf, 20251, Hamburg, Germany.
| |
Collapse
|
13
|
Nguyen ND, Lutas A, Amsalem O, Fernando J, Ahn AYE, Hakim R, Vergara J, McMahon J, Dimidschstein J, Sabatini BL, Andermann ML. Cortical reactivations predict future sensory responses. Nature 2024; 625:110-118. [PMID: 38093002 PMCID: PMC11014741 DOI: 10.1038/s41586-023-06810-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2022] [Accepted: 10/31/2023] [Indexed: 01/05/2024]
Abstract
Many theories of offline memory consolidation posit that the pattern of neurons activated during a salient sensory experience will be faithfully reactivated, thereby stabilizing the pattern1,2. However, sensory-evoked patterns are not stable but, instead, drift across repeated experiences3-6. Here, to investigate the relationship between reactivations and the drift of sensory representations, we imaged the calcium activity of thousands of excitatory neurons in the mouse lateral visual cortex. During the minute after a visual stimulus, we observed transient, stimulus-specific reactivations, often coupled with hippocampal sharp-wave ripples. Stimulus-specific reactivations were abolished by local cortical silencing during the preceding stimulus. Reactivations early in a session systematically differed from the pattern evoked by the previous stimulus-they were more similar to future stimulus response patterns, thereby predicting both within-day and across-day representational drift. In particular, neurons that participated proportionally more or less in early stimulus reactivations than in stimulus response patterns gradually increased or decreased their future stimulus responses, respectively. Indeed, we could accurately predict future changes in stimulus responses and the separation of responses to distinct stimuli using only the rate and content of reactivations. Thus, reactivations may contribute to a gradual drift and separation in sensory cortical response patterns, thereby enhancing sensory discrimination7.
Collapse
Affiliation(s)
- Nghia D Nguyen
- Program in Neuroscience, Harvard University, Boston, MA, USA
| | - Andrew Lutas
- Division of Endocrinology, Department of Medicine, Beth Israel Deaconess Medical Center, Boston, MA, USA
- Diabetes, Endocrinology and Obesity Branch, National Institutes of Diabetes and Digestive and Kidney Diseases, National Institutes of Health, Bethesda, MD, USA
| | - Oren Amsalem
- Division of Endocrinology, Department of Medicine, Beth Israel Deaconess Medical Center, Boston, MA, USA
| | - Jesseba Fernando
- Division of Endocrinology, Department of Medicine, Beth Israel Deaconess Medical Center, Boston, MA, USA
| | - Andy Young-Eon Ahn
- Division of Endocrinology, Department of Medicine, Beth Israel Deaconess Medical Center, Boston, MA, USA
| | - Richard Hakim
- Program in Neuroscience, Harvard University, Boston, MA, USA
- Howard Hughes Medical Institute, Department of Neurobiology, Harvard Medical School, Boston, MA, USA
| | - Josselyn Vergara
- Stanley Center for Psychiatric Research, Broad Institute of Harvard and MIT, Cambridge, MA, USA
| | - Justin McMahon
- Stanley Center for Psychiatric Research, Broad Institute of Harvard and MIT, Cambridge, MA, USA
| | - Jordane Dimidschstein
- Stanley Center for Psychiatric Research, Broad Institute of Harvard and MIT, Cambridge, MA, USA
| | - Bernardo L Sabatini
- Program in Neuroscience, Harvard University, Boston, MA, USA
- Howard Hughes Medical Institute, Department of Neurobiology, Harvard Medical School, Boston, MA, USA
| | - Mark L Andermann
- Program in Neuroscience, Harvard University, Boston, MA, USA.
- Division of Endocrinology, Department of Medicine, Beth Israel Deaconess Medical Center, Boston, MA, USA.
- Department of Neurobiology, Harvard Medical School, Boston, MA, USA.
| |
Collapse
|
14
|
Ohki T, Kunii N, Chao ZC. Efficient, continual, and generalized learning in the brain - neural mechanism of Mental Schema 2.0. Rev Neurosci 2023; 34:839-868. [PMID: 36960579 DOI: 10.1515/revneuro-2022-0137] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2022] [Accepted: 02/26/2023] [Indexed: 03/25/2023]
Abstract
There has been tremendous progress in artificial neural networks (ANNs) over the past decade; however, the gap between ANNs and the biological brain as a learning device remains large. With the goal of closing this gap, this paper reviews learning mechanisms in the brain by focusing on three important issues in ANN research: efficiency, continuity, and generalization. We first discuss the method by which the brain utilizes a variety of self-organizing mechanisms to maximize learning efficiency, with a focus on the role of spontaneous activity of the brain in shaping synaptic connections to facilitate spatiotemporal learning and numerical processing. Then, we examined the neuronal mechanisms that enable lifelong continual learning, with a focus on memory replay during sleep and its implementation in brain-inspired ANNs. Finally, we explored the method by which the brain generalizes learned knowledge in new situations, particularly from the mathematical generalization perspective of topology. Besides a systematic comparison in learning mechanisms between the brain and ANNs, we propose "Mental Schema 2.0," a new computational property underlying the brain's unique learning ability that can be implemented in ANNs.
Collapse
Affiliation(s)
- Takefumi Ohki
- International Research Center for Neurointelligence (WPI-IRCN), The University of Tokyo Institutes for Advanced Study, The University of Tokyo, Tokyo 113-0033, Japan
| | - Naoto Kunii
- Department of Neurosurgery, The University of Tokyo, Tokyo 113-0033, Japan
| | - Zenas C Chao
- International Research Center for Neurointelligence (WPI-IRCN), The University of Tokyo Institutes for Advanced Study, The University of Tokyo, Tokyo 113-0033, Japan
| |
Collapse
|
15
|
Huelin Gorriz M, Takigawa M, Bendor D. The role of experience in prioritizing hippocampal replay. Nat Commun 2023; 14:8157. [PMID: 38071221 PMCID: PMC10710481 DOI: 10.1038/s41467-023-43939-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2023] [Accepted: 11/24/2023] [Indexed: 12/18/2023] Open
Abstract
During sleep, recent memories are replayed by the hippocampus, leading to their consolidation, with a higher priority given to salient experiences. To examine the role of replay in the selective strengthening of memories, we recorded large ensembles of hippocampal place cells while male rats ran repeated spatial trajectories on two linear tracks, differing in either their familiarity or number of laps run. We observed that during sleep, the rate of replay events for a given track increased proportionally with the number of spatial trajectories run by the animal. In contrast, the rate of sleep replay events decreased if the animal was more familiar with the track. Furthermore, we find that the cumulative number of awake replay events occurring during behavior, influenced by both the novelty and duration of an experience, predicts which memories are prioritized for sleep replay, providing a more parsimonious neural correlate for the selective strengthening of memories.
Collapse
Affiliation(s)
- Marta Huelin Gorriz
- Institute of Behavioural Neuroscience (IBN), University College London (UCL), London, WC1H 0AP, UK
| | - Masahiro Takigawa
- Institute of Behavioural Neuroscience (IBN), University College London (UCL), London, WC1H 0AP, UK
| | - Daniel Bendor
- Institute of Behavioural Neuroscience (IBN), University College London (UCL), London, WC1H 0AP, UK.
| |
Collapse
|
16
|
Jeong H, Namboodiri VMK, Jung MW, Andermann ML. Sensory cortical ensembles exhibit differential coupling to ripples in distinct hippocampal subregions. Curr Biol 2023; 33:5185-5198.e4. [PMID: 37995696 PMCID: PMC10842729 DOI: 10.1016/j.cub.2023.10.073] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2023] [Revised: 08/29/2023] [Accepted: 10/31/2023] [Indexed: 11/25/2023]
Abstract
Cortical neurons activated during recent experiences often reactivate with dorsal hippocampal CA1 ripples during subsequent rest. Less is known about cortical interactions with intermediate hippocampal CA1, whose connectivity, functions, and ripple events differ from dorsal CA1. We identified three clusters of putative excitatory neurons in mouse visual cortex that are preferentially excited together with either dorsal or intermediate CA1 ripples or suppressed before both ripples. Neurons in each cluster were evenly distributed across primary and higher visual cortices and co-active even in the absence of ripples. These ensembles exhibited similar visual responses but different coupling to thalamus and pupil-indexed arousal. We observed a consistent activity sequence preceding and predicting ripples: (1) suppression of ripple-suppressed cortical neurons, (2) thalamic silence, and (3) activation of intermediate CA1-ripple-activated cortical neurons. We propose that coordinated dynamics of these ensembles relay visual experiences to distinct hippocampal subregions for incorporation into different cognitive maps.
Collapse
Affiliation(s)
- Huijeong Jeong
- Department of Neurology, University of California, San Francisco, 1651 4th Street, San Francisco, CA 94158, USA; Center for Synaptic Brain Dysfunctions, Institute for Basic Science, 291 Daehak-ro, Daejeon 34141, Republic of Korea; Department of Biological Sciences, Korea Advanced Institute of Science and Technology, 291 Daehak-ro, Daejeon 34141, Republic of Korea
| | - Vijay Mohan K Namboodiri
- Department of Neurology, University of California, San Francisco, 1651 4th Street, San Francisco, CA 94158, USA; Neuroscience Graduate Program, University of California, San Francisco, 1651 4th Street, San Francisco, CA 94158, USA; Weill Institute for Neuroscience, Kavli Institute for Fundamental Neuroscience, Center for Integrative Neuroscience, University of California, San Francisco, 1651 4th Street, San Francisco, CA 94158, USA.
| | - Min Whan Jung
- Center for Synaptic Brain Dysfunctions, Institute for Basic Science, 291 Daehak-ro, Daejeon 34141, Republic of Korea; Department of Biological Sciences, Korea Advanced Institute of Science and Technology, 291 Daehak-ro, Daejeon 34141, Republic of Korea.
| | - Mark L Andermann
- Division of Endocrinology, Metabolism, and Diabetes, Beth Israel Deaconess Medical Center, Harvard Medical School, 330 Brookline Avenue, Boston, MA 02215, USA; Department of Neurobiology, Harvard Medical School, 220 Longwood Avenue, Boston, MA 02115, USA.
| |
Collapse
|
17
|
Kim JZ, Larsen B, Parkes L. Shaping dynamical neural computations using spatiotemporal constraints. ARXIV 2023:arXiv:2311.15572v1. [PMID: 38076517 PMCID: PMC10705584] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/20/2023]
Abstract
Dynamics play a critical role in computation. The principled evolution of states over time enables both biological and artificial networks to represent and integrate information to make decisions. In the past few decades, significant multidisciplinary progress has been made in bridging the gap between how we understand biological versus artificial computation, including how insights gained from one can translate to the other. Research has revealed that neurobiology is a key determinant of brain network architecture, which gives rise to spatiotemporally constrained patterns of activity that underlie computation. Here, we discuss how neural systems use dynamics for computation, and claim that the biological constraints that shape brain networks may be leveraged to improve the implementation of artificial neural networks. To formalize this discussion, we consider a natural artificial analog of the brain that has been used extensively to model neural computation: the recurrent neural network (RNN). In both the brain and the RNN, we emphasize the common computational substrate atop which dynamics occur-the connectivity between neurons-and we explore the unique computational advantages offered by biophysical constraints such as resource efficiency, spatial embedding, and neurodevelopment.
Collapse
Affiliation(s)
- Jason Z. Kim
- Department of Physics, Cornell University, Ithaca, NY 14853, USA
| | - Bart Larsen
- Department of Pediatrics, Masonic Institute for the Developing Brain, University of Minnesota
| | - Linden Parkes
- Department of Psychiatry, Rutgers University, Piscataway, NJ 08854, USA
| |
Collapse
|
18
|
Varma MM, Yu R. A spontaneous neural replay account for involuntary autobiographical memories and déjà vu experiences. Behav Brain Sci 2023; 46:e380. [PMID: 37961766 DOI: 10.1017/s0140525x23000109] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2023]
Abstract
Barzykowski and Moulin argue both involuntary autobiographical memories and déjà vu experiences rely on the same involuntary memory retrieval processes but their underlying neurological basis remains unclear. We propose spontaneous neural replay in the default mode network (DMN) and hippocampus as the basis for involuntary autobiographical memories, whereas for déjà vu experiences such transient activation is limited to the DMN.
Collapse
Affiliation(s)
- Mohith M Varma
- Department of Management, School of Business, Hong Kong Baptist University, Hong Kong, S.A.R. China
| | - Rongjun Yu
- Department of Management, School of Business, Hong Kong Baptist University, Hong Kong, S.A.R. China
| |
Collapse
|
19
|
Santos-Pata D, Barry C, Ólafsdóttir HF. Theta-band phase locking during encoding leads to coordinated entorhinal-hippocampal replay. Curr Biol 2023; 33:4570-4581.e5. [PMID: 37776862 PMCID: PMC10629661 DOI: 10.1016/j.cub.2023.09.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2023] [Revised: 08/06/2023] [Accepted: 09/05/2023] [Indexed: 10/02/2023]
Abstract
Precisely timed interactions between hippocampal and cortical neurons during replay epochs are thought to support learning. Indeed, research has shown that replay is associated with heightened hippocampal-cortical synchrony. Yet many caveats remain in our understanding. Namely, it remains unclear how this offline synchrony comes about, whether it is specific to particular behavioral states, and how-if at all-it relates to learning. In this study, we sought to address these questions by analyzing coordination between CA1 cells and neurons of the deep layers of the medial entorhinal cortex (dMEC) while rats learned a novel spatial task. During movement, we found a subset of dMEC cells that were particularly locked to hippocampal LFP theta-band oscillations and that were preferentially coordinated with hippocampal replay during offline periods. Further, dMEC synchrony with CA1 replay peaked ∼10 ms after replay initiation in CA1, suggesting that the distributed replay reflects extra-hippocampal information propagation and is specific to "offline" periods. Finally, theta-modulated dMEC cells showed a striking experience-dependent increase in synchronization with hippocampal replay trajectories, mirroring the animals' acquisition of the novel task and coupling to the hippocampal local field. Together, these findings provide strong support for the hypothesis that synergistic hippocampal-cortical replay supports learning and highlights phase locking to hippocampal theta oscillations as a potential mechanism by which such cross-structural synchrony comes about.
Collapse
Affiliation(s)
- Diogo Santos-Pata
- Division of Natural and Applied Sciences, Duke Kunshan University, Duke Institute for Brain Sciences, Kunshan 215316, Jiangsu, China
| | - Caswell Barry
- Research Department of Cell and Developmental Biology, University College London, London WC1E 7JE, UK
| | - H Freyja Ólafsdóttir
- Research Department of Cell and Developmental Biology, University College London, London WC1E 7JE, UK; Donders Institute for Brain, Cognition & Behaviour, Radboud Universiteit, 6525 XZ Nijmegen, the Netherlands.
| |
Collapse
|
20
|
Prince SM, Yassine TA, Katragadda N, Roberts TC, Singer AC. New information triggers prospective codes to adapt for flexible navigation. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.10.31.564814. [PMID: 37961524 PMCID: PMC10634986 DOI: 10.1101/2023.10.31.564814] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/15/2023]
Abstract
Navigating a dynamic world requires rapidly updating choices by integrating past experiences with new information. In hippocampus and prefrontal cortex, neural activity representing future goals is theorized to support planning. However, it remains unknown how prospective goal representations incorporate new, pivotal information. Accordingly, we designed a novel task that precisely introduces new information using virtual reality, and we recorded neural activity as mice flexibly adapted their planned destinations. We found that new information triggered increased hippocampal prospective representations of both possible goals; while in prefrontal cortex, new information caused prospective representations of choices to rapidly shift to the new choice. When mice did not flexibly adapt, prefrontal choice codes failed to switch, despite relatively intact hippocampal goal representations. Prospective code updating depended on the commitment to the initial choice and degree of adaptation needed. Thus, we show how prospective codes update with new information to flexibly adapt ongoing navigational plans.
Collapse
Affiliation(s)
- Stephanie M. Prince
- Coulter Department of Biomedical Engineering, Emory University and Georgia Institute of Technology, Atlanta, GA, 30332, United States
| | - Teema A. Yassine
- Coulter Department of Biomedical Engineering, Emory University and Georgia Institute of Technology, Atlanta, GA, 30332, United States
| | - Navya Katragadda
- Coulter Department of Biomedical Engineering, Emory University and Georgia Institute of Technology, Atlanta, GA, 30332, United States
| | - Tyler C. Roberts
- Coulter Department of Biomedical Engineering, Emory University and Georgia Institute of Technology, Atlanta, GA, 30332, United States
| | - Annabelle C. Singer
- Coulter Department of Biomedical Engineering, Emory University and Georgia Institute of Technology, Atlanta, GA, 30332, United States
| |
Collapse
|
21
|
Liang S, Huang L, Zhan S, Zeng Y, Zhang Q, Zhang Y, Wang X, Peng L, Lin B, Xu H. Altered morphological characteristics and structural covariance connectivity associated with verbal working memory performance in ADHD children. Br J Radiol 2023; 96:20230409. [PMID: 37750842 PMCID: PMC10607391 DOI: 10.1259/bjr.20230409] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2023] [Revised: 07/24/2023] [Accepted: 08/10/2023] [Indexed: 09/27/2023] Open
Abstract
OBJECTIVES Deficits in verbal working memory (VWM) observed in attention deficit hyperactivity disorder (ADHD) children can persist into adulthood. Although previous studies have identified brain regions that are activated during VWM tasks, the neural mechanisms underlying the relationship between VWM deficits remain unclear. The objective of this study was to investigate the structural covariance network connectivity and brain morphology changes that are associated with VWM performance in ADHD children. METHODS For this study, we selected 26 ADHD children and 26 healthy control (HC) participants. Participants were instructed to perform an n-back VWM task and their accuracy and response times were subsequently recorded. This research utilised voxel-based morphometry to measure the grey matter (GM) volume and conducted structural covariance connectivity network analysis to explore the changes of brain in ADHD. RESULTS Voxel-based morphometry analysis showed that lower GM volume in the right cerebellum lobule VI and the left parahippocampal gryus in ADHD children. Moreover, a positive correlation was found between the GM volume in the right cerebellum lobule VI and the accuracy of 2-back VWM task with verbal, small reward, and delayed feedback (VSD). Structural covariance network analysis found decreased structural connectivity between right cerebellum lobule VI and right precentral gyrus, right postcentral gyrus, left paracentral lobule, right superior parietal gyrus, and left hippocampus in ADHD children. CONCLUSIONS The low GM volume and altered structural covariance connectivity in the right cerebellum lobule VI might potentially affect VWM performance in ADHD children. ADVANCES IN KNOWLEDGE The innovation of this study lies in its more focused discussion on the morphological characteristics and structural covariance connectivity of VWM deficits in ADHD children, and the innovative finding of a positive correlation between grey matter volume in the right cerebellum lobule VI and accuracy in completing the 2-back VWM task with verbal instructions, small reward, and delayed feedback (VSD). This expands upon previous research by elucidating the specific brain structures involved in VWM deficits in ADHD children and highlights the potential importance of the cerebellum in this cognitive process. Overall, these innovative findings advance our understanding of the neural basis of ADHD and may have important implications for the development of targeted interventions for VWM deficits.
Collapse
Affiliation(s)
| | - Li Huang
- College of Rehabilitation Medicine, Fujian University of Traditional Chinese Medicine, Fuzhou, China
| | - Shiqi Zhan
- College of Rehabilitation Medicine, Fujian University of Traditional Chinese Medicine, Fuzhou, China
| | - Yi Zeng
- College of Rehabilitation Medicine, Fujian University of Traditional Chinese Medicine, Fuzhou, China
| | - Qingqing Zhang
- College of Rehabilitation Medicine, Fujian University of Traditional Chinese Medicine, Fuzhou, China
| | - Yusi Zhang
- College of Rehabilitation Medicine, Fujian University of Traditional Chinese Medicine, Fuzhou, China
| | - Xiuxiu Wang
- College of Rehabilitation Medicine, Fujian University of Traditional Chinese Medicine, Fuzhou, China
| | - Lixin Peng
- College of Rehabilitation Medicine, Fujian University of Traditional Chinese Medicine, Fuzhou, China
| | - Bohong Lin
- College of Rehabilitation Medicine, Fujian University of Traditional Chinese Medicine, Fuzhou, China
| | - Hui Xu
- School of Mental Health, Wenzhou Medical University, Wenzhou, China
| |
Collapse
|
22
|
Liu C, Todorova R, Tang W, Oliva A, Fernandez-Ruiz A. Associative and predictive hippocampal codes support memory-guided behaviors. Science 2023; 382:eadi8237. [PMID: 37856604 PMCID: PMC10894649 DOI: 10.1126/science.adi8237] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2023] [Accepted: 08/21/2023] [Indexed: 10/21/2023]
Abstract
Episodic memory involves learning and recalling associations between items and their spatiotemporal context. Those memories can be further used to generate internal models of the world that enable predictions to be made. The mechanisms that support these associative and predictive aspects of memory are not yet understood. In this study, we used an optogenetic manipulation to perturb the sequential structure, but not global network dynamics, of place cells as rats traversed specific spatial trajectories. This perturbation abolished replay of those trajectories and the development of predictive representations, leading to impaired learning of new optimal trajectories during memory-guided navigation. However, place cell assembly reactivation and reward-context associative learning were unaffected. Our results show a mechanistic dissociation between two complementary hippocampal codes: an associative code (through coactivity) and a predictive code (through sequences).
Collapse
Affiliation(s)
| | | | - Wenbo Tang
- Department of Neurobiology and Behavior, Cornell University, Ithaca, NY, USA
| | - Azahara Oliva
- Department of Neurobiology and Behavior, Cornell University, Ithaca, NY, USA
| | | |
Collapse
|
23
|
Parra-Barrero E, Vijayabaskaran S, Seabrook E, Wiskott L, Cheng S. A map of spatial navigation for neuroscience. Neurosci Biobehav Rev 2023; 152:105200. [PMID: 37178943 DOI: 10.1016/j.neubiorev.2023.105200] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2023] [Revised: 04/13/2023] [Accepted: 04/24/2023] [Indexed: 05/15/2023]
Abstract
Spatial navigation has received much attention from neuroscientists, leading to the identification of key brain areas and the discovery of numerous spatially selective cells. Despite this progress, our understanding of how the pieces fit together to drive behavior is generally lacking. We argue that this is partly caused by insufficient communication between behavioral and neuroscientific researchers. This has led the latter to under-appreciate the relevance and complexity of spatial behavior, and to focus too narrowly on characterizing neural representations of space-disconnected from the computations these representations are meant to enable. We therefore propose a taxonomy of navigation processes in mammals that can serve as a common framework for structuring and facilitating interdisciplinary research in the field. Using the taxonomy as a guide, we review behavioral and neural studies of spatial navigation. In doing so, we validate the taxonomy and showcase its usefulness in identifying potential issues with common experimental approaches, designing experiments that adequately target particular behaviors, correctly interpreting neural activity, and pointing to new avenues of research.
Collapse
Affiliation(s)
- Eloy Parra-Barrero
- Institute for Neural Computation, Faculty of Computer Science, Ruhr University Bochum, Bochum, Germany; International Graduate School of Neuroscience, Ruhr University Bochum, Bochum, Germany
| | - Sandhiya Vijayabaskaran
- Institute for Neural Computation, Faculty of Computer Science, Ruhr University Bochum, Bochum, Germany
| | - Eddie Seabrook
- Institute for Neural Computation, Faculty of Computer Science, Ruhr University Bochum, Bochum, Germany
| | - Laurenz Wiskott
- Institute for Neural Computation, Faculty of Computer Science, Ruhr University Bochum, Bochum, Germany; International Graduate School of Neuroscience, Ruhr University Bochum, Bochum, Germany
| | - Sen Cheng
- Institute for Neural Computation, Faculty of Computer Science, Ruhr University Bochum, Bochum, Germany; International Graduate School of Neuroscience, Ruhr University Bochum, Bochum, Germany.
| |
Collapse
|
24
|
den Bakker H, Van Dijck M, Sun JJ, Kloosterman F. Sharp-wave-ripple-associated activity in the medial prefrontal cortex supports spatial rule switching. Cell Rep 2023; 42:112959. [PMID: 37590137 DOI: 10.1016/j.celrep.2023.112959] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2022] [Revised: 06/22/2023] [Accepted: 07/24/2023] [Indexed: 08/19/2023] Open
Abstract
Previous studies have highlighted an important role for hippocampal sharp-wave ripples in spatial alternation learning, as well as in modulating activity in the medial prefrontal cortex (mPFC). However, the direct influence of hippocampal sharp-wave ripples on mPFC activity during spatial alternation learning has not been investigated. Here, we train Long Evans rats on a three-arm radial maze to perform a sequence of alternations. Three alternation sequences needed to be learned, and while learning a sequence, the activity in the mPFC was inhibited either directly following sharp-wave ripples in the hippocampus (on-time condition) or with a randomized delay (delayed condition). In the on-time condition, the behavioral performance is significantly worse compared to the same animals in the delayed inhibition condition, as measured by a lower correct alternation performance and more perseverative behavior. This indicates that the activity in the mPFC directly following hippocampal sharp-wave ripples is necessary for spatial rule switching.
Collapse
Affiliation(s)
- Hanna den Bakker
- Neuro-Electronics Research Flanders, Leuven, Belgium; Brain & Cognition, KU Leuven, Leuven, Belgium
| | - Marie Van Dijck
- Neuro-Electronics Research Flanders, Leuven, Belgium; Department of Chemistry, KU Leuven, Leuven, Belgium
| | - Jyh-Jang Sun
- Neuro-Electronics Research Flanders, Leuven, Belgium
| | - Fabian Kloosterman
- Neuro-Electronics Research Flanders, Leuven, Belgium; Brain & Cognition, KU Leuven, Leuven, Belgium.
| |
Collapse
|
25
|
Zaki Y, Pennington ZT, Morales-Rodriguez D, Francisco TR, LaBanca AR, Dong Z, Lamsifer S, Segura SC, Chen HT, Wick ZC, Silva AJ, van der Meer M, Shuman T, Fenton A, Rajan K, Cai DJ. Aversive experience drives offline ensemble reactivation to link memories across days. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.03.13.532469. [PMID: 36993254 PMCID: PMC10054942 DOI: 10.1101/2023.03.13.532469] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 05/31/2023]
Abstract
Memories are encoded in neural ensembles during learning and stabilized by post-learning reactivation. Integrating recent experiences into existing memories ensures that memories contain the most recently available information, but how the brain accomplishes this critical process remains unknown. Here we show that in mice, a strong aversive experience drives the offline ensemble reactivation of not only the recent aversive memory but also a neutral memory formed two days prior, linking the fear from the recent aversive memory to the previous neutral memory. We find that fear specifically links retrospectively, but not prospectively, to neutral memories across days. Consistent with prior studies, we find reactivation of the recent aversive memory ensemble during the offline period following learning. However, a strong aversive experience also increases co-reactivation of the aversive and neutral memory ensembles during the offline period. Finally, the expression of fear in the neutral context is associated with reactivation of the shared ensemble between the aversive and neutral memories. Taken together, these results demonstrate that strong aversive experience can drive retrospective memory-linking through the offline co-reactivation of recent memory ensembles with memory ensembles formed days prior, providing a neural mechanism by which memories can be integrated across days.
Collapse
Affiliation(s)
- Yosif Zaki
- Nash Department of Neuroscience, Icahn School of Medicine at Mount Sinai, New York, NY, 10029
| | - Zachary T. Pennington
- Nash Department of Neuroscience, Icahn School of Medicine at Mount Sinai, New York, NY, 10029
| | | | - Taylor R. Francisco
- Nash Department of Neuroscience, Icahn School of Medicine at Mount Sinai, New York, NY, 10029
| | - Alexa R. LaBanca
- Nash Department of Neuroscience, Icahn School of Medicine at Mount Sinai, New York, NY, 10029
| | - Zhe Dong
- Nash Department of Neuroscience, Icahn School of Medicine at Mount Sinai, New York, NY, 10029
| | - Sophia Lamsifer
- Nash Department of Neuroscience, Icahn School of Medicine at Mount Sinai, New York, NY, 10029
| | - Simón Carrillo Segura
- Graduate Program in Mechanical and Aerospace Engineering, Tandon School of Engineering, New York University, Brooklyn, NY, 11201
| | - Hung-Tu Chen
- Department of Psychological & Brain Sciences, Dartmouth College, Hanover, NH, 03755
| | - Zoé Christenson Wick
- Nash Department of Neuroscience, Icahn School of Medicine at Mount Sinai, New York, NY, 10029
| | - Alcino J. Silva
- Department of Neurobiology, Psychiatry & Biobehavioral Sciences, and Psychology, Integrative Center for Learning and Memory, Brain Research Institute, UCLA, Los Angeles, CA 90095
| | | | - Tristan Shuman
- Nash Department of Neuroscience, Icahn School of Medicine at Mount Sinai, New York, NY, 10029
| | - André Fenton
- Center for Neural Science, New York University, New York, NY, 10003
- Neuroscience Institute at the NYU Langone Medical Center, New York, NY, 10016
| | - Kanaka Rajan
- Nash Department of Neuroscience, Icahn School of Medicine at Mount Sinai, New York, NY, 10029
| | - Denise J. Cai
- Nash Department of Neuroscience, Icahn School of Medicine at Mount Sinai, New York, NY, 10029
| |
Collapse
|
26
|
Milstein AD, Tran S, Ng G, Soltesz I. Offline memory replay in recurrent neuronal networks emerges from constraints on online dynamics. J Physiol 2023; 601:3241-3264. [PMID: 35907087 PMCID: PMC9885000 DOI: 10.1113/jp283216] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2022] [Accepted: 07/22/2022] [Indexed: 02/01/2023] Open
Abstract
During spatial exploration, neural circuits in the hippocampus store memories of sequences of sensory events encountered in the environment. When sensory information is absent during 'offline' resting periods, brief neuronal population bursts can 'replay' sequences of activity that resemble bouts of sensory experience. These sequences can occur in either forward or reverse order, and can even include spatial trajectories that have not been experienced, but are consistent with the topology of the environment. The neural circuit mechanisms underlying this variable and flexible sequence generation are unknown. Here we demonstrate in a recurrent spiking network model of hippocampal area CA3 that experimental constraints on network dynamics such as population sparsity, stimulus selectivity, rhythmicity and spike rate adaptation, as well as associative synaptic connectivity, enable additional emergent properties, including variable offline memory replay. In an online stimulus-driven state, we observed the emergence of neuronal sequences that swept from representations of past to future stimuli on the timescale of the theta rhythm. In an offline state driven only by noise, the network generated both forward and reverse neuronal sequences, and recapitulated the experimental observation that offline memory replay events tend to include salient locations like the site of a reward. These results demonstrate that biological constraints on the dynamics of recurrent neural circuits are sufficient to enable memories of sensory events stored in the strengths of synaptic connections to be flexibly read out during rest and sleep, which is thought to be important for memory consolidation and planning of future behaviour. KEY POINTS: A recurrent spiking network model of hippocampal area CA3 was optimized to recapitulate experimentally observed network dynamics during simulated spatial exploration. During simulated offline rest, the network exhibited the emergent property of generating flexible forward, reverse and mixed direction memory replay events. Network perturbations and analysis of model diversity and degeneracy identified associative synaptic connectivity and key features of network dynamics as important for offline sequence generation. Network simulations demonstrate that population over-representation of salient positions like the site of reward results in biased memory replay.
Collapse
Affiliation(s)
- Aaron D. Milstein
- Department of Neurosurgery, Stanford University School of Medicine, Stanford CA
- Department of Neuroscience and Cell Biology, Robert Wood Johnson Medical School and Center for Advanced Biotechnology and Medicine, Rutgers University, Piscataway, NJ
| | - Sarah Tran
- Department of Neurosurgery, Stanford University School of Medicine, Stanford CA
| | - Grace Ng
- Department of Neurosurgery, Stanford University School of Medicine, Stanford CA
| | - Ivan Soltesz
- Department of Neurosurgery, Stanford University School of Medicine, Stanford CA
| |
Collapse
|
27
|
Donato F, Xu Schwartzlose A, Viana Mendes RA. How Do You Build a Cognitive Map? The Development of Circuits and Computations for the Representation of Space in the Brain. Annu Rev Neurosci 2023; 46:281-299. [PMID: 37428607 DOI: 10.1146/annurev-neuro-090922-010618] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/12/2023]
Abstract
In mammals, the activity of neurons in the entorhinal-hippocampal network is modulated by the animal's position and its movement through space. At multiple stages of this distributed circuit, distinct populations of neurons can represent a rich repertoire of navigation-related variables like the animal's location, the speed and direction of its movements, or the presence of borders and objects. Working together, spatially tuned neurons give rise to an internal representation of space, a cognitive map that supports an animal's ability to navigate the world and to encode and consolidate memories from experience. The mechanisms by which, during development, the brain acquires the ability to create an internal representation of space are just beginning to be elucidated. In this review, we examine recent work that has begun to investigate the ontogeny of circuitry, firing patterns, and computations underpinning the representation of space in the mammalian brain.
Collapse
Affiliation(s)
- Flavio Donato
- Biozentrum, University of Basel, Basel, Switzerland;
| | | | | |
Collapse
|
28
|
Quigley LD, Pendry R, Mendoza ML, Pfeiffer BE, Volk LJ. Experience alters hippocampal and cortical network communication via a KIBRA-dependent mechanism. Cell Rep 2023; 42:112662. [PMID: 37347662 PMCID: PMC10592482 DOI: 10.1016/j.celrep.2023.112662] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2022] [Revised: 04/11/2023] [Accepted: 06/01/2023] [Indexed: 06/24/2023] Open
Abstract
Synaptic plasticity is hypothesized to underlie "replay" of salient experience during hippocampal sharp-wave/ripple (SWR)-based ensemble activity and to facilitate systems-level memory consolidation coordinated by SWRs and cortical sleep spindles. It remains unclear how molecular changes at synapses contribute to experience-induced modification of network function. The synaptic protein KIBRA regulates plasticity and memory. To determine the impact of KIBRA-regulated plasticity on circuit dynamics, we recorded in vivo neural activity from wild-type (WT) mice and littermates lacking KIBRA and examined circuit function before, during, and after novel experience. In WT mice, experience altered population activity and oscillatory dynamics in a manner consistent with incorporation of new information content in replay and enhanced hippocampal-cortical communication. While baseline SWR features were normal in KIBRA conditional knockout (cKO) mice, experience-dependent alterations in SWRs were absent. Furthermore, intra-hippocampal and hippocampal-cortical communication during SWRs was disrupted following KIBRA deletion. These results indicate molecular mechanisms that underlie network-level adaptations to experience.
Collapse
Affiliation(s)
- Lilyana D Quigley
- Neuroscience Graduate Program, UT Southwestern Medical Center, Dallas, TX 75390, USA; Department of Neuroscience, UT Southwestern Medical Center, Dallas, TX 75390, USA
| | - Robert Pendry
- Neuroscience Graduate Program, UT Southwestern Medical Center, Dallas, TX 75390, USA; Department of Neuroscience, UT Southwestern Medical Center, Dallas, TX 75390, USA
| | - Matthew L Mendoza
- Neuroscience Graduate Program, UT Southwestern Medical Center, Dallas, TX 75390, USA; Department of Neuroscience, UT Southwestern Medical Center, Dallas, TX 75390, USA
| | - Brad E Pfeiffer
- Department of Neuroscience, UT Southwestern Medical Center, Dallas, TX 75390, USA; Peter O' Donnell Jr. Brain Institute, UT Southwestern Medical Center, Dallas, TX 75390, USA
| | - Lenora J Volk
- Department of Neuroscience, UT Southwestern Medical Center, Dallas, TX 75390, USA; Department of Psychiatry, UT Southwestern Medical Center, Dallas, TX 75390, USA; Peter O' Donnell Jr. Brain Institute, UT Southwestern Medical Center, Dallas, TX 75390, USA.
| |
Collapse
|
29
|
Xie B, Zhen Z, Guo O, Li H, Guo M, Zhen J. Progress on the hippocampal circuits and functions based on sharp wave ripples. Brain Res Bull 2023:110695. [PMID: 37353037 DOI: 10.1016/j.brainresbull.2023.110695] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2023] [Revised: 06/18/2023] [Accepted: 06/20/2023] [Indexed: 06/25/2023]
Abstract
Sharp wave ripples (SWRs) are high-frequency synchronization events generated by hippocampal neuronal circuits during various forms of learning and reactivated during memory consolidation and recall. There is mounting evidence that SWRs are essential for storing spatial and social memories in rodents and short-term episodic memories in humans. Sharp wave ripples originate mainly from the hippocampal CA3 and subiculum, and can be transmitted to modulate neuronal activity in cortical and subcortical regions for long-term memory consolidation and behavioral guidance. Different hippocampal subregions have distinct functions in learning and memory. For instance, the dorsal CA1 is critical for spatial navigation, episodic memory, and learning, while the ventral CA1 and dorsal CA2 may work cooperatively to store and consolidate social memories. Here, we summarize recent studies demonstrating that SWRs are essential for the consolidation of spatial, episodic, and social memories in various hippocampal-cortical pathways, and review evidence that SWR dysregulation contributes to cognitive impairments in neurodegenerative and neurodevelopmental diseases.
Collapse
Affiliation(s)
- Boxu Xie
- Department of Neurology, The Second Hospital of Hebei Medical University, Shijiazhuang, China
| | - Zhihang Zhen
- Department of Neurology, The Second Hospital of Hebei Medical University, Shijiazhuang, China
| | - Ouyang Guo
- Department of Biology, Boston University, Boston, MA, United States
| | - Heming Li
- Department of Neurology, The Second Hospital of Hebei Medical University, Shijiazhuang, China
| | - Moran Guo
- Neurological Laboratory of Hebei Province, Shijiazhuang, China
| | - Junli Zhen
- Department of Neurology, The Second Hospital of Hebei Medical University, Shijiazhuang, China; Neurological Laboratory of Hebei Province, Shijiazhuang, China.
| |
Collapse
|
30
|
Hahamy A, Dubossarsky H, Behrens TEJ. The human brain reactivates context-specific past information at event boundaries of naturalistic experiences. Nat Neurosci 2023:10.1038/s41593-023-01331-6. [PMID: 37248340 DOI: 10.1038/s41593-023-01331-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2022] [Accepted: 04/13/2023] [Indexed: 05/31/2023]
Abstract
Although we perceive the world in a continuous manner, our experience is partitioned into discrete events. However, to make sense of these events, they must be stitched together into an overarching narrative-a model of unfolding events. It has been proposed that such a stitching process happens in offline neural reactivations when rodents build models of spatial environments. Here we show that, while understanding a natural narrative, humans reactivate neural representations of past events. Similar to offline replay, these reactivations occur in the hippocampus and default mode network, where reactivations are selective to relevant past events. However, these reactivations occur, not during prolonged offline periods, but at the boundaries between ongoing narrative events. These results, replicated across two datasets, suggest reactivations as a candidate mechanism for binding temporally distant information into a coherent understanding of ongoing experience.
Collapse
Affiliation(s)
- Avital Hahamy
- Wellcome Trust Centre for Neuroimaging, UCL Queen Square Institute of Neurology, University College London, London, UK.
| | - Haim Dubossarsky
- School of Electronic Engineering and Computer Science, Queen Mary University of London, London, UK
- Language Technology Laboratory, University of Cambridge, Cambridge, UK
| | - Timothy E J Behrens
- Wellcome Trust Centre for Neuroimaging, UCL Queen Square Institute of Neurology, University College London, London, UK
- Wellcome Centre for Integrative Neuroimaging, University of Oxford, John Radcliffe Hospital, Oxford, UK
| |
Collapse
|
31
|
Crivelli-Decker J, Clarke A, Park SA, Huffman DJ, Boorman ED, Ranganath C. Goal-oriented representations in the human hippocampus during planning and navigation. Nat Commun 2023; 14:2946. [PMID: 37221176 PMCID: PMC10206082 DOI: 10.1038/s41467-023-35967-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2021] [Accepted: 01/10/2023] [Indexed: 05/25/2023] Open
Abstract
Recent work in cognitive and systems neuroscience has suggested that the hippocampus might support planning, imagination, and navigation by forming cognitive maps that capture the abstract structure of physical spaces, tasks, and situations. Navigation involves disambiguating similar contexts, and the planning and execution of a sequence of decisions to reach a goal. Here, we examine hippocampal activity patterns in humans during a goal-directed navigation task to investigate how contextual and goal information are incorporated in the construction and execution of navigational plans. During planning, hippocampal pattern similarity is enhanced across routes that share a context and a goal. During navigation, we observe prospective activation in the hippocampus that reflects the retrieval of pattern information related to a key-decision point. These results suggest that, rather than simply representing overlapping associations or state transitions, hippocampal activity patterns are shaped by context and goals.
Collapse
Affiliation(s)
- Jordan Crivelli-Decker
- Center for Neuroscience, University of California, Davis, CA, USA.
- Department of Psychology, University of California, Davis, CA, USA.
| | - Alex Clarke
- Department of Psychology, University of Cambridge, Cambridge, UK
| | - Seongmin A Park
- Center for Neuroscience, University of California, Davis, CA, USA
- Center for Mind and Brain, University of California, Davis, CA, USA
| | - Derek J Huffman
- Center for Neuroscience, University of California, Davis, CA, USA
- Department of Psychology, Colby College, Waterville, ME, USA
| | - Erie D Boorman
- Center for Neuroscience, University of California, Davis, CA, USA
- Department of Psychology, University of Cambridge, Cambridge, UK
| | - Charan Ranganath
- Center for Neuroscience, University of California, Davis, CA, USA
- Department of Psychology, University of California, Davis, CA, USA
| |
Collapse
|
32
|
Duan QT, Dai L, Wang LK, Shi XJ, Chen X, Liao X, Zhang CQ, Yang H. Hippocampal ripples correlate with memory performance in humans. Brain Res 2023; 1810:148370. [PMID: 37080267 DOI: 10.1016/j.brainres.2023.148370] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2023] [Revised: 04/06/2023] [Accepted: 04/13/2023] [Indexed: 04/22/2023]
Abstract
Memory performance evaluation has generally been based on behavioral tests in the past decades. However, its neural correlates remain largely unknown, particularly in humans. Here we addressed this question using intracranial electroencephalography in patients with refractory epilepsy, performing an episodic memory test. We used the presurgical Wechsler Memory Scale (WMS) test to assess the memory performance of each patient. We found that hippocampal ripples significantly exhibited a transient increase during visual stimulation or before verbal recall. This increase in hippocampal ripples positively correlated with memory performance. By contrast, memory performance is negatively correlated with hippocampal interictal epileptic discharges (IEDs) or epileptic ripples in the memory task. However, these correlations were not present during quiet wakefulness. Thus, our findings uncover the neural correlates of memory performance in addition to traditional behavioral tests.
Collapse
Affiliation(s)
- Qing-Tian Duan
- Department of Neurosurgery, Xinqiao Hospital, Third Military Medical University, Chongqing 400037, China
| | - Lu Dai
- Center for Neurointelligence, School of Medicine, Chongqing University, Chongqing 400030, China
| | - Lu-Kang Wang
- Department of Neurosurgery, Xinqiao Hospital, Third Military Medical University, Chongqing 400037, China
| | - Xian-Jun Shi
- Department of Neurosurgery, Xinqiao Hospital, Third Military Medical University, Chongqing 400037, China
| | - Xiaowei Chen
- Brain Research Center and State Key Laboratory of Trauma, Burns, and Combined Injury, Third Military Medical University, Chongqing 400038, China; Chongqing Institute for Brain and Intelligence, Guangyang Bay Laboratory, Chongqing 400064, China
| | - Xiang Liao
- Center for Neurointelligence, School of Medicine, Chongqing University, Chongqing 400030, China.
| | - Chun-Qing Zhang
- Department of Neurosurgery, Xinqiao Hospital, Third Military Medical University, Chongqing 400037, China; Chongqing Institute for Brain and Intelligence, Guangyang Bay Laboratory, Chongqing 400064, China.
| | - Hui Yang
- Department of Neurosurgery, Xinqiao Hospital, Third Military Medical University, Chongqing 400037, China; Chongqing Institute for Brain and Intelligence, Guangyang Bay Laboratory, Chongqing 400064, China.
| |
Collapse
|
33
|
McFadyen J, Liu Y, Dolan RJ. Differential replay of reward and punishment paths predicts approach and avoidance. Nat Neurosci 2023; 26:627-637. [PMID: 37020116 DOI: 10.1038/s41593-023-01287-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2021] [Accepted: 02/16/2023] [Indexed: 04/07/2023]
Abstract
Neural replay is implicated in planning, where states relevant to a task goal are rapidly reactivated in sequence. It remains unclear whether, during planning, replay relates to an actual prospective choice. Here, using magnetoencephalography (MEG), we studied replay in human participants while they planned to either approach or avoid an uncertain environment containing paths leading to reward or punishment. We find evidence for forward sequential replay during planning, with rapid state-to-state transitions from 20 to 90 ms. Replay of rewarding paths was boosted, relative to aversive paths, before a decision to avoid and attenuated before a decision to approach. A trial-by-trial bias toward replaying prospective punishing paths predicted irrational decisions to approach riskier environments, an effect more pronounced in participants with higher trait anxiety. The findings indicate a coupling of replay with planned behavior, where replay prioritizes an online representation of a worst-case scenario for approaching or avoiding.
Collapse
Affiliation(s)
- Jessica McFadyen
- The UCL Max Planck Centre for Computational Psychiatry and Ageing Research, University College London, London, UK.
- Wellcome Centre for Human Neuroimaging, University College London, London, UK.
| | - Yunzhe Liu
- State Key Laboratory of Cognitive Neuroscience and Learning, IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
- Chinese Institute for Brain Research, Beijing, China
| | - Raymond J Dolan
- The UCL Max Planck Centre for Computational Psychiatry and Ageing Research, University College London, London, UK
- Wellcome Centre for Human Neuroimaging, University College London, London, UK
| |
Collapse
|
34
|
Zhu N, Zhang Y, Xiao X, Wang Y, Yang J, Colgin LL, Zheng C. Hippocampal oscillatory dynamics in freely behaving rats during exploration of social and non-social stimuli. Cogn Neurodyn 2023; 17:411-429. [PMID: 37007194 PMCID: PMC10050611 DOI: 10.1007/s11571-022-09829-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2022] [Revised: 04/21/2022] [Accepted: 05/27/2022] [Indexed: 11/03/2022] Open
Abstract
Hippocampal CA2 supports social memory and encodes information about social experiences. Our previous study showed that CA2 place cells responded specifically to social stimuli (Nat Commun, (Alexander et al. 2016)). In addition, a prior study showed that activation of CA2 induces slow gamma rhythms (~ 25-55 Hz) in the hippocampus (Elife, (Alexander 2018)). Together, these results raise the question of whether slow gamma rhythms coordinate CA2 activity during social information processing. We hypothesized that slow gamma would be associated with transmission of social memories from CA2 to CA1, perhaps to integrate information across regions or promote social memory retrieval. We recorded local field potentials from hippocampal subfields CA1, CA2, and CA3 of 4 rats performing a social exploration task. We analyzed the activity of theta, slow gamma, and fast gamma rhythms, as well as sharp wave-ripples (SWRs), within each subfield. We assessed interactions between subfields during social exploration sessions and during presumed social memory retrieval in post-social exploration sessions. We found that CA2 slow gamma rhythms increased during social interactions but not during non-social exploration. CA2-CA1 theta-show gamma coupling was enhanced during social exploration. Furthermore, CA1 slow gamma rhythms and SWRs were associated with presumed social memory retrieval. In conclusion, these results suggest that CA2-CA1 interactions via slow gamma rhythms occur during social memory encoding, and CA1 slow gamma is associated with retrieval of social experience. Supplementary Information The online version contains supplementary material available at 10.1007/s11571-022-09829-8.
Collapse
Affiliation(s)
- Nan Zhu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Yiyuan Zhang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Xi Xiao
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
- Tianjin Key Laboratory of Brain Science and Neuroengineering, Tianjin, China
| | - Yimeng Wang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Jiajia Yang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
- School of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, China
- Tianjin Key Laboratory of Brain Science and Neuroengineering, Tianjin, China
| | - Laura Lee Colgin
- Center for Learning and Memory, University of Texas at Austin, Austin, TX 78712-0805 USA
- Department of Neuroscience, University of Texas at Austin, Austin, TX 78712-0805 USA
- Institute for Neuroscience, University of Texas at Austin, Austin, TX 78712-0805 USA
| | - Chenguang Zheng
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
- School of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, China
- Tianjin Key Laboratory of Brain Science and Neuroengineering, Tianjin, China
| |
Collapse
|
35
|
Burke DA, Jeong H, Wu B, Lee SA, Floeder JR, Namboodiri VMK. Few-shot learning: temporal scaling in behavioral and dopaminergic learning. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.03.31.535173. [PMID: 37034619 PMCID: PMC10081323 DOI: 10.1101/2023.03.31.535173] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
How do we learn associations in the world (e.g., between cues and rewards)? Cue-reward associative learning is controlled in the brain by mesolimbic dopamine1-4. It is widely believed that dopamine drives such learning by conveying a reward prediction error (RPE) in accordance with temporal difference reinforcement learning (TDRL) algorithms5. TDRL implementations are "trial-based": learning progresses sequentially across individual cue-outcome experiences. Accordingly, a foundational assumption-often considered a mere truism-is that the more cue-reward pairings one experiences, the more one learns this association. Here, we disprove this assumption, thereby falsifying a foundational principle of trial-based learning algorithms. Specifically, when a group of head-fixed mice received ten times fewer experiences over the same total time as another, a single experience produced as much learning as ten experiences in the other group. This quantitative scaling also holds for mesolimbic dopaminergic learning, with the increase in learning rate being so high that the group with fewer experiences exhibits dopaminergic learning in as few as four cue-reward experiences and behavioral learning in nine. An algorithm implementing reward-triggered retrospective learning explains these findings. The temporal scaling and few-shot learning observed here fundamentally changes our understanding of the neural algorithms of associative learning.
Collapse
Affiliation(s)
- Dennis A Burke
- Department of Neurology, University of California, San Francisco, CA, USA
| | - Huijeong Jeong
- Department of Neurology, University of California, San Francisco, CA, USA
| | - Brenda Wu
- Department of Neurology, University of California, San Francisco, CA, USA
| | - Seul Ah Lee
- Department of Neurology, University of California, San Francisco, CA, USA
- University of California, Berkeley, CA, USA
| | - Joseph R Floeder
- Neuroscience Graduate Program, University of California, San Francisco, CA, USA
| | - Vijay Mohan K Namboodiri
- Department of Neurology, University of California, San Francisco, CA, USA
- Neuroscience Graduate Program, University of California, San Francisco, CA, USA
- Weill Institute for Neurosciences, Kavli Institute for Fundamental Neuroscience, Center for Integrative Neuroscience, University of California, San Francisco, CA, USA
| |
Collapse
|
36
|
Ormond J, Serka SA, Johansen JP. Enhanced Reactivation of Remapping Place Cells during Aversive Learning. J Neurosci 2023; 43:2153-2167. [PMID: 36596695 PMCID: PMC10039748 DOI: 10.1523/jneurosci.1450-22.2022] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2022] [Revised: 11/23/2022] [Accepted: 12/01/2022] [Indexed: 01/05/2023] Open
Abstract
Study of the hippocampal place cell system has greatly enhanced our understanding of memory encoding for distinct places, but how episodic memories for distinct experiences occurring within familiar environments are encoded is less clear. We developed a spatial decision-making task in which male rats learned to navigate a multiarm maze to a goal location for food reward while avoiding maze arms in which aversive stimuli were delivered. Task learning induced partial remapping in CA1 place cells, allowing us to identify both remapping and stable cell populations. Remapping cells were recruited into sharp-wave ripples and associated replay events to a greater extent than stable cells, despite having similar firing rates during navigation of the maze. Our results suggest that recruitment into replay events may be a mechanism to incorporate new contextual information into a previously formed and stabilized spatial representation.SIGNIFICANCE STATEMENT Hippocampal place cells provide a map of space that animals use to navigate. This map can change to reflect changes in the physical properties of the environment in which the animal finds itself, and also in response to nonphysical contextual changes, such as changes in the valence of specific locations within that environment. We show here that cells which change their spatial tuning after a change in context are preferentially recruited into sharp-wave ripple-associated replay events compared with stable nonremapping cells. Thus, our data lend strong support to the hypothesis that replay is a mechanism for the storage of new spatial maps.
Collapse
Affiliation(s)
- Jake Ormond
- Laboratory for Neural Circuitry of Memory, RIKEN Center for Brain Science, Saitama 351-0198, Japan
| | - Simon A Serka
- Laboratory for Neural Circuitry of Memory, RIKEN Center for Brain Science, Saitama 351-0198, Japan
| | - Joshua P Johansen
- Laboratory for Neural Circuitry of Memory, RIKEN Center for Brain Science, Saitama 351-0198, Japan
| |
Collapse
|
37
|
Jeong H, Namboodiri VMK, Jung MW, Andermann ML. Sensory cortical ensembles exhibit differential coupling to ripples in distinct hippocampal subregions. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.03.17.533028. [PMID: 36993665 PMCID: PMC10055189 DOI: 10.1101/2023.03.17.533028] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
Cortical neurons activated during recent experiences often reactivate with dorsal hippocampal CA1 sharp-wave ripples (SWRs) during subsequent rest. Less is known about cortical interactions with intermediate hippocampal CA1, whose connectivity, functions, and SWRs differ from those of dorsal CA1. We identified three clusters of visual cortical excitatory neurons that are excited together with either dorsal or intermediate CA1 SWRs, or suppressed before both SWRs. Neurons in each cluster were distributed across primary and higher visual cortices and co-active even in the absence of SWRs. These ensembles exhibited similar visual responses but different coupling to thalamus and pupil-indexed arousal. We observed a consistent activity sequence: (i) suppression of SWR-suppressed cortical neurons, (ii) thalamic silence, and (iii) activation of the cortical ensemble preceding and predicting intermediate CA1 SWRs. We propose that the coordinated dynamics of these ensembles relay visual experiences to distinct hippocampal subregions for incorporation into different cognitive maps.
Collapse
Affiliation(s)
- Huijeong Jeong
- Department of Neurology, University of California, San Francisco, CA 94158, USA
- Center for Synaptic Brain Dysfunctions, Institute for Basic Science, Daejeon 34141, Korea
- Department of Biological Sciences, Korea Advanced Institute of Science and Technology, Daejeon 34141, Korea
| | - Vijay Mohan K Namboodiri
- Department of Neurology, University of California, San Francisco, CA 94158, USA
- Neuroscience Graduate Program, University of California, San Francisco, CA 94158, USA
- Weill Institute for Neuroscience, Kavli Institute for Fundamental Neuroscience, Center for Integrative Neuroscience, University of California, San Francisco 94158, CA, USA
| | - Min Whan Jung
- Center for Synaptic Brain Dysfunctions, Institute for Basic Science, Daejeon 34141, Korea
- Department of Biological Sciences, Korea Advanced Institute of Science and Technology, Daejeon 34141, Korea
| | - Mark L. Andermann
- Division of Endocrinology, Metabolism, and Diabetes, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA 02115 USA
- Lead contact
| |
Collapse
|
38
|
Baczkowski BM, Haaker J, Schwabe L. Inferring danger with minimal aversive experience. Trends Cogn Sci 2023; 27:456-467. [PMID: 36941184 DOI: 10.1016/j.tics.2023.02.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2022] [Revised: 01/11/2023] [Accepted: 02/23/2023] [Indexed: 03/22/2023]
Abstract
Learning about threats is crucial for survival and fundamentally rests upon Pavlovian conditioning. However, Pavlovian threat learning is largely limited to detecting known (or similar) threats and involves first-hand exposure to danger, which inevitably poses a risk of harm. We discuss how individuals leverage a rich repertoire of mnemonic processes that operate largely in safety and significantly expand our ability to recognize danger beyond Pavlovian threat associations. These processes result in complementary memories - acquired individually or through social interactions - that represent potential threats and the relational structure of our environment. The interplay between these memories allows danger to be inferred rather than directly learned, thereby flexibly protecting us from potential harm in novel situations despite minimal prior aversive experience.
Collapse
Affiliation(s)
- Blazej M Baczkowski
- Department of Cognitive Psychology, Universität Hamburg, Von-Melle-Park 5, 20146 Hamburg, Germany
| | - Jan Haaker
- Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf, 20246 Hamburg, Germany
| | - Lars Schwabe
- Department of Cognitive Psychology, Universität Hamburg, Von-Melle-Park 5, 20146 Hamburg, Germany.
| |
Collapse
|
39
|
Cisler JM, Tamman AJF, Fonzo GA. Diminished prospective mental representations of reward mediate reward learning strategies among youth with internalizing symptoms. Psychol Med 2023; 53:1-11. [PMID: 36878892 PMCID: PMC10600826 DOI: 10.1017/s0033291723000478] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/21/2022] [Revised: 01/09/2023] [Accepted: 02/08/2023] [Indexed: 03/08/2023]
Abstract
BACKGROUND Adolescent internalizing symptoms and trauma exposure have been linked with altered reward learning processes and decreased ventral striatal responses to rewarding cues. Recent computational work on decision-making highlights an important role for prospective representations of the imagined outcomes of different choices. This study tested whether internalizing symptoms and trauma exposure among youth impact the generation of prospective reward representations during decision-making and potentially mediate altered behavioral strategies during reward learning. METHODS Sixty-one adolescent females with varying exposure to interpersonal violence exposure (n = 31 with histories of physical or sexual assault) and severity of internalizing symptoms completed a social reward learning task during fMRI. Multivariate pattern analyses (MVPA) were used to decode neural reward representations at the time of choice. RESULTS MVPA demonstrated that rewarding outcomes could accurately be decoded within several large-scale distributed networks (e.g. frontoparietal and striatum networks), that these reward representations were reactivated prospectively at the time of choice in proportion to the expected probability of receiving reward, and that youth with behavioral strategies that favored exploiting high reward options demonstrated greater prospective generation of reward representations. Youth internalizing symptoms, but not trauma exposure characteristics, were negatively associated with both the behavioral strategy of exploiting high reward options as well as the prospective generation of reward representations in the striatum. CONCLUSIONS These data suggest diminished prospective mental simulation of reward as a mechanism of altered reward learning strategies among youth with internalizing symptoms.
Collapse
Affiliation(s)
- Josh M. Cisler
- Department of Psychiatry and Behavioral Sciences, Dell Medical School, University of Texas at Austin, USA
- Institute for Early Life Adversity Research, Dell Medical School, University of Texas at Austin, USA
| | - Amanda J. F. Tamman
- Menninger Department of Psychiatry and Behavioral Sciences, Baylor College of Medicine, Houston, TX, USA
| | - Greg A. Fonzo
- Department of Psychiatry and Behavioral Sciences, Dell Medical School, University of Texas at Austin, USA
- Institute for Early Life Adversity Research, Dell Medical School, University of Texas at Austin, USA
- Center for Psychedelic Research and Therapy, Dell Medical School, University of Texas at Austin, USA
| |
Collapse
|
40
|
Chen ZS, Wilson MA. How our understanding of memory replay evolves. J Neurophysiol 2023; 129:552-580. [PMID: 36752404 PMCID: PMC9988534 DOI: 10.1152/jn.00454.2022] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2022] [Revised: 01/20/2023] [Accepted: 01/20/2023] [Indexed: 02/09/2023] Open
Abstract
Memory reactivations and replay, widely reported in the hippocampus and cortex across species, have been implicated in memory consolidation, planning, and spatial and skill learning. Technological advances in electrophysiology, calcium imaging, and human neuroimaging techniques have enabled neuroscientists to measure large-scale neural activity with increasing spatiotemporal resolution and have provided opportunities for developing robust analytic methods to identify memory replay. In this article, we first review a large body of historically important and representative memory replay studies from the animal and human literature. We then discuss our current understanding of memory replay functions in learning, planning, and memory consolidation and further discuss the progress in computational modeling that has contributed to these improvements. Next, we review past and present analytic methods for replay analyses and discuss their limitations and challenges. Finally, looking ahead, we discuss some promising analytic methods for detecting nonstereotypical, behaviorally nondecodable structures from large-scale neural recordings. We argue that seamless integration of multisite recordings, real-time replay decoding, and closed-loop manipulation experiments will be essential for delineating the role of memory replay in a wide range of cognitive and motor functions.
Collapse
Affiliation(s)
- Zhe Sage Chen
- Department of Psychiatry, New York University Grossman School of Medicine, New York, New York, United States
- Department of Neuroscience and Physiology, New York University Grossman School of Medicine, New York, New York, United States
- Neuroscience Institute, New York University Grossman School of Medicine, New York, New York, United States
- Department of Biomedical Engineering, New York University Tandon School of Engineering, Brooklyn, New York, United States
| | - Matthew A Wilson
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, Massachusetts, United States
- Picower Institute for Learning and Memory, Massachusetts Institute of Technology, Cambridge, Massachusetts, United States
| |
Collapse
|
41
|
Wimmer GE, Liu Y, McNamee DC, Dolan RJ. Distinct replay signatures for prospective decision-making and memory preservation. Proc Natl Acad Sci U S A 2023; 120:e2205211120. [PMID: 36719914 PMCID: PMC9963918 DOI: 10.1073/pnas.2205211120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2022] [Accepted: 12/05/2022] [Indexed: 02/01/2023] Open
Abstract
Theories of neural replay propose that it supports a range of functions, most prominently planning and memory consolidation. Here, we test the hypothesis that distinct signatures of replay in the same task are related to model-based decision-making ("planning") and memory preservation. We designed a reward learning task wherein participants utilized structure knowledge for model-based evaluation, while at the same time had to maintain knowledge of two independent and randomly alternating task environments. Using magnetoencephalography and multivariate analysis, we first identified temporally compressed sequential reactivation, or replay, both prior to choice and following reward feedback. Before choice, prospective replay strength was enhanced for the current task-relevant environment when a model-based planning strategy was beneficial. Following reward receipt, and consistent with a memory preservation role, replay for the alternative distal task environment was enhanced as a function of decreasing recency of experience with that environment. Critically, these planning and memory preservation relationships were selective to pre-choice and post-feedback periods, respectively. Our results provide support for key theoretical proposals regarding the functional role of replay and demonstrate that the relative strength of planning and memory-related signals are modulated by ongoing computational and task demands.
Collapse
Affiliation(s)
- G. Elliott Wimmer
- Max Planck University College London Centre for Computational Psychiatry and Ageing Research, University College London, LondonWC1B 5EH, UK
- Wellcome Centre for Human Neuroimaging, University College London, LondonWC1N 3BG, UK
| | - Yunzhe Liu
- State Key Laboratory of Cognitive Neuroscience and Learning, IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing100875, China
- Chinese Institute for Brain Research, Beijing100875, China
| | - Daniel C. McNamee
- Max Planck University College London Centre for Computational Psychiatry and Ageing Research, University College London, LondonWC1B 5EH, UK
- Wellcome Centre for Human Neuroimaging, University College London, LondonWC1N 3BG, UK
- Neuroscience Programme, Champalimaud Research, Lisbon1400-038, Portugal
| | - Raymond J. Dolan
- Max Planck University College London Centre for Computational Psychiatry and Ageing Research, University College London, LondonWC1B 5EH, UK
- Wellcome Centre for Human Neuroimaging, University College London, LondonWC1N 3BG, UK
- State Key Laboratory of Cognitive Neuroscience and Learning, IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing100875, China
| |
Collapse
|
42
|
Aery Jones EA, Giocomo LM. Neural ensembles in navigation: From single cells to population codes. Curr Opin Neurobiol 2023; 78:102665. [PMID: 36542882 PMCID: PMC9845194 DOI: 10.1016/j.conb.2022.102665] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2022] [Revised: 10/27/2022] [Accepted: 11/21/2022] [Indexed: 12/23/2022]
Abstract
The brain can represent behaviorally relevant information through the firing of individual neurons as well as the coordinated firing of ensembles of neurons. Neurons in the hippocampus and associated cortical regions participate in a variety of types of ensembles to support navigation. These ensemble types include single cell codes, population codes, time-compressed sequences, behavioral sequences, and engrams. We present the physiological basis and behavioral relevance of ensemble firing. We discuss how these traditional definitions of ensembles can constrain or expand potential analyses due to the underlying assumptions and abstractions made. We highlight how coding can change at the ensemble level while underlying single cell codes remain intact. Finally, we present how ensemble definitions could be broadened to better understand the full complexity of the brain.
Collapse
Affiliation(s)
- Emily A Aery Jones
- Department of Neurobiology, Stanford University School of Medicine, Stanford, CA, 94305, USA.
| | - Lisa M Giocomo
- Department of Neurobiology, Stanford University School of Medicine, Stanford, CA, 94305, USA.
| |
Collapse
|
43
|
Hall AF, Wang DV. The two tales of hippocampal sharp-wave ripple content: The rigid and the plastic. Prog Neurobiol 2023; 221:102396. [PMID: 36563928 PMCID: PMC9899323 DOI: 10.1016/j.pneurobio.2022.102396] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2022] [Revised: 12/09/2022] [Accepted: 12/19/2022] [Indexed: 12/24/2022]
Abstract
Sharp-wave ripples, prominently in the CA1 region of the hippocampus, are short oscillatory events accompanied by bursts of neural firing. Ripples and associated hippocampal place cell sequences communicate with cortical ensembles during slow-wave sleep, which has been shown to be critical for systems consolidation of episodic memories. This consolidation is not limited to a newly formed memory trace; instead, ripples appear to reactivate and consolidate memories spanning various experiences. Despite this broad spanning influence, ripples remain capable of producing precise memories. The underlying mechanisms that enable ripples to consolidate memories broadly and with specificity across experiences remain unknown. In this review, we discuss data that uncovers circuit-level processes that generate ripples and influence their characteristics during consolidation. Based on current knowledge, we propose that memory emerges from the integration of two parallel consolidation pathways in CA1: the rigid and plastic pathways. The rigid pathway generates ripples stochastically, providing a backbone upon which dynamic plastic pathway inputs carrying novel information are integrated.
Collapse
Affiliation(s)
- Arron F Hall
- Department of Neurobiology & Anatomy, Drexel University College of Medicine, Philadelphia, PA 19129, USA
| | - Dong V Wang
- Department of Neurobiology & Anatomy, Drexel University College of Medicine, Philadelphia, PA 19129, USA.
| |
Collapse
|
44
|
Comrie AE, Frank LM, Kay K. Imagination as a fundamental function of the hippocampus. Philos Trans R Soc Lond B Biol Sci 2022; 377:20210336. [PMID: 36314152 PMCID: PMC9620759 DOI: 10.1098/rstb.2021.0336] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2021] [Accepted: 04/20/2022] [Indexed: 08/25/2023] Open
Abstract
Imagination is a biological function that is vital to human experience and advanced cognition. Despite this importance, it remains unknown how imagination is realized in the brain. Substantial research focusing on the hippocampus, a brain structure traditionally linked to memory, indicates that firing patterns in spatially tuned neurons can represent previous and upcoming paths in space. This work has generally been interpreted under standard views that the hippocampus implements cognitive abilities primarily related to actual experience, whether in the past (e.g. recollection, consolidation), present (e.g. spatial mapping) or future (e.g. planning). However, relatively recent findings in rodents identify robust patterns of hippocampal firing corresponding to a variety of alternatives to actual experience, in many cases without overt reference to the past, present or future. Given these findings, and others on hippocampal contributions to human imagination, we suggest that a fundamental function of the hippocampus is to generate a wealth of hypothetical experiences and thoughts. Under this view, traditional accounts of hippocampal function in episodic memory and spatial navigation can be understood as particular applications of a more general system for imagination. This view also suggests that the hippocampus contributes to a wider range of cognitive abilities than previously thought. This article is part of the theme issue 'Thinking about possibilities: mechanisms, ontogeny, functions and phylogeny'.
Collapse
Affiliation(s)
- Alison E. Comrie
- Neuroscience Graduate Program, University of California San Francisco, 675 Nelson Rising Lane, San Francisco, CA 94158, USA
- Kavli Institute for Fundamental Neuroscience, University of California San Francisco, 675 Nelson Rising Lane, San Francisco, CA 94158, USA
- Center for Integrative Neuroscience, University of California San Francisco, 675 Nelson Rising Lane, San Francisco, CA 94158, USA
- Departments of Physiology and Psychiatry, University of California San Francisco, 675 Nelson Rising Lane, San Francisco, CA 94158, USA
| | - Loren M. Frank
- Kavli Institute for Fundamental Neuroscience, University of California San Francisco, 675 Nelson Rising Lane, San Francisco, CA 94158, USA
- Center for Integrative Neuroscience, University of California San Francisco, 675 Nelson Rising Lane, San Francisco, CA 94158, USA
- Departments of Physiology and Psychiatry, University of California San Francisco, 675 Nelson Rising Lane, San Francisco, CA 94158, USA
- Howard Hughes Medical Institute, University of California San Francisco, 675 Nelson Rising Lane, San Francisco, CA 94158, USA
| | - Kenneth Kay
- Zuckerman Institute, Center for Theoretical Neuroscience, Columbia University, 3227 Broadway, New York, NY 10027, USA
| |
Collapse
|
45
|
Moughrabi N, Botsford C, Gruichich TS, Azar A, Heilicher M, Hiser J, Crombie KM, Dunsmoor JE, Stowe Z, Cisler JM. Large-scale neural network computations and multivariate representations during approach-avoidance conflict decision-making. Neuroimage 2022; 264:119709. [PMID: 36283543 PMCID: PMC9835092 DOI: 10.1016/j.neuroimage.2022.119709] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2022] [Revised: 10/20/2022] [Accepted: 10/21/2022] [Indexed: 11/09/2022] Open
Abstract
Many real-world situations require navigating decisions for both reward and threat. While there has been significant progress in understanding mechanisms of decision-making and mediating neurocircuitry separately for reward and threat, there is limited understanding of situations where reward and threat contingencies compete to create approach-avoidance conflict (AAC). Here, we leverage computational learning models, independent component analysis (ICA), and multivariate pattern analysis (MVPA) approaches to understand decision-making during a novel task that embeds concurrent reward and threat learning and manipulates congruency between reward and threat probabilities. Computational modeling supported a modified reinforcement learning model where participants integrated reward and threat value into a combined total value according to an individually varying policy parameter, which was highly predictive of decisions to approach reward vs avoid threat during trials where the highest reward option was also the highest threat option (i.e., approach-avoidance conflict). ICA analyses demonstrated unique roles for salience, frontoparietal, medial prefrontal, and inferior frontal networks in differential encoding of reward vs threat prediction error and value signals. The left frontoparietal network uniquely encoded degree of conflict between reward and threat value at the time of choice. MVPA demonstrated that delivery of reward and threat could accurately be decoded within salience and inferior frontal networks, respectively, and that decisions to approach reward vs avoid threat were predicted by the relative degree to which these reward vs threat representations were active at the time of choice. This latter result suggests that navigating AAC decisions involves generating mental representations for possible decision outcomes, and relative activation of these representations may bias subsequent decision-making towards approaching reward or avoiding threat accordingly.
Collapse
Affiliation(s)
- Nicole Moughrabi
- Department of Psychiatry and Behavioral Sciences, University of Texas at Austin
| | - Chloe Botsford
- Department of Psychiatry, University of Wisconsin-Madison
| | | | - Ameera Azar
- Department of Psychiatry and Behavioral Sciences, University of Texas at Austin
| | | | - Jaryd Hiser
- Department of Psychiatry, University of Wisconsin-Madison
| | - Kevin M Crombie
- Department of Psychiatry and Behavioral Sciences, University of Texas at Austin
| | - Joseph E Dunsmoor
- Department of Psychiatry and Behavioral Sciences, University of Texas at Austin; Institute for Early Life Adversity Research, University of Texas at Austin
| | - Zach Stowe
- Department of Psychiatry, University of Wisconsin-Madison
| | - Josh M Cisler
- Department of Psychiatry and Behavioral Sciences, University of Texas at Austin; Institute for Early Life Adversity Research, University of Texas at Austin.
| |
Collapse
|
46
|
Uncovering the Hippocampal Mechanisms Underpinning Spatial Learning and Flexible Navigation. J Neurosci 2022; 42:8915-8917. [PMID: 36450594 PMCID: PMC9732818 DOI: 10.1523/jneurosci.1400-22.2022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2022] [Revised: 09/26/2022] [Accepted: 09/30/2022] [Indexed: 01/05/2023] Open
|
47
|
Krishnan S, Heer C, Cherian C, Sheffield MEJ. Reward expectation extinction restructures and degrades CA1 spatial maps through loss of a dopaminergic reward proximity signal. Nat Commun 2022; 13:6662. [PMID: 36333323 PMCID: PMC9636178 DOI: 10.1038/s41467-022-34465-5] [Citation(s) in RCA: 18] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2022] [Accepted: 10/25/2022] [Indexed: 11/06/2022] Open
Abstract
Hippocampal place cells support reward-related spatial memories by forming a cognitive map that over-represents reward locations. The strength of these memories is modulated by the extent of reward expectation during encoding. However, the circuit mechanisms underlying this modulation are unclear. Here we find that when reward expectation is extinguished in mice, they remain engaged with their environment, yet place cell over-representation of rewards vanishes, place field remapping throughout the environment increases, and place field trial-to-trial reliability decreases. Interestingly, Ventral Tegmental Area (VTA) dopaminergic axons in CA1 exhibit a ramping reward-proximity signal that depends on reward expectation and inhibiting VTA dopaminergic neurons largely replicates the effects of extinguishing reward expectation. We conclude that changing reward expectation restructures CA1 cognitive maps and determines map reliability by modulating the dopaminergic VTA-CA1 reward-proximity signal. Thus, internal states of high reward expectation enhance encoding of spatial memories by reinforcing hippocampal cognitive maps associated with reward.
Collapse
Affiliation(s)
- Seetha Krishnan
- Department of Neurobiology and Institute for Neuroscience, University of Chicago, Chicago, IL, 60637, USA
| | - Chad Heer
- Department of Neurobiology and Institute for Neuroscience, University of Chicago, Chicago, IL, 60637, USA
| | - Chery Cherian
- Department of Neurobiology and Institute for Neuroscience, University of Chicago, Chicago, IL, 60637, USA
| | - Mark E J Sheffield
- Department of Neurobiology and Institute for Neuroscience, University of Chicago, Chicago, IL, 60637, USA.
| |
Collapse
|
48
|
Neuronal signature of spatial decision-making during navigation by freely moving rats by using calcium imaging. Proc Natl Acad Sci U S A 2022; 119:e2212152119. [PMID: 36279456 PMCID: PMC9636941 DOI: 10.1073/pnas.2212152119] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
This manuscript addresses a longstanding problem about how place cell firing contributes to navigation in spatial environments, and data derived from on-line calcium imaging offer a new solution. These data support the view that prior to entering an arena where an animal will navigate to only one of several possible places on each day, a population of spatially responsive cells, including place cells, fire during the last 5 s. This population is shown to be predictive of the destination and trajectory that the animal is about to take. A challenge in spatial memory is understanding how place cell firing contributes to decision-making in navigation. A spatial recency task was created in which freely moving rats first became familiar with a spatial context over several days and thereafter were required to encode and then selectively recall one of three specific locations within it that was chosen to be rewarded that day. Calcium imaging was used to record from more than 1,000 cells in area CA1 of the hippocampus of five rats during the exploration, sample, and choice phases of the daily task. The key finding was that neural activity in the startbox rose steadily in the short period prior to entry to the arena and that this selective population cell firing was predictive of the daily changing goal on correct trials but not on trials in which the animals made errors. Single-cell and population activity measures converged on the idea that prospective coding of neural activity can be involved in navigational decision-making.
Collapse
|
49
|
Chockanathan U, Padmanabhan K. From synapses to circuits and back: Bridging levels of understanding in animal models of Alzheimer's disease. Eur J Neurosci 2022; 56:5564-5586. [PMID: 35244297 PMCID: PMC10926359 DOI: 10.1111/ejn.15636] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2021] [Revised: 02/04/2022] [Accepted: 02/23/2022] [Indexed: 12/14/2022]
Abstract
Alzheimer's disease (AD) is a neurodegenerative disorder characterized by behavioural changes that include memory loss and cognitive decline and is associated with the appearance of amyloid-β plaques and neurofibrillary tangles throughout the brain. Although aspects of the disease percolate across multiple levels of neuronal organization, from the cellular to the behavioural, it is increasingly clear that circuits are a critical junction between the cellular pathology and the behavioural phenotypes that bookend these levels of analyses. In this review, we discuss critical aspects of neural circuit research, beginning with synapses and progressing to network activity and how they influence our understanding of disease processed in AD.
Collapse
Affiliation(s)
- Udaysankar Chockanathan
- Department of Neuroscience, University of Rochester School of Medicine and Dentistry, Rochester, New York, USA
- Neuroscience Graduate Program, University of Rochester School of Medicine and Dentistry, Rochester, New York, USA
- Medical Scientist Training Program, University of Rochester School of Medicine and Dentistry, Rochester, New York, USA
- Ernest J. Del Monte Institute for Neuroscience, University of Rochester School of Medicine and Dentistry, Rochester, New York, USA
| | - Krishnan Padmanabhan
- Department of Neuroscience, University of Rochester School of Medicine and Dentistry, Rochester, New York, USA
- Neuroscience Graduate Program, University of Rochester School of Medicine and Dentistry, Rochester, New York, USA
- Medical Scientist Training Program, University of Rochester School of Medicine and Dentistry, Rochester, New York, USA
- Ernest J. Del Monte Institute for Neuroscience, University of Rochester School of Medicine and Dentistry, Rochester, New York, USA
- Center for Visual Science, University of Rochester School of Medicine and Dentistry, Rochester, New York, USA
- Intellectual and Developmental Disabilities Research Center, University of Rochester School of Medicine and Dentistry, Rochester, New York, USA
| |
Collapse
|
50
|
Liu AA, Henin S, Abbaspoor S, Bragin A, Buffalo EA, Farrell JS, Foster DJ, Frank LM, Gedankien T, Gotman J, Guidera JA, Hoffman KL, Jacobs J, Kahana MJ, Li L, Liao Z, Lin JJ, Losonczy A, Malach R, van der Meer MA, McClain K, McNaughton BL, Norman Y, Navas-Olive A, de la Prida LM, Rueckemann JW, Sakon JJ, Skelin I, Soltesz I, Staresina BP, Weiss SA, Wilson MA, Zaghloul KA, Zugaro M, Buzsáki G. A consensus statement on detection of hippocampal sharp wave ripples and differentiation from other fast oscillations. Nat Commun 2022; 13:6000. [PMID: 36224194 PMCID: PMC9556539 DOI: 10.1038/s41467-022-33536-x] [Citation(s) in RCA: 24] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2022] [Accepted: 09/21/2022] [Indexed: 02/05/2023] Open
Abstract
Decades of rodent research have established the role of hippocampal sharp wave ripples (SPW-Rs) in consolidating and guiding experience. More recently, intracranial recordings in humans have suggested their role in episodic and semantic memory. Yet, common standards for recording, detection, and reporting do not exist. Here, we outline the methodological challenges involved in detecting ripple events and offer practical recommendations to improve separation from other high-frequency oscillations. We argue that shared experimental, detection, and reporting standards will provide a solid foundation for future translational discovery.
Collapse
Affiliation(s)
- Anli A Liu
- Department of Neurology, NYU Grossman School of Medicine, New York, NY, USA
- Neuroscience Institute, NYU Langone Medical Center, New York, NY, USA
| | - Simon Henin
- Department of Neurology, NYU Grossman School of Medicine, New York, NY, USA
| | - Saman Abbaspoor
- Department of Psychology, Vanderbilt University, Nashville, TN, USA
| | - Anatol Bragin
- Department of Neurology, David Geffen School of Medicine at UCLA, Los Angeles, CA, USA
| | - Elizabeth A Buffalo
- Department of Physiology and Biophysics, Washington National Primate Center, University of Washington, Seattle, WA, USA
| | - Jordan S Farrell
- Department of Neurosurgery, Stanford University, Stanford, CA, USA
| | - David J Foster
- Department of Psychology and Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA, USA
| | - Loren M Frank
- Kavli Institute for Fundamental Neuroscience, Center for Integrative Neuroscience and Department of Physiology, University of California San Francisco, San Francisco, CA, USA
- Howard Hughes Medical Institute, Chevy Chase, MD, USA
| | - Tamara Gedankien
- Department of Biomedical Engineering, Department of Neurological Surgery, Columbia University, New York, NY, USA
| | - Jean Gotman
- Montreal Neurological Institute, McGill University, Montreal, QC, Canada
| | - Jennifer A Guidera
- Kavli Institute for Fundamental Neuroscience, Center for Integrative Neuroscience and Department of Physiology, University of California San Francisco, San Francisco, CA, USA
- Medical Scientist Training Program, Department of Bioengineering, University of California, San Francisco, San Francisco, CA, USA
| | - Kari L Hoffman
- Vanderbilt Brain Institute, Vanderbilt University, Nashville, TN, USA
| | - Joshua Jacobs
- Department of Biomedical Engineering, Department of Neurological Surgery, Columbia University, New York, NY, USA
| | - Michael J Kahana
- Department of Psychology, University of Pennsylvania, Philadelphia, PA, USA
| | - Lin Li
- Department of Biomedical Engineering, University of North Texas, Denton, TX, USA
| | - Zhenrui Liao
- Department of Neuroscience, Columbia University, New York, NY, USA
| | - Jack J Lin
- Department of Neurology, Center for Mind and Brain, University of California Davis, Oakland, CA, USA
| | - Attila Losonczy
- Department of Neuroscience, Columbia University, New York, NY, USA
| | - Rafael Malach
- Department of Brain Sciences, Weizmann Institute of Science, Rehovot, Israel
| | | | - Kathryn McClain
- Neuroscience Institute, NYU Langone Medical Center, New York, NY, USA
| | - Bruce L McNaughton
- The Canadian Centre for Behavioural Neuroscience, University of Lethbridge, Lethbridge, AB, Canada
| | - Yitzhak Norman
- Department of Brain Sciences, Weizmann Institute of Science, Rehovot, Israel
- Department of Neurological Surgery, University of California, San Francisco, CA, USA
| | | | | | - Jon W Rueckemann
- Department of Physiology and Biophysics, Washington National Primate Center, University of Washington, Seattle, WA, USA
| | - John J Sakon
- Department of Psychology, University of Pennsylvania, Philadelphia, PA, USA
| | - Ivan Skelin
- Department of Neurology, Center for Mind and Brain, University of California Davis, Oakland, CA, USA
| | - Ivan Soltesz
- Department of Neurosurgery, Stanford University, Stanford, CA, USA
| | - Bernhard P Staresina
- Department of Experimental Psychology, Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford, UK
| | - Shennan A Weiss
- Brookdale Hospital Medical Center, SUNY Downstate Medical Center, Brooklyn, NY, USA
| | - Matthew A Wilson
- Department of Brain and Cognitive Sciences and Picower Institute for Learning and Memory, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Kareem A Zaghloul
- Surgical Neurology Branch, National Institute of Neurological Disorders and Stroke (NINDS), National Institutes of Health, Bethesda, MD, USA
| | - Michaël Zugaro
- Center for Interdisciplinary Research in Biology (CIRB), Collège de France, CNRS, INSERM, Université PSL, Paris, France
| | - György Buzsáki
- Department of Neurology, NYU Grossman School of Medicine, New York, NY, USA.
- Neuroscience Institute, NYU Langone Medical Center, New York, NY, USA.
| |
Collapse
|