Testing Models of Human Declarative Memory at the Single-Neuron Level

A neuronal code for object representation and memory in the human amygdala and hippocampus

How the brain encodes, recognizes, and memorizes general visual objects is a fundamental question in neuroscience. Here, we investigated the neural processes underlying visual object perception and memory by recording from 3173 single neurons in the human amygdala and hippocampus across four experiments. We employed both passive-viewing and recognition memory tasks involving a diverse range of naturalistic object stimuli. Our findings reveal a region-based feature code for general objects, where neurons exhibit receptive fields in the high-level visual feature space. This code can be validated by independent new stimuli and replicated across all experiments, including fixation-based analyses with large natural scenes. This region code explains the long-standing visual category selectivity, preferentially enhances memory of encoded stimuli, predicts memory performance, encodes image memorability, and exhibits intricate interplay with memory contexts. Together, region-based feature coding provides an important mechanism for visual object processing in the human brain.

The neuroscience of active learning and direct instruction

Throughout the educational system, students experiencing active learning pedagogy perform better and fail less than those taught through direct instruction. Can this be ascribed to differences in learning from a neuroscientific perspective? This review examines mechanistic, neuroscientific evidence that might explain differences in cognitive engagement contributing to learning outcomes between these instructional approaches. In classrooms, direct instruction comprehensively describes academic content, while active learning provides structured opportunities for learners to explore, apply, and manipulate content. Synaptic plasticity and its modulation by arousal or novelty are central to all learning and both approaches. As a form of social learning, direct instruction relies upon working memory. The reinforcement learning circuit, associated agency, curiosity, and peer-to-peer social interactions combine to enhance motivation, improve retention, and build higher-order-thinking skills in active learning environments. When working memory becomes overwhelmed, additionally engaging the reinforcement learning circuit improves retention, providing an explanation for the benefits of active learning. This analysis provides a mechanistic examination of how emerging neuroscience principles might inform pedagogical choices at all educational levels.

A theory of hippocampal function: New developments

We develop further here the only quantitative theory of the storage of information in the hippocampal episodic memory system and its recall back to the neocortex. The theory is upgraded to account for a revolution in understanding of spatial representations in the primate, including human, hippocampus, that go beyond the place where the individual is located, to the location being viewed in a scene. This is fundamental to much primate episodic memory and navigation: functions supported in humans by pathways that build 'where' spatial view representations by feature combinations in a ventromedial visual cortical stream, separate from those for 'what' object and face information to the inferior temporal visual cortex, and for reward information from the orbitofrontal cortex. Key new computational developments include the capacity of the CA3 attractor network for storing whole charts of space; how the correlations inherent in self-organizing continuous spatial representations impact the storage capacity; how the CA3 network can combine continuous spatial and discrete object and reward representations; the roles of the rewards that reach the hippocampus in the later consolidation into long-term memory in part via cholinergic pathways from the orbitofrontal cortex; and new ways of analysing neocortical information storage using Potts networks.

In vivo structural connectivity of the reward system along the hippocampal long axis

Recent work has identified a critical role for the hippocampus in reward-sensitive behaviors, including motivated memory, reinforcement learning, and decision-making. Animal histology and human functional neuroimaging have shown that brain regions involved in reward processing and motivation are more interconnected with the ventral/anterior hippocampus. However, direct evidence examining gradients of structural connectivity between reward regions and the hippocampus in humans is lacking. The present study used diffusion MRI (dMRI) and probabilistic tractography to quantify the structural connectivity of the hippocampus with key reward processing regions in vivo. Using a large sample of subjects (N = 628) from the human connectome dMRI data release, we found that connectivity profiles with the hippocampus varied widely between different regions of the reward circuit. While the dopaminergic midbrain (ventral tegmental area) showed stronger connectivity with the anterior versus posterior hippocampus, the ventromedial prefrontal cortex showed stronger connectivity with the posterior hippocampus. The limbic (ventral) striatum demonstrated a more homogeneous connectivity profile along the hippocampal long axis. This is the first study to generate a probabilistic atlas of the hippocampal structural connectivity with reward-related networks, which is essential to investigating how these circuits contribute to normative adaptive behavior and maladaptive behaviors in psychiatric illness. These findings describe nuanced structural connectivity that sets the foundation to better understand how the hippocampus influences reward-guided behavior in humans.

Multimodal single-neuron, intracranial EEG, and fMRI brain responses during movie watching in human patients

We present a multimodal dataset of intracranial recordings, fMRI, and eye tracking in 20 participants during movie watching. Recordings consist of single neurons, local field potential, and intracranial EEG activity acquired from depth electrodes targeting the amygdala, hippocampus, and medial frontal cortex implanted for monitoring of epileptic seizures. Participants watched an 8-min long excerpt from the video "Bang! You're Dead" and performed a recognition memory test for movie content. 3 T fMRI activity was recorded prior to surgery in 11 of these participants while performing the same task. This NWB- and BIDS-formatted dataset includes spike times, field potential activity, behavior, eye tracking, electrode locations, demographics, and functional and structural MRI scans. For technical validation, we provide signal quality metrics, assess eye tracking quality, behavior, the tuning of cells and high-frequency broadband power field potentials to familiarity and event boundaries, and show brain-wide inter-subject correlations for fMRI. This dataset will facilitate the investigation of brain activity during movie watching, recognition memory, and the neural basis of the fMRI-BOLD signal.

Single-neuron mechanisms of neural adaptation in the human temporal lobe

A central function of the human brain is to adapt to new situations based on past experience. Adaptation is reflected behaviorally by shorter reaction times to repeating or similar stimuli, and neurophysiologically by reduced neural activity in bulk-tissue measurements with fMRI or EEG. Several potential single-neuron mechanisms have been hypothesized to cause this reduction of activity at the macroscopic level. We here explore these mechanisms using an adaptation paradigm with visual stimuli bearing abstract semantic similarity. We recorded intracranial EEG (iEEG) simultaneously with spiking activity of single neurons in the medial temporal lobes of 25 neurosurgical patients. Recording from 4917 single neurons, we demonstrate that reduced event-related potentials in the macroscopic iEEG signal are associated with a sharpening of single-neuron tuning curves in the amygdala, but with an overall reduction of single-neuron activity in the hippocampus, entorhinal cortex, and parahippocampal cortex, consistent with fatiguing in these areas.

Neural correlates of paired associate recollection: A neuroimaging meta-analysis

Functional neuroimaging data on paired associate recollection have expanded over the years, raising the need for an integrative understanding of the literature. The present study performed a quantitative meta-analysis of the data to fulfill that need. The meta-analysis focused on the three most widely used types of activation contrast: Hit > Miss, Intact > Rearranged, and Memory > Perception. The major results were as follows. First, the Hit > Miss contrast mainly involved regions in the default mode network (DMN)/medial temporal lobe (MTL), likely reflecting a greater amount of retrieved information during the Hit than Miss trials. Second, the Intact > Rearranged contrast mainly involved regions in the DMN/MTL, supporting the view that rejecting recombination foils is based on familiarity with the component parts in the absence of recollection. Third, the Memory > Perception contrast primarily involved regions in the frontoparietal control network, likely reflecting the greater demands on controlled processing during Memory than Perception conditions. Fourth, the subcortical clusters included the amygdala, caudate nucleus/putamen, and mediodorsal thalamus regions, suggesting that these regions are components of the neural circuits supporting associative recollection. Finally, comparisons with previous meta-analyses suggested that associative recollection involves the DMN regions more strongly than source recollection but less strongly than subjective recollection. In conclusion, this study contributes uniquely to the growing literature on paired associate recollection by clarifying the convergent findings and differences among studies.

The functional dissociation of posterior parietal regions during multimodal memory formation

The incidental acquisition of multimodal associations is a key memory function for everyday life. While the posterior parietal cortex has been frequently shown to be involved for these memory functions, ventral and dorsal regions revealed differences in their functional recruitment and the precise difference in multimodal memory processing with respect to the associative process has not been differentiated. Using an incidental multimodal learning task, we isolated the associative process during multimodal learning and recollection. The result of the present functional magnetic resonance imaging (fMRI) study demonstrated that during both learning and recollection a clear functional differentiation between ventral and dorsal posterior parietal regions was found and can be related directly to the associative process. The recruitment of a ventral region, the angular gyrus, was specific for learning and recollection of multimodal associations. In contrast, a dorsal region, the superior parietal lobule, could be attributed to memory guided attentional processing. Independent of the memory stage, we assumed a general role for the angular gyrus in the generation of associative representations and updating of fixed association, episodic memory.

Neurons detect cognitive boundaries to structure episodic memories in humans

While experience is continuous, memories are organized as discrete events. Cognitive boundaries are thought to segment experience and structure memory, but how this process is implemented remains unclear. We recorded the activity of single neurons in the human medial temporal lobe during the formation and retrieval of memories with complex narratives. Here we show that neurons responded to abstract cognitive boundaries between different episodes. Boundary-induced neural state changes during encoding predicted subsequent recognition accuracy but impaired event order memory, mirroring a fundamental behavioral tradeoff between content and time memory. Furthermore, the neural state following boundaries was reinstated during both successful retrieval and false memories. These findings reveal a neuronal substrate for detecting cognitive boundaries that transform experience into mnemonic episodes and structure mental time travel during retrieval.

Comparison of cognitive performance between patients with Parkinson's disease and dystonia using an intraoperative recognition memory test

Neuroscientific studies on the function of the basal ganglia often examine the behavioral performance of patients with movement disorders, such as Parkinson’s disease (PD) and dystonia (DT), while simultaneously examining the underlying electrophysiological activity during deep brain stimulation surgery. Nevertheless, to date, there have been no studies comparing the cognitive performance of PD and DT patients during surgery. In this study, we assessed the memory function of PD and DT patients with the Montreal Cognitive Assessment (MoCA) and the Mini-Mental State Examination (MMSE). We also tested their cognitive performance during the surgery using a continuous recognition memory test. The results of the MoCA and MMSE failed to reveal significant differences between the PD and DT patients. Additionally, no significant difference was detected by the intraoperative memory test between the PD and DT patients. The intraoperative memory test scores were highly correlated with the MMSE scores and MoCA scores. Our data suggest that DT patients perform similarly to PD patients in cognitive tests during surgery, and intraoperative memory tests can be used as a quick memory assessment tool during surgery.

Single-neuron correlate of epilepsy-related cognitive deficits in visual recognition memory in right mesial temporal lobe

OBJECTIVE

Impaired memory is a common comorbidity of refractory temporal lobe epilepsy (TLE) and often perceived by patients as more problematic than the seizures themselves. The objective of this study is to understand what the relationship of these behavioral impairments is to the underlying pathophysiology, as there are currently no treatments for these deficits, and it remains unknown what circuits are affected.

METHODS

We recorded single neurons in the medial temporal lobes (MTLs) of 62 patients (37 with refractory TLE) who performed a visual recognition memory task to characterize the relationship between behavior, tuning, and anatomical location of memory selective and visually selective neurons.

RESULTS

Subjects with a seizure onset zone (SOZ) in the right but not left MTL demonstrated impaired ability to recollect as indicated by the degree of asymmetry of the receiver operating characteristic curve. Of the 1973 recorded neurons, 159 were memory selective (MS) and 366 were visually selective (VS) category cells. The responses of MS neurons located within right but not left MTL SOZs were impaired during high-confidence retrieval trials, mirroring the behavioral deficit seen both in our task and in standardized neuropsychological tests. In contrast, responses of VS neurons were unimpaired in both left and right MTL SOZs. Our findings show that neuronal dysfunction within SOZs in the MTL was specific to a functional cell type and behavior, whereas other cell types respond normally even within the SOZ. We show behavioral metrics that detect right MTL SOZ-related deficits and identify a neuronal correlate of this impairment.

SIGNIFICANCE

Together, these findings show that single-cell responses can be used to assess the causal effects of local circuit disruption by an SOZ in the MTL, and establish a neural correlate of cognitive impairment due to epilepsy that can be used as a biomarker to assess the efficacy of novel treatments.

Limbic and Executive Meso- and Nigrostriatal Tracts Predict Impulsivity Differences in Attention-Deficit/Hyperactivity Disorder

BACKGROUND

Impulsivity is a defining characteristic of attention-deficit/hyperactivity disorder (ADHD), which has been associated with substance use disorders, higher accident rates, and lower educational and occupational outcomes. The meso- and nigrostriatal pathways of the dopamine system are hypothesized to be functionally heterogeneous, supporting diverse cognitive functions and impairments, including those associated with ADHD. We tested whether human midbrain pathways (where dopaminergic cell bodies originate) between the substantia nigra (SN) and ventral tegmental area (VTA) and the striatum differed between participants with ADHD and typically developing adolescent and young adult participants. We also assessed whether pathway connectivity predicted impulsivity regardless of diagnosis.

METHODS

Diffusion tensor imaging data were used to predict impulsivity (parent and self-report ratings, task-based behavioral measures) from participants with ADHD and typically developing adolescent and young adult participants (n = 155; 86 male, 69 female). Using probabilistic tractography, we mapped these pathways and divided the tracts into limbic, executive, and sensorimotor based on frontostriatal connectivity. ADHD and typically developing participants differed on all behavioral measures of impulsivity. We used correlation and machine learning analyses to test for a relationship between tract probabilities and impulsivity regardless of diagnosis.

RESULTS

Participants with ADHD had stronger structural connectivity between SN/VTA regions and the limbic striatum, weaker connectivity with the executive striatum, and no significant differences in sensorimotor tracts. Increased tract integrity between the limbic striatal and SN/VTA regions predicted greater impulsivity, while increased integrity between executive striatal and SN/VTA regions predicted reduced impulsivity.

CONCLUSIONS

These findings support the theory that functional diversity in the dopamine system is an important consideration for understanding dysfunction in ADHD.

The Architecture of Human Memory: Insights from Human Single-Neuron Recordings

Deciphering the mechanisms of human memory is a central goal of neuroscience, both from the point of view of the fundamental biology of memory and for its translational relevance. Here, we review some contributions that recordings from neurons in humans implanted with electrodes for clinical purposes have made toward this goal. Recordings from the medial temporal lobe, including the hippocampus, reveal the existence of two classes of cells: those encoding highly selective and invariant representations of abstract concepts, and memory-selective cells whose activity is related to familiarity and episodic retrieval. Insights derived from observing these cells in behaving humans include that semantic representations are activated before episodic representations, that memory content and memory strength are segregated, and that the activity of both types of cells is related to subjective awareness as expected from a substrate for declarative memory. Visually selective cells can remain persistently active for several seconds, thereby revealing a cellular substrate for working memory in humans. An overarching insight is that the neural code of human memory is interpretable at the single-neuron level. Jointly, intracranial recording studies are starting to reveal aspects of the building blocks of human memory at the single-cell level. This work establishes a bridge to cellular-level work in animals on the one hand, and the extensive literature on noninvasive imaging in humans on the other hand. More broadly, this work is a step toward a detailed mechanistic understanding of human memory that is needed to develop therapies for human memory disorders.

The role of intrinsic excitability in the evolution of memory: Significance in memory allocation, consolidation, and updating

Memory is a dynamic process that is continuously regulated by both synaptic and intrinsic neural mechanisms. While numerous studies have shown that synaptic plasticity is important in various types and phases of learning and memory, neuronal intrinsic excitability has received relatively less attention, especially regarding the dynamic nature of memory. In this review, we present evidence demonstrating the importance of intrinsic excitability in memory allocation, consolidation, and updating. We also consider the intricate interaction between intrinsic excitability and synaptic plasticity in shaping memory, supporting both memory stability and flexibility.

Patterns of single-neuron activity during associative recognition memory in the human medial temporal lobe

Electrophysiological activity in medial temporal lobe (MTL) structures is pivotal for declarative long-term memory. Single-neuron and microcircuit findings capitalizing on human microwire recordings from the medial temporal lobe are still fragmentary. In particular, it is an open question whether identical or different groups of neurons participate in different memory functions. Here, we investigated category-specific responses in the human MTL based on single-neuron recordings in presurgical epilepsy patients performing an associative long-term memory task. Additionally, auditory beat stimuli were presented during encoding and retrieval to modulate memory performance. We describe the proportion of neurons in amygdala, entorhinal cortex, hippocampus and parahippocampal cortex belonging to different response classes. These entail neurons coding stimulus-familiarity, neurons coding successful item memory, and neurons coding associated source memory, as well as the overlap between these classes. As major results we demonstrate that neurons responding to stimulus familiarity (old/new effect) can be identified in the MTL even when using previously known rather than entirely novel stimulus material (words). We observed a significant overlap between familiarity-related neurons and neurons coding item retrieval (remembered/forgotten effect). The largest fraction of familiarity-related neurons was found in the parahippocampal cortex, and a considerable fraction of all parahippocampal neurons was related to successful item retrieval. Neurons related to successful source retrieval were different from the neurons coding the associated information. Most importantly, there was no overlap between neurons coding item memory and those coding associated source memory strongly suggesting that these functions are facilitated by different sets of neurons.

A NWB-based dataset and processing pipeline of human single-neuron activity during a declarative memory task

A challenge for data sharing in systems neuroscience is the multitude of different data formats used. Neurodata Without Borders: Neurophysiology 2.0 (NWB:N) has emerged as a standardized data format for the storage of cellular-level data together with meta-data, stimulus information, and behavior. A key next step to facilitate NWB:N adoption is to provide easy to use processing pipelines to import/export data from/to NWB:N. Here, we present a NWB-formatted dataset of 1863 single neurons recorded from the medial temporal lobes of 59 human subjects undergoing intracranial monitoring while they performed a recognition memory task. We provide code to analyze and export/import stimuli, behavior, and electrophysiological recordings to/from NWB in both MATLAB and Python. The data files are NWB:N compliant, which affords interoperability between programming languages and operating systems. This combined data and code release is a case study for how to utilize NWB:N for human single-neuron recordings and enables easy re-use of this hard-to-obtain data for both teaching and research on the mechanisms of human memory.

Measurement(s)	medial temporal lobe • memory • amygdala • hippocampus
Technology Type(s)	single-unit recording
Factor Type(s)	confidence • remembered/forgotten • old/new • visual category • stimulus onset (visual)
Sample Characteristic - Organism	Homo sapiens

Machine-accessible metadata file describing the reported data: 10.6084/m9.figshare.11835801

Between persistently active and activity-silent frameworks: novel vistas on the cellular basis of working memory

Recent work has revealed important new discoveries on the cellular mechanisms of working memory (WM). These findings have motivated several seemingly conflicting theories on the mechanisms of short‐term memory maintenance. Here, we summarize the key insights gained from these new experiments and critically evaluate them in light of three hypotheses: classical persistent activity, activity‐silent, and dynamic coding. The experiments discussed include the first direct demonstration of persistently active neurons in the human medial temporal lobe that form static attractors with relevance to WM, single‐neuron recordings in the macaque prefrontal cortex that show evidence for both persistent and more dynamic types of WM representations, and noninvasive neuroimaging in humans that argues for activity‐silent representations. A key insight that emerges from these new results is that there are several neural mechanisms that support the maintenance of information in WM. Finally, based on established cognitive theories of WM, we propose a coherent model that encompasses these seemingly contradictory results. We propose that the three neuronal mechanisms of persistent activity, activity‐silent, and dynamic coding map well onto the cognitive levels of information processing (within focus of attention, activated long‐term memory, and central executive) that Cowan's WM model proposes.