Content Tuning in the Medial Temporal Lobe Cortex: Voxels that Perceive, Retrieve

Adding Meaning to Memories: How Parietal Cortex Combines Semantic Content with Episodic Experience

Neuroimaging studies of human memory have consistently found that univariate responses in parietal cortex track episodic experience with stimuli (whether stimuli are 'old' or 'new'). More recently, pattern-based fMRI studies have shown that parietal cortex also carries information about the semantic content of remembered experiences. However, it is not well understood how memory-based and content-based signals are integrated within parietal cortex. Here, in humans (males and females), we used voxel-wise encoding models and a recognition memory task to predict the fMRI activity patterns evoked by complex natural scene images based on (1) the episodic history and (2) the semantic content of each image. Models were generated and compared across distinct subregions of parietal cortex and for occipitotemporal cortex. We show that parietal and occipitotemporal regions each encode memory and content information, but they differ in how they combine this information. Among parietal subregions, angular gyrus was characterized by robust and overlapping effects of memory and content. Moreover, subject-specific semantic tuning functions revealed that successful recognition shifted the amplitude of tuning functions in angular gyrus but did not change the selectivity of tuning. In other words, effects of memory and content were additive in angular gyrus. This pattern of data contrasted with occipitotemporal cortex where memory and content effects were interactive: memory effects were preferentially expressed by voxels tuned to the content of a remembered image. Collectively, these findings provide unique insight into how parietal cortex combines information about episodic memory and semantic content.SIGNIFICANCE STATEMENT Neuroimaging studies of human memory have identified multiple brain regions that not only carry information about "whether" a visual stimulus is successfully recognized but also "what" the content of that stimulus includes. However, a fundamental and open question concerns how the brain integrates these two types of information (memory and content). Here, using a powerful combination of fMRI analysis methods, we show that parietal cortex, particularly the angular gyrus, robustly combines memory- and content-related information, but these two forms of information are represented via additive, independent signals. In contrast, memory effects in high-level visual cortex critically depend on (and interact with) content representations. Together, these findings reveal multiple and distinct ways in which the brain combines memory- and content-related information.

Category-specific memory encoding in the medial temporal lobe and beyond: the role of reward

The medial temporal lobe (MTL), including the hippocampus (HC), perirhinal cortex (PRC), and parahippocampal cortex (PHC), is central to memory formation. Reward enhances memory through interplay between the HC and substantia nigra/ventral tegmental area (SNVTA). While the SNVTA also innervates the MTL cortex and amygdala (AMY), their role in reward-enhanced memory is unclear. Prior research suggests category specificity in the MTL cortex, with the PRC and PHC processing object and scene memory, respectively. It is unknown, however, whether reward modulates category-specific memory processes. Furthermore, no study has demonstrated clear category specificity in the MTL for encoding processes contributing to subsequent recognition memory. To address these questions, we had 39 healthy volunteers (27 for all memory-based analyses) undergo functional magnetic resonance imaging while performing an incidental encoding task pairing objects or scenes with high or low reward, followed by a next-day recognition test. Behaviorally, high reward preferably enhanced object memory. Neural activity in the PRC and PHC reflected successful encoding of objects and scenes, respectively. Importantly, AMY encoding effects were selective for high-reward objects, with a similar pattern in the PRC. The SNVTA and HC showed no clear evidence of successful encoding. This behavioral and neural asymmetry may be conveyed through an anterior-temporal memory system, including the AMY and PRC, potentially in interplay with the ventromedial prefrontal cortex.

Category-sensitive incidental reinstatement in medial temporal lobe subregions during word recognition

During associative retrieval, the brain reinstates neural representations that were present during encoding. The human medial temporal lobe (MTL), with its subregions hippocampus (HC), perirhinal cortex (PRC), and parahippocampal cortex (PHC), plays a central role in neural reinstatement. Previous studies have given compelling evidence for reinstatement in the MTL during explicitly instructed associative retrieval. High-confident recognition may be similarly accompanied by recollection of associated information from the encoding context. It is unclear, however, whether high-confident recognition memory elicits reinstatement in the MTL even in the absence of an explicit instruction to retrieve associated information. Here, we addressed this open question using high-resolution fMRI. Twenty-eight male and female human volunteers engaged in a recognition memory task for words that they had previously encoded together with faces and scenes. Using complementary univariate and multivariate approaches, we show that MTL subregions including the PRC, PHC, and HC differentially reinstate category-sensitive representations during high-confident word recognition, even though no explicit instruction to retrieve the associated category was given. This constitutes novel evidence that high-confident recognition memory is accompanied by incidental reinstatement of associated category information in MTL subregions, and supports a functional model of the MTL that emphasizes content-sensitive representations during both encoding and retrieval.

Shared Representational Formats for Information Maintained in Working Memory and Information Retrieved from Long-Term Memory

Current theories propose that the short-term retention of information in working memory (WM) and the recall of information from long-term memory (LTM) are supported by overlapping neural mechanisms in occipital and parietal cortex. However, the extent of the shared representations between WM and LTM is unclear. We designed a spatial memory task that allowed us to directly compare the representations of remembered spatial information in WM and LTM with carefully matched behavioral response precision between tasks. Using multivariate pattern analyses on functional magnetic resonance imaging data, we show that visual memories were represented in a sensory-like code in both memory tasks across retinotopic regions in occipital and parietal cortex. Regions in lateral parietal cortex also encoded remembered locations in both tasks, but in a format that differed from sensory-evoked activity. These results suggest a striking correspondence in the format of representations maintained in WM and retrieved from LTM across occipital and parietal cortex. On the other hand, we also show that activity patterns in nearly all parietal regions, but not occipital regions, contained information that could discriminate between WM and LTM trials. Our data provide new evidence for theories of memory systems and the representation of mnemonic content.

Neural correlates of the production effect: An fMRI study

Recognition memory is improved for items produced at study (e.g., by reading them aloud) relative to a non-produced control condition (e.g., silent reading). This production effect is typically attributed to the extra elements in the production task (e.g., motor activation, auditory perception) enhancing item distinctiveness. To evaluate this claim, the present study examined the neural mechanisms underlying the production effect. Prior to a recognition memory test, different words within a study list were read either aloud, silently, or while saying "check" (as a sensorimotor control condition). Production improved recognition, and aloud words yielded higher rates of both recollection and familiarity judgments than either silent or control words. During encoding, fMRI revealed stronger activation in regions associated with motor, somatosensory, and auditory processing for aloud items than for either silent or control items. These activations were predictive of recollective success for aloud items at test. Together, our findings are compatible with a distinctiveness-based account of the production effect, while also pointing to the possible role of other processing differences during the aloud trials as compared to silent and control.

A network linking scene perception and spatial memory systems in posterior cerebral cortex

The neural systems supporting scene-perception and spatial-memory systems of the human brain are well-described. But how do these neural systems interact? Here, using fine-grained individual-subject fMRI, we report three cortical areas of the human brain, each lying immediately anterior to a region of the scene perception network in posterior cerebral cortex, that selectively activate when recalling familiar real-world locations. Despite their close proximity to the scene-perception areas, network analyses show that these regions constitute a distinct functional network that interfaces with spatial memory systems during naturalistic scene understanding. These "place-memory areas" offer a new framework for understanding how the brain implements memory-guided visual behaviors, including navigation.

Neural correlates of episodic memory modulated by temporally delayed rewards

When a stimulus is associated with an external reward, its chance of being consolidated into long-term memory is boosted via dopaminergic facilitation of long-term potentiation in the hippocampus. Given that higher temporal distance (TD) has been found to discount the subjective value of a reward, we hypothesized that memory performance associated with a more immediate reward will result in better memory performance. We tested this hypothesis by measuring both behavioral memory performance and brain activation using functional magnetic resonance imaging (fMRI) during memory encoding and retrieval tasks. Contrary to our hypothesis, both behavioral and fMRI results suggest that the TD of rewards might enhance the chance of the associated stimulus being remembered. The fMRI data demonstrate that the lateral prefrontal cortex, which shows encoding-related activation proportional to the TD, is reactivated when searching for regions that show activation proportional to the TD during retrieval. This is not surprising given that this region is not only activated to discriminate between future vs. immediate rewards, it is also a part of the retrieval-success network. These results provide support for the conclusion that the encoding-retrieval overlap provoked as the rewards are more delayed may lead to better memory performance of the items associated with the rewards.

Quantifying aphantasia through drawing: Those without visual imagery show deficits in object but not spatial memory

Congenital aphantasia is a recently characterized variation of experience defined by the inability to form voluntary visual imagery, in individuals who are otherwise high performing. Because of this specific deficit to visual imagery, individuals with aphantasia serve as an ideal group for probing the nature of representations in visual memory, particularly the interplay of object, spatial, and symbolic information. Here, we conducted a large-scale online study of aphantasia and revealed a dissociation in object and spatial content in their memory representations. Sixty-one individuals with aphantasia and matched controls with typical imagery studied real-world scene images, and were asked to draw them from memory, and then later copy them during a matched perceptual condition. Drawings were objectively quantified by 2,795 online scorers for object and spatial details. Aphantasic participants recalled significantly fewer objects than controls, with less color in their drawings, and an increased reliance on verbal scaffolding. However, aphantasic participants showed high spatial accuracy equivalent to controls, and made significantly fewer memory errors. These differences between groups only manifested during recall, with no differences between groups during the matched perceptual condition. This object-specific memory impairment in individuals with aphantasia provides evidence for separate systems in memory that support object versus spatial information. The study also provides an important experimental validation for the existence of aphantasia as a variation in human imagery experience.

Distinct Representational Structure and Localization for Visual Encoding and Recall during Visual Imagery

During memory recall and visual imagery, reinstatement is thought to occur as an echoing of the neural patterns during encoding. However, the precise information in these recall traces is relatively unknown, with previous work primarily investigating either broad distinctions or specific images, rarely bridging these levels of information. Using ultra-high-field (7T) functional magnetic resonance imaging with an item-based visual recall task, we conducted an in-depth comparison of encoding and recall along a spectrum of granularity, from coarse (scenes, objects) to mid (e.g., natural, manmade scenes) to fine (e.g., living room, cupcake) levels. In the scanner, participants viewed a trial-unique item, and after a distractor task, visually imagined the initial item. During encoding, we observed decodable information at all levels of granularity in category-selective visual cortex. In contrast, information during recall was primarily at the coarse level with fine-level information in some areas; there was no evidence of mid-level information. A closer look revealed segregation between voxels showing the strongest effects during encoding and those during recall, and peaks of encoding-recall similarity extended anterior to category-selective cortex. Collectively, these results suggest visual recall is not merely a reactivation of encoding patterns, displaying a different representational structure and localization from encoding, despite some overlap.

Volumetric GWAS of medial temporal lobe structures identifies an ERC1 locus using ADNI high-resolution T2-weighted MRI data

Medial temporal lobe (MTL) consists of hippocampal subfields and neighboring cortices. These heterogeneous structures are differentially involved in memory, cognitive and emotional functions, and present nonuniformly distributed atrophy contributing to cognitive disorders. This study aims to examine how genetics influences Alzheimer's disease (AD) pathogenesis via MTL substructures by analyzing high-resolution magnetic resonance imaging (MRI) data. We performed genome-wide association study to examine the associations between 565,373 single nucleotide polymorphisms (SNPs) and 14 MTL substructure volumes. A novel association with right Brodmann area 36 volume was discovered in an ERC1 SNP (i.e., rs2968869). Further analyses on larger samples found rs2968869 to be associated with gray matter density and glucose metabolism measures in the right hippocampus, and disease status. Tissue-specific transcriptomic analysis identified the minor allele of rs2968869 (rs2968869-C) to be associated with reduced ERC1 expression in the hippocampus. All the findings indicated a protective role of rs2968869-C in AD. We demonstrated the power of high-resolution MRI and the promise of fine-grained MTL substructures for revealing the genetic basis of AD biomarkers.

An Integrated Index: Engrams, Place Cells, and Hippocampal Memory

The hippocampus and its extended network contribute to encoding and recall of episodic experiences. Drawing from recent anatomical, physiological, and behavioral studies, we propose that hippocampal engrams function as indices to mediate memory recall. We broaden this idea to discuss potential relationships between engrams and hippocampal place cells, as well as the molecular, cellular, physiological, and circuit determinants of engrams that permit flexible routing of information to intra- and extrahippocampal circuits for reinstatement, a feature critical to memory indexing. Incorporating indexing into frameworks of memory function opens new avenues of study and even therapies for hippocampal dysfunction.