Behavioral representational similarity analysis reveals how episodic learning is influenced by and reshapes semantic memory

While semantic and episodic memory have been shown to influence each other, uncertainty remains as to how this interplay occurs. We introduce a behavioral representational similarity analysis approach to assess whether semantic space can be subtly re-sculpted by episodic learning. Eighty participants learned word pairs that varied in semantic relatedness, and learning was bolstered via either testing or restudying. Next-day recall is superior for semantically related pairs, but there is a larger benefit of testing for unrelated pairs. Analyses of representational change reveal that successful recall is accompanied by a pulling together of paired associates, with cue words in semantically related (but not unrelated) pairs changing more across learning than target words. Our findings show that episodic learning is associated with systematic and asymmetrical distortions of semantic space which improve later recall by making cues more predictive of targets, reducing interference from potential lures, and establishing novel connections within pairs.

Establishing a causal role for left ventrolateral prefrontal cortex in value-directed memory encoding with high-definition transcranial direct current stimulation

One critical approach for promoting the efficiency of memory is to adopt selective encoding strategies to prioritize more valuable information. Past neuroimaging studies have shown that value-directed modulation of verbal memory depends heavily on the engagement of left-lateralized semantic processing regions, particularly in the ventrolateral prefrontal cortex (VLPFC). In the present study, we used high-definition transcranial direct current stimulation (HD-tDCS) to seek evidence for a causal role of left VLPFC in supporting the memory advantage for high-value items. Three groups of healthy young adult participants were presented with lists of words to remember, with each word accompanied by an arbitrarily assigned point value. During the first session, all participants received sham stimulation as they encoded five lists of 30 words each. Two of these lists were immediately tested with free recall, with feedback given to allow participants to develop metacognitive insight and strategies to maximize their point total. The second session had the exact same structure as the first, but the groups differed in whether they received continued sham stimulation (N = 22) or anodal stimulation of the left VLPFC (N = 21) or right VLPFC (N = 20). Those lists not tested with immediate recall were tested with recognition judgments after a one-day delay. Since no brain stimulation was applied during this Day 2 test, any performance differences can be attributed to the effects of stimulation on Day 1 encoding processes. Anodal stimulation of left VLPFC significantly boosted participants' memory encoding selectivity. In comparison, no such effect was seen in participants who received right VLPFC or sham stimulation. Estimates of recollection- and familiarity-based responding revealed that left VLPFC stimulation specifically amplified the effects of item value on recollection. These results demonstrate a causal role for left VLPFC in the implementation of selective value-directed encoding strategies, putatively by boosting deep semantic processing of high-value words. Our findings also provide further evidence on the hemispheric lateralization of value-directed verbal memory encoding.

Enhancing learning and retention with distinctive virtual reality environments and mental context reinstatement

Memory is inherently context-dependent: internal and environmental cues become bound to learnt information, and the later absence of these cues can impair recall. Here, we developed an approach to leverage context-dependence to optimise learning of challenging, interference-prone material. While navigating through desktop virtual reality (VR) contexts, participants learnt 80 foreign words in two phonetically similar languages. Those participants who learnt each language in its own unique context showed reduced interference and improved one-week retention (92%), relative to those who learnt the languages in the same context (76%)-however, this advantage was only apparent if participants subjectively experienced VR-based contexts as "real" environments. A follow-up fMRI experiment confirmed that reinstatement of brain activity patterns associated with the original encoding context during word retrieval was associated with improved recall performance. These findings establish that context-dependence can be harnessed with VR to optimise learning and showcase the important role of mental context reinstatement.

Evidence of memory from brain data

Much courtroom evidence relies on assessing witness memory. Recent advances in brain imaging analysis techniques offer new information about the nature of autobiographical memory and introduce the potential for brain-based memory detection. In particular, the use of powerful machine-learning algorithms reveals the limits of technological capacities to detect true memories and contributes to existing psychological understanding that all memory is potentially flawed. This article first provides the conceptual foundation for brain-based memory detection as evidence. It then comprehensively reviews the state of the art in brain-based memory detection research before establishing a framework for admissibility of brain-based memory detection evidence in the courtroom and considering whether and how such use would be consistent with notions of justice. The central question that this interdisciplinary analysis presents is: if the science is sophisticated enough to demonstrate that accurate, veridical memory detection is limited by biological, rather than technological, constraints, what should that understanding mean for broader legal conceptions of how memory is traditionally assessed and relied upon in legal proceedings? Ultimately, we argue that courtroom admissibility is presently a misdirected pursuit, though there is still much to be gained from advancing our understanding of the biology of human memory.

Anodal Transcranial Direct Current Stimulation to the Left Rostrolateral Prefrontal Cortex Selectively Improves Source Memory Retrieval

Functional neuroimaging studies have consistently implicated the left rostrolateral prefrontal cortex (RLPFC) as playing a crucial role in the cognitive operations supporting episodic memory and analogical reasoning. However, the degree to which the left RLPFC causally contributes to these processes remains underspecified. We aimed to assess whether targeted anodal stimulation—thought to boost cortical excitability—of the left RLPFC with transcranial direct current stimulation (tDCS) would lead to augmentation of episodic memory retrieval and analogical reasoning task performance in comparison to cathodal stimulation or sham stimulation. Seventy-two healthy adult participants were evenly divided into three experimental groups. All participants performed a memory encoding task on Day 1, and then on Day 2, they performed continuously alternating tasks of episodic memory retrieval, analogical reasoning, and visuospatial perception across two consecutive 30-min experimental sessions. All groups received sham stimulation for the first experimental session, but the groups differed in the stimulation delivered to the left RLPFC during the second session (either sham, 1.5 mA anodal tDCS, or 1.5 mA cathodal tDCS). The experimental group that received anodal tDCS to the left RLPFC during the second session demonstrated significantly improved episodic memory source retrieval performance, relative to both their first session performance and relative to performance changes observed in the other two experimental groups. Performance on the analogical reasoning and visuospatial perception tasks did not exhibit reliable changes as a result of tDCS. As such, our results demonstrate that anodal tDCS to the left RLPFC leads to a selective and robust improvement in episodic source memory retrieval.

White matter integrity in brain structures supporting semantic processing is associated with value-directed remembering in older adults

White matter microstructure changes substantially in aging. To better understand how the integrity of white matter structures supports the selective learning of rewarding material, 23 healthy older adults were tested on a value-directed remembering task. This task involved successive free recall word lists where items differed in importance, as denoted by value cues preceding each word. White matter structure was measured using diffusion tensor imaging (DTI). We found that greater structural integrity (as measured by lower mean diffusivity) in left inferior fronto-occipital fasciculus was associated with greater recall for high-value items, but not low-value items. Older adults with greater structural integrity in a tract involved in semantic processing are thus able to more successfully encode high-value items for subsequent recall. However, unlike prior findings in younger adults, older adults' memory for high value-items was not significantly correlated with the structural integrity of the uncinate fasciculus, nor with the strength of anatomical connectedness between the bilateral nucleus accumbens to ventral tegmental area reward pathway. These structural imaging findings add support to recent functional neuroimaging demonstrations that value-related modulation of memory in older adults depends heavily on brain circuits implicated in controlled processing of semantic knowledge.

Enhancing the Ecological Validity of fMRI Memory Research Using Virtual Reality

Functional magnetic resonance imaging (fMRI) is a powerful research tool to understand the neural underpinnings of human memory. However, as memory is known to be context-dependent, differences in contexts between naturalistic settings and the MRI scanner environment may potentially confound neuroimaging findings. Virtual reality (VR) provides a unique opportunity to mitigate this issue by allowing memories to be formed and/or retrieved within immersive, navigable, visuospatial contexts. This can enhance the ecological validity of task paradigms, while still ensuring that researchers maintain experimental control over critical aspects of the learning and testing experience. This mini-review surveys the growing body of fMRI studies that have incorporated VR to address critical questions about human memory. These studies have adopted a variety of approaches, including presenting research participants with VR experiences in the scanner, asking participants to retrieve information that they had previously acquired in a VR environment, or identifying neural correlates of behavioral metrics obtained through VR-based tasks performed outside the scanner. Although most such studies to date have focused on spatial or navigational memory, we also discuss the promise of VR in aiding other areas of memory research and facilitating research into clinical disorders.

Memory Recall for High Reward Value Items Correlates With Individual Differences in White Matter Pathways Associated With Reward Processing and Fronto-Temporal Communication

When given a long list of items to remember, people typically prioritize the memorization of the most valuable items. Prior neuroimaging studies have found that cues denoting the presence of high value items can lead to increased activation of the mesolimbic dopaminergic reward circuit, including the nucleus accumbens (NAcc) and ventral tegmental area (VTA), which in turn results in up-regulation of medial temporal lobe encoding processes and better memory for the high value items. Value cues may also trigger the use of elaborative semantic encoding strategies which depend on interactions between frontal and temporal lobe structures. We used diffusion tensor imaging (DTI) to examine whether individual differences in anatomical connectivity within these circuits are associated with value-induced modulation of memory. DTI data were collected from 19 adults who also participated in an functional magnetic resonanceimaging (fMRI) study involving a value-directed memory task. In this task, subjects encoded words with arbitrarily assigned point values and completed free recall tests after each list, showing improved recall performance for high value items. Motivated by our prior fMRI finding of increased recruitment of left-lateralized semantic network regions during the encoding of high value words (Cohen et al., 2014), we predicted that the robustness of the white matter pathways connecting the ventrolateral prefrontal cortex (VLPFC) with the temporal lobe might be a determinant of recall performance for high value items. We found that the mean fractional anisotropy (FA) of each subject’s left uncinate fasciculus (UF), a fronto-temporal fiber bundle thought to play a critical role in semantic processing, correlated with the mean number of high value, but not low value, words that subjects recalled. Given prior findings on reward-induced modulation of memory, we also used probabilistic tractography to examine the white matter pathway that links the NAcc to the VTA. We found that the number of fibers projecting from left NAcc to VTA was reliably correlated with subjects’ selectivity index, a behavioral measure reflecting the degree to which recall performance was impacted by item value. Together, these findings help to elucidate the neuroanatomical pathways that support verbal memory encoding and its modulation by value.

Dissociating neural markers of stimulus memorability and subjective recognition during episodic retrieval

While much of memory research takes an observer-centric focus looking at participant performance, recent work has pinpointed important item-centric effects on memory, or how intrinsically memorable a given stimulus is. However, little is known about the neural correlates of memorability during memory retrieval, or how such correlates relate to subjective memory behavior. Here, stimuli and blood-oxygen-level dependent data from a prior functional magnetic resonance imaging (fMRI) study were reanalyzed using a memorability-based framework. In that study, sixteen participants studied 200 novel face images and were scanned while making recognition memory judgments on those faces, interspersed with 200 unstudied faces. In the current investigation, memorability scores for those stimuli were obtained through an online crowd-sourced (N = 740) continuous recognition test that measured each image's corrected recognition rate. Representational similarity analyses were conducted across the brain to identify regions wherein neural pattern similarity tracked item-specific effects (stimulus memorability) versus observer-specific effects (individual memory performance). We find two non-overlapping sets of regions, with memorability-related information predominantly represented within ventral and medial temporal regions and memory retrieval outcome-related information within fronto-parietal regions. These memorability-based effects persist regardless of image history, implying that coding of stimulus memorability may be a continuous and automatic perceptual process.

Differential Medial Temporal Lobe and Parietal Cortical Contributions to Real-world Autobiographical Episodic and Autobiographical Semantic Memory

Autobiographical remembering can depend on two forms of memory: episodic (event) memory and autobiographical semantic memory (remembering personally relevant semantic knowledge, independent of recalling a specific experience). There is debate about the degree to which the neural signals that support episodic recollection relate to or build upon autobiographical semantic remembering. Pooling data from two fMRI studies of memory for real-world personal events, we investigated whether medial temporal lobe (MTL) and parietal subregions contribute to autobiographical episodic and semantic remembering. During scanning, participants made memory judgments about photograph sequences depicting past events from their life or from others’ lives, and indicated whether memory was based on episodic or semantic knowledge. Results revealed several distinct functional patterns: activity in most MTL subregions was selectively associated with autobiographical episodic memory; the hippocampal tail, superior parietal lobule, and intraparietal sulcus were similarly engaged when memory was based on retrieval of an autobiographical episode or autobiographical semantic knowledge; and angular gyrus demonstrated a graded pattern, with activity declining from autobiographical recollection to autobiographical semantic remembering to correct rejections of novel events. Collectively, our data offer insights into MTL and parietal cortex functional organization, and elucidate circuitry that supports different forms of real-world autobiographical memory.

Multivariate resting-state functional connectivity predicts response to cognitive behavioral therapy in obsessive-compulsive disorder

Cognitive behavioral therapy (CBT) is an effective treatment for many with obsessive-compulsive disorder (OCD). However, response varies considerably among individuals. Attaining a means to predict an individual's potential response would permit clinicians to more prudently allocate resources for this often stressful and time-consuming treatment. We collected resting-state functional magnetic resonance imaging from adults with OCD before and after 4 weeks of intensive daily CBT. We leveraged machine learning with cross-validation to assess the power of functional connectivity (FC) patterns to predict individual posttreatment OCD symptom severity. Pretreatment FC patterns within the default mode network and visual network significantly predicted posttreatment OCD severity, explaining up to 67% of the variance. These networks were stronger predictors than pretreatment clinical scores. Results have clinical implications for developing personalized medicine approaches to identifying individual OCD patients who will maximally benefit from intensive CBT.

Can Memories of Traumatic Experiences or Addiction Be Erased or Modified? A Critical Review of Research on the Disruption of Memory Reconsolidation and Its Applications

Recent research suggests that the mere act of retrieving a memory can temporarily make that memory vulnerable to disruption. This process of "reconsolidation" will typically restabilize the neural representation of the memory and foster its long-term storage. However, the process of reconsolidating the memory takes time to complete, and during this limited time window, the original memory may be modified either by the presentation of new information or with pharmacological agents. Such findings have prompted rising interest in using disruption during reconsolidation as a clinical intervention for anxiety, posttraumatic stress, and substance use disorders. However, "boundary conditions" on memory reconsolidation may pose significant obstacles to clinical translation. The aim of this article is to critically examine the nature of these boundary conditions, their neurobiological substrates, and the potential effect they may have on disruption of reconsolidation as a clinical intervention. These boundary conditions also highlight potential constraints on the reconsolidation phenomenon and suggest a limited role for memory updating consistent with evolutionary accounts of associative learning for threat and reward. We conclude with suggestions for future research needed to elucidate the precise conditions under which reconsolidation disruption may be clinically useful.

Free recall test experience potentiates strategy-driven effects of value on memory

People tend to show better memory for information that is deemed valuable or important. By one mechanism, individuals selectively engage deeper, semantic encoding strategies for high value items (Cohen, Rissman, Suthana, Castel, & Knowlton, 2014). By another mechanism, information paired with value or reward is automatically strengthened in memory via dopaminergic projections from midbrain to hippocampus (Shohamy & Adcock, 2010). We hypothesized that the latter mechanism would primarily enhance recollection-based memory, while the former mechanism would strengthen both recollection and familiarity. We also hypothesized that providing interspersed tests during study is a key to encouraging selective engagement of strategies. To test these hypotheses, we presented participants with sets of words, and each word was associated with a high or low point value. In some experiments, free recall tests were given after each list. In all experiments, a recognition test was administered 5 minutes after the final word list. Process dissociation was accomplished via remember/know judgments at recognition, a recall test probing both item memory and memory for a contextual detail (word plurality), and a task dissociation combining a recognition test for plurality (intended to probe recollection) with a speeded item recognition test (to probe familiarity). When recall tests were administered after study lists, high value strengthened both recollection and familiarity. When memory was not tested after each study list, but rather only at the end, value increased recollection but not familiarity. These dual process dissociations suggest that interspersed recall tests guide learners' use of metacognitive control to selectively apply effective encoding strategies. (PsycINFO Database Record

Dissociable profiles of generalization/discrimination in the human hippocampus during associative retrieval

When encountering stimuli that vary slightly from previous experiences, neural signals within the CA₃ and dentate gyrus (CA₃ DG) hippocampal subfields are thought to facilitate mnemonic discrimination, whereas CA₁ may be less sensitive to minor stimulus changes, allowing for generalization across similar events. Studies have also posited a critical role for CA₁ in the comparison of events to memory-derived expectations, but the degree to which these processes are impacted by explicit retrieval demands is yet unclear. To evaluate extant accounts of hippocampal subfield function, we acquired high-resolution fMRI data as participants performed a task in which famous names were used to cue the retrieval of previously paired images. Although both left CA₃ DG and CA₁ showed match enhancement effects, responding more to original paired images (targets) than to never-before-seen images (novels), the sensitivity of these subfields to stimulus changes and task demands diverged. CA₃ DG showed a goal-independent, yet highly specific, preference for previously encountered stimuli, responding equally strongly to targets and mispaired associates, while showing equally weak responses to close lures and novels. In contrast, recognition signals in CA₁ were goal-dependent (i.e., not evoked by mispaired associates), yet accommodating of subtle stimulus differences, such that close lures evoked comparable activity as targets. © 2016 Wiley Periodicals, Inc.

Decoding fMRI Signatures of Real-world Autobiographical Memory Retrieval

Extant neuroimaging data implicate frontoparietal and medial-temporal lobe regions in episodic retrieval, and the specific pattern of activity within and across these regions is diagnostic of an individual's subjective mnemonic experience. For example, in laboratory-based paradigms, memories for recently encoded faces can be accurately decoded from single-trial fMRI patterns [Uncapher, M. R., Boyd-Meredith, J. T., Chow, T. E., Rissman, J., & Wagner, A. D. Goal-directed modulation of neural memory patterns: Implications for fMRI-based memory detection. Journal of Neuroscience, 35, 8531–8545, 2015; Rissman, J., Greely, H. T., & Wagner, A. D. Detecting individual memories through the neural decoding of memory states and past experience. Proceedings of the National Academy of Sciences, U.S.A., 107, 9849–9854, 2010]. Here, we investigated the neural patterns underlying memory for real-world autobiographical events, probed at 1- to 3-week retention intervals as well as whether distinct patterns are associated with different subjective memory states. For 3 weeks, participants (n = 16) wore digital cameras that captured photographs of their daily activities. One week later, they were scanned while making memory judgments about sequences of photos depicting events from their own lives or events captured by the cameras of others. Whole-brain multivoxel pattern analysis achieved near-perfect accuracy at distinguishing correctly recognized events from correctly rejected novel events, and decoding performance did not significantly vary with retention interval. Multivoxel pattern classifiers also differentiated recollection from familiarity and reliably decoded the subjective strength of recollection, of familiarity, or of novelty. Classification-based brain maps revealed dissociable neural signatures of these mnemonic states, with activity patterns in hippocampus, medial PFC, and ventral parietal cortex being particularly diagnostic of recollection. Finally, a classifier trained on previously acquired laboratory-based memory data achieved reliable decoding of autobiographical memory states. We discuss the implications for neuroscientific accounts of episodic retrieval and comment on the potential forensic use of fMRI for probing experiential knowledge.

Shared and distinct contributions of rostrolateral prefrontal cortex to analogical reasoning and episodic memory retrieval

Rostrolateral prefrontal cortex (RLPFC) is widely appreciated to support higher cognitive functions, including analogical reasoning and episodic memory retrieval. However, these tasks have typically been studied in isolation, and thus it is unclear whether they involve common or distinct RLPFC mechanisms. Here, we introduce a novel functional magnetic resonance imaging (fMRI) task paradigm to compare brain activity during reasoning and memory tasks while holding bottom-up perceptual stimulation and response demands constant. Univariate analyses on fMRI data from twenty participants identified a large swath of left lateral prefrontal cortex, including RLPFC, that showed common engagement on reasoning trials with valid analogies and memory trials with accurately retrieved source details. Despite broadly overlapping recruitment, multi-voxel activity patterns within left RLPFC reliably differentiated these two trial types, highlighting the presence of at least partially distinct information processing modes. Functional connectivity analyses demonstrated that while left RLPFC showed consistent coupling with the fronto-parietal control network across tasks, its coupling with other cortical areas varied in a task-dependent manner. During the memory task, this region strengthened its connectivity with the default mode and memory retrieval networks, whereas during the reasoning task it coupled more strongly with a nearby left prefrontal region (BA 45) associated with semantic processing, as well as with a superior parietal region associated with visuospatial processing. Taken together, these data suggest a domain-general role for left RLPFC in monitoring and/or integrating task-relevant knowledge representations and showcase how its function cannot solely be attributed to episodic memory or analogical reasoning computations.

Effects of aging on value-directed modulation of semantic network activity during verbal learning

While impairments in memory recall are apparent in aging, older adults show a remarkably preserved ability to selectively remember information deemed valuable. Here, we use fMRI to compare brain activation in healthy older and younger adults during encoding of high and low value words to determine whether there are differences in how older adults achieve value-directed memory selectivity. We find that memory selectivity in older adults is associated with value-related changes in activation during word presentation in left hemisphere regions that are involved in semantic processing, similar to young adults. However, highly selective young adults show a relatively greater increase in semantic network activity during encoding of high-value items, whereas highly selective older adults show relatively diminished activity during encoding of low-value items. Additionally, only younger adults showed value-related increases in activity in semantic and reward processing regions during presentation of the value cue preceding each to-be-remembered word. Young adults therefore respond to cue value more proactively than do older adults, yet the magnitude of value-related differences in cue period brain activity did not predict individual differences in memory selectivity. Thus, our data also show that age-related reductions in prestimulus activity do not always lead to inefficient performance.

Cortical reinstatement mediates the relationship between content-specific encoding activity and subsequent recollection decisions

Episodic recollection entails the conscious remembrance of event details associated with previously encountered stimuli. Recollection depends on both the establishment of cortical representations of event features during stimulus encoding and the cortical reinstatement of these representations at retrieval. Here, we used multivoxel pattern analyses of functional magnetic resonance imaging data to examine how cortical and hippocampal activity at encoding and retrieval drive recollective memory decisions. During encoding, words were associated with face or scene source contexts. At retrieval, subjects were cued to recollect the source associate of each presented word. Neurally derived estimates of encoding strength and pattern reinstatement in occipitotemporal cortex were computed for each encoding and retrieval trial, respectively. Analyses demonstrated that (1) cortical encoding strength predicted subsequent memory accuracy and reaction time, (2) encoding strength predicted encoding-phase hippocampal activity, and (3) encoding strength and retrieval-phase hippocampal activity predicted the magnitude of cortical reinstatement. Path analyses further indicated that cortical reinstatement partially mediated both the effect of cortical encoding strength and the effect of retrieval-phase hippocampal activity on subsequent source memory performance. Taken together, these results indicate that memory-guided decisions are driven in part by a pathway leading from hippocampally linked cortical encoding of event attributes to hippocampally linked cortical reinstatement at retrieval.

Distributed representations in memory: insights from functional brain imaging

Forging new memories for facts and events, holding critical details in mind on a moment-to-moment basis, and retrieving knowledge in the service of current goals all depend on a complex interplay between neural ensembles throughout the brain. Over the past decade, researchers have increasingly utilized powerful analytical tools (e.g., multivoxel pattern analysis) to decode the information represented within distributed functional magnetic resonance imaging activity patterns. In this review, we discuss how these methods can sensitively index neural representations of perceptual and semantic content and how leverage on the engagement of distributed representations provides unique insights into distinct aspects of memory-guided behavior. We emphasize that, in addition to characterizing the contents of memories, analyses of distributed patterns shed light on the processes that influence how information is encoded, maintained, or retrieved, and thus inform memory theory. We conclude by highlighting open questions about memory that can be addressed through distributed pattern analyses.

Multi-voxel patterns of visual category representation during episodic encoding are predictive of subsequent memory

Successful encoding of episodic memories is thought to depend on contributions from prefrontal and temporal lobe structures. Neural processes that contribute to successful encoding have been extensively explored through univariate analyses of neuroimaging data that compare mean activity levels elicited during the encoding of events that are subsequently remembered vs. those subsequently forgotten. Here, we applied pattern classification to fMRI data to assess the degree to which distributed patterns of activity within prefrontal and temporal lobe structures elicited during the encoding of word-image pairs were diagnostic of the visual category (Face or Scene) of the encoded image. We then assessed whether representation of category information was predictive of subsequent memory. Classification analyses indicated that temporal lobe structures contained information robustly diagnostic of visual category. Information in prefrontal cortex was less diagnostic of visual category, but was nonetheless associated with highly reliable classifier-based evidence for category representation. Critically, trials associated with greater classifier-based estimates of category representation in temporal and prefrontal regions were associated with a higher probability of subsequent remembering. Finally, consideration of trial-by-trial variance in classifier-based measures of category representation revealed positive correlations between prefrontal and temporal lobe representations, with the strength of these correlations varying as a function of the category of image being encoded. Together, these results indicate that multi-voxel representations of encoded information can provide unique insights into how visual experiences are transformed into episodic memories.

Imaging the human medial temporal lobe with high-resolution fMRI

High-resolution functional MRI (hr-fMRI) affords unique leverage on the functional properties of human medial temporal lobe (MTL) substructures. We review initial hr-fMRI efforts to delineate (1) encoding and retrieval processes within the hippocampal circuit, (2) hippocampal subfield contributions to pattern separation and pattern completion, and (3) the representational capabilities of distinct MTL subregions. Extant data reveal functional heterogeneity within human MTL and highlight the promise of hr-fMRI for bridging human, animal, and computational approaches to understanding MTL function.

The effect of non-visual working memory load on top-down modulation of visual processing

While a core function of the working memory (WM) system is the active maintenance of behaviorally relevant sensory representations, it is also critical that distracting stimuli are appropriately ignored. We used functional magnetic resonance imaging to examine the role of domain-general WM resources in the top-down attentional modulation of task-relevant and irrelevant visual representations. In our dual-task paradigm, each trial began with the auditory presentation of six random (high load) or sequentially ordered (low load) digits. Next, two relevant visual stimuli (e.g., faces), presented amongst two temporally interspersed visual distractors (e.g., scenes), were to be encoded and maintained across a 7-s delay interval, after which memory for the relevant images and digits was probed. When taxed by high load digit maintenance, participants exhibited impaired performance on the visual WM task and a selective failure to attenuate the neural processing of task-irrelevant scene stimuli. The over-processing of distractor scenes under high load was indexed by elevated encoding activity in a scene-selective region-of-interest relative to low load and passive viewing control conditions, as well as by improved long-term recognition memory for these items. In contrast, the load manipulation did not affect participants' ability to upregulate activity in this region when scenes were task-relevant. These results highlight the critical role of domain-general WM resources in the goal-directed regulation of distractor processing. Moreover, the consequences of increased WM load in young adults closely resemble the effects of cognitive aging on distractor filtering [Gazzaley, A., Cooney, J. W., Rissman, J., & D'Esposito, M. (2005). Top-down suppression deficit underlies working memory impairment in normal aging. Nature Neuroscience 8, 1298-1300], suggesting the possibility of a common underlying mechanism.

Functional interactions between prefrontal and visual association cortex contribute to top-down modulation of visual processing

Attention-dependent modulation of neural activity in visual association cortex (VAC) is thought to depend on top-down modulatory control signals emanating from the prefrontal cortex (PFC). In a previous functional magnetic resonance imaging study utilizing a working memory task, we demonstrated that activity levels in scene-selective VAC (ssVAC) regions can be enhanced above or suppressed below a passive viewing baseline level depending on whether scene stimuli were attended or ignored (Gazzaley, Cooney, McEvoy, et al. 2005). Here, we use functional connectivity analysis to identify possible sources of these modulatory influences by examining how network interactions with VAC are influenced by attentional goals at the time of encoding. Our findings reveal a network of regions that exhibit strong positive correlations with a ssVAC seed during all task conditions, including foci in the left middle frontal gyrus (MFG). This PFC region is more correlated with the VAC seed when scenes were remembered and less correlated when scenes were ignored, relative to passive viewing. Moreover, the strength of MFG-VAC coupling correlates with the magnitude of attentional enhancement and suppression of VAC activity. Although our correlation analyses do not permit assessment of directionality, these findings suggest that PFC biases activity levels in VAC by adjusting the strength of functional coupling in accordance with stimulus relevance.

Dynamic adjustments in prefrontal, hippocampal, and inferior temporal interactions with increasing visual working memory load

The maintenance of visual stimuli across a delay interval in working memory tasks is thought to involve reverberant neural communication between the prefrontal cortex and posterior visual association areas. Recent studies suggest that the hippocampus might also contribute to this retention process, presumably via reciprocal interactions with visual regions. To characterize the nature of these interactions, we performed functional connectivity analysis on an event-related functional magnetic resonance imaging data set in which participants performed a delayed face recognition task. As the number of faces that participants were required to remember was parametrically increased, the right inferior frontal gyrus (IFG) showed a linearly decreasing degree of functional connectivity with the fusiform face area (FFA) during the delay period. In contrast, the hippocampus linearly increased its delay period connectivity with both the FFA and the IFG as the mnemonic load increased. Moreover, the degree to which participants' FFA showed a load-dependent increase in its connectivity with the hippocampus predicted the degree to which its connectivity with the IFG decreased with load. Thus, these neural circuits may dynamically trade off to accommodate the particular mnemonic demands of the task, with IFG-FFA interactions mediating maintenance at lower loads and hippocampal interactions supporting retention at higher loads.

Modulation of inferotemporal cortex activation during verbal working memory maintenance

Regions of the left inferotemporal cortex are involved in visual word recognition and semantics. We utilized functional magnetic resonance imaging to localize an inferotemporal language area and to demonstrate that this area is involved in the active maintenance of visually presented words in working memory. Maintenance activity in this inferotemporal area showed an effect of memory load for words, but not pseudowords. In the absence of visual input, the selective modulation of this language-related inferotemporal area for the maintenance of words is accompanied by an increased functional connectivity with left prefrontal cortex. These results demonstrate an involvement of inferotemporal cortex in verbal working memory and provide neurophysiological support for the notion that nonphonological language representations can be recruited in the service of verbal working memory. More generally, they suggest that verbal working memory should be conceptualized as the frontally guided, sustained activation of pre-existing cortical language representations.

Top-down suppression deficit underlies working memory impairment in normal aging

In this study, we assess the impact of normal aging on top-down modulation, a cognitive control mechanism that supports both attention and memory by the suppression and enhancement of sensory processing in accordance with task goals. Using fMRI (functional magnetic resonance imaging), we show that healthy older adults demonstrated a prominent deficit in the suppression of cortical activity associated with task-irrelevant representations, whereas enhancement of task-relevant activity was preserved. Moreover, this suppression-specific attention deficit correlated with impaired working memory performance.

The Perception of Voice Onset Time: An fMRI Investigation of Phonetic Category Structure

This study explored the neural systems underlying the perception of phonetic category structure by investigating the perception of a voice onset time (VOT) continuum in a phonetic categorization task. Stimuli consisted of five synthetic speech stimuli which ranged in VOT from 0 msec ([da]) to 40 msec ([ta]). Results from 12 subjects showed that the neural system is sensitive to VOT differences of 10 msec and that details of phonetic category structure are retained throughout the phonetic processing stream. Both the left inferior frontal gyrus (IFG) and cingulate showed graded activation as a function of category membership with increasing activation as stimuli approached the phonetic category boundary. These results are consistent with the view that the left IFG is involved in phonetic decision processes, with the extent of activation influenced by increased resources devoted to resolving phonetic category membership and/or selecting between competing phonetic categories. Activation patterns in the cingulate suggest that it is sensitive to stimulus difficulty and resolving response conflict. In contrast, activation in the posterior left middle temporal gyrus and the left angular gyrus showed modulation of activation only to the “best fit” of the phonetic category, suggesting that these areas are involved in mapping sound structure to its phonetic representation. The superior temporal gyrus (STG) bilaterally showed weaker sensitivity to the differences in phonetic category structure, providing further evidence that the STG is involved in the early analysis of the sensory properties of speech.

Functional connectivity during working memory maintenance

Neurophysiological experiments with monkeys have demonstrated that working memory (WM) is associated with persistent neural activity in multiple brain regions, such as the prefrontal cortex (PFC), the parietal cortex, and posterior unimodal association areas. WM maintenance is believed to require the coordination of these brain regions, which do not function in isolation but, rather, interact to maintain visual percepts that are no longer present in the environment. However, single-unit physiology studies and traditional univariate analyses of functional brain imaging data cannot evaluate interactions between distant brain regions, and so evidence of regional integration during WM maintenance is largely indirect. In this study, we utilized a recently developed multivariate analysis method that allows us to explore functional connectivity between brain regions during the distinct stages of a delayed face recognition task. To characterize the neural network mediating the on-line maintenance of faces, the fusiform face area (FFA) was defined as a seed and was then used to generate whole-brain correlation maps. A random effects analysis of the correlation data revealed a network of brain regions exhibiting significant correlations with the FFA seed during the WM delay period. This maintenance network included the dorsolateral and ventrolateral PFC, the premotor cortex, the intraparietal sulcus, the caudate nucleus, the thalamus, the hippocampus, and occipitotemporal regions. These findings support the notion that the coordinated functional interaction between nodes of a widely distributed network underlies the active maintenance of a perceptual representation.

The role of lexical competition and acoustic-phonetic structure in lexical processing: evidence from normal subjects and aphasic patients

This study examined the effects that the acoustic-phonetic structure of a stimulus exerts on the processes by which lexical candidates compete for activation. An auditory lexical decision paradigm was used to investigate whether shortening the VOT of an initial voiceless stop consonant in a real word results in the activation of the lexical-semantic network of its voiced competitor, i.e., does acoustically modified time prime penny via dime. Results for normal subjects showed semantic priming for related pairs and mediated priming for voiced competitors, consistent with cascade models of language processing allowing for interaction between phonological and semantic levels of processing. Although Broca's aphasics showed semantic priming (dime primed penny), they failed to show priming in the context of a lexical competitor. These results are consistent with the hypothesis that these patients have a lexical processing deficit characterized by an overall reduction in lexical activation.

Measuring functional connectivity during distinct stages of a cognitive task

The inherently multivariate nature of functional brain imaging data affords the unique opportunity to explore how anatomically disparate brain areas interact during cognitive tasks. We introduce a new method for characterizing inter-regional interactions using event-related functional magnetic resonance imaging (fMRI) data. This method's principle advantage over existing analytical techniques is its ability to model the functional connectivity between brain regions during distinct stages of a cognitive task. The method is implemented by using separate covariates to model the activity evoked during each stage of each individual trial in the context of the general linear model (GLM). The resulting parameter estimates (beta values) are sorted according to the stage from which they were derived to form a set of stage-specific beta series. Regions whose beta series are correlated during a given stage are inferred to be functionally interacting during that stage. To validate the assumption that correlated fluctuations in trial-to-trial beta values imply functional connectivity, we applied the method to an event-related fMRI data set in which subjects performed two sequence-tapping tasks. In concordance with previous electrophysiological and fMRI coherence studies, we found that the task requiring greater bimanual coordination induced stronger correlations between motor regions of the two hemispheres. The method was then applied to an event-related fMRI data set in which subjects performed a delayed recognition task. Distinct functional connectivity maps were generated during the component stages of this task, illustrating how important and novel observations of neural networks within the isolated stages of a cognitive task can be obtained.

Functional connectivity with the hippocampus during successful memory formation

Although it is well established that the hippocampus is critical for episodic memory, little is known about how the hippocampus interacts with cortical regions during successful memory formation. Here, we used event-related functional magnetic resonance imaging (fMRI) to identify areas that exhibited differential functional connectivity with the hippocampus during processing of novel objects that were subsequently remembered or forgotten on a postscan test. Functional connectivity with the hippocampus was enhanced during successful, as compared with unsuccessful, memory formation, in a distributed network of limbic cortical areas-including perirhinal, orbitofrontal, and retrosplenial/posterior cingulate cortex-that are anatomically connected with the hippocampal formation. Increased connectivity was also observed in lateral temporal, medial parietal, and medial occipital cortex. These findings demonstrate that successful memory formation is associated with transient increases in cortico-hippocampal interaction.

An Event-Related fMRI Investigation of Implicit Semantic Priming

The neural basis underlying implicit semantic priming was investigated using event-related fMRI. Prime-target pairs were presented auditorily for lexical decision (LD) on the target stimulus, which was either semantically related or unrelated to the prime, or was a nonword. A tone task was also administered as a control. Behaviorally, all participants demonstrated semantic priming in the LD task. fMRI results showed that for all three conditions of the LD task, activation was seen in the superior temporal gyrus (STG), the middle temporal gyrus (MTG), and the inferior parietal lobe, with greater activation in the unrelated and nonword conditions than in the related condition. Direct comparisons of the related and unrelated conditions revealed foci in the left STG, left precentral gyrus, left and right MTGs, and right caudate, exhibiting significantly lower activation levels in the related condition. The reduced activity in the temporal lobe suggests that the perception of the prime word activates a lexical— semantic network that shares common elements with the target word, and, thus, the target can be recognized with enhanced neural efficiency. The frontal lobe reductions most likely reflect the increased efficiency in monitoring the activation of lexical representations in the temporal lobe, making a decision, and planning the appropriate motor response.