Rapid retinotopic reactivation during spatial memory

Spatial memory encoding is associated with the anterior and posterior hippocampus: An fMRI activation likelihood estimation meta-analysis

It has been hypothesized that differential processing occurs along the longitudinal (anterior-posterior) axis of the hippocampus. One hypothesis is that spatial memory (during both encoding and retrieval) is associated with the posterior hippocampus. An alternative hypothesis is that memory encoding (either spatial or nonspatial) is associated with the anterior hippocampus and memory retrieval is associated with the posterior hippocampus. Of importance, during spatial memory encoding, the spatial-posterior hypothesis predicts posterior hippocampal involvement, whereas the encoding-retrieval hypothesis predicts anterior hippocampal involvement. To distinguish between these hypotheses, we conducted a coordinate-based fMRI activation likelihood estimation (ALE) meta-analysis of 26 studies (with a total of 435 participants) that reported hippocampal activity during spatial memory encoding and/or spatial memory retrieval. Both spatial memory encoding and spatial memory retrieval produced extensive activity along the longitudinal axis of the hippocampus as well as the entorhinal cortex, the perirhinal cortex, and the parahippocampal cortex. Critically, the contrast of spatial memory encoding and spatial memory retrieval produced activations in both the anterior hippocampus and the posterior hippocampus. That spatial memory encoding produced activity in both the anterior and posterior hippocampus can be taken to reject strict forms of the spatial-posterior hypothesis, which stipulates that all forms of spatial memory produce activity in the posterior hippocampus, and the encoding-retrieval hypothesis, which stipulates that all forms of encoding versus retrieval produce activity in only the anterior hippocampus. Our results indicate that spatial memory encoding can involve the anterior hippocampus and the posterior hippocampus.

Behavioral asymmetries in visual short-term memory occur in retinotopic coordinates

Visual short-term memory (VSTM) is an essential store that creates continuous representations from disjointed visual input. However, severe capacity limits exist, reflecting constraints in supporting brain networks. VSTM performance shows spatial biases predicted by asymmetries in the brain based upon the location of the remembered object. Visual representations are retinotopic, or relative to location of the representation on the retina. It therefore stands to reason that memory performance may also show retinotopic biases. Here, eye position was manipulated to tease apart retinotopic coordinates from spatiotopic coordinates, or location relative to the external world. Memory performance was measured while participants performed a color change-detection task for items presented across the visual field while subjects fixated central or peripheral position. VSTM biases reflected the location of the stimulus on the retina, regardless of where the stimulus appeared on the screen. Therefore, spatial biases occur in retinotopic coordinates in VSTM and suggest a fundamental link between behavioral VSTM measures and visual representations.

Confident false memories for spatial location are mediated by V1

Prior functional magnetic resonance imaging (fMRI) results suggest that true memories, but not false memories, activate early sensory cortex. It is thought that false memories, which reflect conscious processing, do not activate early sensory cortex because these regions are associated with nonconscious processing. We posited that false memories may activate the earliest visual cortical processing region (i.e., V1) when task conditions are manipulated to evoke conscious processing in this region. In an fMRI experiment, abstract shapes were presented to the left or right of fixation during encoding. During retrieval, old shapes were presented at fixation and participants characterized each shape as previously on the "left" or "right" followed by an "unsure"-"sure"-"very sure" confidence rating. False memories for spatial location (i.e., "right"/left or "left"/right trials with "sure" or "very sure" confidence ratings) were associated with activity in bilateral early visual regions, including V1. In a follow-up fMRI-guided transcranial magnetic stimulation (TMS) experiment that employed the same paradigm, we assessed whether V1 activity was necessary for false memory construction. Between the encoding phase and the retrieval phase of each run, TMS (1 Hz, 8 min) was used to target the location of false memory activity (identified in the fMRI experiment) in left V1, right V1, or the vertex (control site). Confident false memories for spatial location were significantly reduced following TMS to V1, as compared to vertex. The results of the present experiments provide convergent evidence that early sensory cortex can contribute to false memory construction under particular task conditions.

False memories for shape activate the lateral occipital complex

Previous functional magnetic resonance imaging evidence has shown that false memories arise from higher-level conscious processing regions rather than lower-level sensory processing regions. In the present study, we assessed whether the lateral occipital complex (LOC)—a lower-level conscious shape processing region—was associated with false memories for shape. During encoding, participants viewed intact or scrambled colored abstract shapes. During retrieval, colored disks were presented and participants indicated whether the corresponding item was previously “intact” or “scrambled.” False memories for shape (“intact”/scrambled > “scrambled”/scrambled) activated LOC, which indicates lower-level sensory processing regions can support false memory.

Effect of emotional valence on retrieval-related recapitulation of encoding activity in the ventral visual stream

While prior work has shown greater retrieval-related reactivation in the ventral visual stream for emotional stimuli compared to neutral stimuli, the effects of valence on retrieval-related recapitulation of successful encoding processes (Dm effects) have yet to be investigated. Here, seventeen participants (aged 19-35) studied line drawings of negative, positive, or neutral images followed immediately by the complete photo. After a 20-min delay, participants performed a challenging recognition memory test, distinguishing the studied line drawing outlines from novel ones. First, results replicated earlier work by demonstrating that negative and positive hits elicited greater ventral occipito-temporal cortex (VOTC) activity than neutral hits during both encoding and retrieval. Moreover, the amount of activation in portions of the VOTC correlated with the magnitude of participants' emotional memory enhancement. Second, results revealed significant retrieval-related recapitulation of Dm effects (Hits>Misses) in VOTC (anterior inferior temporal gyri) only for negative stimuli. Third, connectivity between the amygdala and fusiform gyrus during the encoding of negative stimuli increased the likelihood of fusiform activation during successful retrieval. Together, these results suggest that recapitulation in posterior VOTC reflects memory for the affective dimension of the stimuli (Emotional Hits>Neutral Hits) and the magnitude of activation in some of these regions is related to superior emotional memory. Moreover, for negative stimuli, recapitulation in more anterior portions of the VOTC is greater for remembered than forgotten items. The current study offers new evidence for effects of emotion on recapitulation of activity and functional connectivity in support of memory.

Memory for shape reactivates the lateral occipital complex

Memory is thought to be a constructive process in which the cortical regions associated with processing event features are reactivated during retrieval. Although there is evidence for non-detailed cortical reactivation during retrieval (e.g., memory for visual or auditory information reactivates the visual or auditory processing regions, respectively), there is limited evidence that memory can reactivate cortical regions associated with processing detailed, feature-specific information. Such evidence is critical to our understanding of the mechanisms of episodic retrieval. The present functional magnetic resonance imaging (fMRI) study assessed whether the lateral occipital complex (LOC), a region that preferentially processes shape, is associated with retrieval of shape information. During encoding, participants were presented with colored abstract shapes that were either intact or scrambled. During retrieval, colored disks were presented and participants indicated whether the corresponding shape was previously "intact" or "scrambled". To assess whether conscious retrieval of intact shapes reactivated LOC, we conducted a conjunction of shape perception/encoding and accurate versus inaccurate retrieval of intact shapes, which produced many activations in LOC. To determine whether activity in LOC was specific to intact shapes, we conducted a conjunction of shape perception/encoding and intact versus scrambled shapes, which also produced many activations in LOC. Furthermore, memory for intact shapes in each hemifield produced contralateral activity in LOC (e.g., memory for left visual field intact shapes activated right LOC), which reflects the specific reinstatement of perception/encoding activity. The present results extend previous feature-specific memory reactivation evidence and support the view that memory is a constructive process.

Cortical reinstatement and the confidence and accuracy of source memory

Cortical reinstatement refers to the overlap between neural activity elicited during the encoding and the subsequent retrieval of an episode, and is held to reflect retrieved mnemonic content. Previous findings have demonstrated that reinstatement effects reflect the quality of retrieved episodic information as this is operationalized by the accuracy of source memory judgments. The present functional magnetic resonance imaging (fMRI) study investigated whether reinstatement-related activity also co-varies with the confidence of accurate source judgments. Participants studied pictures of objects along with their visual or spoken names. At test, they first discriminated between studied and unstudied pictures and then, for each picture judged as studied, they also judged whether it had been paired with a visual or auditory name, using a three-point confidence scale. Accuracy of source memory judgments- and hence the quality of the source-specifying information--was greater for high than for low confidence judgments. Modality-selective retrieval-related activity (reinstatement effects) also co-varied with the confidence of the corresponding source memory judgment. The findings indicate that the quality of the information supporting accurate judgments of source memory is indexed by the relative magnitude of content-selective, retrieval-related neural activity.

Human fMRI reveals that delayed action re-recruits visual perception

Behavioral and neuropsychological research suggests that delayed actions rely on different neural substrates than immediate actions; however, the specific brain areas implicated in the two types of actions remain unknown. We used functional magnetic resonance imaging (fMRI) to measure human brain activation during delayed grasping and reaching. Specifically, we examined activation during visual stimulation and action execution separated by a 18-s delay interval in which subjects had to remember an intended action toward the remembered object. The long delay interval enabled us to unambiguously distinguish visual, memory-related, and action responses. Most strikingly, we observed reactivation of the lateral occipital complex (LOC), a ventral-stream area implicated in visual object recognition, and early visual cortex (EVC) at the time of action. Importantly this reactivation was observed even though participants remained in complete darkness with no visual stimulation at the time of the action. Moreover, within EVC, higher activation was observed for grasping than reaching during both vision and action execution. Areas in the dorsal visual stream were activated during action execution as expected and, for some, also during vision. Several areas, including the anterior intraparietal sulcus (aIPS), dorsal premotor cortex (PMd), primary motor cortex (M1) and the supplementary motor area (SMA), showed sustained activation during the delay phase. We propose that during delayed actions, dorsal-stream areas plan and maintain coarse action goals; however, at the time of execution, motor programming requires re-recruitment of detailed visual information about the object through reactivation of (1) ventral-stream areas involved in object perception and (2) early visual areas that contain richly detailed visual representations, particularly for grasping.

Conscious processing during retrieval can occur in early and late visual regions

Previous evidence has suggested a functional-anatomic dissociation between conscious and nonconscious processing during retrieval where early visual regions BA17/18 are associated with nonconscious processing and late visual regions BA19/37 are associated with conscious processing. However, evidence for this dissociation has only been observed using a limited number of experimental paradigms. In the present functional magnetic resonance imaging (fMRI) study, we tested the hypothesis that conscious processing during retrieval can occur in BA17/18 using memorial paradigms that recruited processing in these early visual regions. During the encoding phase of Experiment 1, abstract shapes with colored and oriented internal lines were presented to the left and right of fixation. During the retrieval phase, old shapes and new shapes were presented at fixation and participants classified each item as "old-left", "old-right", or "new". The contrast of spatial memory-hits>spatial memory-misses (with accurate item memory) produced activity in BA17/18. During the encoding phase of Experiment 2, abstract shapes with colored and oriented internal lines were presented at fixation. During the retrieval phase, old shapes, changed shapes (with the same outline but different colored and oriented internal lines), and new shapes were presented at fixation and participants made an old-new classification during runs with a specific retrieval orientation or a non-specific retrieval orientation. Critically, the contrast of old-hits>old-misses during specific retrieval orientation produced activity in BA17/18. The results of the present experiments support the hypothesis that conscious processing during retrieval can occur in BA17/18.

fMRI correlates of working memory: specific posterior representation sites for motion and position information

We assume that working memory is provided by a network comprising domain-general anterior and different domain-specific posterior brain areas depending on the type of stimulus and the task demands. Based on imaging studies from perception, we hypothesized that dynamic spatial (motion) and static spatial (position) information can be dissociated during retention in working memory. Participants were presented with a moving dot. About one second after stimulus presentation, a cue indicated whether its motion or end position should be held in memory. Six seconds later, a second stimulus was shown which was to be compared with the first one with respect to identity on the cued dimension. In the baseline condition, the cue indicated that no memory task would follow. We contrasted activity during maintenance of the different features. Differential activations in regions related to motion perception (area hMT/V5+, superior temporal sulcus) were observed in the motion working memory task. For position working memory, enhanced activations in a right brain region at the temporo-parieto-occipital junction emerged. The results are discussed with respect to domain-specific regions active in perception and how they can be also involved in short term retention for those very features. It is suggested that two types of spatial information categories can be dissociated: dynamic spatial (motion) and static spatial (position) information seem to be processed by different working memory structures.

Memory for motion and spatial location is mediated by contralateral and ipsilateral motion processing cortex

Memory and perception have been associated with common sensory cortical activity. However, previous studies have only investigated memory and perception effects associated with a single feature (i.e., spatial location or color). The aim of the present functional magnetic resonance imaging (fMRI) and transcranial magnetic stimulation (TMS) study was to assess whether memory for multiple (two) features would produce sensory cortical activity that mirrored perceptual processing of the same features. During encoding, moving or stationary abstract shapes were presented to the right or left of fixation. During retrieval, shapes were presented at fixation and participants classified each item as previously in motion or stationary within the right or left visual field. Memory for items in motion, regardless of spatial location, produced fMRI activity in perceptual motion processing region MT+. Memory for motion and spatial location produced contralateral and ipsilateral fMRI activity in perceptual motion processing sub-region MT. Following TMS to MT, memory for motion was impaired, but performance did not differ between the contralateral and ipsilateral visual fields. The present results are consistent with previous findings in that memory for motion produced fMRI activity in MT+ and was impaired following TMS to MT. However, memory for motion and spatial location produced contralateral and ipsilateral fMRI and TMS effects, deviating from the primarily contralateral perceptual processing organization of MT. The present evidence suggests that during memory for motion and spatial location only motion information is coded in motion processing cortex, while previous findings suggest spatial location information is coded in earlier extrastriate cortex.

High density event-related potential data acquisition in cognitive neuroscience

Functional magnetic resonance imaging (fMRI) is currently the standard method of evaluating brain function in the field of Cognitive Neuroscience, in part because fMRI data acquisition and analysis techniques are readily available. Because fMRI has excellent spatial resolution but poor temporal resolution, this method can only be used to identify the spatial location of brain activity associated with a given cognitive process (and reveals virtually nothing about the time course of brain activity). By contrast, event-related potential (ERP) recording, a method that is used much less frequently than fMRI, has excellent temporal resolution and thus can track rapid temporal modulations in neural activity. Unfortunately, ERPs are under utilized in Cognitive Neuroscience because data acquisition techniques are not readily available and low density ERP recording has poor spatial resolution. In an effort to foster the increased use of ERPs in Cognitive Neuroscience, the present article details key techniques involved in high density ERP data acquisition. Critically, high density ERPs offer the promise of excellent temporal resolution and good spatial resolution (or excellent spatial resolution if coupled with fMRI), which is necessary to capture the spatial-temporal dynamics of human brain function.

Synchronous retinotopic frontal-temporal activity during long-term memory for spatial location

Early visual areas in occipital cortex are known to be retinotopic. Recently, retinotopic maps have been reported in frontal and parietal cortex during spatial attention and working memory. The present event-related potential (ERP) and functional magnetic resonance imaging (fMRI) study determined whether spatial long-term memory was associated with retinotopic activity in frontal and parietal regions, and assessed whether retinotopic activity in these higher level control regions was synchronous with retinotopic activity in lower level visual sensory regions. During encoding, abstract shapes were presented to the left or right of fixation. During retrieval, old and new shapes were presented at fixation and participants classified each shape as old and previously on the "left", old and previously on the "right", or "new". Retinotopic effects were manifested by accurate memory for items previously presented on the left producing activity in the right hemisphere and accurate memory for items previously presented on the right producing activity in the left hemisphere. Retinotopic ERP activity was observed in frontal regions and visual sensory (occipital and temporal) regions. In frontal cortex, retinotopic fMRI activity was localized to the frontal eye fields. There were no significant ERP or fMRI retinotopic memory effects in parietal regions. The present long-term memory retinotopic effects complement previous spatial attention and working memory findings (and suggest retinotopic activity in parietal cortex may require an external peripheral stimulus). Furthermore, ERP cross-correlogram analysis revealed that retinotopic activations in frontal and temporal regions were synchronous, indicating that these regions interact during retrieval of spatial information.

Conscious and nonconscious memory effects are temporally dissociable

Intentional (explicit) retrieval can reactivate sensory cortex, which is widely assumed to reflect conscious processing. In the present study, we used an explicit visual memory event-related potential paradigm to investigate whether such retrieval related sensory activity could be separated into conscious and nonconscious components. During study, abstract shapes were presented in the left or right visual field. During test, old and new shapes were presented centrally and participants classified each shape as "old-left", "old-right", or "new". Conscious activity was isolated by comparing accurate memory for shape and location (old-hits) with forgotten shapes (old-misses), and nonconscious activity was isolated by comparing old-left-misses with old-right-misses and vice versa. Conscious visual sensory activity had a late temporal onset (after 800 ms) while nonconscious visual sensory activity had an early temporal onset (before 800 ms). These results suggest explicit memory related sensory activity reflects both conscious and nonconscious processes that are temporally dissociable.

Memory for color reactivates color processing region

Memory is thought to be constructive in nature, where features processed in different cortical regions are synthesized during retrieval. In an effort to support this constructive memory framework, the present functional magnetic resonance imaging study assessed whether memory for color reactivated color processing regions. During encoding, participants were presented with colored and gray abstract shapes. During retrieval, old and new shapes were presented in gray and participants responded 'old-colored', 'old-gray', or 'new'. Within color perception regions, color memory related activity was observed in the left fusiform gyrus, adjacent to the collateral sulcus. A retinotopic mapping analysis indicated this activity occurred within color processing region V8. The present feature specific evidence provides compelling support for a constructive view of memory.