Neural correlates of temporal-order judgments versus those of spatial-location: Deactivation of hippocampus may facilitate spatial performance

Brain representations of space and time in episodic memory: A systematic review and meta-analysis

All experiences preserved within episodic memory contain information on the space and time of events. The hippocampus is the main brain region involved in processing spatial and temporal information for incorporation within episodic memory representations. However, the other brain regions involved in the encoding and retrieval of spatial and temporal information within episodic memory are unclear, because a systematic review of related studies is lacking and the findings are scattered. The present study was designed to integrate the results of functional magnetic resonance imaging and positron emission tomography studies by means of a systematic review and meta-analysis to provide converging evidence. In particular, we focused on identifying the brain regions involved in the retrieval of spatial and temporal information. We identified a spatial retrieval network consisting of the inferior temporal gyrus, parahippocampal gyrus, superior parietal lobule, angular gyrus, and precuneus. Temporal context retrieval was supported by the dorsolateral prefrontal cortex. Thus, the retrieval of spatial and temporal information is supported by different brain regions, highlighting their different natures within episodic memory.

Time processing in neurological and psychiatric conditions

A central question in understanding cognition and pathology-related cognitive changes is how we process time. However, time processing difficulties across several neurological and psychiatric conditions remain seldom investigated. The aim of this review is to develop a unifying taxonomy of time processing, and a neuropsychological perspective on temporal difficulties. Four main temporal judgments are discussed: duration processing, simultaneity and synchrony, passage of time, and mental time travel. We present an integrated theoretical framework of timing difficulties across psychiatric and neurological conditions based on selected patient populations. This framework provides new mechanistic insights on both (a) the processes involved in each temporal judgement, and (b) temporal difficulties across pathologies. By identifying underlying transdiagnostic time-processing mechanisms, this framework opens fruitful avenues for future research.

Decoding Spatial Memory Retrieval in Cubical Space Using fMRI Signals

The way spatial memory retrieval is represented in the brain remains unclear to date. Previous studies have displayed a hippocampus-centered navigation network using functional magnetic resonance imaging (fMRI) analysis. There have been some studies on the representation of navigation behavior by signal distribution patterns, but only in the hippocampus and adjacent structures. In this study, we aimed to determine (1) the brain regions that represent information in both intensity and distribution patterns during spatial memory retrieval and (2) whether the patterns of neural responses represent spatial memory retrieval behavior performance. Both univariate analysis [general linear model (GLM)] and multivariate pattern analysis (MVPA) were employed to reveal the spatial distributions of brain responses elicited by spatial memory retrieval. Correlation analyses were performed to detect the correspondences between brain responses and behavior performance. We found that spatial memory retrieval occurred in widespread brain regions, including the bilateral hippocampi, bilateral superior frontal gyrus, bilateral superior parietal lobules, bilateral occipital lobes, and cerebellum. The amplitude of activation in the left hippocampus showed a significant negative correlation (r = −0.46, p = 0.039) with the number of task completions. Additionally, within-subject classification accuracies based on the blood oxygenation level-dependent (BOLD) signal patterns of the right middle temporal gyrus (rMTG) rostral areas in the Brainnetome Atlas showed a significant positive correlation (r = 0.78, p < 0.0001) with retrieval accuracy. In summary, our findings have implications for understanding the separation between navigational and non-navigational states and emphasizing the utility of MVPA in the whole brain.

The Neural Correlates of Time: A Meta-analysis of Neuroimaging Studies

During the last two decades, our inner sense of time has been repeatedly studied with the help of neuroimaging techniques. These investigations have suggested the specific involvement of different brain areas in temporal processing. At least two distinct neural systems are likely to play a role in measuring time: One is mainly constituted of subcortical structures and is supposed to be more related to the estimation of time intervals below the 1-sec range (subsecond timing tasks), and the other is mainly constituted of cortical areas and is supposed to be more related to the estimation of time intervals above the 1-sec range (suprasecond timing tasks). Tasks can then be performed in motor or nonmotor (perceptual) conditions, thus providing four different categories of time processing. Our meta-analytical investigation partly confirms the findings of previous meta-analytical works. Both sub- and suprasecond tasks recruit cortical and subcortical areas, but subcortical areas are more intensely activated in subsecond tasks than in suprasecond tasks, which instead receive more contributions from cortical activations. All the conditions, however, show strong activations in the SMA, whose rostral and caudal parts have an important role not only in the discrimination of different time intervals but also in relation to the nature of the task conditions. This area, along with the striatum (especially the putamen) and the claustrum, is supposed to be an essential node in the different networks engaged when the brain creates our sense of time.

Social cognition and the cerebellum: A meta-analytic connectivity analysis

This meta-analytic connectivity modeling (MACM) study explores the functional connectivity of the cerebellum with the cerebrum in social cognitive processes. In a recent meta-analysis, Van Overwalle, Baetens, Mariën, and Vandekerckhove (2014) documented that the cerebellum is implicated in social processes of "body" reading (mirroring; e.g., understanding other persons' intentions from observing their movements) and "mind" reading (mentalizing, e.g., inferring other persons' beliefs, intentions or personality traits, reconstructing persons' past, future, or hypothetical events). In a recent functional connectivity study, Buckner et al. (2011) offered a novel parcellation of cerebellar topography that substantially overlaps with the cerebellar meta-analytic findings of Van Overwalle et al. (2014). This overlap suggests that the involvement of the cerebellum in social reasoning depends on its functional connectivity with the cerebrum. To test this hypothesis, we explored the meta-analytic co-activations as indices of functional connectivity between the cerebellum and the cerebrum during social cognition. The MACM results confirm substantial and distinct connectivity with respect to the functions of (a) action understanding ("body" reading) and (b) mentalizing ("mind" reading). The consistent and strong connectivity findings of this analysis suggest that cerebellar activity during social judgments reflects distinct mirroring and mentalizing functionality, and that these cerebellar functions are connected with corresponding functional networks in the cerebrum.

Medial temporal lobe activation during autobiographical context memory retrieval of time and place and its dependency upon recency

The contribution of the medial temporal lobe (MTL) to the retrieval of autobiographical memories is widely accepted. Results of former patient studies and functional imaging studies suggest different involvement of the MTL during the retrieval of autobiographical context information and the remoteness of these. Varying recency, the MTL contribution during chronological and locational autobiographical context information processing was investigated in this study. Thirteen males (mean = 25 years) judged the event's place or time in a two-choice recognition task. Subjects made significantly more errors on chronological judgments. Retrieval of chronological information activated the left MTL, while retrieval of locational information activated the MTL bilaterally. Retrieval of more recent than remote context information activated especially the right MTL. Our results underline different MTL contributions on the retrieval of autobiographical context information, depending on the content and on the remoteness of the event that took place.

Reasoning with linear orders: differential parietal cortex activation in sub-clinical depression. An FMRI investigation in sub-clinical depression and controls

The capacity to learn new information and manipulate it for efficient retrieval has long been studied through reasoning paradigms, which also has applicability to the study of social behavior. Humans can learn about the linear order within groups using reasoning, and the success of such reasoning may vary according to affective state, such as depression. We investigated the neural basis of these latter findings using functional neuroimaging. Using BDI-II criteria, 14 non-depressed (ND) and 12 mildly depressed volunteers took part in a linear-order reasoning task during functional magnetic resonance imaging. The hippocampus, parietal, and prefrontal cortices were activated during the task, in accordance with previous studies. In the learning phase and in the test phase, greater activation of the parietal cortex was found in the depressed group, which may be a compensatory mechanism in order to reach the same behavioral performance as the ND group, or evidence for a different reasoning strategy in the depressed group.

Temporal texture of associative encoding modulates recall processes

Binding aspects of an experience that are distributed over time is an important element of episodic memory. In the current study, we examined how the temporal complexity of an experience may govern the processes required for its retrieval. We recorded event-related potentials during episodic cued recall following pair associate learning of concurrently and sequentially presented object-picture pairs. Cued recall success effects over anterior and posterior areas were apparent in several time windows. In anterior locations, these recall success effects were similar for concurrently and sequentially encoded pairs. However, in posterior sites clustered over parietal scalp the effect was larger for the retrieval of sequentially encoded pairs. We suggest that anterior aspects of the mid-latency recall success effects may reflect working-with-memory operations or direct access recall processes, while more posterior aspects reflect recollective processes which are required for retrieval of episodes of greater temporal complexity.

Social cognition and the cerebellum: a meta-analysis of over 350 fMRI studies

This meta-analysis explores the role of the cerebellum in social cognition. Recent meta-analyses of neuroimaging studies since 2008 demonstrate that the cerebellum is only marginally involved in social cognition and emotionality, with a few meta-analyses pointing to an involvement of at most 54% of the individual studies. In this study, novel meta-analyses of over 350 fMRI studies, dividing up the domain of social cognition in homogeneous subdomains, confirmed this low involvement of the cerebellum in conditions that trigger the mirror network (e.g., when familiar movements of body parts are observed) and the mentalizing network (when no moving body parts or unfamiliar movements are present). There is, however, one set of mentalizing conditions that strongly involve the cerebellum in 50-100% of the individual studies. In particular, when the level of abstraction is high, such as when behaviors are described in terms of traits or permanent characteristics, in terms of groups rather than individuals, in terms of the past (episodic autobiographic memory) or the future rather than the present, or in terms of hypothetical events that may happen. An activation likelihood estimation (ALE) meta-analysis conducted in this study reveals that the cerebellum is critically implicated in social cognition and that the areas of the cerebellum which are consistently involved in social cognitive processes show extensive overlap with the areas involved in sensorimotor (during mirror and self-judgments tasks) as well as in executive functioning (across all tasks). We discuss the role of the cerebellum in social cognition in general and in higher abstraction mentalizing in particular. We also point out a number of methodological limitations of some available studies on the social brain that hamper the detection of cerebellar activity.

Negative BOLD response in the hippocampus during short-term spatial memory retrieval

A parieto-medial temporal pathway is thought to underlie spatial navigation in humans. fMRI was used to assess the role of this pathway, including the hippocampus, in the cognitive processes likely to underlie navigation based on environmental cues. Participants completed a short-term spatial memory task in virtual space, which required no navigation but involved the recognition of a target location from a foil location based on environmental landmarks. The results showed that spatial memory retrieval based on environmental landmarks was indeed associated with increased signal in regions of the parieto-medial temporal pathway, including the superior parietal cortex, the retrosplenial cortex, and the lingual gyrus. However, the hippocampus demonstrated a signal decrease below the fixation baseline during landmark-based retrieval, whereas there was no signal change from baseline during retrieval based on viewer position. In a discussion of the origins of such negative BOLD response in the hippocampus, we consider both a suppression of default activity and an increase in activity without a corresponding boost in CBF as possible mechanisms.

Brain Activation in Primary Motor and Somatosensory Cortices during Motor Imagery Correlates with Motor Imagery Ability in Stroke Patients

Aims. While studies on healthy subjects have shown a partial overlap between the motor execution and motor imagery neural circuits, few have investigated brain activity during motor imagery in stroke patients with hemiparesis. This work is aimed at examining similarities between motor imagery and execution in a group of stroke patients. Materials and Methods. Eleven patients were asked to perform a visuomotor tracking task by either physically or mentally tracking a sine wave force target using their thumb and index finger during fMRI scanning. MIQ-RS questionnaire has been administered. Results and Conclusion. Whole-brain analyses confirmed shared neural substrates between motor imagery and motor execution in bilateral premotor cortex, SMA, and in the contralesional inferior parietal lobule. Additional region of interest-based analyses revealed a negative correlation between kinaesthetic imagery ability and percentage BOLD change in areas 4p and 3a; higher imagery ability was associated with negative and lower percentage BOLD change in primary sensorimotor areas during motor imagery.

Search-Related Suppression of Hippocampus and Default Network Activity during Associative Memory Retrieval

Episodic memory retrieval involves the coordinated interaction of several cognitive processing stages such as mental search, access to a memory store, associative re-encoding, and post-retrieval monitoring. The neural response during memory retrieval is an integration of signals from multiple regions that may subserve supportive cognitive control, attention, sensory association, encoding, or working memory functions. It is particularly challenging to dissociate contributions of these distinct components to brain responses in regions such as the hippocampus, which lies at the interface between overlapping memory encoding and retrieval, and “default” networks. In the present study, event-related functional magnetic resonance imaging (fMRI) and measures of memory performance were used to differentiate brain responses to memory search from subcomponents of episodic memory retrieval associated with successful recall. During the attempted retrieval of both poorly and strongly remembered word pair associates, the hemodynamic response was negatively deflected below baseline in anterior hippocampus and regions of the default network. Activations in anterior hippocampus were functionally distinct from those in posterior hippocampus and negatively correlated with response times. Thus, relative to the pre-stimulus period, the hippocampus shows reduced activity during intensive engagement in episodic memory search. Such deactivation was most salient during trials that engaged only pre-retrieval search processes in the absence of successful recollection or post-retrieval processing. Implications for interpretation of hippocampal fMRI responses during retrieval are discussed. A model is presented to interpret such activations as representing modulation of encoding-related activity, rather than retrieval-related activity. Engagement in intensive mental search may reduce neural and attentional resources that are otherwise tonically devoted to encoding an individual’s stream of experience into episodic memory.

Functional neural networks of time perception: challenge and opportunity for schizophrenia research

With the double objective of searching for a physiological brain circuit concerned with time estimation and establishing whether this circuit is dysfunctional in schizophrenia patients, we carried out an activation likelihood estimate (ALE) meta-analysis of published functional neuroimaging studies. Our results reproduce the previous finding of a neurophysiological cortico-cerebellar-thalamic circuit related with time estimation in healthy individuals. In schizophrenia patients, the analysis indicates significantly lower activation of most right hemisphere regions of the circuit, suggesting that it may be subject to a pattern of disconnectivity. The ALE-meta-analysis approach is useful and further studies could elucidate how the timing circuit is connected with other cognitive tasks.

Stimulus content and the neural correlates of source memory

It has been suggested that several regions of the brain, including subregions of the medial temporal lobe (MTL) and the posterior parietal cortex, contribute to source memory success in a material-general manner, with most models highlighting the importance of memory process rather than material type. For the MTL in particular, however, increasing evidence suggests that MTL subregions may be specialized for processing different materials, raising the possibility that source memory-related activity may be material-sensitive. Previous fMRI studies have not directly compared source memory activity for different categories of stimuli, and it remains unclear whether source memory effects, in the MTL or elsewhere, are influenced by material. To investigate this issue, young participants were scanned during study while they made semantic judgments about words, pictures of objects and scenes, and during test when they retrieved the context (source) in which these items were studied. Several regions, including the hippocampi, medial and lateral parietal cortex, exhibited source memory effects common to words, objects and scenes, at both study and test. Material-dependent source memory effects were also identified in the left posterior inferior frontal and left perirhinal cortex for words and objects, respectively, at study but not test. These results offer direct support for the hypothesis that the MTL and posterior parietal cortex make material-general contributions to recollection. These results also point to a dissociation between encoding and retrieval with regard to the influence of material on the neural correlates of source memory accuracy, supporting the idea that a relatively small proportion of the activity elicited by a stimulus during encoding is incorporated into an episodic memory representation of the stimulus.

Orbito-frontal cortex is necessary for temporal context memory

Lesion and neuroimaging studies suggest that orbito-frontal cortex (OFC) supports temporal aspects of episodic memory. However, it is unclear whether OFC contributes to the encoding and/or retrieval of temporal context and whether it is selective for temporal relative to nontemporal (spatial) context memory. We addressed this issue with two complimentary studies: functional magnetic resonance imaging to measure OFC activity associated with successful temporal and spatial context memory during encoding and retrieval in healthy young participants, and a neuropsychological investigation to measure changes in spatial and temporal context memory in OFC lesion patients. Imaging results revealed that OFC contributed to encoding and retrieval of associations between objects and their temporal but not their spatial contexts. Consistent with this, OFC patients exhibited impairments in temporal but not spatial source memory accuracy. These results suggest that OFC plays a critical role in the formation and subsequent retrieval of temporal context.

How and when the fMRI BOLD signal relates to underlying neural activity: the danger in dissociation

Functional magnetic resonance imaging (fMRI) has become the dominant means of measuring behavior-related neural activity in the human brain. Yet the relation between the blood oxygen-level dependent (BOLD) signal and underlying neural activity remains an open and actively researched question. A widely accepted model, established for sensory neo-cortex, suggests that the BOLD signal reflects peri-synaptic activity in the form of the local field potential rather than the spiking rate of individual neurons. Several recent experimental results, however, suggest situations in which BOLD, spiking, and the local field potential dissociate. Two different models are discussed, based on the literature reviewed to account for this dissociation, a circuitry-based and vascular-based explanation. Both models are found to account for existing data under some testing situations and in certain brain regions. Because both the vascular and local circuitry-based explanations challenge the BOLD-LFP coupling model, these models provide guidance in predicting when BOLD can be expected to reflect neural processing and when the underlying relation with BOLD may be more complex than a direct correspondence.

A specific role of the human hippocampus in recall of temporal sequences

There is a growing interest in how temporal order of episodic memories is represented within the medial temporal lobe (MTL). Animal studies suggest that the hippocampal formation (HF) is critical for retrieving the temporal order of past experiences. However, human imaging studies that have tested recency discrimination between pairs of previously encoded items have generally failed to report HF activation. We hypothesized that recalling a naturalistic sequence of past events would be particularly sensitive to HF function, attributable to greater involvement of associative processes. To test this prediction, we let subjects watch a novel movie and later, during functional magnetic resonance imaging, asked them to rearrange and "replay" scenes from the movie in correct order. To identify areas specifically involved in retrieval of temporal order, we used a control condition where subjects logically inferred the order of scenes from the same movie. Extensive MTL activation was observed during sequence recall. Activation within the right HF was specifically related to retrieval of temporal order and correlated positively with accuracy of sequence recall. Also, the bilateral parahippocampal cortex responded to retrieval of temporal order, but the activation here was not related to performance. Our study is the first to unequivocally demonstrate that correct sequence recall depends on HF.

Correlation between BOLD fMRI and theta-band local field potentials in the human hippocampal area

The relation between the blood-oxygen-level-dependent (BOLD) signal, which forms the basis of functional magnetic resonance imaging (fMRI), and underlying neural activity is not well understood. We performed high-resolution fMRI in patients scheduled for implantation with depth electrodes for seizure monitoring while they navigated a virtual environment. We then recorded local field potentials (LFPs) and neural firing rate directly from the hippocampal area of the same subjects during the same task. Comparing BOLD signal changes with 396 LFP and 185 neuron recordings in the hippocampal area, we found that BOLD signal changes correlated positively with LFP power changes in the theta-band (4-8 Hz). This correlation, however, was largely present for parahippocampal BOLD signal changes; BOLD changes in the hippocampus correlated weakly or not at all with LFP power changes. We did not find a significant relationship between BOLD activity and neural firing rate in either region, which could not be accounted for by a lesser tendency for neurons to respond or a greater tendency for neurons to habituate to the task. Strengthening the idea of a dissociation between LFP power and neural firing rate in their relation to the BOLD signal, simultaneously recorded LFP power and neural firing rate changes were uncorrelated across electrodes. Together, our results suggest that the BOLD signal in the human hippocampal area has a more heterogenous relationship with underlying neural activity than has been described previously in other brain regions.

Self, mother and abstract other: an fMRI study of reflective social processing

Using fMRI, we studied the neural correlates of self-referential processing by comparing BOLD signal changes during self and mother conditions of a self-reference effect (SRE) task. Conjunction analysis of these two conditions showed several common areas of significant activation, including the medial aspects of the superior frontal gyri, left inferior frontal gyrus, bilateral temporal poles, left superior temporal sulcus and left precuneus. The locations of the 7 strongest peak activations for the self condition and for the mother condition were compared on a subject-by-subject basis in native space. Of the 119 pairs of peaks explored, 87% were located within 2 voxels of each other, demonstrating the commonality of the brain regions subserving both self- and mother-referential processing within an individual subject. In group analyses of the self-referential vs. mother-referential contrast, small differences in activation strength were observed in the left superior frontal sulcus, right cingulate gyrus and the left fusiform gyrus. Greater activation for mother than for self was observed in bilateral temporal lobes. Subjects also performed a social attribution task (SAT) in which they inferred mental states about interacting geometric shapes. Activations from this visual theory of mind task were compared with the activations demonstrated during self-referential processing. Striking similarities were found, including overlapping activations in bilateral medial prefrontal cortices, left inferior frontal gyrus and precuneus. These data suggest that reflective analysis of self, mother and abstract others relies predominantly on the same neural architecture.

Dissociation of response inhibition and performance monitoring in the stop signal task using event-related fMRI

We examined the neural substrate of motor response inhibition and performance monitoring in the stop signal task (SST) using event-related functional magnetic resonance imaging (fMRI). The SST involves a go task and the occasional requirement to stop the go response. We posit that both the go and the stop phases of the SST involve components of inhibition and performance monitoring. The goal of this study was to determine whether inhibition and performance monitoring during go and stop phases of the task activated different networks. We isolated go-phase activities underlying response withholding, monitoring, and sensorimotor processing and contrasted these with successful inhibition to identify the substrate of response inhibition. Error detection activity was isolated using trials in which a stop signal appeared but the response was executed. These trials were modeled as a hand-specific go trial followed by error processing. Cognitive go-phase processes included response withholding and monitoring and activated right prefrontal and midline networks. Response withdrawal additionally activated right inferior frontal gyrus and basal ganglia (caudate). Error detection invoked by failed inhibition activated dorsal anterior cingulate cortex (dACC) and right middle frontal Brodmann's area 9. Our results confirm that there are distinct aspects of inhibition and performance monitoring functions which come into play at various phases within a given trial of the SST, and that these are separable using fMRI.

Spatial and temporal episodic memory retrieval recruit dissociable functional networks in the human brain

Imaging, electrophysiological studies, and lesion work have shown that the medial temporal lobe (MTL) is important for episodic memory; however, it is unclear whether different MTL regions support the spatial, temporal, and item elements of episodic memory. In this study we used fMRI to examine retrieval performance emphasizing different aspects of episodic memory in the context of a spatial navigation paradigm. Subjects played a taxi-driver game ("yellowcab"), in which they freely searched for passengers and delivered them to specific landmark stores. Subjects then underwent fMRI scanning as they retrieved landmarks, spatial, and temporal associations from their navigational experience in three separate runs. Consistent with previous findings on item memory, perirhinal cortex activated most strongly during landmark retrieval compared with spatial or temporal source information retrieval. Both hippocampus and parahippocampal cortex activated significantly during retrieval of landmarks, spatial associations, and temporal order. We found, however, a significant dissociation between hippocampal and parahippocampal cortex activations, with spatial retrieval leading to greater parahippocampal activation compared with hippocampus and temporal order retrieval leading to greater hippocampal activation compared with parahippocampal cortex. Our results, coupled with previous findings, demonstrate that the hippocampus and parahippocampal cortex are preferentially recruited during temporal order and spatial association retrieval--key components of episodic "source" memory.

Temporal context discrimination in patients with schizophrenia: associations with auditory hallucinations and negative symptoms

BACKGROUND

A deficit in remembering the temporal context of events (a type of source memory) has been observed in schizophrenia, and suggested to be associated with positive symptoms.

METHODS

In order to investigate memory for temporal context, we administered a list discrimination task to a sample of schizophrenia patients and a sample of healthy controls. Participants were required to learn two lists of mixed high- and low-frequency words separated by 10 min, then to remember whether each word had been presented in the first or in the second list.

RESULTS

The number of misattributions to the wrong list was significantly higher in patients than in healthy controls. However, the group difference was eliminated when recall efficiency was covaried. The number of list misattributions was higher in patients with auditory hallucinations than in the other patients, independently of verbal recall efficiency. By contrast, affective flattening and anhedonia were associated with fewer list misattributions of the high-frequency words.

CONCLUSIONS

It is suggested that auditory hallucinations are associated with deficit in processing or remembering the temporal context. Conversely, certain negative symptoms are associated with reduced temporal context errors. The possible neural mechanisms involved in temporal context deficit as well as in these specific clinical symptoms are discussed.