Nature and nurture effects on the spatiality of the mental time line

Travelling beyond time: shared brain system for self-projection in the temporal, political and moral domains

Mental time travel (MTT), a cornerstone of human cognition, enables individuals to mentally project themselves into their past or future. It was shown that this self-projection may extend beyond the temporal domain to the spatial and social domains. What about higher cognitive domains? Twenty-eight participants underwent functional magnetic resonance imaging (fMRI) while self-projecting to different political, moral and temporal perspectives. For each domain, participants were asked to judge their relationship to various people (politicians, moral figures, personal acquaintances) from their actual or projected self-location. Findings showed slower, less accurate responses during self-projection across all domains. fMRI analysis revealed self-projection elicited brain activity at the precuneus, medial and dorsolateral prefrontal cortex, temporoparietal junction and anterior insula, bilaterally and right lateral temporal cortex. Notably, 23.5% of active voxels responded to all three domains and 27% to two domains, suggesting a shared brain system for self-projection. For ordinality judgement (self-reference), 52.5% of active voxels corresponded to the temporal domain specifically. Self-projection activity overlapped mostly with the frontoparietal control network, followed by the default mode network, while self-reference showed a reversed pattern, demonstrating MTT's implication in spontaneous brain activity. MTT may thus be regarded as a 'mental-experiential travel', with self-projection as a domain-general construct and self-reference related mostly to time. This article is part of the theme issue 'Elements of episodic memory: lessons from 40 years of research'.

Evidence for grid-cell-like activity in the time domain

The relation between the processing of space and time in the brain has been an enduring cross-disciplinary question. Grid cells have been recognized as a hallmark of the mammalian navigation system, with recent studies attesting to their involvement in the organization of conceptual knowledge in humans. To determine whether grid-cell-like representations support temporal processing, we asked subjects to mentally simulate changes in age and time-of-day, each constituting "trajectory" in an age-day space, while undergoing fMRI. We found that grid-cell-like representations supported trajecting across this age-day space. Furthermore, brain regions concurrently coding past-to-future orientation positively modulated the magnitude of grid-cell-like representation in the left entorhinal cortex. Finally, our findings suggest that temporal processing may be supported by spatially modulated systems, and that innate regularities of abstract domains may interface and alter grid-cell-like representations, similarly to spatial geometry.

Horizontal mapping of time-related words in first and second language

The existence of a consistent horizontal spatial-conceptual mapping for words denoting time is a well-established phenomenon. For example, words related to the past or future (e.g., yesterday/tomorrow) facilitate respective leftward/rightward attentional shifts and responses, suggesting the visual-spatial grounding of temporal semantics, at least in the native language (L1). To examine whether similar horizontal bias also accompanies access to time-related words in a second language (L2), we tested 53 Russian-English (Experiment 1) and 48 German-English (Experiment 2) bilinguals, who classified randomly presented L1 and L2 time-related words as past- or future-related using left or right response keys. The predicted spatial congruency effect was registered in all tested languages and, furthermore, was positively associated with higher L2 proficiency in Experiment 2. Our findings (1) support the notion of horizontal spatial-conceptual mapping in diverse L1s, (2) demonstrate the existence of a similar spatial bias when processing temporal words in L2, and (3) show that the strength of time-space association in L2 may depend on individual L2 proficiency.

The time course of the spatial representation of 'past' and 'future' concepts: New evidence from the STEARC effect

Humans use space to think of and communicate the flow of time. This spatial representation of time is influenced by cultural habits so that in left-to-right reading cultures, short durations and past events are mentally positioned to the left of long durations and future events. The STEARC effect (Space Temporal Association of Response Codes) shows a faster classification of short durations/past events with responses on the left side of space and of long durations/future events with responses on the right side. We have recently showed that during the classification of time durations, space is a late heuristic of time because in this case, the STEARC appears only when manual responses are slow, not when they are fast. Here, we wished to extend this observation to the semantic classification of words as referring to the 'past' or the 'future'. We hypothesised that the semantic processing of 'past' and 'future' concepts would have engaged slower decision processes than the classification of short versus long time durations. According to dual-route models of conflict tasks, if the task-dependent classification/decision process were to proceed relatively slowly, then the effects of direct activation of culturally preferred links between stimulus and response (S-R), i.e., past/left and future/right in the case of the present task, should attain higher amplitudes before the instruction-dependent correct response is selected. This would imply that, at variance with the faster classification of time durations, during the slower semantic classification of time concepts, in incongruent trials, the direct activation of culturally preferred S-R links should introduce significant reaction time (RT) costs and a corresponding STEARC at the fastest manual responses in the experiment too. The study's results confirmed this hypothesis and showed that in the classification of temporal words, the STEARC also increased as a function of the length of RTs. Taken together, the results from sensory duration and semantic classification STEARC tasks show that the occurrence, strength and time course of the STEARC varies significantly as a function of the speed and level of cognitive processing required in the task.

How time gets spatial: factors determining the stability and instability of the mental time line

Left-to-right readers classify faster past events with motor responses on the left side of space and future events with responses on the right side. This suggests a left-to-right spatial organization in the mental representation of time. Here, we show that the significance and reliability of this representation are linked to the joint use of temporal and spatial codes in the task at hand. In a first unimanual Go/No-Go Implicit Association Test (IAT), attending selectively to "past" or to "future" words did not activate corresponding "left" or "right" spatial concepts and vice versa. In a second IAT, attending to both temporal (i.e., "past" and "future") words and spatial targets (i.e., "left" and "right") pointing arrows produced faster responses for congruent rather than incongruent combinations of temporal and spatial concepts in task instructions (e.g., congruent = "Go with past words and left-pointing arrows"; incongruent = "Go with past words and right-pointing arrows"). This effect increased markedly in a STEARC task where spatial codes defined the selection between "left-side" and "right-side" button presses that were associated with "past" and "future" words. Two control experiments showed only partial or unreliable space-time congruency effects when (a) participants attended to superordinate semantic codes that included both spatial "left"/"right" or temporal "past/future" subordinate codes; (b) a primary speeded response was assigned to one dimension (e.g., "past vs. future") and a nonspeeded one to the other dimension (e.g., "left" vs. "right"). These results help to define the conditions that trigger a stable and reliable spatial representation of time-related concepts.

Space is a late heuristic of elapsing time: New evidence from the STEARC effect

To get a concrete representation of its intangible flow, culture frames elapsing time along spatially oriented mental or graphical lines, which are organised according to reading habits, from left to right in western cultures. One of the strongest evidence for this spatial representation of time is the STEARC effect (Spatial-Temporal Association of Response Codes), which consists of faster coding of "short" durations with motor responses in the left side of space and of "long" durations with responses in the right side. Here, we investigated the STEARC as a function of response speed in two different experiments in healthy participants. Surprisingly, in both sub- and supra-second ranges, we found the STEARC only when decisions on time durations were slow, while no spatial representation of time was present with fast decisions. This first demonstrates that space slowly takes over faster non-spatial processing of time flow and that it is possible to empirically separate the behavioural manifestations of the non-spatial and the nurtured spatial mechanisms of time coding.

The Variability of Mental Timeline in Vertical Dimension

People often use concrete spatial terms to represent abstract time. Previous studies have shown that mental timeline (MTL) is represented along a horizontal axis. Studies of the mental timeline have demonstrated that compared with English speakers, Mandarin speakers are more likely to think about time vertically (up-down) than horizontally (left-right/front-back). Prior studies have suggested that MTL in the up and down dimensions originated from temporal-spatial metaphors in language. However, there are still a large number of perceptual experiences in the up and down dimensions, such as visual and sensorimotor experience. Then does the visual experience in daily life affect the MTL in the vertical dimension? This study is aimed to investigate whether visual experience can promote or activate the opposite direction of MTL from implicit and explicit levels. The results showed that when the time information in the task was not prominent, the direction of vertical MTL cannot be affected by ascending or descending perceptual experience. While when the time information was prominent, whether the task was implicit or explicit, compared with the control group, watching the top-down scene significantly increased the top-down direction selection, while in the implicit task, watching the bottom-up scene made the top-down MTL disappear. To the best of our knowledge, our study provides the first evidence that the flexibility of space–time associations in vertical dimension extends beyond explicit and embraces even implicit levels. This study shows that the vertical MTL is activated in certain conditions and could be affected by the visual experience.

Time Interaction With Two Spatial Dimensions: From Left/Right to Near/Far

In this study, we explored the time and space relationship according to two different spatial codings, namely, the left/right extension and the reachability of stimulus along a near/far dimension. Four experiments were carried out in which healthy participants performed the time and spatial bisection tasks in near/far space, before and after short or long tool-use training. Stimuli were prebisected horizontal lines of different temporal durations in which the midpoint was manipulated according to the Muller-Lyer illusion. The perceptual illusory effects emerged in spatial but not temporal judgments. We revealed that temporal and spatial representations dynamically change according to the action potentialities of an individual: temporal duration was perceived as shorter and the perceived line’s midpoint was shifted to the left in far than in near space. Crucially, this dissociation disappeared following a long but not short tool-use training. Finally, we observed age-related differences in spatial attention which may be crucial in building the memory temporal standard to categorize durations.

Spatial conceptual mapping of words with temporal semantics

Unlike concrete words related to sensory perception (e.g., hear, sun), abstract words (including the words with temporal semantics, e.g., year, tomorrow) do not have direct embodied sensory correlates. Nevertheless, existing research indicates that abstract concepts’ representations make regular reference to sensorimotor processes, e.g., visual perception. For example, regular expressions such as “the future is ahead” or “the flow of time” are common in different languages reflecting a relatively universal nature of space-time correspondences. Moreover, these regular correspondences are commonly demonstrated in experimental studies; for example — by registering attentional displacement during processing of past and future related words. Here, the main theoretical approaches as well as existing experimental data documenting neurocognitive foundations of space-time representations are reviewed. A detailed overview of research on spatial-conceptual mapping of time concepts in three-dimensional visual space is offered. We also consider features of space-time associations that reflect linguistic and socio-cultural differences. In conclusion, the main areas of current and future that will allow an integration of the existing data within a common theoretical framework are defined.

Use of the Montreal Cognitive Assessment Thai Version to Discriminate Amnestic Mild Cognitive Impairment from Alzheimer's Disease and Healthy Controls: Machine Learning Results

BACKGROUND

The Montreal Cognitive Assessment (MoCA) is an effective and applicable screening instrument to confirm the diagnosis of amnestic mild cognitive impairment (aMCI) from patients with Alzheimer's disease (AD) and healthy controls (HCs).

OBJECTIVES

This study aimed to determine the reliability and validity of the following: (a) Thai translation of the MoCA (MoCA-Thai) and (b) delineate the key features of aMCI based on the MoCA subdomains.

METHODS

This study included 60 HCs, 61 aMCI patients, and 60 AD patients. The MoCA-Thai shows adequate psychometric properties including internal consistency, concurrent validity, test-retest validity, and inter-rater reliability.

RESULTS

The MoCA-Thai may be employed as a diagnostic criterion to make the diagnosis of aMCI, whereby aMCI patients are discriminated from HC with an area under the receiver-operating characteristic (AUC-ROC) curve of 0.813 and from AD patients with an AUC-ROC curve of 0.938. The best cutoff scores of the MoCA-Thai to discriminate aMCI from HC is ≤24 and from AD > 16. Neural network analysis showed that (a) aberrations in recall was the most important feature of aMCI versus HC with impairments in language and orientation being the second and third most important features and (b) aberrations in visuospatial skills and executive functions were the most important features of AD versus aMCI and that impairments in recall, language, and orientation but not attention, concentration, and working memory, further discriminated AD from aMCI.

CONCLUSIONS

The MoCA-Thai is an appropriate cognitive assessment tool to be used in the Thai population for the diagnosis of aMCI and AD.

The categorical use of a continuous time representation

The abstract concept of time is mentally represented as a spatially oriented line, with the past associated with the left space and the future associated with the right. Although the line is supposed to be continuous, most available evidence is also consistent with a categorical representation that only discriminates between past and future. The aim of the present study was to test the continuous or categorical nature of the mental timeline. Italian participants judged the temporal reference of 20 temporal expressions by pressing keys on either the left or the right. In Experiment 1 (N = 32), all words were presented at the center of the screen. In Experiment 2 (N = 32), each word was presented on the screen in a central, left, or right position. In Experiment 3 (N = 32), all text was mirror-reversed. In all experiments, participants were asked to place the 20 temporal expressions on a 10-cm line. The results showed a clear Spatial–TEmporal Association of Response Codes (STEARC) effect which did not vary in strength depending on the location of the temporal expressions on the line. However, there was also a clear Distance effect: latencies were slower for words that were closer to the present than further away. We conclude that the mental timeline is a continuous representation that can be used in a categorical way when an explicit past vs. future discrimination is required by the task.

Travel in the Physical and Mental Space: A Behavioral Assessment of the Phylogenetic Continuity Hypothesis Between Egocentric Navigation and Episodic Memory

Based on the neuro-functional association between navigation in the physical and the mental space at the level of the hippocampal-entorhinal system, Buzsáki and Moser (2013) have hypothesized a phylogenetic continuity between spatial navigation and declarative memory functions. According to this proposal, mechanisms of episodic and semantic memory would have evolved from mechanisms of self-based and map-based navigation in the physical space, respectively. Using classic versions of path integration and item recognition tasks in human subjects, we have recently described a correlation and a predictive relationship between abilities in egocentric navigation and episodic memory. Here we aim at confirming and extending this association to the dynamic component of sequential updating in the physical (egocentric navigation) and mental (episodic memory) space, and at investigating the relationship of these self-centered abilities with semantic memory. To this aim, we developed three new experimental tasks in which the dynamic component of updating information is particularly emphasized in the spatial, the temporal, and the semantic domain. The contribution of visual short-term memory to the three tasks was also controlled by including an additional task. The results confirmed the existence of a direct and predictive relationship between self-based spatial navigation and episodic memory. We also found a significant association between egocentric navigation and semantic memory, but this relationship was explained by short-term memory abilities and was mediated by episodic memory functions. Our results support the hypothesis of an evolutionary link between mechanisms that allow spatial navigation in the physical space and time travel in the mental space.

Mental representation of autobiographical memories along the sagittal mental timeline: Evidence from spatiotemporal interference

Time is usually conceived of in terms of space: many natural languages refer to time according to a back-to-front axis. Indeed, whereas the past is usually conceived to be "behind us", the future is considered to be "in front of us." Despite temporal coding is pivotal for the development of autonoetic consciousness, little is known about the organization of autobiographical memories along this axis. Here we developed a spatial compatibility task (SCT) to test the organization of autobiographical memories along the sagittal plane, using spatiotemporal interference. Twenty-one participants were asked to recall both episodic and semantic autobiographical memories (EAM and SAM, respectively) to be used in the SCT. Then, during the SCT, they were asked to decide whether each event occurred before or after the event presented right before, using a response code that could be compatible with the back-to-front axis (future in front) or not (future at back). We found that performance was significantly worse during the non-compatible condition, especially for EAM. The results are discussed in light of the evidence for spatiotemporal encoding of episodic autobiographical memories, taking into account possible mechanisms explaining compatibility effects.

Neglect in temporal domain: Amelioration following a prismatic adaptation treatment and implications in everyday life. A single case study

As in line bisection, in time bisection, neglect patients fail to process the first/left part of time representation (Mental-Time-Line-MTL) resulting in a rightward shift of the interval midpoint. A leftward shift of spatial attention after one session of prismatic-adaptation (PA) reduces this deficit. The impact on daily life of time deficit is little investigated in neglect. Here we study the time deficit and its ecological impact in an outpatient with neglect (LL) and the effects of a PA-treatment (ten sessions) on the deficit and its impact. Before and after PA-treatment, LL completed a: time-bisection-task assessing the MTL in the milliseconds-seconds range; lifespan-task assessing the MTL in the lifespan range; qualitative interview assessing the impact on daily routines. Patient's performance on the tasks was compared with the performance of non-neurological controls. Before PA-treatment, LL showed a rightward shift in the time-bisection-task and a compression of life events distribution in the lifespan-task. The feeling "to be forward in time" emerged in the interview. The PA-treatment reduced the deficits in the tasks and the feeling "to be forward in time" in the interview. PA-treatment is suggested as a powerful instrument for the reduction of time deficit and its ecological impact in neglect patients.

An asymmetry in past and future mental time travel following vmPFC damage

The role of ventromedial prefrontal cortex (vmPFC) in mental time travel toward the past and the future is debated. Here, patients with focal lesions to the vmPFC and brain-damaged and healthy controls mentally projected themselves to a past, present or future moment of subjective time (self-projection) and classified a series of events as past or future relative to the adopted temporal self-location (self-reference). We found that vmPFC patients were selectively impaired in projecting themselves to the future and in recognizing relative-future events. These findings indicate that vmPFC damage hinders the mental processing of and movement toward future events, pointing to a prominent, multifaceted role of vmPFC in future-oriented mental time travel.

Effect of Presentation Format on Judgment of Long-Range Time Intervals

Investigations in the temporal estimation domain are quite vast in the range of milliseconds, seconds, and minutes. This study aimed to determine the psychophysical function that best describes long-range time interval estimation and evaluate the effect of numerals in duration presentation on the form of this function. Participants indicated on a line the magnitude of time intervals presented either as a number + time-unit (e.g., “9 months”; Group I), unitless numerals (e.g., “9”; Group II), or tagged future personal events (e.g., “Wedding”; Group III). The horizontal line was labeled rightward (“Very short” = >“Very long”) or leftward (“Very long” = >“Very short”) for Group I and II, but only rightward for Group III. None of the linear, power, logistic or logarithmic functions provided the best fit to the individual participant data in more than 50% of participants for any group. Individual power exponents were different only between the tagged personal events (Group III) and the other two groups. When the same analysis was repeated for the aggregated data, power functions provided a better fit than other tested functions in all groups with a difference in the power function parameters again between the tagged personal events and the other groups. A non-linear mixed effects analysis indicated a difference in the power function exponent between Group III and the other groups, but not between Group I and II. No effect of scale directionality was found in neither of the experiments in which scale direction was included as independent variable. These results suggest that the judgment of intervals in a number + time-unit presentation invoke, at least in part, processing mechanisms other than those used for time-domain. Consequently, we propose the use of event-tagged assessment for characterizing long-range interval representation. We also recommend that analyses in this field should not be restricted to aggregated data given the qualitative variation between participants.