The oculomotor resonance effect in spatial-numerical mapping

Writing direction influences the spatial representations of past- and future-tense forms: Evidence from eye tracking

The present study tests the hypothesis that the directionality of reading habits (left-to-right or right-to-left) impacts individuals' representation of nonspatial events. Using the blank screen paradigm, we examine whether eye movements reflect culture-specific spatial biases in processing temporal information, specifically, grammatical tense in Russian and Hebrew. Sixty-two native speakers of Russian (a language with a left-to-right reading and writing system) and 62 native speakers of Hebrew (a language with a right-to-left reading and writing system) listened to verbs in the past or future tense while their spontaneous gaze positions were recorded. Following the verb, a visual spatial probe appeared in one of the five locations of the screen, and participants responded manually to indicate its position. While participants' response latencies to the spatial probe revealed no significant effects, their gaze positions along the horizontal axis for past- and future-tensed verbs aligned with the reading and writing direction in their language. These results provide novel evidence that eye movements during auditory processing of grammatical tense are influenced by culturally specific reading and writing conventions, shifting leftward or rightward on the horizontal plane depending on the stimuli's time reference (past or future) and the participants' language (Russian or Hebrew). This spatial bias indicates a common underlying cognitive mechanism that uses spatial dimensions to represent temporal constructs.

Keeping track of time: Horizontal spatial biases for hours, days, and months

In many Western cultures, the processing of temporal words related to the past and to the future is associated with left and right space, respectively - a phenomenon known as the horizontal Mental Time Line (MTL). While this mapping is apparently quite ubiquitous, its regularity and consistency across different types of temporal concepts remain to be determined. Moreover, it is unclear whether such spatial mappings are an essential and early constituent of concept activation. In the present study, we used words denoting time units at different scales (hours of the day, days of the week, months of the year) associated with either left space (e.g., 9 a.m., Monday, February) or right space (e.g., 8 p.m., Saturday, November) as cues in a line bisection task. Fifty-seven healthy adults listened to temporal words and then moved a mouse cursor to the perceived midpoint of a horizontally presented line. We measured movement trajectories, initial line intersection coordinates, and final bisection response coordinates. We found movement trajectory displacements for left- vs. right-biasing hour and day cues. Initial line intersections were biased specifically by month cues, while final bisection responses were biased specifically by hour cues. Our findings offer general support to the notion of horizontal space-time associations and suggest further investigation of the exact chronometry and strength of this association across individual time units.

Horizontal mapping of time-related words in first and second language

The existence of a consistent horizontal spatial-conceptual mapping for words denoting time is a well-established phenomenon. For example, words related to the past or future (e.g., yesterday/tomorrow) facilitate respective leftward/rightward attentional shifts and responses, suggesting the visual-spatial grounding of temporal semantics, at least in the native language (L1). To examine whether similar horizontal bias also accompanies access to time-related words in a second language (L2), we tested 53 Russian-English (Experiment 1) and 48 German-English (Experiment 2) bilinguals, who classified randomly presented L1 and L2 time-related words as past- or future-related using left or right response keys. The predicted spatial congruency effect was registered in all tested languages and, furthermore, was positively associated with higher L2 proficiency in Experiment 2. Our findings (1) support the notion of horizontal spatial-conceptual mapping in diverse L1s, (2) demonstrate the existence of a similar spatial bias when processing temporal words in L2, and (3) show that the strength of time-space association in L2 may depend on individual L2 proficiency.

Eye movements reveal that young school children shift attention when solving additions and subtractions

Adults shift their attention to the right or to the left along a spatial continuum when solving additions and subtractions, respectively. Studies suggest that these shifts not only support the exact computation of the results but also anticipatively narrow down the range of plausible answers when processing the operands. However, little is known on when and how these attentional shifts arise in childhood during the acquisition of arithmetic. Here, an eye-tracker with high spatio-temporal resolution was used to measure spontaneous eye movements, used as a proxy for attentional shifts, while children of 2nd (8 y-o; N = 50) and 4th (10 y-o; N = 48) Grade solved simple additions (e.g., 4+3) and subtractions (e.g., 3-2). Gaze patterns revealed horizontal and vertical attentional shifts in both groups. Critically, horizontal eye movements were observed in 4th Graders as soon as the first operand and the operator were presented and thus before the beginning of the exact computation. In 2nd Graders, attentional shifts were only observed after the presentation of the second operand just before the response was made. This demonstrates that spatial attention is recruited when children solve arithmetic problems, even in the early stages of learning mathematics. The time course of these attentional shifts suggests that with practice in arithmetic children start to use spatial attention to anticipatively guide the search for the answer and facilitate the implementation of solving procedures. RESEARCH HIGHLIGHTS: Additions and subtractions are associated to right and left attentional shifts in adults, but it is unknown when these mechanisms arise in childhood. Children of 8-10 years old solved single-digit additions and subtractions while looking at a blank screen. Eye movements showed that children of 8 years old already show spatial biases possibly to represent the response when knowing both operands. Children of 10 years old shift attention before knowing the second operand to anticipatively guide the search for plausible answers.

Abstract concepts: external influences, internal constraints, and methodological issues

There is a longstanding and widely held misconception about the relative remoteness of abstract concepts from concrete experiences. This review examines the current evidence for external influences and internal constraints on the processing, representation, and use of abstract concepts, like truth, friendship, and number. We highlight the theoretical benefit of distinguishing between grounded and embodied cognition and then ask which roles do perception, action, language, and social interaction play in acquiring, representing and using abstract concepts. By reviewing several studies, we show that they are, against the accepted definition, not detached from perception and action. Focussing on magnitude-related concepts, we also discuss evidence for cultural influences on abstract knowledge and explore how internal processes such as inner speech, metacognition, and inner bodily signals (interoception) influence the acquisition and retrieval of abstract knowledge. Finally, we discuss some methodological developments. Specifically, we focus on the importance of studies that investigate the time course of conceptual processing and we argue that, because of the paramount role of sociality for abstract concepts, new methods are necessary to study concepts in interactive situations. We conclude that bodily, linguistic, and social constraints provide important theoretical limitations for our theories of conceptual knowledge.

Spatial-numerical associations without a motor response? Grip force says 'Yes'

In numerical processing, the functional role of Spatial-Numerical Associations (SNAs, such as the association of smaller numbers with left space and larger numbers with right space, the Mental Number Line hypothesis) is debated. Most studies demonstrate SNAs with lateralized responses, and there is little evidence that SNAs appear when no response is required. We recorded passive holding grip forces in no-go trials during number processing. In Experiment 1, participants performed a surface numerical decision task ("Is it a number or a letter?"). In Experiment 2, we used a deeper semantic task ("Is this number larger or smaller than five?"). Despite instruction to keep their grip force constant, participants' spontaneous grip force changed in both experiments: Smaller numbers led to larger force increase in the left than in the right hand in the numerical decision task (500-700 ms after stimulus onset). In the semantic task, smaller numbers again led to larger force increase in the left hand, and larger numbers increased the right-hand holding force. This effect appeared earlier (180 ms) and lasted longer (until 580 ms after stimulus onset). This is the first demonstration of SNAs with passive holding force. Our result suggests that (1) explicit motor response is not a prerequisite for SNAs to appear, and (2) the timing and strength of SNAs are task-dependent. (216 words).

The predictive role of eye movements in mental arithmetic

Behavioural studies have suggested that number manipulation involves shifting attention along a left-to-right oriented continuum. However, these studies provide little evidence about the time course of attention shifts during number processing. We used an eye-tracker with high spatio-temporal resolution to measure eye movements during the mental solving of addition (e.g., 43 + 4) and subtraction problems (e.g., 53 - 6), as a proxy for the rightward and leftward attention shifts that accompany these operations. A first difference in eye position was observed as soon as the operator was heard: the hearing of "plus" shifted the eye rightward compared to "minus". A second difference was observed later between problem offset and response onset: addition shifted the eye rightward and upward compared to subtraction, suggesting that the space used to represent the problem is bidimensional. Further analyses confirmed the fast deployment of spatial attention and evidenced its relationship with the carrying and borrowing procedures triggered by the problem presentation. The predictive role of horizontal eye movements, in particular, is essential to understand how attention contributes to narrow down the range of plausible answers. We propose that attention illuminates significant portions of the numerical continuum anticipatively to guide the search of the answer and facilitate the implementation of solving procedures in verbal working memory.

Saccadic adaptation shapes perceived size: Common codes for action and perception

Recent findings suggest that perceptual and motor systems share common codes; for instance, perceived object location is known to correlate with motor changes in the oculomotor system. Here, we investigate whether modifying saccade amplitude affects object size perception. Participants saw in peripheral vision a test disk that could vary in size across trials. This disk was then replaced by a small target cross, which was the signal to make a saccade. After the saccade, the target cross was extinguished and replaced by a reference disk (thus seen in foveal vision). Participants had to compare the post- to the pre-saccade disk sizes. Psychometric functions were obtained before and after one session of 142 saccades made toward the cross that either stepped toward the fixation point during the saccade (backward adaptation group) or remained stationary (control group). In the experimental group, stepping the target cross toward fixation during saccades decreased movement amplitude, a phenomenon called saccadic adaptation. We observed a concurrent shift in the psychometric functions reflecting a decrease in perceived object size. Such a perceptual modification did not occur in the control group. Our results reveal that motor changes co-occur with changes in perceived object size. Unlike previous studies evaluating the impact of saccadic adaptation on perceived location, we measured here the perception of another spatial feature (the object size) that is not relevant for the sensorimotor transformation. Theoretical implications of the strong links between oculomotor parameters and object perception are discussed.

Emotional SNARC: emotional faces affect the impact of number magnitude on gaze patterns

The Spatial-Numerical Association of Response Codes (SNARC) effect is characterised by a spatial cognitive representation of low numbers to the left side of space and high numbers to the right side of space. This effect has been found using a diversity of stimuli and experimental paradigms. However, the influence of emotional stimuli on this effect remains unclear. In this study, the SNARC effect is analysed in relation to pairs of emotional facial stimuli (happy-neutral, sad-neutral and happy-sad pairs). Gaze patterns of 151 participants were analysed when exposed to a free-viewing eye-tracking paradigm consisting of pairs of emotional faces preceded by small and large numbers. Replicating previous results, a standard SNARC effect was found independently of the emotional expressions of the faces (i.e., there was a significant linear trend of number magnitude in the frequency of first fixations of the gaze to the left side space). However, specific slope analyses revealed that the SNARC effect was influenced by the spatial position of each emotion presented in the emotional pairs. Specifically, the effect disappeared in happy-neutral trials, when the happy faces were allocated in the right position and also in happy-sad trials when two emotional stimuli were simultaneously displayed. The study revealed that the SNARC effect is sensitive to the spatial position of emotional stimuli which further adds to other known limits of the phenomenon. The limitations of the study and its implications in the area of cognition and emotion are also discussed.

How does number magnitude influence temporal and spatial parameters of eye movements?

The influence of numerical processing on individuals' behavior is now well documented. The spatial representation of numbers on a left-to-right mental line (i.e., SNARC effect) has been shown to have sensorimotor consequences, the majority of studies being mainly concerned with its impact on the response times. Its impact on the motor programming stage remains less documented, although swiping movement amplitudes have recently been shown to be modulated by number magnitude. Regarding saccadic eye movements, the few available studies have not provided clear-cut conclusions. They showed that spatial-numerical associations modulated ocular drifts, but not the amplitude of memory-guided saccades. Because these studies held saccadic coordinates constant, which might have masked potential numerical effects, we examined whether spontaneous saccadic eye movements (with no saccadic target) could reflect numerical effects. Participants were asked to look either to the left or to the right side of an empty screen to estimate the magnitude (< or > 5) of a centrally presented digit. Latency data confirmed the presence of the classical SNARC and distance effects. More critically, saccade amplitude reflected a numerical effect: participants' saccades were longer for digits far from the standard (1 and 9) and were shorter for digits close to it (4 and 6). Our results suggest that beyond response times, kinematic parameters also offer valuable information for the understanding of the link between numerical cognition and motor programming.

Asymmetries in flanker-target interference at different levels of number processing

Visual stimuli presented in peripheries can be barely recognized when they are surrounded by flankers (crowding). The target-flanker interference can be asymmetrical, and this asymmetry depends on a stimulus type. In particular, recognition of a letter or a number is more disturbed by the presence of a leftward flanker, reflecting the direction of reading. So far, such reading-related asymmetry has been observed with visual recognition tasks. In the following studies, we used numbers as stimuli to examine whether the leftward asymmetry in crowding extends to other levels of information processing, i.e. whether it is present when more abstract, semantic features are extracted. We presented participants with numerical triplets in the left or right visual field, and asked them to classify the middle number according to its magnitude (Experiment 1), physical characteristics (Experiment 2) or parity (Experiment 3). We observed that the leftward flanker interfered stronger with the target than the rightward flanker, but only when magnitude and physical characteristics were classified. Our findings suggest that the leftward asymmetry in crowding extends up to the semantic level of number processing, but only selectively, i.e. when a certain sort of information (magnitude) is extracted.

Number line estimation and complex mental calculation: Is there a shared cognitive process driving the two tasks?

It is widely accepted that different number-related tasks, including solving simple addition and subtraction, may induce attentional shifts on the so-called mental number line, which represents larger numbers on the right and smaller numbers on the left. Recently, it has been shown that different number-related tasks also employ spatial attention shifts along with general cognitive processes. Here we investigated for the first time whether number line estimation and complex mental arithmetic recruit a common mechanism in healthy adults. Participants' performance in two-digit mental additions and subtractions using visual stimuli was compared with their performance in a mental bisection task using auditory numerical intervals. Results showed significant correlations between participants' performance in number line bisection and that in two-digit mental arithmetic operations, especially in additions, providing a first proof of a shared cognitive mechanism (or multiple shared cognitive mechanisms) between auditory number bisection and complex mental calculation.

Time dependency of the SNARC effect for different number formats: evidence from saccadic responses

In line with the suggestion that the strength of the spatial numerical association of response codes (SNARC) effect was time dependent, the aim of the present study was to assess whether the association strength depends on the processing time of numerical quantity and/or of the time to initiate responses. More specifically, we examined whether and how the SNARC effect could be modulated by number format and effector type. Experiment 1 compared the effect induced by Arabic numbers and number words on the basis of saccadic responses in a parity judgment task. Indeed, previous studies have shown that Arabic numbers lead to faster processing than number words. The results replicated the SNARC effect with Arabic numbers, but not with number words. Experiment 2 was similar to Experiment 1, but this time manual responses (i.e., responses far slower than saccadic ones) were recorded. A strong SNARC effect was observed for both number formats. Further analyses revealed a correlation between mean individual response times and the strength of the SNARC effect. We proposed that the initiation times for saccadic responses may be too short for the SNARC effect to appear, in particular with the written number format for which activation of magnitude takes time. We conclude in terms of time variations resulting from processing specificities related with number format, effector type and also individual reaction and processing speed.

Numerical value biases sound localization

Speech recognition starts with representations of basic acoustic perceptual features and ends by categorizing the sound based on long-term memory for word meaning. However, little is known about whether the reverse pattern of lexical influences on basic perception can occur. We tested for a lexical influence on auditory spatial perception by having subjects make spatial judgments of number stimuli. Four experiments used pointing or left/right 2-alternative forced choice tasks to examine perceptual judgments of sound location as a function of digit magnitude (1–9). The main finding was that for stimuli presented near the median plane there was a linear left-to-right bias for localizing smaller-to-larger numbers. At lateral locations there was a central-eccentric location bias in the pointing task, and either a bias restricted to the smaller numbers (left side) or no significant number bias (right side). Prior number location also biased subsequent number judgments towards the opposite side. Findings support a lexical influence on auditory spatial perception, with a linear mapping near midline and more complex relations at lateral locations. Results may reflect coding of dedicated spatial channels, with two representing lateral positions in each hemispace, and the midline area represented by either their overlap or a separate third channel.

Ocular drift along the mental number line

We examined the spontaneous association between numbers and space by documenting attention deployment and the time course of associated spatial-numerical mapping with and without overt oculomotor responses. In Experiment 1, participants maintained central fixation while listening to number names. In Experiment 2, they made horizontal target-direct saccades following auditory number presentation. In both experiments, we continuously measured spontaneous ocular drift in horizontal space during and after number presentation. Experiment 2 also measured visual-probe-directed saccades following number presentation. Reliable ocular drift congruent with a horizontal mental number line emerged during and after number presentation in both experiments. Our results provide new evidence for the implicit and automatic nature of the oculomotor resonance effect associated with the horizontal spatial-numerical mapping mechanism.