Concerning imagery

Differential eye movements and greater pupil size during mental scene construction in autobiographical recall

There is growing evidence supporting a role for eye movements during autobiographical recall, but their potential functionality remains unclear. We hypothesise that the oculomotor system facilitates the process of mental scene construction, in which complex scenes associated with an autobiographical event are generated and maintained during recall. To explore this, we examined spontaneous eye movements during retrieval of cued autobiographical memories. Participants' verbal descriptions of each memory were recorded in synchronisation with their eye movements and pupil size during recall. For each memory participants described the place (details of the environment where the event took place) and the event (details of what happened). Narratives were analyzed using the Autobiographical Interview procedure, which separated internal spatial (place) and non-spatial (event, thoughts and emotion) details. Eye movements during recall of spatial details had significantly higher fixation duration and smaller saccade amplitude and peak velocity, and a higher number of consecutive unidirectional saccades, in comparison to recall of non-spatial details. Recurrence quantification analysis indicated longer sequences of refixations and more repetitions of the same fixation pattern when participants described spatial details. Recall of spatial details was also associated with significantly greater pupil area. Overall findings are consistent with the spontaneous production of more structured saccade patterns and greater cognitive load during the recall of internal spatial episodic scene details in comparison to episodic non-spatial details. These results are consistent with the oculomotor system facilitating the activation and correct positioning of elements of a complex scene relative to other imagined elements during autobiographical recall.

Eye movements follow the dynamic shifts of attention through serial order in verbal working memory

How are arbitrary sequences of verbal information retained and manipulated in working memory? Increasing evidence suggests that serial order in verbal WM is spatially coded and that spatial attention is involved in access and retrieval. Based on the idea that brain areas controlling spatial attention are also involved in oculomotor control, we used eye tracking to reveal how the spatial structure of serial order information is accessed in verbal working memory. In two experiments, participants memorized a sequence of auditory words in the correct order. While their eye movements were being measured, they named the memorized items in a self-determined order in Experiment 1 and in a cued order in Experiment 2. We tested the hypothesis that serial order in verbal working memory interacts with the spatial attention system whereby gaze patterns in visual space closely follow attentional shifts in the internal space of working memory. In both experiments, we found that the gaze shifts in visual space correlated with the spatial shifts of attention along the left-to-right one-dimensional mapping of serial order positions in verbal WM. These findings suggest that spatial attention is employed for dynamically searching through verbal WM and that eye movements reflect the spontaneous association of order and space even in the absence of visuospatial input.

A short natural history of mental time travels: a journey still travelled?

Tulving's introduction of episodic memory and the metaphor of mental time travel has immensely enriched our understanding of human cognition. However, his focus on human psychology, with limited consideration of evolutionary perspectives, led to the entrenched notion that mental time travel is uniquely human. We contend that adopting a phylogenetic perspective offers a deeper insight into cognition, revealing it as a continuous evolutionary process. Adherence to the uniqueness of pre-defined psychological concepts obstructs a more complete understanding. We offer a concise natural history to elucidate how events that occurred hundreds of millions of years ago have been pivotal for our ability to mentally time travel. We discuss how the human brain, utilizing parts with ancient origins in a networked manner, enables mental time travel. This underscores that episodic memories and mental time travel are not isolated mental constructs but integral to our perception and representation of the world. We conclude by examining recent evidence of neuroanatomical correlates found only in great apes, which show great variability, indicating the ongoing evolution of mental time travel in humans.This article is part of the theme issue 'Elements of episodic memory: lessons from 40 years of research'.

Defining and 'diagnosing' aphantasia: Condition or individual difference?

Research into the newly-coined 'condition' of 'aphantasia', an individual difference involving the self-reported absence of voluntary visual imagery, has taken off in recent years, and more and more people are 'self-diagnosing' as aphantasic. Yet, there is no consensus on whether aphantasia should really be described as a 'condition', and there is no battery of psychometric instruments to detect or 'diagnose' aphantasia. Instead, researchers currently rely on the Vividness of Visual Imagery Questionnaire (VVIQ) to 'diagnose' aphantasia. We review here fundamental and methodological problems affecting aphantasia research stemming from an inadequate focus on how we should define aphantasia, whether aphantasia is a pathological condition, and the extensive use of VVIQ as a 'diagnostic test' for aphantasia. Firstly, we draw attention to 'literature blindness' for visual imagery research from the 1960s-1990s concerning individual differences in visual imagery vividness. Secondly, despite aphantasia being defined as a 'condition' where voluntary visual imagery is absent as indicated by the lowest score on the VVIQ, aphantasia studies inconsistently employ samples comprised of a mixture of participants with no visual imagery and low visual imagery, and we argue that this hinders the uncovering of the underlying cause of aphantasia. Thirdly, the scores used to designate the boundary between aphantasia and non-aphantasia are arbitrary and differ between studies, compromising the possibility for cross-study comparison of results. Fourthly, the problems of 'diagnosing' aphantasia are not limited to the academic sphere, as one can 'self-diagnose' online, for example by using the variant-VVIQ on the Aphantasia Network website. However, the variant-VVIQ departs from the original in ways likely to impact validity and accuracy, which could lead people to falsely believe they have been 'diagnosed' with aphantasia by a scientifically-validated measure. Fifthly, we discuss the hypothesis that people who believe they have been 'diagnosed' with aphantasia might be vulnerable to health anxiety, distress, and stigma. We conclude with a discussion about some fundamental aspects of how to classify a disorder, and suggest the need for a new psychometric measure of aphantasia.

Perception and memory have distinct spatial tuning properties in human visual cortex

Reactivation of earlier perceptual activity is thought to underlie long-term memory recall. Despite evidence for this view, it is unclear whether mnemonic activity exhibits the same tuning properties as feedforward perceptual activity. Here, we leverage population receptive field models to parameterize fMRI activity in human visual cortex during spatial memory retrieval. Though retinotopic organization is present during both perception and memory, large systematic differences in tuning are also evident. Whereas there is a three-fold decline in spatial precision from early to late visual areas during perception, this pattern is not observed during memory retrieval. This difference cannot be explained by reduced signal-to-noise or poor performance on memory trials. Instead, by simulating top-down activity in a network model of cortex, we demonstrate that this property is well explained by the hierarchical structure of the visual system. Together, modeling and empirical results suggest that computational constraints imposed by visual system architecture limit the fidelity of memory reactivation in sensory cortex.

Eye-movement replay supports episodic remembering

When we bring to mind something we have seen before, our eyes spontaneously unfold in a sequential pattern strikingly similar to that made during the original encounter, even in the absence of supporting visual input. Oculomotor movements of the eye may then serve the opposite purpose of acquiring new visual information; they may serve as self-generated cues, pointing to stored memories. Over 50 years ago Donald Hebb, the forefather of cognitive neuroscience, posited that such a sequential replay of eye movements supports our ability to mentally recreate visuospatial relations during episodic remembering. However, direct evidence for this influential claim is lacking. Here we isolate the sequential properties of spontaneous eye movements during encoding and retrieval in a pure recall memory task and capture their encoding-retrieval overlap. Critically, we show that the fidelity with which a series of consecutive eye movements from initial encoding is sequentially retained during subsequent retrieval predicts the quality of the recalled memory. Our findings provide direct evidence that such scanpaths are replayed to assemble and reconstruct spatio-temporal relations as we remember and further suggest that distinct scanpath properties differentially contribute depending on the nature of the goal-relevant memory.

Neural reactivation and judgements of vividness reveal separable contributions to mnemonic representation

Mnemonic representations vary in fidelity, sharpness, and strength-qualities that can be examined using both introspective judgements of mental states and objective measures of brain activity. Subjective and objective measures are both valid ways of "reading out" the content of someone's internal mnemonic states, each with different strengths and weaknesses. St-Laurent and colleagues (2015) compared the neural correlates of memory vividness ratings with patterns of neural reactivation evoked during memory recall and found considerable overlap between the two, suggesting a common neural basis underlying these different markers of representational quality. Here we extended this work with meta-analytic methods by pooling together four neuroimaging datasets in order to contrast the neural substrates of neural reactivation and those of vividness judgements. While reactivation and vividness judgements correlated positively with one another and were associated with common univariate activity in the dorsal attention network and anterior hippocampus, some notable differences were also observed. Vividness judgments were tied to stronger activation in the striatum and dorsal attention network, together with activity suppression in default mode network nodes. We also observed a trend for reactivation to be more closely associated with early visual cortex activity. A mediation analysis found support for the hypothesis that neural reactivation is necessary for memory vividness, with activity in the anterior hippocampus associated with greater reactivation. Our results suggest that neural reactivation and vividness judgements reflect common mnemonic processes but differ in the extent to which they engage effortful, attentional processes. Additionally, the similarity between reactivation and vividness appears to arise, partly, through hippocampal engagement during memory retrieval.

Looking for the neural basis of memory

Memory neuroscientists often measure neural activity during task trials designed to recruit specific memory processes. Behavior is championed as crucial for deciphering brain-memory linkages but is impoverished in typical experiments that rely on summary judgments. We criticize this approach as being blind to the multiple cognitive, neural, and behavioral processes that occur rapidly within a trial to support memory. Instead, time-resolved behaviors such as eye movements occur at the speed of cognition and neural activity. We highlight successes using eye-movement tracking with in vivo electrophysiology to link rapid hippocampal oscillations to encoding and retrieval processes that interact over hundreds of milliseconds. This approach will improve research on the neural basis of memory because it pinpoints discrete moments of brain-behavior-cognition correspondence.

Neurofunctional Symmetries and Asymmetries during Voluntary out-of- and within-Body Vivid Imagery Concurrent with Orienting Attention and Visuospatial Detection

We explored whether two visual mental imagery experiences may be differentiated by electroencephalographic (EEG) and performance interactions with concurrent orienting external attention (OEA) to stimulus location and subsequent visuospatial detection. We measured within-subject (N = 10) event-related potential (ERP) changes during out-of-body imagery (OBI)—vivid imagery of a vertical line outside of the head/body—and within-body imagery (WBI)—vivid imagery of the line within one’s own head. Furthermore, we measured ERP changes and line offset Vernier acuity (hyperacuity) performance concurrent with those imagery, compared to baseline detection without imagery. Relative to OEA baseline, OBI yielded larger N200 and P300, whereas WBI yielded larger P50, P100, N400, and P800. Additionally, hyperacuity dropped significantly when concurrent with both imagery types. Partial least squares analysis combined behavioural performance, ERPs, and/or event-related EEG band power (ERBP). For both imagery types, hyperacuity reduction correlated with opposite frontal and occipital ERP amplitude and polarity changes. Furthermore, ERP modulation and ERBP synchronizations for all EEG frequencies correlated inversely with hyperacuity. Dipole Source Localization Analysis revealed unique generators in the left middle temporal gyrus (WBI) and in the right frontal middle gyrus (OBI), whereas the common generators were in the left precuneus and middle occipital cortex (cuneus). Imagery experiences, we conclude, can be identified by symmetric and asymmetric combined neurophysiological-behavioural patterns in interactions with the width of attentional focus.

Eye movements during visual imagery and perception show spatial correspondence but have unique temporal signatures

Eye fixation patterns during mental imagery are similar to those during perception of the same picture, suggesting that oculomotor mechanisms play a role in mental imagery (i.e., the "looking at nothing" effect). Previous research has focused on the spatial similarities of eye movements during perception and mental imagery. The primary aim of this study was to assess whether the spatial similarity translates to the temporal domain. We used recurrence quantification analysis (RQA) to assess the temporal structure of eye fixations in visual perception and mental imagery and we compared the temporal as well as the spatial characteristics in mental imagery with perception by means of Bayesian hierarchical regression models. We further investigated how person and picture-specific characteristics contribute to eye movement behavior in mental imagery. Working memory capacity and mental imagery abilities were assessed to either predict gaze dynamics in visual imagery or to moderate a possible correspondence between spatial or temporal gaze dynamics in perception and mental imagery. We were able to show the spatial similarity of fixations between visual perception and imagery and we provide first evidence for its moderation by working memory capacity. Interestingly, the temporal gaze dynamics in mental imagery were unrelated to those in perception and their variance between participants was not explained by variance in visuo-spatial working memory capacity or vividness of mental images. The semantic content of the imagined pictures was the only meaningful predictor of temporal gaze dynamics. The spatial correspondence reflects shared spatial structure of mental images and perceived pictures, while the unique temporal gaze behavior could be driven by generation, maintenance and protection processes specific to visual imagery. The unique temporal gaze dynamics offer a window to new insights into the genuine process of mental imagery independent of its similarity to perception.

The prioritization of visuo-spatial associations during mental imagery

While previous research has shown that during mental imagery participants look back to areas visited during encoding it is unclear what happens when information presented during encoding is incongruent. To investigate this research question, we presented 30 participants with incongruent audio-visual associations (e.g. the image of a car paired with the sound of a cat) and later asked them to create a congruent mental representation based on the auditory cue (e.g. to create a mental representation of a cat while hearing the sound of a cat). The results revealed that participants spent more time in the areas where they previously saw the object and that incongruent audio-visual information during encoding did not appear to interfere with the generation and maintenance of mental images. This finding suggests that eye movements can be flexibly employed during mental imagery depending on the demands of the task.

Hallucination, imagery, dreaming: reassembling stimulus-independent perceptions based on Edmund Parish's classic misperception framework

Within the broad field of human perception lies the category of stimulus-independent perceptions, which draws together experiences such as hallucinations, mental imagery and dreams. Traditional divisions between medical and psychological sciences have contributed to these experiences being investigated separately. This review aims to examine their similarities and differences at the levels of phenomenology and underlying brain function and thus reassemble them within a common framework. Using Edmund Parish's historical work as a guiding tool and the latest research findings in the cognitive, clinical and computational sciences, we consider how different perspectives may be reconciled and help generate novel hypotheses for future research. This article is part of the theme issue 'Offline perception: voluntary and spontaneous perceptual experiences without matching external stimulation'.

The link between detail generation and eye movements when encoding and retrieving complex images

Examining eye movement patterns when encoding and retrieving visually complex memories is useful to understand the link between visuo-perceptual processes and how associated details are represented within these memories. Here, we used images of real-world scenes (e.g., a couple grocery shopping) to examine how encoding and retrieval eye movements are linked to the details used to describe complex images during these two phases of memory. Given that memories are often elaborated upon during retrieval, we also examined whether eye-movements at retrieval related to details that were the same as those described when encoding the image (reinstated details) as well as details about the image event that were not initially described at encoding (newly generated details). Testing young healthy participants, we found that retrieval eye movements, specifically eye fixation rate, predicted reinstated details, but not newly generated details. This suggests that visuo-perceptual processes are preferentially engaged at retrieval to reactivate perceived information. At encoding, we found a relationship between eye movements and detail generation that changed over time. This relationship was positive early on in the encoding phase but changed to a negative relationship later in the phase, indicating that a unique relationship exists between activating visuo-perceptual processes during early encoding versus late encoding. Overall, our results provide new insights into how visuo-perceptual processes contribute to different components of complex memory.

Computational discrimination between natural images based on gaze during mental imagery

When retrieving image from memory, humans usually move their eyes spontaneously as if the image were in front of them. Such eye movements correlate strongly with the spatial layout of the recalled image content and function as memory cues facilitating the retrieval procedure. However, how close the correlation is between imagery eye movements and the eye movements while looking at the original image is unclear so far. In this work we first quantify the similarity of eye movements between recalling an image and encoding the same image, followed by the investigation on whether comparing such pairs of eye movements can be used for computational image retrieval. Our results show that computational image retrieval based on eye movements during spontaneous imagery is feasible. Furthermore, we show that such a retrieval approach can be generalized to unseen images.

Eye Movement Reinstatement and Neural Reactivation During Mental Imagery

Half a century ago, Donald Hebb posited that mental imagery is a constructive process that emulates perception. Specifically, Hebb claimed that visual imagery results from the reactivation of neural activity associated with viewing images. He also argued that neural reactivation and imagery benefit from the re-enactment of eye movement patterns that first occurred at viewing (fixation reinstatement). To investigate these claims, we applied multivariate pattern analyses to functional MRI (fMRI) and eye tracking data collected while healthy human participants repeatedly viewed and visualized complex images. We observed that the specificity of neural reactivation correlated positively with vivid imagery and with memory for stimulus image details. Moreover, neural reactivation correlated positively with fixation reinstatement, meaning that image-specific eye movements accompanied image-specific patterns of brain activity during visualization. These findings support the conception of mental imagery as a simulation of perception, and provide evidence consistent with the supportive role of eye movement in neural reactivation.

Feature-specific neural reactivation during episodic memory

We present a multi-voxel analytical approach, feature-specific informational connectivity (FSIC), that leverages hierarchical representations from a neural network to decode neural reactivation in fMRI data collected while participants performed an episodic visual recall task. We show that neural reactivation associated with low-level (e.g. edges), high-level (e.g. facial features), and semantic (e.g. “terrier”) features occur throughout the dorsal and ventral visual streams and extend into the frontal cortex. Moreover, we show that reactivation of both low- and high-level features correlate with the vividness of the memory, whereas only reactivation of low-level features correlates with recognition accuracy when the lure and target images are semantically similar. In addition to demonstrating the utility of FSIC for mapping feature-specific reactivation, these findings resolve the contributions of low- and high-level features to the vividness of visual memories and challenge a strict interpretation the posterior-to-anterior visual hierarchy.

Memory recollection involves reactivation of neural activity that occurred during the recalled experience. Here, the authors show that neural reactivation can be decomposed into visual-semantic features, is widely synchronized throughout the brain, and predicts memory vividness and accuracy.

Power spectrum and coherence of electroencephalograms of young people with the use of mnemotechnics

The increase of external information and the need for processing of large information arrays has been leading to the search for mechanisms of thinking in mental activity, as well as new methods of data protection and reproduction. Power spectrum and coherence of electroencephalograms (EEG) during memorizing of foreign words has been analyzed in many ways: in the usual one with the help of mnemotechnics. The research was conducted during the ovarian phase of the cycle of 11 female students aged 18–20. Registration of EEG activity was carried out according to the international system of H. Jasper,"10–20". The process of recollection of associative information led to the decrease in the power spectrum of the EEG in the alpha range in the frontal and temporal loci of the left hemisphere and the prefrontal sections of both hemispheres, in the beta range it was probable only in T6 zone of beta2 range, in the delta range it was in the prefrontal, posterior lower-frontal and posttemporal loci of both hemispheres, in the central, parietal and occipital regions of the left hemisphere, as well as in the anteriofrontal zone of the right hemisphere, in the theta-range – in the prefrontal and posterior lower-frontal regions of both hemispheres and in the posttemporal and occipital loci of the left hemisphere. Synchronization in the delta range is the reflection of the processes of figural information processing and manipulation. With the increase of attention concentration, the synchronization was observed in the theta range in the anteriofrontal and F4–P4 zones. Interhemispheric functional and symmetrical bonds in the alpha and beta ranges indicate the involvement of the corpus callosum in the process of memorizing foreign words, which facilitates their faster, more correct and easier reproduction, especially with the use of associative images. The decrease of power spectrum in the delta and theta ranges showed that less effort was required to reproduce associative information than to mention unsupported images of foreign words. The effective use of the association method is realized by reduction of the power spectrum of the waves in the alpha range in the frontal and temporal loci of the left hemisphere and the prefrontal sections of both hemispheres, which indicates the activation of mental activity in these zones in the processes of maintaining and reproducing associative information.

The function of "looking-at-nothing" for sequential sensorimotor tasks: Eye movements to remembered action-target locations

When performing manual actions, eye movements precede hand movements to target locations: Before we grasp an object, we look at it. Eye-hand guidance is even preserved when visual targets are unavailable, e.g., grasping behind an occlusion. This "looking-atnothing" behavior might be functional, e.g., as "deictic pointer" for manual control or as memory-retrieval cue, or a by-product of automatization. Here, it is studied if looking at empty locations before acting on them is beneficial for sensorimotor performance. In five experiments, participants completed a click sequence on eight visual targets for 0-100 trials while they had either to fixate on the screen center or could move their eyes freely. During 50-100 consecutive trials, participants clicked the same sequence on a blank screen with free or fixed gaze. During both phases, participants looked at target locations when gaze shifts were allowed. With visual targets, target fixations led to faster, more precise clicking, fewer errors, and sparser cursor-paths than central fixation. Without visual information, a tiny free-gaze benefit could sometimes be observed and was rather a memory than a motor-calculation benefit. Interestingly, central fixation during learning forced early explicit encoding causing a strong benefit for acting on remembered targets later, independent of whether eyes moved then.

Eye Movements Actively Reinstate Spatiotemporal Mnemonic Content

Eye movements support memory encoding by binding distinct elements of the visual world into coherent representations. However, the role of eye movements in memory retrieval is less clear. We propose that eye movements play a functional role in retrieval by reinstating the encoding context. By overtly shifting attention in a manner that broadly recapitulates the spatial locations and temporal order of encoded content, eye movements facilitate access to, and reactivation of, associated details. Such mnemonic gaze reinstatement may be obligatorily recruited when task demands exceed cognitive resources, as is often observed in older adults. We review research linking gaze reinstatement to retrieval, describe the neural integration between the oculomotor and memory systems, and discuss implications for models of oculomotor control, memory, and aging.

I Am Conscious, Therefore, I Am: Imagery, Affect, Action, and a General Theory of Behavior

Organisms are adapted to each other and the environment because there is an inbuilt striving toward security, stability, and equilibrium. A General Theory of Behavior connects imagery, affect, and action with the central executive system we call consciousness, a direct emergent property of cerebral activity. The General Theory is founded on the assumption that the primary motivation of all of consciousness and intentional behavior is psychological homeostasis. Psychological homeostasis is as important to the organization of mind and behavior as physiological homeostasis is to the organization of bodily systems. Consciousness processes quasi-perceptual images independently of the input to the retina and sensorium. Consciousness is the "I am" control center for integration and regulation of (my) thoughts, (my) feelings, and (my) actions with (my) conscious mental imagery as foundation stones. The fundamental, universal conscious desire for psychological homeostasis benefits from the degree of vividness of inner imagery. Imagery vividness, a combination of clarity and liveliness, is beneficial to imagining, remembering, thinking, predicting, planning, and acting. Assessment of vividness using introspective report is validated by objective means such as functional magnetic resonance imaging (fMRI). A significant body of work shows that vividness of visual imagery is determined by the similarity of neural responses in imagery to those occurring in perception of actual objects and performance of activities. I am conscious; therefore, I am.

Recurrence quantification analysis of eye movements during mental imagery

Several studies demonstrated similarities of eye fixations during mental imagery and visual perception but-to our knowledge-the temporal characteristics of eye movements during imagery have not yet been considered in detail. To fill this gap, the same data is analyzed with conventional spatial techniques such as analysis of areas of interest (AOI), ScanMatch, and MultiMatch and with recurrence quantification analysis (RQA), a new way of analyzing gaze data by tracking re-fixations and their temporal dynamics. Participants viewed and afterwards imagined three different kinds of pictures (art, faces, and landscapes) while their eye movements were recorded. While fixation locations during imagery were related to those during perception, participants returned more often to areas they had previously looked at during imagery and their scan paths were more clustered and more repetitive when compared to visual perception. Furthermore, refixations of the same area occurred sooner after initial fixation during mental imagery. The results highlight not only content-driven spatial similarities between imagery and perception but also shed light on the processes of mental imagery maintenance and interindividual differences in these processes.

Action dual tasks reveal differential effects of visual imagery perspectives on motor performance

Imagery research has identified two main visual perspectives, external visual imagery (EVI, third person) and internal visual imagery (IVI, first person). Based upon findings from brain imaging literature showing that different neural substrates are recruited for IVI and EVI perspectives, and that IVI activates motor system brain areas, we hypothesised that a concurrent action dual task would cause greater interference in performance for IVI than EVI. In a first experiment, participants were allocated to either an IVI or an EVI group, and were tasked with moving an onscreen marker towards a target in three blocked conditions: imagery, imagery with a concurrent motor dual-task of sequencing, and a math control. An interaction between imagery group and condition was driven by greater root mean square error for participants in the dual-task condition in the IVI group compared with the EVI group. We replicated the experiment with an eye-tracking objective measure of IVI; the results again showed that participants in the IVI group made more errors in motor movements, and an interference effect in eye movements, during the dual-task sequencing condition compared with the EVI group. The results of the two experiments reveal that a secondary motor task does interfere with IVI, providing behavioural evidence that IVI appears to rely on motor system processes more than EVI. These results have important implications for the use of visual imagery perspectives across a number of domains, with this paper being an essential reference for those conducting visual imagery perspectives research.

Rapid Eye Movements in Sleep Furnish a Unique Probe Into Consciousness

The neural correlates of rapid eye movements (REMs) in sleep are extraordinarily robust; including REM-locked multisensory-motor integration and accompanying activation in the retrosplenial cortex, the supplementary eye field and areas encompassing cholinergic basal nucleus (Hong et al., 2009). The phenomenology of REMs speaks to the notion that perceptual experience in both sleep and wakefulness is a constructive process - in which we generate predictions of sensory inputs and then test those predictions through actively sampling the sensorium with eye movements. On this view, REMs during sleep may index an internalized active sampling or 'scanning' of self-generated visual constructs that are released from the constraints of visual input. If this view is correct, it renders REMs an ideal probe to study consciousness as "an exclusively internal affair" (Metzinger, 2009). In other words, REMs offer a probe of active inference - in the sense of predictive coding - when the brain is isolated from the sensorium in virtue of the natural blockade of sensory afferents during REM sleep. Crucially, REMs are temporally precise events that enable powerful inferences based on time series analyses. As a natural, task-free probe, (REMs) could be used in non-compliant subjects, including infants and animals. In short, REMs constitute a promising probe to study the ontogenetic and phylogenetic development of consciousness and perhaps the psychopathology of schizophrenia and autism, which have been considered in terms of aberrant predictive coding.

Less imageable words lead to more looks to blank locations during memory retrieval

People revisit spatial locations of visually encoded information when they are asked to retrieve that information, even when the visual image is no longer present. Such “looking at nothing” during retrieval is likely modulated by memory load (i.e., mental effort to maintain and reconstruct information) and the strength of mental representations. We investigated whether words that are more difficult to remember also lead to more looks to relevant, blank locations. Participants were presented four nouns on a two by two grid. A number of lexico-semantic variables were controlled to form high-difficulty and low-difficulty noun sets. Results reveal more frequent looks to blank locations during retrieval of high-difficulty nouns compared to low-difficulty ones. Mixed-effects modelling demonstrates that imagery-related semantic factors (imageability and concreteness) predict looking at nothing during retrieval. Results provide the first direct evidence that looking at nothing is modulated by word difficulty and in particular, word imageability. Overall, the research provides substantial support to the integrated memory account for linguistic stimuli and looking at nothing as a form of mental imagery.

Gaze patterns reveal how situation models and text representations contribute to episodic text memory

When recalling something you have previously read, to what degree will such episodic remembering activate a situation model of described events versus a memory representation of the text itself? The present study was designed to address this question by recording eye movements of participants who recalled previously read texts while looking at a blank screen. An accumulating body of research has demonstrated that spontaneous eye movements occur during episodic memory retrieval and that fixation locations from such gaze patterns to a large degree overlap with the visuospatial layout of the recalled information. Here we used this phenomenon to investigate to what degree participants' gaze patterns corresponded with the visuospatial configuration of the text itself versus a visuospatial configuration described in it. The texts to be recalled were scene descriptions, where the spatial configuration of the scene content was manipulated to be either congruent or incongruent with the spatial configuration of the text itself. Results show that participants' gaze patterns were more likely to correspond with a visuospatial representation of the described scene than with a visuospatial representation of the text itself, but also that the contribution of those representations of space is sensitive to the text content. This is the first demonstration that eye movements can be used to discriminate on which representational level texts are remembered and the findings provide novel insight into the underlying dynamics in play.

"Looking-at-nothing" during sequential sensorimotor actions: Long-term memory-based eye scanning of remembered target locations

Before acting humans saccade to a target object to extract relevant visual information. Even when acting on remembered objects, locations previously occupied by relevant objects are fixated during imagery and memory tasks - a phenomenon called "looking-at-nothing". While looking-at-nothing was robustly found in tasks encouraging declarative memory built-up, results are mixed in the case of procedural sensorimotor tasks. Eye-guidance to manual targets in complete darkness was observed in a task practiced for days beforehand, while investigations using only a single session did not find fixations to remembered action targets. Here, it is asked whether looking-at-nothing can be found in a single sensorimotor session and thus independent from sleep consolidation, and how it progresses when visual information is repeatedly unavailable. Eye movements were investigated in a computerized version of the trail making test. Participants clicked on numbered circles in ascending sequence. Fifty trials were performed with the same spatial arrangement of 9 visual targets to enable long-term memory consolidation. During 50 consecutive trials, participants had to click the remembered target sequence on an empty screen. Participants scanned the visual targets and also the empty target locations sequentially with their eyes, however, the latter less precise than the former. Over the course of the memory trials, manual and oculomotor sequential target scanning became more similar to the visual trials. Results argue for robust looking-at-nothing during procedural sensorimotor tasks provided that long-term memory information is sufficient.