Pupil old/new effects reflect stimulus encoding and decoding in short-term memory

Pupil size tracks cue-trace interactions during episodic memory retrieval

Our ability to remember past events requires not only storing enduring engrams or memory traces of these events, but also successfully reactivating these latent traces in response to appropriate cues at the time of retrieval-a process that has been termed ecphory. However, relatively little is known about the processes that facilitate the dynamic interactions between retrieval cues and stored memory traces that are critical for successful recognition and recollection. Recently, an intriguing link between pupil dilation and recognition memory has been identified, with studied items eliciting greater pupil dilation than unstudied items during retrieval. However, the processes contributing to this "pupillary old/new effect" remain unresolved, with current explanations suggesting that it reflects the strength of the underlying memory trace. Here, we explore the novel hypothesis that the pupillary old/new effect does not index memory strength alone, but rather reflects the facilitation of cue-trace interactions during episodic memory retrieval that may be supported by activity within the pupil-linked locus coeruleus-noradrenergic (LC-NA) arousal system. First, we show that the magnitude of pupil dilation is influenced by the degree of overlap between cue and trace information. Second, we find that the magnitude of pupil dilation reflects the amount of study contextual information reinstated during retrieval. These findings provide a novel framework for understanding the pupillary old/new effect, and identify a potential role for the LC-NA system in recognition memory retrieval.

Pupil Dilation During Encoding, But Not Type of Auditory Stimulation, Predicts Recognition Success in Face Memory

We encounter and process information from multiple sensory modalities in our daily lives, and research suggests that learning can be more efficient when contexts are multisensory. In this study, we were interested in whether face identity recognition memory might be improved in multisensory learning conditions, and to explore associated changes in pupil dilation during encoding and recognition. In two studies participants completed old/new face recognition tasks wherein visual face stimuli were presented in the context of sounds. Faces were learnt alongside no sound, low arousal sounds (Experiment 1), high arousal non-face relevant, or high arousal face relevant (Experiment 2) sounds. We predicted that the presence of sounds during encoding would improve later recognition accuracy, however, the results did not support this with no effect of sound condition on memory. Pupil dilation, however, was found to predict later successful recognition both at encoding and during recognition. While these results do not provide support to the notion that face learning is improved under multisensory conditions relative to unisensory conditions, they do suggest that pupillometry may be a useful tool to further explore face identity learning and recognition.

Is Pupil Activity Associated With the Strength of Memory Signal for Words in a Continuous Recognition Memory Paradigm?

Research on pupillometry provides an increasing evidence for associations between pupil activity and memory processing. The most consistent finding is related to an increase in pupil size for old items compared with novel items, suggesting that pupil activity is associated with the strength of memory signal. However, the time course of these changes is not completely known, specifically, when items are presented in a running recognition task maximizing interference by requiring the recognition of the most recent items from a sequence of old/new items. The sample comprised 42 healthy participants who performed a visual word recognition task under varying conditions of retention interval. Recognition responses were evaluated using behavioral variables for discrimination accuracy, reaction time, and confidence in recognition decisions. Pupil activity was recorded continuously during the entire experiment. The results suggest a decrease in recognition performance with increasing study-test retention interval. Pupil size decreased across retention intervals, while pupil old/new effects were found only for words recognized at the shortest retention interval. Pupillary responses consisted of a pronounced early pupil constriction at retrieval under longer study-test lags corresponding to weaker memory signals. However, the pupil size was also sensitive to the subjective feeling of familiarity as shown by pupil dilation to false alarms (new items judged as old). These results suggest that the pupil size is related not only to the strength of memory signal but also to subjective familiarity decisions in a continuous recognition memory paradigm.

Blue blood, red blood. How does the color of an emotional scene affect visual attention and pupil size?

The function of color in the processing of emotional scenes is not entirely clear. While there are studies showing that color matters in terms of the capture of covert attention by emotional stimuli, the impact of color on fixation patterns, reflecting overt attention, is unresolved. Studies on the role of color in evoking emotional response have also produced mixed results. Here, we aimed to explore how image color and content influence pupillary response and the engagement of overt visual attention. In the first experiment, we examined the pupillary reaction to neutral images (intact and phase scrambled) in three color variants (natural, abnormal, and grayscale). In the second experiment, we investigated the pupillary changes and fixation pattern in response to images of different valence (neutral, positive, and negative), again in three color versions. The results showed that pupillary responses were influenced by both content and the color of the images. The pupillary response to phase-scrambled images did not differ between the color versions. Intact neutral and positive images, but not negative ones, evoked smaller pupil responses if they were presented in abnormal colors rather than natural ones. The initial capture of attention by emotional content depended on the color version, whereas holding of attention was affected solely by the emotional valence. Thus, color changes the physiological response to images, particularly low-arousing ones, and modulates the initial engagement of attention by image content.

Pupil dilation as an implicit measure of appetitive Pavlovian learning

Appetitive Pavlovian conditioning is a learning mechanism of fundamental biological and pathophysiological significance. Nonetheless, its exploration in humans remains sparse, which is partly attributed to the lack of an established psychophysiological parameter that aptly represents conditioned responding. This study evaluated pupil diameter and other ocular response measures (gaze dwelling time, blink duration and count) as indices of conditioning. Additionally, a learning model was used to infer participants' learning progress on the basis of their pupil dilation. Twenty-nine healthy volunteers completed an appetitive differential delay conditioning paradigm with a primary reward, while the ocular response measures along with other psychophysiological (heart rate, electrodermal activity, postauricular and eyeblink reflex) and behavioral (ratings, contingency awareness) parameters were obtained to examine the relation among different measures. A significantly stronger increase in pupil diameter, longer gaze duration and shorter eyeblink duration was observed in response to the reward-predicting cue compared to the control cue. The Pearce-Hall attention model best predicted the trial-by-trial pupil diameter. This conditioned response was corroborated by a pronounced heart rate deceleration to the reward-predicting cue, while no conditioning effect was observed in the electrodermal activity or startle responses. There was no discernible correlation between the psychophysiological response measures. These results highlight the potential value of ocular response measures as sensitive indices for representing appetitive conditioning.

Cortical modulation of pupillary function: systematic review

BACKGROUND

The pupillary light reflex is the main mechanism that regulates the pupillary diameter; it is controlled by the autonomic system and mediated by subcortical pathways. In addition, cognitive and emotional processes influence pupillary function due to input from cortical innervation, but the exact circuits remain poorly understood. We performed a systematic review to evaluate the mechanisms behind pupillary changes associated with cognitive efforts and processing of emotions and to investigate the cerebral areas involved in cortical modulation of the pupillary light reflex.

METHODOLOGY

We searched multiple databases until November 2018 for studies on cortical modulation of pupillary function in humans and non-human primates. Of 8,809 papers screened, 258 studies were included.

RESULTS

Most investigators focused on pupillary dilatation and/or constriction as an index of cognitive and emotional processing, evaluating how changes in pupillary diameter reflect levels of attention and arousal. Only few tried to correlate specific cerebral areas to pupillary changes, using either cortical activation models (employing micro-stimulation of cortical structures in non-human primates) or cortical lesion models (e.g., investigating patients with stroke and damage to salient cortical and/or subcortical areas). Results suggest the involvement of several cortical regions, including the insular cortex (Brodmann areas 13 and 16), the frontal eye field (Brodmann area 8) and the prefrontal cortex (Brodmann areas 11 and 25), and of subcortical structures such as the locus coeruleus and the superior colliculus.

CONCLUSIONS

Pupillary dilatation occurs with many kinds of mental or emotional processes, following sympathetic activation or parasympathetic inhibition. Conversely, pupillary constriction may occur with anticipation of a bright stimulus (even in its absence) and relies on a parasympathetic activation. All these reactions are controlled by subcortical and cortical structures that are directly or indirectly connected to the brainstem pupillary innervation system.

Using task effort and pupil size to track covert shifts of visual attention independently of a pupillary light reflex

We tested the link between pupil size and the task effort involved in covert shifts of visual attention. The goal of this study was to establish pupil size as a marker of attentional shifting in the absence of luminance manipulations. In three experiments, participants evaluated two stimuli that were presented peripherally, appearing equidistant from and on opposite sides of eye fixation. The angle between eye fixation and the peripherally presented target stimuli varied from 12.5° to 42.5°. The evaluation of more distant stimuli led to poorer performance than did the evaluation of more proximal stimuli throughout our study, confirming that the former required more effort than the latter. In addition, in Experiment 1 we found that pupil size increased with increasing angle and that this effect could not be reduced to the operation of low-level visual processes in the task. In Experiment 2 the pupil dilated more strongly overall when participants evaluated the target stimuli, which required shifts of attention, than when they merely reported on the target's presence versus absence. Both conditions yielded larger pupils for more distant than for more proximal stimuli, however. In Experiment 3, we manipulated task difficulty more directly, by changing the contrast at which the target stimuli were presented. We replicated the results from Experiment 1 only with the high-contrast stimuli. With stimuli of low contrast, ceiling effects in pupil size were observed. Our data show that the link between task effort and pupil size can be used to track the degree to which an observer covertly shifts attention to or detects stimuli in peripheral vision.

Recognition memory and featural similarity between concepts: The pupil's point of view

Differences in pupil dilation are observed for studied compared to new items in recognition memory. According to cognitive load theory, this effect reflects the greater cognitive demands of retrieving contextual information from study phase. Pupil dilation can also occur when new items conceptually related to old ones are erroneously recognized as old, but the aspects of similarity that modulate false memory and related pupil responses remain unclear. We investigated this issue by manipulating the degree of featural similarity between new (unstudied) and old (studied) concepts in an old/new recognition task. We found that new concepts with high similarity were mistakenly identified as old and had greater pupil dilation than those with low similarity, suggesting that pupil dilation reflects the strength of evidence on which recognition judgments are based and, importantly, greater locus coeruleus and prefrontal activity determined by the higher degree of retrieval monitoring involved in recognizing these items.

Decision-related factors in pupil old/new effects: Attention, response execution, and false memory

In this study, we investigate the effects of decision-related factors on recognition memory in pupil old/new paradigms. In Experiment 1, we used an old/new paradigm with words and pseudowords and participants made lexical decisions during recognition rather than old/new decisions. Importantly, participants were instructed to focus on the nonword-likeness of presented items, not their word-likeness. We obtained no old/new effects. In Experiment 2, participants discriminated old from new words and old from new pseudowords during recognition, and they did so as quickly as possible. We found old/new effects for both words and pseudowords. In Experiment 3, we used materials and an old/new design known to elicit a large number of incorrect responses. For false alarms ("old" response for new word), we found larger pupils than for correctly classified new items, starting at the point at which response execution was allowed (2750ms post stimulus onset). In contrast, pupil size for misses ("new" response for old word) was statistically indistinguishable from pupil size in correct rejections. Taken together, our data suggest that pupil old/new effects result more from the intentional use of memory than from its automatic use.