Pupil Size as a Window on Neural Substrates of Cognition

Independent bilateral-eye stimulation for gaze pattern recognition based on steady-state pupil light reflex

Objective:recently, pupil oscillations synchronized with steady visual stimuli were used as input for an interface. The proposed system, inspired by a brain-computer interface based on steady-state visual evoked potentials, does not require contact with the participant. However, the pupil oscillation mechanism limits the stimulus frequency to 2.5 Hz or less, making it hard to enhance the information transfer rate (ITR).Approach:here, we compared multiple conditions for stimulation to increase the ITR of the pupil vibration-based interface, which were called monocular-single, monocular-superposed, and binocular-independent conditions. The binocular-independent condition stimulates each eye at different frequencies respectively and mixes them by using the visual stereoscopic perception of users. The monocular-superposed condition stimulates both eyes by a mixed signal of two different frequencies. We selected the shape of the stimulation signal, evaluated the amount of spectral leakage in the monocular-superposed and binocular-independent conditions, and compared the power spectrum density at the stimulation frequency. Moreover, 5, 10, and 15 patterns of stimuli were classified in each condition.Main results:a square wave, which causes an efficient pupil response, was used as the stimulus. Spectral leakage at the beat frequency was higher in the monocular-superposed condition than in the binocular-independent one. The power spectral density of stimulus frequencies was greatest in the monocular-single condition. Finally, we could classify the 15-stimulus pattern, with ITRs of 14.4 (binocular-independent, using five frequencies), 14.5 (monocular-superimposed, using five frequencies), and 23.7 bits min^-1(monocular-single, using 15 frequencies). There were no significant differences for the binocular-independent and monocular-superposed conditions.Significance:this paper shows a way to increase the number of stimuli that can be simultaneously displayed without decreasing ITR, even when only a small number of frequencies are available. This could lead to the provision of an interface based on pupil oscillation to a wider range of users.

Pupillary dynamics of mice performing a Pavlovian delay conditioning task reflect reward-predictive signals

Pupils can signify various internal processes and states, such as attention, arousal, and working memory. Changes in pupil size have been associated with learning speed, prediction of future events, and deviations from the prediction in human studies. However, the detailed relationships between pupil size changes and prediction are unclear. We explored pupil size dynamics in mice performing a Pavlovian delay conditioning task. A head-fixed experimental setup combined with deep-learning-based image analysis enabled us to reduce spontaneous locomotor activity and to track the precise dynamics of pupil size of behaving mice. By setting up two experimental groups, one for which mice were able to predict reward in the Pavlovian delay conditioning task and the other for which mice were not, we demonstrated that the pupil size of mice is modulated by reward prediction and consumption, as well as body movements, but not by unpredicted reward delivery. Furthermore, we clarified that pupil size is still modulated by reward prediction even after the disruption of body movements by intraperitoneal injection of haloperidol, a dopamine D2 receptor antagonist. These results suggest that changes in pupil size reflect reward prediction signals. Thus, we provide important evidence to reconsider the neuronal circuit involved in computing reward prediction error. This integrative approach of behavioral analysis, image analysis, pupillometry, and pharmacological manipulation will pave the way for understanding the psychological and neurobiological mechanisms of reward prediction and the prediction errors essential to learning and behavior.

Attention to Stimuli of Learned versus Innate Biological Value Relies on Separate Neural Systems

The neural bases of attention, a set of neural processes that promote behavioral selection, is a subject of intense investigation. In humans, rewarded cues influence attention, even when those cues are irrelevant to the current task. Because the amygdala plays a role in reward processing, and the activity of amygdala neurons has been linked to spatial attention, we reasoned that the amygdala may be essential for attending to rewarded images. To test this possibility, we used an attentional capture task, which provides a quantitative measure of attentional bias. Specifically, we compared reaction times (RTs) of adult male rhesus monkeys with bilateral amygdala lesions and unoperated controls as they made a saccade away from a high- or low-value rewarded image to a peripheral target. We predicted that: (1) RTs will be longer for high- compared with low-value images, revealing attentional capture by rewarded stimuli; and (2) relative to controls, monkeys with amygdala lesions would exhibit shorter RT for high-value images. For comparison, we assessed the same groups of monkeys for attentional capture by images of predators and conspecifics, categories thought to have innate biological value. In performing the attentional capture task, all monkeys were slowed more by high-value relative to low-value rewarded images. Contrary to our prediction, amygdala lesions failed to disrupt this effect. When presented with images of predators and conspecifics, however, monkeys with amygdala lesions showed significantly diminished attentional capture relative to controls. Thus, separate neural pathways are responsible for allocating attention to stimuli with learned versus innate value.SIGNIFICANCE STATEMENT Valuable objects attract attention. The amygdala is known to contribute to reward processing and the encoding of object reward value. We therefore examined whether the amygdala is necessary for allocating attention to rewarded objects. For comparison, we assessed the amygdala's contribution to attending to objects with innate biological value: predators and conspecifics. We found that the macaque amygdala is necessary for directing attention to images with innate biological value, but not for directing attention to recently learned reward-predictive images. These findings indicate that the amygdala makes selective contributions to attending to valuable objects. The data are relevant to mental health disorders, such as social anxiety disorders and small animal phobias, that arise from biased attention to select categories of objects.

Atypical Response to Affective Touch in Children with Autism: Multi-Parametric Exploration of the Autonomic System

This study aimed at evaluating the autonomic response to pleasant affective touch in children with Autism Spectrum Disorders (ASD) and age-matched typically developing (TD) peers, thanks to multiple autonomic nervous system (ANS) parameters and by contrasting CT (C-tactile fibers) high- vs. low-density territory stimulations. We measured pupil diameter, skin conductance, and heart rate during gentle stroking of two skin territories (CT high- and low-density, respectively, forearm and palm of the hand) in thirty 6-12-year-old TD children and twenty ASD children. TD children showed an increase in pupil diameter and skin conductance associated with a heart rate deceleration in response to tactile stimulations at the two locations. Only the pupil was influenced by the stimulated location, with a later dilation peak following CT low-density territory stimulation. Globally, ASD children exhibited reduced autonomic responses, as well as different ANS baseline values compared to TD children. These atypical ANS responses to pleasant touch in ASD children were not specific to CT-fiber stimulation. Overall, these results point towards both basal autonomic dysregulation and lower tactile autonomic evoked responses in ASD, possibly reflecting lower arousal and related to social disengagement.

Measures of tonic and phasic activity of the locus coeruleus-norepinephrine system in children with autism spectrum disorder: An event-related potential and pupillometry study

A growing body of research suggests that locus coeruleus-norepinephrine (LC-NE) system may function differently in individuals with autism spectrum disorder (ASD). Understanding the dynamics of both tonic (resting pupil diameter) and phasic (pupil dilation response [PDR] and event-related potential [ERP]) indices may provide meaningful insights about the nature of LC-NE function in ASD. Twenty-four children with ASD and 27 age- and nonverbal-IQ matched typically developing (TD) children completed two experiments: (1) a resting eye-tracking task to measure tonic pupil diameter, and (2) a three-stimulus oddball paradigm to measure phasic responsivity using PDR and ERP. Consistent with prior reports, our results indicate that children with ASD exhibit increased tonic (resting pupil diameter) and reduced phasic (PDR and ERP) activity of the LC-NE system compared to their TD peers. For both groups, decreased phasic responsivity was associated with increased resting pupil diameter. Lastly, tonic and phasic LC-NE indices were primarily related to measures of attention-deficit/hyperactivity disorder (ADHD), and not ASD, symptomatology. These findings expand our understanding of neurophysiological differences present in ASD and demonstrate that aberrant LC-NE activation may be associated with atypical arousal and decreased responsivity to behaviorally-relevant information in ASD.

Kinetic pupillary size using Pentacam in myopia

Purpose

To compare if the kinetic pupillary changes differs between high myopia (HM) and low/moderate myopia by Pentacam.

Setting

Chinese People's Liberation Army (PLA) General Hospital, Beijing, China.

Design

Comparative study.

Methods

In this cross-sectional retrospective study, 44 eyes of 44 patients were recruited in the Refractive Surgery Center of Chinese PLA General Hospital. Eyes were divided into two groups according to the refractive error: low/moderate myopia (22 eyes; -2.99 ± 1.09 D) and HM (22 eyes, -12.93 ± 3.44 D). At the beginning of the experiment, we made trials of scanning one false pupil by Pentacam. All patients underwent the Pentacam examination three times. Pupillary diameters (PD) during the scan process and other parameters were measured using the Pentacam. Coefficient variations of PD (CV) during the different scanning periods were analyzed comparatively between the two groups.

Results

Pentacam once time output 25 Scheimpflug images, with 13 ones during the period from 1st to 1.5th s and 12 ones during the period from 2.5th to 3rd s after the scanning onset. For the spatial order on all the 25 meridians, 13 Scheimpflug images came out when the Pentacam rotated from 60° to 153°meridians and the remaining 12 Scheimpflug images from 161° to 245° meridians. Among pupillary parameters, no statistical significance existed in PD25, PD13, and PD12 (pupil diameter's mean from all, former 13 and remaining 12 of 25 Scheimpflug images, respectively) (P > 0.05) between the two groups. However, there were statistically significant differences in CV25 and CV13 (coefficient variation of the pupil diameters from all and former 13 of 25 images, respectively) (P < 0.001), with no statistical significance in CV12 (coefficient variation of the pupil diameters from remaining 12 of 25 images) between both groups.

Conclusion

Twenty-five Scheimpflug images on Pentacam had the temporal and the spatial orders. CV in eyes with HM was lower than that in eyes with low/moderate myopia in a certain period of the Pentacam scan. Kinetic pupillary size in HM changed more slowly than that in low/moderate myopia during some scanning period analogous to the phasic response of the pupil reflex.

Baseline pupil size encodes task-related information and modulates the task-evoked response in a speech-in-noise task

Pupillometry data are commonly reported relative to a baseline value recorded in a controlled pre-task condition. In this study, the influence of the experimental design and the preparatory processing related to task difficulty on the baseline pupil size was investigated during a speech intelligibility in noise paradigm. Furthermore, the relationship between the baseline pupil size and the temporal dynamics of the pupil response was assessed. The analysis revealed strong effects of block presentation order, within-block sentence order and task difficulty on the baseline values. An interaction between signal-to-noise ratio and block order was found, indicating that baseline values reflect listener expectations arising from the order in which the different blocks were presented. Furthermore, the baseline pupil size was found to affect the slope, delay and curvature of the pupillary response as well as the peak pupil dilation. This suggests that baseline correction might be sufficient when reporting pupillometry results in terms of mean pupil dilation only, but not when a more complex characterization of the temporal dynamics of the response is considered. By clarifying which factors affect baseline pupil size and how baseline values interact with the task-evoked response, the results from the present study can contribute to a better interpretation of the pupillary response as a marker of cognitive processing.

Facial mask disturbs ocular exploration but not pupil reactivity

INTRODUCTION

The COVID-19 pandemic has imposed to wear a face mask that may have negative consequences for social interactions despite its health benefits. A lot of recent studies focused on emotion recognition of masked faces, as the mouth is, with the eyes, essential to convey emotional content. However, none have studied neurobehavioral and neurophysiological markers of masked faces perception, such as ocular exploration and pupil reactivity. The purpose of this eye tracking study was to quantify how wearing a facial accessory, and in particular a face mask, affected the ocular and pupillary response to a face, emotional or not.

METHODS

We used videos of actors wearing a facial accessory to characterize the visual exploration and pupillary response in several occlusion (no accessory, sunglasses, scarf, and mask) and emotional conditions (neutral, happy, and sad) in a population of 44 adults.

RESULTS

We showed that ocular exploration differed for face covered with an accessory, and in particular a mask, compared to the classical visual scanning pattern of a non-covered face. The covered areas of the face were less explored. Pupil reactivity seemed only slightly affected by the mask, while its sensitivity to emotions was observed even in the presence of a facial accessory.

DISCUSSION

These results suggest a mixed impact of the mask on attentional capture and physiological adjustment, which does not seem to be reconcilable with its strong effect on behavioral emotional recognition previously described.

Neurocomputational mechanisms of affected beliefs

The feedback people receive on their behavior shapes the process of belief formation and self-efficacy in mastering a particular task. However, the neural and computational mechanisms of how the subjective value of self-efficacy beliefs, and the corresponding affect, influence the learning process remain unclear. We investigated these mechanisms during self-efficacy belief formation using fMRI, pupillometry, and computational modeling, and by analyzing individual differences in affective experience. Biases in the formation of self-efficacy beliefs were associated with affect, pupil dilation, and neural activity within the anterior insula, amygdala, ventral tegmental area/ substantia nigra, and mPFC. Specifically, neural and pupil responses mapped the valence of the prediction errors in correspondence with individuals’ experienced affective states and learning biases during self-efficacy belief formation. Together with the functional connectivity dynamics of the anterior insula within this network, our results provide evidence for neural and computational mechanisms of how we arrive at affected beliefs.

Pupil diameter tracked during motor adaptation in humans

Pupil diameter, under constant illumination, is known to reflect individuals' internal states, such as surprise about observation and environmental uncertainty. Despite the growing use of pupillometry in cognitive learning studies as an additional measure for examining internal states, few studies have used pupillometry in human motor learning studies. Here, we provide the first detailed characterization of pupil diameter changes in a short-term reach adaptation paradigm. We measured pupil changes in 121 human participants while they adapted to abrupt, gradual, or switching force field conditions. Sudden increases in movement error caused by the introduction/reversal of the force field resulted in strong phasic pupil dilation during movement accompanied by a transient increase in tonic premovement baseline pupil diameter in subsequent trials. In contrast, pupil responses were reduced when the force field was gradually introduced, indicating that large, unexpected errors drove the changes in pupil responses. Interestingly, however, error-induced pupil responses gradually became insensitive after experiencing multiple force field reversals. We also found an association between baseline pupil diameter and incidental knowledge of the gradually introduced perturbation. Finally, in all experiments, we found a strong co-occurrence of larger baseline pupil diameter with slower reaction and movement times after each rest break. Collectively, these results suggest that tonic baseline pupil diameter reflects one's belief about environmental uncertainty, whereas phasic pupil dilation during movement reflects surprise about a sensory outcome (i.e., movement error), and both effects are modulated by novelty. Our results provide a new approach for nonverbally assessing participants' internal states during motor learning.NEW & NOTEWORTHY Pupil diameter is known as a noninvasive window into individuals' internal states. Despite the growing use of pupillometry in cognitive learning studies, it receives little attention in motor learning studies. Here, we characterized the pupil responses in a short-term reach adaptation paradigm by measuring pupil diameter of human participants while they adapted to abrupt, gradual, or switching force field conditions. Our results demonstrate how surprise and uncertainty reflected in pupil diameter develop during motor adaptation.

Manipulating expectancies in optometry practice: Ocular accommodation and stereoacuity are sensitive to placebo and nocebo effects

INTRODUCTION

There is scientific evidence that an individual's beliefs and/or expectations play a role in the behavioural and physiological response to a given treatment. This study aimed to assess whether the dynamics of the accommodative response and stereoacuity are sensitive to experimentally induced placebo and nocebo effects.

METHODS

Nineteen healthy university students performed three experimental sessions (placebo, nocebo and control) in randomised order, with the dynamics of the accommodative response (magnitude and variability), stereoacuity and subjective measures being assessed in all sessions. For the experimental manipulation, participants ingested an inert capsule that was alleged to have positive (white capsule, placebo condition) or negative (yellow capsule, nocebo conditions) effects on the human physiology. In the control condition, participants did not ingest a capsule.

RESULTS

The data revealed that the variability of accommodation was sensitive to experimentally induced placebo and nocebo effects, showing a more stable accommodative response for the placebo compared with the nocebo condition (corrected p-value = 0.04, Cohen's d = 0.60). In addition, better stereoacuity was found with the placebo, compared with the nocebo (corrected p-value = 0.01, Cohen's d = 0.69) and control (corrected p-value = 0.03, Cohen's d = 0.59) conditions. Successful experimental manipulation was confirmed by the analysis of subjective perceptions.

CONCLUSIONS

These findings provide evidence that manipulating expectations about the efficacy of an inert treatment affect the dynamics of the accommodative response (variability of accommodation) and stereoacuity. The results have important applications in both clinical and research outcomes, where individuals´ beliefs/expectations could modulate the visual function.

Pupillometric measures of altered stimulus-evoked locus coeruleus-norepinephrine activity explain attenuated social attention in preschoolers with autism spectrum disorder

Attenuated social attention has been described as a reduced preference for social compared to geometric motion in preschoolers with autism spectrum disorder (ASD). The locus coeruleus-norpinephrine (LC-NE) system modulates sensory reactivity and is a promising underlying mechanism. LC-NE activity is indexed by a stimulus-evoked pupillary response (SEPR) and partially by a luminance-adaptation pupillary response (LAPR), which were both shown to be aberrant in ASD. We examined whether SEPR and LAPR explain an attenuated social motion preference. We applied pupillometry via video-based eye tracking in young children (18-65 months) with ASD (n = 57) and typically developing (TD) children (n = 39) during a preferential looking paradigm of competing social and geometric motion and a changing light condition paradigm. We found an attenuated social motion preference in the ASD compared to the TD group. This was accompanied by atypical pupillometry showing a smaller SEPR to social motion, a larger SEPR to geometric motion and a reduced LAPR to a dark screen. SEPR but not LAPR explained the group difference in social motion preference. An ASD diagnosis was statistically predicted by the social motion preference, while this effect was mediated by the inclusion of SEPR to geometric and social motion. Our findings suggest a decreased sensory reactivity to social and increased reactivity to non-social motion in ASD, which may concurrently contribute to an attenuated social attention. The LC-NE system is supported as a promising underlying mechanism of altered social attention in young children with ASD, while the specificity of findings remains to be addressed.

Pupillary fluctuation amplitude preceding target presentation is linked to the variable foreperiod effect on reaction time in Psychomotor Vigilance Tasks

Understanding temporally attention fluctuations can benefit scientific knowledge and real-life applications. Temporal attention studies have typically used the reaction time (RT), which can be measured only after a target presentation, as an index of attention level. We have proposed the Micro-Pupillary Unrest Index (M-PUI) based on pupillary fluctuation amplitude to estimate RT before the target presentation. However, the kind of temporal attention effects that the M-PUI reflects remains unclear. We examined if the M-PUI shows two types of temporal attention effects initially reported for RTs in the variable foreperiod tasks: the variable foreperiod effect (FP effect) and the sequential effect (SE effect). The FP effect refers to a decrease in the RT due to an increase in the foreperiod of the current trial, whereas the SE effect refers to an increase in the RT in the early part of the foreperiod of the current trial due to an increase in the foreperiod of the previous trial. We used a simple reaction task with the medium-term variable foreperiods (Psychomotor Vigilance Task) and found that the M-PUI primarily reflects the FP effect. Inter-individual analyses showed that the FP effect on the M-PUI, unlike other eye movement indices, is correlated with the FP effect on RT. These results suggest that the M-PUI is a potentially powerful tool for investigating temporal attention fluctuations for a partly unpredictable target.

Rule-based and stimulus-based cues bias auditory decisions via different computational and physiological mechanisms

Expectations, such as those arising from either learned rules or recent stimulus regularities, can bias subsequent auditory perception in diverse ways. However, it is not well understood if and how these diverse effects depend on the source of the expectations. Further, it is unknown whether different sources of bias use the same or different computational and physiological mechanisms. We examined how rule-based and stimulus-based expectations influenced behavior and pupil-linked arousal, a marker of certain forms of expectation-based processing, of human subjects performing an auditory frequency-discrimination task. Rule-based cues consistently biased choices and response times (RTs) toward the more-probable stimulus. In contrast, stimulus-based cues had a complex combination of effects, including choice and RT biases toward and away from the frequency of recently presented stimuli. These different behavioral patterns also had: 1) distinct computational signatures, including different modulations of key components of a novel form of a drift-diffusion decision model and 2) distinct physiological signatures, including substantial bias-dependent modulations of pupil size in response to rule-based but not stimulus-based cues. These results imply that different sources of expectations can modulate auditory processing via distinct mechanisms: one that uses arousal-linked, rule-based information and another that uses arousal-independent, stimulus-based information to bias the speed and accuracy of auditory perceptual decisions.

Prior information about upcoming stimuli can bias our perception of those stimuli. Whether different sources of prior information bias perception in similar or distinct ways is not well understood. We compared the influence of two kinds of prior information on tone-frequency discrimination: rule-based cues, in the form of explicit information about the most-likely identity of the upcoming tone; and stimulus-based cues, in the form of sequences of tones presented before the to-be-discriminated tone. Although both types of prior information biased auditory decision-making, they demonstrated distinct behavioral, computational, and physiological signatures. Our results suggest that the brain processes prior information in a form-specific manner rather than utilizing a general-purpose prior. Such form-specific processing has implications for understanding decision biases real-world contexts, in which prior information comes from many different sources and modalities.

Predicting Product Preferences on Retailers’ Web Shops through Measurement of Gaze and Pupil Size Dynamics

Previous studies used gaze behavior to predict product preference in value-based decision-making, based on gaze angle variables such as dwell time, fixation duration and the first fixated product. While the application for online retail seems obvious, research with realistic web shop stimuli has been lacking so far. Here, we studied the decision process for 60 Dutch web shops of a variety of retailers, by measuring eye movements and pupil size during the viewing of web shop images. The outcomes of an ordinal linear regression model showed that a combination of gaze angle variables accurately predicted product choice, with the total dwell time being the most predictive gaze dynamic. Although pupillometric analysis showed a positive relationship between pupil dilation and product preference, adding pupil size to the model only slightly improved the prediction accuracy. The current study holds the potential to substantially improve retargeting mechanisms in online marketing based on consumers’ gaze information. Also, gaze-based product preference proves to be a valuable metric in pre-testing product introductions for market research and prevent product launches from failure.

Blunted pupil light reflex is associated with negative symptoms and working memory in individuals with schizophrenia

Two largely separate lines of research have documented altered pupillary dynamics in individuals diagnosed with schizophrenia. An older set of studies has demonstrated reductions in the pupillary light reflex (PLR) in individuals with schizophrenia; however, clinical and cognitive correlates of this blunted PLR have been relatively unexplored. More recently, a large body of work has demonstrated reductions in pupillary dilation in response to cognitive demands in individuals with schizophrenia, and the degree of this blunted pupil dilation has been related to more severe cognitive deficits and motivational negative symptoms. These clinically relevant alterations in the cognitive modulation of pupil size have been interpreted as reflecting insufficient information processing resources or inappropriate effort allocation. To begin to bridge these two lines of work, we investigated the PLR in 34 individuals with schizophrenia and 30 healthy controls and related the amplitude of the PLR to motivational negative symptoms and cognitive performance. Consistent with prior work, we found that the PLR was reduced in individuals with schizophrenia, and furthermore, that these measurements were highly reliable across individuals. Blunted constriction was associated with more severe motivational negative symptoms and poorer working memory among individuals with schizophrenia. These observed correlates provide a bridge between older literature documenting an altered PLR and more recent work reporting associations between negative symptoms, cognition, and blunted pupillary dilation in response to cognitive demands in individuals with schizophrenia. We provide possible mechanistic interpretations of our data and consider a parsimonious explanation for reduced cognitive- and light-related modulation of pupil size.

Autonomic tone in children and adults: Pupillary, electrodermal and cardiac activity at rest

Considering the suspected involvement of the autonomic nervous system (ANS) in several neurodevelopmental disorders, a description of its tonus in typical populations and of its maturation between childhood and adulthood is necessary. We aimed to arrive at a better understanding of the maturation of the sympathetic (SNS) and parasympathetic (PNS) tonus by comparing children and adults at rest, via recordings of multiple ANS indices. We recorded simultaneously pupil diameter, electrodermal activity (EDA) and cardiac activity (RR interval and HRV: heart rate variability) in 29 children (6-12 years old) and 30 adults (20-42 years old) during a 5-min rest period. Children exhibited lower RR intervals, higher LF peak frequencies, and lower LF/HF (low frequency/high frequency) ratios compared to adults. Children also produced more spontaneous EDA peaks, reflected in a larger EDA AUC (area under the curve), in comparison with adults. Finally, children displayed a larger median pupil diameter and a higher pupillary hippus frequency than adults. Our results converged towards higher SNS and PNS tones in children compared to adults. Childhood would thus be characterized by a high autonomic tone, possibly reflecting a physiological state compatible with developmental acquisitions.

Pupillometry tracks errors in interval timing

Recent primate studies suggest a potential link between pupil size and subjectively elapsed duration. Here, we sought to investigate the relationship between pupil size and perceived duration in human participants performing two temporal bisection tasks in the subsecond and suprasecond interval ranges. In the subsecond task, pupil diameter was greater during stimulus processing when shorter intervals were overestimated but also during and after stimulus offset when longer intervals were underestimated. By contrast, in the suprasecond task, larger pupil diameter was observed only in the late stimulus offset phase prior to response prompts when longer intervals were underestimated. This pattern of results suggests that pupil diameter relates to an error monitoring mechanism in interval timing. These results are at odds with a direct relationship between pupil size and the perception of duration but suggest that pupillometric variation might play a key role in signifying errors related to temporal judgments.

Pupil dilation and response slowing distinguish deliberate explorative choices in the probabilistic learning task

This study examined whether pupil size and response time would distinguish directed exploration from random exploration and exploitation. Eighty-nine participants performed the two-choice probabilistic learning task while their pupil size and response time were continuously recorded. Using LMM analysis, we estimated differences in the pupil size and response time between the advantageous and disadvantageous choices as a function of learning success, i.e., whether or not a participant has learned the probabilistic contingency between choices and their outcomes. We proposed that before a true value of each choice became known to a decision-maker, both advantageous and disadvantageous choices represented a random exploration of the two options with an equally uncertain outcome, whereas the same choices after learning manifested exploitation and direct exploration strategies, respectively. We found that disadvantageous choices were associated with increases both in response time and pupil size, but only after the participants had learned the choice-reward contingencies. For the pupil size, this effect was strongly amplified for those disadvantageous choices that immediately followed gains as compared to losses in the preceding choice. Pupil size modulations were evident during the behavioral choice rather than during the pretrial baseline. These findings suggest that occasional disadvantageous choices, which violate the acquired internal utility model, represent directed exploration. This exploratory strategy shifts choice priorities in favor of information seeking and its autonomic and behavioral concomitants are mainly driven by the conflict between the behavioral plan of the intended exploratory choice and its strong alternative, which has already proven to be more rewarding.

Pupil-linked arousal with very light exercise: pattern of pupil dilation during graded exercise

Although it has been hypothesized that moderate to vigorous exercise immediately modulates cognition via ascending arousal system activation, such activation during very-light to light exercise has remained uncertain. Here, we aimed to uncover the exact exercise intensity necessary for ascending arousal system activation using pupillometry. The pupil diameter, psychological arousal, and ventilation during graded exercise of 26 young males were analyzed based on %[Formula: see text]. Pupils dilated with very-light exercise compared to rest, stabilized, and then drastically increased again with moderate exercise and above. Pupil dilation with very-light exercise was positively correlated with increases in psychological arousal. Thus, we have shown that there are two phases of pupil dilation during graded exercise: one with very-light exercise coinciding with psychological arousal response, and the other with moderate exercise or above similar to the ventilation increase pattern. This unique pupil dilation pattern provides physiological evidence of ascending arousal system activation with very-light exercise.

Building a decoder of perceptual decisions from microsaccades and pupil size

Many studies have reported neural correlates of visual awareness across several brain regions, including the sensory, parietal, and frontal areas. In most of these studies, participants were instructed to explicitly report their perceptual experience through a button press or verbal report. It is conceivable, however, that explicit reporting itself may trigger specific neural responses that can confound the direct examination of the neural correlates of visual awareness. This suggests the need to assess visual awareness without explicit reporting. One way to achieve this is to develop a technique to predict the visual awareness of participants based on their peripheral responses. Here, we used eye movements and pupil sizes to decode trial-by-trial changes in the awareness of a stimulus whose visibility was deteriorated due to adaptation-induced blindness (AIB). In the experiment, participants judged whether they perceived a target stimulus and rated the confidence they had in their perceptual judgment, while their eye movements and pupil sizes were recorded. We found that not only perceptual decision but also perceptual confidence can be separately decoded from the eye movement and pupil size. We discuss the potential of this technique with regard to assessing visual awareness in future neuroimaging experiments.

Systemic injection of nicotinic acetylcholine receptor antagonist mecamylamine affects licking, eyelid size, and locomotor and autonomic activities but not temporal prediction in male mice

Nicotinic acetylcholine receptors are thought to be associated with a wide range of phenomena, such as movement, learning, memory, attention, and addiction. However, the causal relationship between nicotinic receptor activity and behavior remains unclear. Contrary to the studies that examined the functions of muscarinic acetylcholine receptors, the role of the nicotinic acetylcholine receptors on behavior has not been examined as extensively. Here, we examined the effects of intraperitoneal injection of mecamylamine, a nicotinic acetylcholine receptor antagonist, on the performance of male mice in a head-fixed temporal conditioning task and a free-moving open-field task. The head-fixed experimental setup allowed us to record and precisely quantify the licking response while the mice performed the behavioral task with no external cues. In addition, by combining the utility of the head-fixed experimental design with computer vision analysis based on deep learning algorithms, we succeeded in quantifying the eyelid size of awake mice. In the temporal conditioning task, we delivered a 10% sucrose solution every 10 s using a blunt-tipped needle placed within the licking distance of the mice. After the training, the mice showed increased anticipatory licking toward the timing of sucrose delivery, suggesting that the mice could predict the timing of the reward. Systemic injection of mecamylamine decreased licking behavior and caused eye closure but had no effect on learned conditioned predictive behavior in the head-fixed temporal conditioning task. In addition, the injection of mecamylamine decreased spontaneous locomotor activity in a dose-dependent manner in the free-moving open-field task. The results in the open-field experiments further revealed that the effect of mecamylamine on fecal output and urination, suggesting the effects on autonomic activities. Our achievement of successful eyelid size recording has potential as a useful approach in initial screening for drug discovery. Our study paves a way forward to understanding the role of nicotinic acetylcholine receptors on learning and behavior.

Recognition of Emotion by Brain Connectivity and Eye Movement

Simultaneous activation of brain regions (i.e., brain connection features) is an essential mechanism of brain activity in emotion recognition of visual content. The occipital cortex of the brain is involved in visual processing, but the frontal lobe processes cranial nerve signals to control higher emotions. However, recognition of emotion in visual content merits the analysis of eye movement features, because the pupils, iris, and other eye structures are connected to the nerves of the brain. We hypothesized that when viewing video content, the activation features of brain connections are significantly related to eye movement characteristics. We investigated the relationship between brain connectivity (strength and directionality) and eye movement features (left and right pupils, saccades, and fixations) when 47 participants viewed an emotion-eliciting video on a two-dimensional emotion model (valence and arousal). We found that the connectivity eigenvalues of the long-distance prefrontal lobe, temporal lobe, parietal lobe, and center are related to cognitive activity involving high valance. In addition, saccade movement was correlated with long-distance occipital-frontal connectivity. Finally, short-distance connectivity results showed emotional fluctuations caused by unconscious stimulation.

Arousal impacts distributed hubs modulating the integration of brain functional connectivity

Even when subjects are at rest, it is thought that brain activity is organized into distinct brain states during which reproducible patterns are observable. Yet, it is unclear how to define or distinguish different brain states. A potential source of brain state variation is arousal, which may play a role in modulating functional interactions between brain regions. Here, we use simultaneous resting state functional magnetic resonance imaging (fMRI) and pupillometry to study the impact of arousal levels indexed by pupil area on the integration of large-scale brain networks. We employ a novel sparse dictionary learning-based method to identify hub regions participating in between-network integration stratified by arousal, by measuring k-hubness, the number (k) of functionally overlapping networks in each brain region. We show evidence of a brain-wide decrease in between-network integration and inter-subject variability at low relative to high arousal, with differences emerging across regions of the frontoparietal, default mode, motor, limbic, and cerebellum networks. State-dependent changes in k-hubness relate to the actual patterns of network integration within these hubs, suggesting a brain state transition from high to low arousal characterized by global synchronization and reduced network overlaps. We demonstrate that arousal is not limited to specific brain areas known to be directly associated with arousal regulation, but instead has a brain-wide impact that involves high-level between-network communications. Lastly, we show a systematic change in pairwise fMRI signal correlation structures in the arousal state-stratified data, and demonstrate that the choice of global signal regression could result in different conclusions in conventional graph theoretical analysis and in the analysis of k-hubness when studying arousal modulations. Together, our results suggest the presence of global and local effects of pupil-linked arousal modulations on resting state brain functional connectivity.

Contribution of behavioural variability to representational drift

Neuronal responses to similar stimuli change dynamically over time, raising the question of how internal representations can provide a stable substrate for neural coding. Recent work has suggested a large degree of drift in neural representations even in sensory cortices, which are believed to store stable representations of the external world. While the drift of these representations is mostly characterized in relation to external stimuli, the behavioural state of the animal (for instance, the level of arousal) is also known to strongly modulate the neural activity. We therefore asked how the variability of such modulatory mechanisms can contribute to representational changes. We analysed large-scale recording of neural activity from the Allen Brain Observatory, which was used before to document representational drift in the mouse visual cortex. We found that, within these datasets, behavioural variability significantly contributes to representational changes. This effect was broadcasted across various cortical areas in the mouse, including the primary visual cortex, higher order visual areas, and even regions not primarily linked to vision like hippocampus. Our computational modelling suggests that these results are consistent with independent modulation of neural activity by behaviour over slower timescales. Importantly, our analysis suggests that reliable but variable modulation of neural representations by behaviour can be misinterpreted as representational drift if neuronal representations are only characterized in the stimulus space and marginalized over behavioural parameters.

Human inference reflects a normative balance of complexity and accuracy

We must often infer latent properties of the world from noisy and changing observations. Complex, probabilistic approaches to this challenge such as Bayesian inference are accurate but cognitively demanding, relying on extensive working memory and adaptive processing. Simple heuristics are easy to implement but may be less accurate. What is the appropriate balance between complexity and accuracy? Here we model a hierarchy of strategies of variable complexity and find a power law of diminishing returns: increasing complexity gives progressively smaller gains in accuracy. The rate of diminishing returns depends systematically on the statistical uncertainty in the world, such that complex strategies do not provide substantial benefits over simple ones when uncertainty is either too high or too low. In between, there is a complexity dividend. In two psychophysical experiments, we confirm specific model predictions about how working memory and adaptivity should be modulated by uncertainty.

Readiness to remember: predicting variability in episodic memory

Learning and remembering are fundamental to our lives, so what causes us to forget? Answers often highlight preparatory processes that precede learning, as well as mnemonic processes during the act of encoding or retrieval. Importantly, evidence now indicates that preparatory processes that precede retrieval attempts also have powerful influences on memory success or failure. Here, we review recent work from neuroimaging, electroencephalography, pupillometry, and behavioral science to propose an integrative framework of retrieval-period dynamics that explains variance in remembering in the moment and across individuals as a function of interactions among preparatory attention, goal coding, and mnemonic processes. Extending this approach, we consider how a 'readiness to remember' (R2R) framework explains variance in high-level functions of memory and mnemonic disruptions in aging.

Do pupillary responses during authentic slot machine use reflect arousal or screen luminance fluctuations? A proof-of-concept study

Modern slot machines are among the more harmful forms of gambling. Psychophysiological measures may provide a window into mental processes that underpin these harms. Here we investigated pupil dilation derived from eye tracking as a means of capturing changes in sympathetic nervous system arousal following outcomes on a real slot machine. We hypothesized that positively reinforcing slot machine outcomes would be associated with increases in arousal, reflected in larger pupil diameter. We further examined the contribution of game luminance fluctuations on pupil diameter. In Experiment 1A, experienced slot machine gamblers (N = 53) played a commercially-available slot machine in a laboratory for 20 minutes while wearing mobile eye tracking glasses. Analyses differentiated loss outcomes, wins, losses-disguised-as-wins, and (free-spin) bonus features. Bonus features were associated with rapid increases in pupil diameter following the onset of outcome-related audiovisual feedback, relative to losses. In Experiment 1B, luminance data were extracted from captured screen videos (derived from Experiment 1A) to characterize on-screen luminance changes that could modulate pupil diameter. Bonus features and wins were associated with pronounced and complex fluctuations in screen luminance (≈50 L and ≈25L, respectively). However, the pupil dilation that was observed to bonus features in Experiment 1A coincided temporally with only negligible changes in screen luminance, providing partial evidence that the pupil dilation to bonus features may be due to arousal. In Experiment 2, 12 participants viewed pairs of stimuli (scrambled slot machine images) at luminance difference thresholds of ≈25L, ≈50L, and ≈100L. Scrambled images presented at luminance differences of ≈25L and greater were sufficient to cause pupillary responses. Overall, pupillometry may detect event-related changes in sympathetic nervous system arousal following gambling outcomes, but researchers must pay careful attention to substantial in-game luminance changes that may confound arousal-based interpretations.

A decrease in physiological arousal accompanied by stable behavioral performance reflects task habituation

Despite the evidence of a positive relationship between task demands and listening effort, the Framework for Understanding Effortful Listening (FUEL) highlights the important role of arousal on an individual’s choice to engage in challenging listening tasks. Previous studies have interpreted physiological responses in conjunction with behavioral responses as markers of task engagement. The aim of the current study was to investigate the effect of potential changes in physiological arousal, indexed by the pupil baseline, on task engagement over the course of an auditory recall test. Furthermore, the aim was to investigate whether working memory (WM) capacity and the signal-to-noise ratio (SNR) at which the test was conducted had an effect on changes in arousal. Twenty-one adult hearing aid users with mild to moderately severe symmetrical sensorineural hearing loss were included. The pupil baseline was measured during the Sentence-final Word Identification and Recall (SWIR) test, which was administered in a background noise composed of sixteen talkers. The Reading Span (RS) test was used as a measure of WM capacity. The findings showed that the pupil baseline decreased over the course of the SWIR test. However, recall performance remained stable, indicating that the participants maintained the necessary engagement level required to perform the task. These findings were interpreted as a decline in arousal as a result of task habituation. There was no effect of WM capacity or individual SNR level on the change in pupil baseline over time. A significant interaction was found between WM capacity and SNR level on the overall mean pupil baseline. Individuals with higher WM capacity exhibited an overall larger mean pupil baseline at low SNR levels compared to individuals with poorer WM capacity. This may be related to the ability of individuals with higher WM capacity to perform better than individual with poorer WM capacity in challenging listening conditions.

The eyes reflect an internal cognitive state hidden in the population activity of cortical neurons

Decades of research have shown that global brain states such as arousal can be indexed by measuring the properties of the eyes. The spiking responses of neurons throughout the brain have been associated with the pupil, small fixational saccades, and vigor in eye movements, but it has been difficult to isolate how internal states affect the eyes, and vice versa. While recording from populations of neurons in the visual and prefrontal cortex (PFC), we recently identified a latent dimension of neural activity called "slow drift," which appears to reflect a shift in a global brain state. Here, we asked if slow drift is correlated with the action of the eyes in distinct behavioral tasks. We recorded from visual cortex (V4) while monkeys performed a change detection task, and PFC, while they performed a memory-guided saccade task. In both tasks, slow drift was associated with the size of the pupil and the microsaccade rate, two external indicators of the internal state of the animal. These results show that metrics related to the action of the eyes are associated with a dominant and task-independent mode of neural activity that can be accessed in the population activity of neurons across the cortex.

Role of noradrenergic arousal for fear extinction processes in rodents and humans

Fear extinction is a learning mechanism that is pivotal for the inhibition of fear responses towards cues or contexts that no longer predict the occurrence of a threat. Failure of fear extinction leads to fear expression under safe conditions and is regarded to be a cardinal characteristic of many anxiety-related disorders and posttraumatic stress disorder. Importantly, the neurotransmitter noradrenaline was shown to be a potent modulator of fear extinction. Rodent studies demonstrated that excessive noradrenaline transmission after acute stress opens a time window of vulnerability, in which fear extinction learning results in attenuated long-term extinction success. In contrast, when excessive noradrenergic transmission subsides, well-coordinated noradrenaline transmission is necessary for the formation of a long-lasting extinction memory. In addition, emerging evidence suggests that the neuropeptide corticotropin releasing hormone (CRF), which strongly regulates noradrenaline transmission under conditions of acute stress, also impedes long-term extinction success. Recent rodent work - using sophisticated methods - provides evidence for a hypothetical mechanistic framework of how noradrenaline and CRF dynamically orchestrate the neural fear and extinction circuitry to attenuate or to improve fear extinction and extinction recall. Accordingly, we review the evidence from rodent studies linking noradrenaline and CRF to fear extinction learning and recall and derive the hypothetical mechanistic framework of how different levels of noradrenaline and CRF may create a time window of vulnerability which impedes successful long-term fear extinction. We also address evidence from human studies linking noradrenaline and fear extinction success. Moreover, we accumulate emerging approaches to non-invasively measure and manipulate the noradrenergic system in healthy humans. Finally, we emphasize the importance of future studies to account for sex (hormone) differences when examining the interaction between fear extinction, noradrenaline, and CRF. To conclude, NA's effects on fear extinction recall strongly depend on the arousal levels at the onset of fear extinction learning. Our review aimed at compiling the available (mainly rodent) data in a neurobiological framework, suited to derive testable hypotheses for future work in humans.

Neural Algorithms and Circuits for Motor Planning

The brain plans and executes volitional movements. The underlying patterns of neural population activity have been explored in the context of movements of the eyes, limbs, tongue, and head in nonhuman primates and rodents. How do networks of neurons produce the slow neural dynamics that prepare specific movements and the fast dynamics that ultimately initiate these movements? Recent work exploits rapid and calibrated perturbations of neural activity to test specific dynamical systems models that are capable of producing the observed neural activity. These joint experimental and computational studies show that cortical dynamics during motor planning reflect fixed points of neural activity (attractors). Subcortical control signals reshape and move attractors over multiple timescales, causing commitment to specific actions and rapid transitions to movement execution. Experiments in rodents are beginning to reveal how these algorithms are implemented at the level of brain-wide neural circuits.

Eye Movements as a Window into Decision-Making

For over 100 years, eye movements have been studied and used as indicators of human sensory and cognitive functions. This review evaluates how eye movements contribute to our understanding of the processes that underlie decision-making. Eye movement metrics signify the visual and task contexts in which information is accumulated and weighed. They indicate the efficiency with which we evaluate the instructions for decision tasks, the timing and duration of decision formation, the expected reward associated with a decision, the accuracy of the decision outcome, and our ability to predict and feel confident about a decision. Because of their continuous nature, eye movements provide an exciting opportunity to probe decision processes noninvasively in real time. Expected final online publication date for the Annual Review of Vision Science, Volume 8 is September 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Pupillometry as an integrated readout of distinct attentional networks

The course of pupillary constriction and dilation provides an easy-to-access, inexpensive, and noninvasive readout of brain activity. We propose a new taxonomy of factors affecting the pupil and link these to associated neural underpinnings in an ascending hierarchy. In addition to two well-established low-level factors (light level and focal distance), we suggest two further intermediate-level factors, alerting and orienting, and a higher-level factor, executive functioning. Alerting, orienting, and executive functioning - including their respective underlying neural circuitries - overlap with the three principal attentional networks, making pupil size an integrated readout of distinct states of attention. As a now widespread technique, pupillometry is ready to provide meaningful applications and constitutes a viable part of the psychophysiological toolbox.

An Easily Compatible Eye-tracking System for Freely-moving Small Animals

Measuring eye movement is a fundamental approach in cognitive science as it provides a variety of insightful parameters that reflect brain states such as visual attention and emotions. Combining eye-tracking with multimodal neural recordings or manipulation techniques is beneficial for understanding the neural substrates of cognitive function. Many commercially-available and custom-built systems have been widely applied to awake, head-fixed small animals. However, the existing eye-tracking systems used in freely-moving animals are still limited in terms of their compatibility with other devices and of the algorithm used to detect eye movements. Here, we report a novel system that integrates a general-purpose, easily compatible eye-tracking hardware with a robust eye feature-detection algorithm. With ultra-light hardware and a detachable design, the system allows for more implants to be added to the animal's exposed head and has a precise synchronization module to coordinate with other neural implants. Moreover, we systematically compared the performance of existing commonly-used pupil-detection approaches, and demonstrated that the proposed adaptive pupil feature-detection algorithm allows the analysis of more complex and dynamic eye-tracking data in free-moving animals. Synchronized eye-tracking and electroencephalogram recordings, as well as algorithm validation under five noise conditions, suggested that our system is flexibly adaptable and can be combined with a wide range of neural manipulation and recording technologies.

The relationship between pupillary baseline manipulated by mental effort or luminance and subsequent pupillary responses

Measuring pupillary response is a prevalent technique to evaluate mental states. It is indispensable to conduct a correction procedure for the pupillary baseline to get a meaningful conclusion from the pupillary response. However, the relationship between pupillary baseline and subsequent stimulus-evoked pupillary response varies among studies. In this study, we used the subtractive and proportional baseline corrections to analyze the results. Furthermore, we manipulated the pupillary baseline through mental effort or luminance in the baseline period and investigated whether the subsequent stimulus-evoked pupillary responses were affected. We found that the mental effort–evoked pupillary response was attenuated with a larger pupillary baseline manipulated by a higher mental effort, whereas it was unaffected with the baseline manipulated by luminance. Also, the luminance-evoked pupillary response was attenuated with a smaller pupillary baseline manipulated by a brighter disk, whereas it was unaffected with the baseline manipulated by mental effort. The results could be obtained from subtractive and proportional baseline corrections. Our results suggest that mental effort manipulated pupillary baseline interacts with the subsequent mental effort elicited pupillary response, but not with the luminance elicited pupillary response; the luminance manipulated pupillary baseline interacts with the subsequent luminance elicited pupillary response, but not with the mental effort elicited pupillary response. It is important to consider the ways of controlling the pupillary baseline and subsequent pupillary response simultaneously.

Slow fluctuations in ongoing brain activity decrease in amplitude with ageing yet their impact on task-related evoked responses is dissociable from behavior

In humans, ageing is characterized by decreased brain signal variability and increased behavioral variability. To understand how reduced brain variability segregates with increased behavioral variability, we investigated the association between reaction time variability, evoked brain responses and ongoing brain signal dynamics, in young (N=36) and older adults (N=39). We studied the electroencephalogram (EEG) and pupil size fluctuations to characterize the cortical and arousal responses elicited by a cued go/no-go task. Evoked responses were strongly modulated by slow (<2 Hz) fluctuations of the ongoing signals, which presented reduced power in the older participants. Although variability of the evoked responses was lower in the older participants, once we adjusted for the effect of the ongoing signal fluctuations, evoked responses were equally variable in both groups. Moreover, the modulation of the evoked responses caused by the ongoing signal fluctuations had no impact on reaction time, thereby explaining why although ongoing brain signal variability is decreased in older individuals, behavioral variability is not. Finally, we showed that adjusting for the effect of the ongoing signal was critical to unmask the link between neural responses and behavior as well as the link between task-related evoked EEG and pupil responses.

Pupil-linked Arousal Signals in the Midbrain Superior Colliculus

The orienting response evoked by the appearance of a salient stimulus is modulated by arousal; however, neural underpinnings for the interplay between orienting and arousal are not well understood. The superior colliculus (SC), causally involved in multiple components of the orienting response including gaze and attention shifts, receives not only multisensory and cognitive inputs but also arousal-regulated inputs from various cortical and subcortical structures. To investigate the impact of moment-by-moment fluctuations in arousal on orienting saccade responses, we used microstimulation of the monkey SC to trigger saccade responses, and we used pupil size and velocity to index the level of arousal at stimulation onset because these measures correlate with changes in brain states and locus coeruleus activity. Saccades induced by SC microstimulation correlated with prestimulation pupil velocity, with higher pupil velocities on trials without evoked saccades than with evoked saccades. In contrast, prestimulation absolute pupil size did not correlate with saccade behavior. However, pupil velocity correlated with evoked saccade latency and metrics. Together, our results demonstrated that small fluctuations in arousal, indexed by pupil velocity, can modulate the saccade response evoked by SC microstimulation in awake behaving monkeys.

Emotion schema effects on associative memory differ across emotion categories at the behavioural, physiological and neural level: Emotion schema effects on associative memory differs for disgust and fear

Previous behavioural and neuroimaging studies have consistently reported that memory is enhanced for associations congruent or incongruent with the structure of prior knowledge, termed as schemas. However, it remains unclear if similar effects arise with emotion-related associations, and whether they depend on the type of emotions. Here, we addressed this question using a novel face-word pair association paradigm combined with fMRI and eye-tracking techniques. In two independent studies, we demonstrated and replicated that both congruency with emotion schemas and emotion category interact to affect associative memory. Overall, memory retrieval was higher for faces from pairs congruent vs. incongruent with emotion schemas, paralleled by a greater recruitment of left inferior frontal gyrus (IFG) during successful encoding. However, emotion schema effects differed across two negative emotion categories. Disgust was remembered better than fear, and only disgust activated left IFG stronger during encoding of congruent vs. incongruent pairs, suggestive of deeper semantic processing for the associations. On the contrary, encoding of congruent fear vs. disgust-related pairs was accompanied with greater activity in right fusiform gyrus (FG), suggesting a stronger sensory processing of faces. In addition, successful memory formation for congruent disgust pairs was associated with a higher pupil dilation index related to sympathetic activation, longer gaze time on words compared to faces, and more gaze switches between paired words and faces. This was reversed for fear-related congruent pairs where the faces attracted longer gaze time (compared to words). Overall, our results provide converging evidence from behavioural, physiological, and neural measures to suggest that congruency with available emotion schemas influence memory associations in a similar manner to semantic schemas. However, these effects vary across distinct emotion categories, pointing to a differential role of semantic processing and visual attention processes in the modulation of memory by disgust and fear, respectively.

Processing speed, but not working memory or global cognition, is associated with pupil diameter during fixation

Mean pupil size during fixation has been suggested to reflect interindividual differences in working memory and fluid intelligence. However, due to small samples with limited age range (17-35 years) and suboptimal light conditions in previous studies, these associations are still controversial and it is unclear whether they are observed at older ages. Therefore, we assessed whether interindividual differences in cognitive performance are reflected in pupil diameter during fixation and whether these associations are age-dependent. We analyzed pupillometry and cognition data of 4560 individuals aged 30-95 years of the community-based Rhineland Study. Pupillometry data were extracted from a one-minute fixation task. The cognitive test battery included tests of oculomotor control, working memory, episodic verbal memory, processing speed, executive function, and crystallized intelligence. For data analysis, we used multivariable regression models. Working memory and global cognition were not associated with pupil diameter during fixation. Better processing speed performance was associated with larger pupil diameter during fixation. Associations between cognition and pupil diameter during fixation hardly varied with age, but pupil diameter during fixation declined linearly with age (adjusted decline: 0.33 mm per 10 years of age). There were no significant sex differences in pupil size. We conclude that interindividual differences in mean pupil diameter during fixation may partly reflect interindividual differences in the speed of processing and response generation. We could not confirm that interindividual differences in working memory and fluid intelligence are reflected in pupil size during fixation; however, our sample differed in age range from previous studies.

Spectral Fingerprints of Cortical Neuromodulation

Pupil size has been established as a versatile marker of noradrenergic and cholinergic neuromodulation, which has profound effects on neuronal processing, cognition, and behavior. However, little is known about the cortical control and effects of pupil-linked neuromodulation. Here, we show that pupil dynamics are tightly coupled to temporally, spectrally, and spatially specific modulations of local and large-scale cortical population activity in the human brain. We quantified the dynamics of band-limited cortical population activity in resting human subjects using magnetoencephalography and investigated how neural dynamics were linked to simultaneously recorded pupil dynamics. Our results show that pupil-linked neuromodulation does not merely affect cortical population activity in a stereotypical fashion. Instead, we identified three frontal, precentral, and occipitoparietal networks, in which local population activity with distinct spectral profiles in the theta, beta, and alpha bands temporally preceded and followed changes in pupil size. Furthermore, we found that amplitude coupling at ∼16 Hz in a large-scale frontoparietal network predicted pupil dynamics. Our results unravel network-specific spectral fingerprints of cortical neuromodulation in the human brain that likely reflect both the causes and effects of neuromodulation.SIGNIFICANCE STATEMENT Brain function is constantly affected by modulatory neurotransmitters. Pupil size has been established as a versatile marker of noradrenergic and cholinergic neuromodulation. However, because the cortical correlates of pupil dynamics are largely unknown, fundamental questions remain unresolved. Which cortical networks control pupil-linked neuromodulation? Does neuromodulation affect cortical activity in a stereotypical or region-specific fashion? To address this, we quantified the dynamics of cortical population activity in human subjects using magnetoencephalography. We found that pupil dynamics are coupled to highly specific modulations of local and large-scale cortical activity in the human brain. We identified four cortical networks with distinct spectral profiles that temporally predicted and followed pupil size dynamics. These effects likely reflect both the cortical control and effect of neuromodulation.

EEG Signals Index a Global Signature of Arousal Embedded in Neuronal Population Recordings

Electroencephalography (EEG) has long been used to index brain states, from early studies describing activity in the presence and absence of visual stimulation to modern work employing complex perceptual tasks. These studies have shed light on brain-wide signals but often lack explanatory power at the single neuron level. Similarly, single neuron recordings can suffer from an inability to measure brain-wide signals accessible using EEG. Here, we combined these techniques while monkeys performed a change detection task and discovered a novel link between spontaneous EEG activity and a neural signal embedded in the spiking responses of neuronal populations. This "slow drift" was associated with fluctuations in the subjects' arousal levels over time: decreases in prestimulus α power were accompanied by increases in pupil size and decreases in microsaccade rate. These results show that brain-wide EEG signals can be used to index modes of activity present in single neuron recordings, that in turn reflect global changes in brain state that influence perception and behavior.

A unified model of the task-evoked pupil response

The pupil dilates and reconstricts following task events. It is popular to model this task-evoked pupil response as a linear transformation of event-locked impulses, whose amplitudes are used as estimates of arousal. We show that this model is incorrect and propose an alternative model based on the physiological finding that a common neural input drives saccades and pupil size. The estimates of arousal from our model agreed with key predictions: Arousal scaled with task difficulty and behavioral performance but was invariant to small differences in trial duration. Moreover, the model offers a unified explanation for a wide range of phenomena: entrainment of pupil size and saccades to task timing, modulation of pupil response amplitude and noise with task difficulty, reaction time-dependent modulation of pupil response timing and amplitude, a constrictory pupil response time-locked to saccades, and task-dependent distortion of this saccade-locked pupil response.

Arousal state affects perceptual decision-making by modulating hierarchical sensory processing in a large-scale visual system model

Arousal levels strongly affect task performance. Yet, what arousal level is optimal for a task depends on its difficulty. Easy task performance peaks at higher arousal levels, whereas performance on difficult tasks displays an inverted U-shape relationship with arousal, peaking at medium arousal levels, an observation first made by Yerkes and Dodson in 1908. It is commonly proposed that the noradrenergic locus coeruleus system regulates these effects on performance through a widespread release of noradrenaline resulting in changes of cortical gain. This account, however, does not explain why performance decays with high arousal levels only in difficult, but not in simple tasks. Here, we present a mechanistic model that revisits the Yerkes-Dodson effect from a sensory perspective: a deep convolutional neural network augmented with a global gain mechanism reproduced the same interaction between arousal state and task difficulty in its performance. Investigating this model revealed that global gain states differentially modulated sensory information encoding across the processing hierarchy, which explained their differential effects on performance on simple versus difficult tasks. These findings offer a novel hierarchical sensory processing account of how, and why, arousal state affects task performance.

New approaches for the quantification and targeting of noradrenergic dysfunction in Alzheimer's disease

There is clear, early noradrenergic dysfunction in Alzheimer's disease. This is likely secondary to pathological tau deposition in the locus coeruleus, the pontine nucleus that produces and releases noradrenaline, prior to involvement of cortical brain regions. Disruption of noradrenergic pathways affects cognition, especially attention, impacting memory and broader functioning. Additionally, it leads to autonomic and neuropsychiatric symptoms. Despite the strong evidence of noradrenergic involvement in Alzheimer's, there are no clear trial data supporting the clinical use of any noradrenergic treatments. Several approaches have been tried, including proof-of-principle studies and (mostly small scale) randomised controlled trials. Treatments have included pharmacotherapies as well as stimulation. The lack of clear positive findings is likely secondary to limitations in gauging locus coeruleus integrity and dysfunction at an individual level. However, the recent development of several novel biomarkers holds potential and should allow quantification of dysfunction. This may then inform inclusion criteria and stratification for future trials. Imaging approaches have improved greatly following the development of neuromelanin-sensitive sequences, enabling the use of structural MRI to estimate locus coeruleus integrity. Additionally, functional MRI scanning has the potential to quantify network dysfunction. As well as neuroimaging, EEG, fluid biomarkers and pupillometry techniques may prove useful in assessing noradrenergic tone. Here, we review the development of these biomarkers and how they might augment clinical studies, particularly randomised trials, through identification of patients most likely to benefit from treatment. We outline the biomarkers with most potential, and how they may transform symptomatic therapy for people living with Alzheimer's disease.

Behavioral and physiological monitoring for awake neurovascular coupling experiments: a how-to guide

Significance: Functional brain imaging in awake animal models is a popular and powerful technique that allows the investigation of neurovascular coupling (NVC) under physiological conditions. However, ubiquitous facial and body motions (fidgeting) are prime drivers of spontaneous fluctuations in neural and hemodynamic signals. During periods without movement, animals can rapidly transition into sleep, and the hemodynamic signals tied to arousal state changes can be several times larger than sensory-evoked responses. Given the outsized influence of facial and body motions and arousal signals in neural and hemodynamic signals, it is imperative to detect and monitor these events in experiments with un-anesthetized animals. Aim: To cover the importance of monitoring behavioral state in imaging experiments using un-anesthetized rodents, and describe how to incorporate detailed behavioral and physiological measurements in imaging experiments. Approach: We review the effects of movements and sleep-related signals (heart rate, respiration rate, electromyography, intracranial pressure, whisking, and other body movements) on brain hemodynamics and electrophysiological signals, with a focus on head-fixed experimental setup. We summarize the measurement methods currently used in animal models for detection of those behaviors and arousal changes. We then provide a guide on how to incorporate this measurements with functional brain imaging and electrophysiology measurements. Results: We provide a how-to guide on monitoring and interpreting a variety of physiological signals and their applications to NVC experiments in awake behaving mice. Conclusion: This guide facilitates the application of neuroimaging in awake animal models and provides neuroscientists with a standard approach for monitoring behavior and other associated physiological parameters in head-fixed animals.

The pupillary light response as a physiological index of aphantasia, sensory and phenomenological imagery strength

The pupillary light response is an important automatic physiological response which optimizes light reaching the retina. Recent work has shown that the pupil also adjusts in response to illusory brightness and a range of cognitive functions, however, it remains unclear what exactly drives these endogenous changes. Here, we show that the imagery pupillary light response correlates with objective measures of sensory imagery strength. Further, the trial-by-trial phenomenological vividness of visual imagery is tracked by the imagery pupillary light response. We also demonstrated that a group of individuals without visual imagery (aphantasia) do not show any significant evidence of an imagery pupillary light response, however they do show perceptual pupil light responses and pupil dilation with larger cognitive load. Our results provide evidence that the pupillary light response indexes the sensory strength of visual imagery. This work also provides the first physiological validation of aphantasia.