Pupil Size as a Window on Neural Substrates of Cognition

Visual attention to features and space in mice using reverse correlation

Visual attention allows the brain to evoke behaviors based on the most important visual features. Mouse models offer immense potential to gain a circuit-level understanding of this phenomenon, yet how mice distribute attention across features and locations is not well understood. Here, we describe a new approach to address this limitation by training mice to detect weak vertical bars in a background of dynamic noise while spatial cues manipulate their attention. By adapting a reverse-correlation method from human studies, we linked behavioral decisions to stimulus features and locations. We show that mice deployed attention to a small rostral region of the visual field. Within this region, mice attended to multiple features (orientation, spatial frequency, contrast) that indicated the presence of weak vertical bars. This attentional tuning grew with training, multiplicatively scaled behavioral sensitivity, approached that of an ideal observer, and resembled the effects of attention in humans. Taken together, we demonstrate that mice can simultaneously attend to multiple features and locations of a visual stimulus.

The integrity of dopaminergic and noradrenergic brain regions is associated with different aspects of late-life memory performance

Changes in dopaminergic neuromodulation play a key role in adult memory decline. Recent research has also implicated noradrenaline in shaping late-life memory. However, it is unclear whether these two neuromodulators have distinct roles in age-related cognitive changes. Here, combining longitudinal MRI of the dopaminergic substantia nigra-ventral tegmental area (SN-VTA) and noradrenergic locus coeruleus (LC) in younger (n = 69) and older (n = 251) adults, we found that dopaminergic and noradrenergic integrity are differentially associated with memory performance. While LC integrity was related to better episodic memory across several tasks, SN-VTA integrity was linked to working memory. Longitudinally, we found that older age was associated with more negative change in SN-VTA and LC integrity. Notably, changes in LC integrity reliably predicted future episodic memory. These differential associations of dopaminergic and noradrenergic nuclei with late-life cognitive decline have potential clinical utility, given their degeneration in several age-associated diseases.

Metacognitive prompts and numerical ordinality in solving word problems: An eye-tracking study

BACKGROUND

The ability to translate concrete manipulatives into abstract mathematical formulas can aid in the solving of mathematical word problems among students, and metacognitive prompts play a significant role in enhancing this process.

AIMS

Based on the concept of semantic congruence, we explored the effects of metacognitive prompts and numerical ordinality on information searching and cognitive processing, throughout the process of solving mathematical word problems among primary school students in China.

SAMPLE

Participants included 73 primary school students (38 boys and 35 girls) with normal or corrected visual acuity.

METHODS

This study was based on a 2 (prompt information: no-prompt, metacognitive-prompt) × 2 (number attribute: cardinal number, ordinal number) mixed experimental design. We analysed multiple eye-movement indices, such as fixation duration, saccadic amplitude, and pupil size, since they pertained to the areas of interest.

RESULTS

When solving both types of problems, pupil sizes were significantly smaller under the metacognitive-prompt condition compared with the no-prompt condition, and shorter dwell time for specific sentences, conditional on metacognitive prompts, indicated the optimization of the presented algorithm. Additionally, the levels of fixation durations and saccadic amplitudes were significantly higher when solving ordinal number word problems compared with solving ordinal number problems, indicating that primary school students were less efficient in reading and faced increased levels of difficulty when solving ordinal number problems.

CONCLUSIONS

The results indicate that for Chinese upper-grade primary school students, cognitive load was lower in the metacognitive prompting condition and when solving cardinal problems, and higher when solving ordinal problems.

Look into my eyes: What can eye-based measures tell us about the relationship between physical activity and cognitive performance?

BACKGROUND

There is a growing interest to understand the neurobiological mechanisms that drive the positive associations of physical activity and fitness with measures of cognitive performance. To better understand those mechanisms, several studies have employed eye-based measures (e.g., eye movement measures such as saccades, pupillary measures such as pupil dilation, and vascular measures such as retinal vessel diameter) deemed to be proxies for specific neurobiological mechanisms. However, there is currently no systematic review providing a comprehensive overview of these studies in the field of exercise-cognition science. Thus, this review aimed to address that gap in the literature.

METHODS

To identify eligible studies, we searched 5 electronic databases on October 23, 2022. Two researchers independently extracted data and assessed the risk of bias using a modified version of the Tool for the assEssment of Study qualiTy and reporting in EXercise (TESTEX scale, for interventional studies) and the critical appraisal tool from the Joanna Briggs Institute (for cross-sectional studies).

RESULTS

Our systematic review (n = 35 studies) offers the following main findings: (a) there is insufficient evidence available to draw solid conclusions concerning gaze-fixation-based measures; (b) the evidence that pupillometric measures, which are a proxy for the noradrenergic system, can explain the positive effect of acute exercise and cardiorespiratory fitness on cognitive performance is mixed; (c) physical training- or fitness-related changes of the cerebrovascular system (operationalized via changes in retinal vasculature) are, in general, positively associated with cognitive performance improvements; (d) acute and chronic physical exercises show a positive effect based on an oculomotor-based measure of executive function (operationalized via antisaccade tasks); and (e) the positive association between cardiorespiratory fitness and cognitive performance is partly mediated by the dopaminergic system (operationalized via spontaneous eye-blink rate).

CONCLUSION

This systematic review offers confirmation that eye-based measures can provide valuable insight into the neurobiological mechanisms that may drive positive associations between physical activity and fitness and measures of cognitive performance. However, due to the limited number of studies utilizing specific methods for obtaining eye-based measures (e.g., pupillometry, retinal vessel analysis, spontaneous eye blink rate) or investigating a possible dose-response relationship, further research is necessary before more nuanced conclusions can be drawn. Given that eye-based measures are economical and non-invasive, we hope this review will foster the future application of eye-based measures in the field of exercise-cognition science.

Pupil Size Encodes Uncertainty during Exploration

Exploration is an important part of decision making and is crucial to maximizing long-term rewards. Past work has shown that people use different forms of uncertainty to guide exploration. In this study, we investigate the role of the pupil-linked arousal system in uncertainty-guided exploration. We measured participants' (n = 48) pupil dilation while they performed a two-armed bandit task. Consistent with previous work, we found that people adopted a hybrid of directed, random, and undirected exploration, which are sensitive to relative uncertainty, total uncertainty, and value difference between options, respectively. We also found a positive correlation between pupil size and total uncertainty. Furthermore, augmenting the choice model with subject-specific total uncertainty estimates decoded from the pupil size improved predictions of held-out choices, suggesting that people used the uncertainty estimate encoded in pupil size to decide which option to explore. Together, the data shed light on the computations underlying uncertainty-driven exploration. Under the assumption that pupil size reflects locus coeruleus-norepinephrine neuromodulatory activity, these results also extend the theory of the locus coeruleus-norepinephrine function in exploration, highlighting its selective role in driving uncertainty-guided random exploration.

Pupil-linked arousal modulates network-level EEG signatures of attention reorienting during immersive multitasking

Objective. When multitasking, we must dynamically reorient our attention between different tasks. Attention reorienting is thought to arise through interactions of physiological arousal and brain-wide network dynamics. In this study, we investigated the relationship between pupil-linked arousal and electroencephalography (EEG) brain dynamics in a multitask driving paradigm conducted in virtual reality. We hypothesized that there would be an interaction between arousal and EEG dynamics and that this interaction would correlate with multitasking performance.Approach. We collected EEG and eye tracking data while subjects drove a motorcycle through a simulated city environment, with the instructions to count the number of target images they observed while avoiding crashing into a lead vehicle. The paradigm required the subjects to continuously reorient their attention between the two tasks. Subjects performed the paradigm under two conditions, one more difficult than the other.Main results. We found that task difficulty did not strongly correlate with pupil-linked arousal, and overall task performance increased as arousal level increased. A single-trial analysis revealed several interesting relationships between pupil-linked arousal and task-relevant EEG dynamics. Employing exact low-resolution electromagnetic tomography, we found that higher pupil-linked arousal led to greater EEG oscillatory activity, especially in regions associated with the dorsal attention network and ventral attention network (VAN). Consistent with our hypothesis, we found a relationship between EEG functional connectivity and pupil-linked arousal as a function of multitasking performance. Specifically, we found decreased functional connectivity between regions in the salience network (SN) and the VAN as pupil-linked arousal increased, suggesting that improved multitasking performance at high arousal levels may be due to a down-regulation in coupling between the VAN and the SN. Our results suggest that when multitasking, our brain rebalances arousal-based reorienting so that individual task demands can be met without prematurely reorienting to competing tasks.

The art of the deal: Deciphering the endowment effect from traders' eyes

People are often reluctant to trade, a reticence attributed to the endowment effect. The prevailing account attributes the endowment effect to valuation-related bias, manifesting as sellers valuing goods more than buyers, whereas an alternative account attributes it to response-related bias, manifesting as both buyers and sellers tending to stick to the status quo. Here, by tracking and modeling eye activity of buyers and sellers during trading, we accommodate both views within an evidence-accumulation framework. We find that valuation-related bias is indexed by asymmetric attentional allocation between buyers and sellers, whereas response-related bias is indexed by arousal-linked pupillary reactivity. A deal emerges when both buyers and sellers attend to their potential gains and dilate their pupils. Our study provides preliminary evidence for our computational framework of the dynamic processes mediating the endowment effect and identifies physiological biomarkers of deal-making.

Trigeminal Stimulation and Visuospatial Performance: The Struggle between Chewing and Trigeminal Asymmetries

Chewing improves visuospatial performance through locus coeruleus (LC) activation. The effects of bilateral and unilateral mastication were investigated in subjects showing different degrees of asymmetry in masseter electromyographic (EMG) activity during clenching and in pupil size at rest (anisocoria), which is a proxy of LC imbalance. Correlations between performance changes and asymmetry values were found in males, but not in females. Among males, subjects with low asymmetry values (balanced-BAL) were more sensitive than those with high asymmetry values (imbalanced-IMB) to bilateral and unilateral chewing on the side with higher EMG activity (hypertonic). The opposite was true for hypotonic side chewing. BAL subjects were sensitive to unilateral chewing on both sides, while in IMB subjects, hypertonic side chewing did not influence performance in either males or females. Bilateral chewing elicited larger effects in BAL subjects than in IMB subjects, exceeding the values predicted from unilateral chewing in both groups. Finally, pupil size and anisocoria changes elicited by chewing were correlated with asymmetry values, independent of sex. Data confirmed the facilitation of visuospatial performance exerted by chewing. Trigeminal asymmetries modulate the chewing effects, making occlusal rebalancing an appropriate strategy to improve performance.

Pupil dynamics during very light exercise predict benefits to prefrontal cognition

Physical exercise, even stress-free very-light-intensity exercise such as yoga and very slow running, can have beneficial effects on executive function, possibly by potentiating prefrontal cortical activity. However, the exact mechanisms underlying this potentiation have not been identified. Evidence from studies using pupillometry demonstrates that pupil changes track the real-time dynamics of activity linked to arousal and attention, including neural circuits from the locus coeruleus to the cortex. This makes it possible to examine whether pupil-linked brain dynamics induced during very-light-intensity exercise mediate benefits to prefrontal executive function in healthy young adults. In this experiment, pupil diameter was measured during 10 min of very-light-intensity exercise (30% V˙o2peak). A Stroop task was used to assess executive function before and after exercise. Prefrontal cortical activation during the task was assessed using multichannel functional near-infrared spectroscopy (fNIRS). We observed that very-light-intensity exercise significantly elicited pupil dilation, reduction of Stroop interference, and task-related left dorsolateral prefrontal cortex activation compared with the resting-control condition. The magnitude of change in pupil dilation predicted the magnitude of improvement in Stroop performance. In addition, causal mediation analysis showed that pupil dilation during very-light-intensity exercise robustly determined subsequent enhancement of Stroop performance. This finding supports our hypothesis that the pupil-linked mechanisms, which may be tied to locus coeruleus activation, are a potential mechanism by which very light exercise enhances prefrontal cortex activation and executive function. It also suggests that pupillometry may be a useful tool to interpret the beneficial impact of exercise on boosting cognition.

Eye Movements Decrease during Effortful Speech Listening

Hearing impairment affects many older adults but is often diagnosed decades after speech comprehension in noisy situations has become effortful. Accurate assessment of listening effort may thus help diagnose hearing impairment earlier. However, pupillometry-the most used approach to assess listening effort-has limitations that hinder its use in practice. The current study explores a novel way to assess listening effort through eye movements. Building on cognitive and neurophysiological work, we examine the hypothesis that eye movements decrease when speech listening becomes challenging. In three experiments with human participants from both sexes, we demonstrate, consistent with this hypothesis, that fixation duration increases and spatial gaze dispersion decreases with increasing speech masking. Eye movements decreased during effortful speech listening for different visual scenes (free viewing, object tracking) and speech materials (simple sentences, naturalistic stories). In contrast, pupillometry was less sensitive to speech masking during story listening, suggesting pupillometric measures may not be as effective for the assessments of listening effort in naturalistic speech-listening paradigms. Our results reveal a critical link between eye movements and cognitive load, suggesting that neural activity in the brain regions that support the regulation of eye movements, such as frontal eye field and superior colliculus, are modulated when listening is effortful.SIGNIFICANCE STATEMENT Assessment of listening effort is critical for early diagnosis of age-related hearing loss. Pupillometry is most used but has several disadvantages. The current study explores a novel way to assess listening effort through eye movements. We examine the hypothesis that eye movements decrease when speech listening becomes effortful. We demonstrate, consistent with this hypothesis, that fixation duration increases and gaze dispersion decreases with increasing speech masking. Eye movements decreased during effortful speech listening for different visual scenes (free viewing, object tracking) and speech materials (sentences, naturalistic stories). Our results reveal a critical link between eye movements and cognitive load, suggesting that neural activity in brain regions that support the regulation of eye movements are modulated when listening is effortful.

Vision rivals audition in alerting humans for fast action

Successful behaviour requires that humans act promptly upon the ubiquitous rapid changes in the environment. Prompt actions are supported by phasic alertness, the increased readiness for perception and action elicited by warning stimuli (alerting cues). Audition is assumed to induce phasic alertness for action faster and more strongly than other senses. Here, we show that vision can be equally effective as audition. We investigated the temporal evolution and the effectiveness of visual and auditory alerting for action in a speeded choice task, while controlling for basic sensitivity differences between the modalities that are unrelated to action control (by matching auditory and visual stimuli according to reaction times in a prior simple detection task). Results revealed that alerting sped up responses, but this happened equally fast and equally strong for visual and auditory alerting cues. Thus, these findings argue that vision rivals audition in phasic alerting for prompt actions, and suggest that the underlying mechanisms work across both modalities.

How and when EEG reflects changes in neuronal connectivity due to time awake

Being awake means forming new memories, primarily by strengthening neuronal synapses. The increase in synaptic strength results in increasing neuronal synchronicity, which should result in higher amplitude electroencephalography (EEG) oscillations. This is observed for slow waves during sleep but has not been found for wake oscillations. We hypothesized that this was due to a limitation of spectral power analysis, which does not distinguish between changes in amplitudes from changes in number of occurrences of oscillations. By using cycle-by-cycle analysis instead, we found that theta and alpha oscillation amplitudes increase as much as 30% following 24 h of extended wake. These increases were interrupted during the wake maintenance zone (WMZ), a window just before bedtime when it is difficult to fall asleep. We found that pupil diameter increased during this window, suggesting the ascending arousal system is responsible. In conclusion, wake oscillation amplitudes reflect increased synaptic strength, except during the WMZ.

Effort cost of harvest affects decisions and movement vigor of marmosets during foraging

Our decisions are guided by how we perceive the value of an option, but this evaluation also affects how we move to acquire that option. Why should economic variables such as reward and effort alter the vigor of our movements? In theory, both the option that we choose and the vigor with which we move contribute to a measure of fitness in which the objective is to maximize rewards minus efforts, divided by time. To explore this idea, we engaged marmosets in a foraging task in which on each trial they decided whether to work by making saccades to visual targets, thus accumulating food, or to harvest by licking what they had earned. We varied the effort cost of harvest by moving the food tube with respect to the mouth. Theory predicted that the subjects should respond to the increased effort costs by choosing to work longer, stockpiling food before commencing harvest, but reduce their movement vigor to conserve energy. Indeed, in response to an increased effort cost of harvest, marmosets extended their work duration, but slowed their movements. These changes in decisions and movements coincided with changes in pupil size. As the effort cost of harvest declined, work duration decreased, the pupils dilated, and the vigor of licks and saccades increased. Thus, when acquisition of reward became effortful, the pupils constricted, the decisions exhibited delayed gratification, and the movements displayed reduced vigor.

Significance statement

Our results suggest that as the brainstem neuromodulatory circuits that control pupil size respond to effort costs, they alter computations in the brain regions that control decisions, encouraging work and delaying gratification, and the brain regions that control movements, reducing vigor and suppressing energy expenditure. This coordinated response suggests that decisions and actions are part of a single control policy that aims to maximize a variable relevant to fitness: the capture rate.

Short-term transcutaneous vagus nerve stimulation increases pupil size but does not affect EEG alpha power: A replication of Sharon et al. (2021, Journal of Neuroscience)

BACKGROUND

Transcutaneous auricular vagus nerve stimulation (taVNS) has been tested as a potential treatment for pharmaco-resistant epilepsy and depression. Its clinical efficacy is thought to depend on taVNS-induced activation of the locus coeruleus and other neuromodulator systems. However, unlike for invasive VNS in rodents, there is little evidence for an effect of taVNS on noradrenergic activity.

OBJECTIVE

We attempted to replicate recently published findings by Sharon et al. (2021), showing that short bursts of taVNS transiently increased pupil size and decreased EEG alpha power, two correlates of central noradrenergic activity.

METHODS

Following the original study, we used a single-blind, sham-controlled, randomized cross-over design. Human volunteers (n = 29) received short-term (3.4 s) taVNS at the maximum level below the pain threshold, while we collected resting-state pupil-size and EEG data. To analyze the data, we used scripts provided by Sharon and colleagues.

RESULTS

Consistent with Sharon et al. (2021), pupil dilation was significantly larger during taVNS than during sham stimulation (p = .009; Bayes factor supporting the difference = 7.45). However, we failed to replicate the effect of taVNS on EEG alpha power (p = .37); the data were four times more likely under the null hypothesis (BF10 = 0.28).

CONCLUSION

Our findings support the effectiveness of short-term taVNS in inducing transient pupil dilation, a correlate of phasic noradrenergic activity. However, we failed to replicate the recent finding by Sharon et al. (2021) that taVNS attenuates EEG alpha activity. Overall, this study highlights the need for continued research on the neural mechanisms underlying taVNS efficacy and its potential as a treatment option for pharmaco-resistant conditions. It also highlights the need for direct replications of influential taVNS studies.

Why is everyone talking about brain state?

The rapid and coordinated propagation of neural activity across the brain provides the foundation for complex behavior and cognition. Technical advances across neuroscience subfields have advanced understanding of these dynamics, but points of convergence are often obscured by semantic differences, creating silos of subfield-specific findings. In this review we describe how a parsimonious conceptualization of brain state as the fundamental building block of whole-brain activity offers a common framework to relate findings across scales and species. We present examples of the diverse techniques commonly used to study brain states associated with physiology and higher-order cognitive processes, and discuss how integration across them will enable a more comprehensive and mechanistic characterization of the neural dynamics that are crucial to survival but are disrupted in disease.

Fixation offset decreases pupillary inhibition of return

Inhibition of return (IOR) is reflected as a slower manual or saccadic response to a cued rather than an uncued target (manual IOR and saccadic IOR, respectively), and as a pupillary dilation when a bright, relative to a dark side of a display is cued (pupillary IOR). The aim of this study was to investigate the relation between an IOR and oculomotor system. According to the predominant view, only the saccadic IOR is strictly related to the visuomotor process, and the manual and pupillary IORs depend on non-motor factors (e.g., short-term visual depression). Alternatively, the after-effect of the covert-orienting hypothesis postulates that IOR is strictly related to the oculomotor system. As fixation offset affects oculomotor processes, this study investigated whether fixation offset also affects pupillary and manual IORs. The results show that fixation offset decreased IOR in pupillary but not manual responses, and provides support for the hypothesis that at least the pupillary IOR is tightly linked to eye movement preparation.

Dopamine and norepinephrine differentially mediate the exploration-exploitation tradeoff

The catecholamines dopamine (DA) and norepinephrine (NE) have been repeatedly implicated in neuropsychiatric vulnerability, in part via their roles in mediating the decision making processes. Although the two neuromodulators share a synthesis pathway and are co-activated under states of arousal, they engage in distinct circuits and roles in modulating neural activity across the brain. However, in the computational neuroscience literature, they have been assigned similar roles in modulating the latent cognitive processes of decision making, in particular the exploration-exploitation tradeoff. Revealing how each neuromodulator contributes to this explore-exploit process will be important in guiding mechanistic hypotheses emerging from computational psychiatric approaches. To understand the differences and overlaps of the roles of these two catecholamine systems in regulating exploration and exploitation, a direct comparison using the same dynamic decision making task is needed. Here, we ran mice in a restless two-armed bandit task, which encourages both exploration and exploitation. We systemically administered a nonselective DA receptor antagonist (flupenthixol), a nonselective DA receptor agonist (apomorphine), a NE beta-receptor antagonist (propranolol), and a NE beta-receptor agonist (isoproterenol), and examined changes in exploration within subjects across sessions. We found a bidirectional modulatory effect of dopamine receptor activity on the level of exploration. Increasing dopamine activity decreased exploration and decreasing dopamine activity increased exploration. Beta-noradrenergic receptor activity also modulated exploration, but the modulatory effect was mediated by sex. Reinforcement learning model parameters suggested that dopamine modulation affected exploration via decision noise and norepinephrine modulation affected exploration via outcome sensitivity. Together, these findings suggested that the mechanisms that govern the transition between exploration and exploitation are sensitive to changes in both catecholamine functions and revealed differential roles for NE and DA in mediating exploration.

Pupil size reflects activation of subcortical ascending arousal system nuclei during rest

Neuromodulatory nuclei that are part of the ascending arousal system (AAS) play a crucial role in regulating cortical state and optimizing task performance. Pupil diameter, under constant luminance conditions, is increasingly used as an index of activity of these AAS nuclei. Indeed, task-based functional imaging studies in humans have begun to provide evidence of stimulus-driven pupil-AAS coupling. However, whether there is such a tight pupil-AAS coupling during rest is not clear. To address this question, we examined simultaneously acquired resting-state fMRI and pupil-size data from 74 participants, focusing on six AAS nuclei: the locus coeruleus, ventral tegmental area, substantia nigra, dorsal and median raphe nuclei, and cholinergic basal forebrain. Activation in all six AAS nuclei was optimally correlated with pupil size at 0-2 s lags, suggesting that spontaneous pupil changes were almost immediately followed by corresponding BOLD-signal changes in the AAS. These results suggest that spontaneous changes in pupil size that occur during states of rest can be used as a noninvasive general index of activity in AAS nuclei. Importantly, the nature of pupil-AAS coupling during rest appears to be vastly different from the relatively slow canonical hemodynamic response function that has been used to characterize task-related pupil-AAS coupling.

Data-Driven Pupil Response Profiles as Transdiagnostic Readouts for the Detection of Neurocognitive Functioning in Affective and Anxiety Disorders

BACKGROUND

Neurocognitive functioning is a relevant transdiagnostic dimension in psychiatry. As pupil size dynamics track cognitive load during a working memory task, we aimed to explore if this parameter allows identification of psychophysiological subtypes in healthy participants and patients with affective and anxiety disorders.

METHODS

Our sample consisted of 226 participants who completed the n-back task during simultaneous functional magnetic resonance imaging and pupillometry measurements. We used latent class growth modeling to identify clusters based on pupil size in response to cognitive load. In a second step, these clusters were compared on affective and anxiety symptom levels, performance in neurocognitive tests, and functional magnetic resonance imaging activity.

RESULTS

The clustering analysis resulted in two distinct pupil response profiles: one with a stepwise increasing pupil size with increasing cognitive load (reactive group) and one with a constant pupil size across conditions (nonreactive group). A larger increase in pupil size was significantly associated with better performance in neurocognitive tests in executive functioning and sustained attention. Statistical maps of parametric modulation of pupil size during the n-back task showed the frontoparietal network in the positive contrast and the default mode network in the negative contrast. The pupil response profile of the reactive group was associated with more thalamic activity, likely reflecting better arousal upregulation and less deactivation of the limbic system.

CONCLUSIONS

Pupil measurements have the potential to serve as a highly sensitive psychophysiological readout for detection of neurocognitive deficits in the core domain of executive functioning, adding to the development of valid transdiagnostic constructs in psychiatry.

Spontaneous variations in arousal modulate subsequent visual processing and local field potential dynamics in the ferret during quiet wakefulness

Behavioral states affect neuronal responses throughout the cortex and influence visual processing. Quiet wakefulness (QW) is a behavioral state during which subjects are quiescent but awake and connected to the environment. Here, we examined the effects of pre-stimulus arousal variability on post-stimulus neural activity in the primary visual cortex and posterior parietal cortex in awake ferrets, using pupil diameter as an indicator of arousal. We observed that the power of stimuli-induced alpha (8-12 Hz) decreases when the arousal level increases. The peak of alpha power shifts depending on arousal. High arousal increases inter- and intra-areal coherence. Using a simplified model of laminar circuits, we show that this connectivity pattern is compatible with feedback signals targeting infragranular layers in area posterior parietal cortex and supragranular layers in V1. During high arousal, neurons in V1 displayed higher firing rates at their preferred orientations. Broad-spiking cells in V1 are entrained to high-frequency oscillations (>80 Hz), whereas narrow-spiking neurons are phase-locked to low- (12-18 Hz) and high-frequency (>80 Hz) rhythms. These results indicate that the variability and sensitivity of post-stimulus cortical responses and coherence depend on the pre-stimulus behavioral state and account for the neuronal response variability observed during repeated stimulation.

A possible contribution of the locus coeruleus to arousal enhancement with mild exercise: evidence from pupillometry and neuromelanin imaging

Acute mild exercise has been observed to facilitate executive function and memory. A possible underlying mechanism of this is the upregulation of the ascending arousal system, including the catecholaminergic system originating from the locus coeruleus (LC). Prior work indicates that pupil diameter, as an indirect marker of the ascending arousal system, including the LC, increases even with very light-intensity exercise. However, it remains unclear whether the LC directly contributes to exercise-induced pupil-linked arousal. Here, we examined the involvement of the LC in the change in pupil dilation induced by very light-intensity exercise using pupillometry and neuromelanin imaging to assess the LC integrity. A sample of 21 young males performed 10 min of very light-intensity exercise, and we measured changes in the pupil diameters and psychological arousal levels induced by the exercise. Neuromelanin-weighted magnetic resonance imaging scans were also obtained. We observed that pupil diameter and psychological arousal levels increased during very light-intensity exercise, which is consistent with previous findings. Notably, the LC contrast, a marker of LC integrity, predicted the magnitude of pupil dilation and psychological arousal enhancement with exercise. These relationships suggest that the LC-catecholaminergic system is a potential a mechanism for pupil-linked arousal induced by very light-intensity exercise.

Neural α Oscillations and Pupil Size Differentially Index Cognitive Demand under Competing Audiovisual Task Conditions

Cognitive demand is thought to modulate two often used, but rarely combined, measures: pupil size and neural α (8-12 Hz) oscillatory power. However, it is unclear whether these two measures capture cognitive demand in a similar way under complex audiovisual-task conditions. Here we recorded pupil size and neural α power (using electroencephalography), while human participants of both sexes concurrently performed a visual multiple object-tracking task and an auditory gap detection task. Difficulties of the two tasks were manipulated independent of each other. Participants' performance decreased in accuracy and speed with increasing cognitive demand. Pupil size increased with increasing difficulty for both the auditory and the visual task. In contrast, α power showed diverging neural dynamics: parietal α power decreased with increasing difficulty in the visual task, but not with increasing difficulty in the auditory task. Furthermore, independent of task difficulty, within-participant trial-by-trial fluctuations in pupil size were negatively correlated with α power. Difficulty-induced changes in pupil size and α power, however, did not correlate, which is consistent with their different cognitive-demand sensitivities. Overall, the current study demonstrates that the dynamics of the neurophysiological indices of cognitive demand and associated effort are multifaceted and potentially modality-dependent under complex audiovisual-task conditions.SIGNIFICANCE STATEMENT Pupil size and oscillatory α power are associated with cognitive demand and effort, but their relative sensitivity under complex audiovisual-task conditions is unclear, as is the extent to which they share underlying mechanisms. Using an audiovisual dual-task paradigm, we show that pupil size increases with increasing cognitive demands for both audition and vision. In contrast, changes in oscillatory α power depend on the respective task demands: parietal α power decreases with visual demand but not with auditory task demand. Hence, pupil size and α power show different sensitivity to cognitive demands, perhaps suggesting partly different underlying neural mechanisms.

How uncertain are you? Disentangling expected and unexpected uncertainty in pupil-linked brain arousal during reversal learning

During decision making, we are continuously faced with two sources of uncertainty regarding the links between stimuli, our actions, and outcomes. On the one hand, our expectations are often probabilistic, that is, stimuli or actions yield the expected outcome only with a certain probability (expected uncertainty). On the other hand, expectations might become invalid due to sudden, unexpected changes in the environment (unexpected uncertainty). Several lines of research show that pupil-linked brain arousal is a sensitive indirect measure of brain mechanisms underlying uncertainty computations. Thus, we investigated whether it is involved in disentangling these two forms of uncertainty. To this aim, we measured pupil size during a probabilistic reversal learning task. In this task, participants had to figure out which of two response options led to reward with higher probability, whereby sometimes the identity of the more advantageous response option was switched. Expected uncertainty was manipulated by varying the reward probability of the advantageous choice option, whereas the level of unexpected uncertainty was assessed by using a Bayesian computational model estimating change probability and resulting uncertainty. We found that both aspects of unexpected uncertainty influenced pupil responses, confirming that pupil-linked brain arousal is involved in model updating after unexpected changes in the environment. Furthermore, high level of expected uncertainty impeded the detection of sudden changes in the environment, both on physiological and behavioral level. These results emphasize the role of pupil-linked brain arousal and underlying neural structures in handling situations in which the previously established contingencies are no longer valid.

Pupil size predicts the onset of exploration in brain and behavior

In uncertain environments, intelligent decision-makers exploit actions that have been rewarding in the past, but also explore actions that could be even better. Several neuromodulatory systems are implicated in exploration, based, in part, on work linking exploration to pupil size-a peripheral correlate of neuromodulatory tone and index of arousal. However, pupil size could instead track variables that make exploration more likely, like volatility or reward, without directly predicting either exploration or its neural bases. Here, we simultaneously measured pupil size, exploration, and neural population activity in the prefrontal cortex while two rhesus macaques explored and exploited in a dynamic environment. We found that pupil size under constant luminance specifically predicted the onset of exploration, beyond what could be explained by reward history. Pupil size also predicted disorganized patterns of prefrontal neural activity at both the single neuron and population levels, even within periods of exploitation. Ultimately, our results support a model in which pupil-linked mechanisms promote the onset of exploration via driving the prefrontal cortex through a critical tipping point where prefrontal control dynamics become disorganized and exploratory decisions are possible.

Brain State Relays Self-Processing and Heartbeat-Evoked Cortical Responses

The self has been proposed to be grounded in interoceptive processing, with heartbeat-evoked cortical activity as a neurophysiological marker of this processing. However, inconsistent findings have been reported on the relationship between heartbeat-evoked cortical responses and self-processing (including exteroceptive- and mental-self-processing). In this review, we examine previous research on the association between self-processing and heartbeat-evoked cortical responses and highlight the divergent temporal-spatial characteristics and brain regions involved. We propose that the brain state relays the interaction between self-processing and heartbeat-evoked cortical responses and thus accounts for the inconsistency. The brain state, spontaneous brain activity which highly and continuously changes in a nonrandom way, serves as the foundation upon which the brain functions and was proposed as a point in an extremely high-dimensional space. To elucidate our assumption, we provide reviews on the interactions between dimensions of brain state with both self-processing and heartbeat-evoked cortical responses. These interactions suggest the relay of self-processing and heartbeat-evoked cortical responses by brain state. Finally, we discuss possible approaches to investigate whether and how the brain state impacts the self-heart interaction.

Pupillary response is associated with the reset and switching of functional brain networks during salience processing

The interface between processing internal goals and salient events in the environment involves various top-down processes. Previous studies have identified multiple brain areas for salience processing, including the salience network (SN), dorsal attention network, and the locus coeruleus-norepinephrine (LC-NE) system. However, interactions among these systems in salience processing remain unclear. Here, we simultaneously recorded pupillometry, EEG, and fMRI during an auditory oddball paradigm. The analyses of EEG and fMRI data uncovered spatiotemporally organized target-associated neural correlates. By modeling the target-modulated effective connectivity, we found that the target-evoked pupillary response is associated with the network directional couplings from late to early subsystems in the trial, as well as the network switching initiated by the SN. These findings indicate that the SN might cooperate with the pupil-indexed LC-NE system in the reset and switching of cortical networks, and shed light on their implications in various cognitive processes and neurological diseases.

On the relationship of arousal and attentional distraction by emotional novel sounds

Unexpected and task-irrelevant sounds can impair performance in a task. It has been shown that highly arousing emotional distractor sounds impaired performance less compared to moderately arousing neutral distractor sounds. The present study tests whether these differential emotion-related distraction effects are directly related to an enhancement of arousal evoked by processing of emotional distractor sounds. We disentangled costs of orienting of attention and benefits of increased arousal levels during the presentation of highly arousing emotional and moderately arousing neutral novel sounds that were embedded in a sequence of repeated standard sounds. We used sound-related pupil dilation responses as a marker of arousal and RTs as a marker of distraction in a visual categorization task in 57 healthy young adults. Multilevel analyses revealed increased RT and increased pupil dilation in response to novel vs. standard sounds. Emotional novel sounds reduced distraction effects on the behavioral level and increased pupil dilation responses compared to neutral novel sounds. Bayes Factors revealed strong evidence against an inverse proportional relationship between behavioral distraction effects and sound-related pupil dilation responses for emotional sounds. Given that the activity of the locus coeruleus has been linked to both changes in pupil diameter and arousal, it may embody an indirect relationship as a common antecedent by the release of norepinephrine into brain networks involved in attention control and control of the pupil. The present study provides new insights into the relation of changes in arousal and attentional distraction during the processing of emotional task-irrelevant novel sounds.

Priorities for research on neuromodulatory subcortical systems in Alzheimer's disease: Position paper from the NSS PIA of ISTAART

The neuromodulatory subcortical system (NSS) nuclei are critical hubs for survival, hedonic tone, and homeostasis. Tau-associated NSS degeneration occurs early in Alzheimer's disease (AD) pathogenesis, long before the emergence of pathognomonic memory dysfunction and cortical lesions. Accumulating evidence supports the role of NSS dysfunction and degeneration in the behavioral and neuropsychiatric manifestations featured early in AD. Experimental studies even suggest that AD-associated NSS degeneration drives brain neuroinflammatory status and contributes to disease progression, including the exacerbation of cortical lesions. Given the important pathophysiologic and etiologic roles that involve the NSS in early AD stages, there is an urgent need to expand our understanding of the mechanisms underlying NSS vulnerability and more precisely detail the clinical progression of NSS changes in AD. Here, the NSS Professional Interest Area of the International Society to Advance Alzheimer's Research and Treatment highlights knowledge gaps about NSS within AD and provides recommendations for priorities specific to clinical research, biomarker development, modeling, and intervention. HIGHLIGHTS: Neuromodulatory nuclei degenerate in early Alzheimer's disease pathological stages. Alzheimer's pathophysiology is exacerbated by neuromodulatory nuclei degeneration. Neuromodulatory nuclei degeneration drives neuropsychiatric symptoms in dementia. Biomarkers of neuromodulatory integrity would be value-creating for dementia care. Neuromodulatory nuclei present strategic prospects for disease-modifying therapies.

Pupillometric evidence for a temporal expectations-based account of persistence under temporal uncertainty

People often quit waiting for delayed rewards when the exact timing of those rewards is uncertain. This behavior often has been attributed to self-control failure. Another possibility is that quitting is the result of a rational decision-making process in the face of uncertainty, based on the decision-maker's expectations about the possible arrival times of the awaited reward. There are forms of temporal expectations (e.g., heavy-tailed) under which the expected time remaining until a reward arrives actually increases as time elapses. In those cases, the rational strategy is to quit waiting when the expected reward is no longer worth the expected time remaining. To arbitrate between the "limited self-control" and "temporal expectations" accounts of persistence, we measured pupil diameter during a persistence task, as a physiological marker of surprise (phasic responses) and effort (pre-decision diameter). Phasic pupil responses were elevated in response to reward receipt. Critically, the extent to which pupils dilated following rewards depended on the delay: people showed larger pupillary surprise responses the more delayed the reward was. This result suggests that people expect the reward less the longer they wait for it-a form of temporal expectations under which limiting persistence is rational. Moreover, predecision pupil diameter before quit events was not associated with how long the participant had been waiting, but rather, depended on how atypical the quit decision was compared with the participant's usual behavior. These data provide physiological evidence for a temporal expectations account of persistence under temporal uncertainty.

Testing locus coeruleus-norepinephrine accounts of working memory, attention control, and fluid intelligence

The current set of studies examined the relationship among working memory capacity, attention control, fluid intelligence, and pupillary correlates of tonic arousal regulation and phasic responsiveness in a combined sample of more than 1,000 participants in two different age ranges (young adults and adolescents). Each study was designed to test predictions made by two recent theories regarding the role of the locus coeruleus-norepinephrine (LC-NE) system in determining individual differences in cognitive ability. The first theory, proposed by Unsworth and Robison (2017a), posits two important individual differences: the moment-to-moment regulation of tonic arousal, and the phasic responsiveness of the system to goal-relevant stimuli. The second theory, proposed by Tsukahara and Engle (2021a), argues that people with higher cognitive abilities have greater functional connectivity between the LC-NE system and cortical networks at rest. These two theories are not mutually exclusive, but they make different predictions. Overall, we found no evidence consistent with a resting-state theory. However, phasic responsiveness was consistently correlated with working memory capacity, attention control, and fluid intelligence, supporting a prediction made by Unsworth and Robison (2017a). Tonic arousal regulation was not correlated with working memory or fluid intelligence and was inconsistently correlated with attention control, which offers only partial support for Unsworth and Robison's (2017a) second prediction.

Peripheral nerve stimulation: A neuromodulation-based approach

Recent technological improvements have positioned us at the threshold of innovative discoveries that will assist in new perspectives and avenues of research. Increased attention has been directed towards peripheral nerve stimulation, particularly of the vagus, trigeminal, or greater occipital nerve, due to their unique pathway that engages neural circuits within networks involved in higher cognitive processes. Here, we question whether the effects of transcutaneous electrical stimulation are mediated by synergistic interactions of multiple neuromodulatory networks, considering this pathway is shared by more than one neuromodulatory system. By spotlighting this attractive transcutaneous pathway, this opinion piece aims to acknowledge the contributions of four vital neuromodulators and prompt researchers to consider them in future investigations or explanations.

Adaptive tuning of human learning and choice variability to unexpected uncertainty

Human value-based decisions are notably variable under uncertainty. This variability is known to arise from two distinct sources: variable choices aimed at exploring available options and imprecise learning of option values due to limited cognitive resources. However, whether these two sources of decision variability are tuned to their specific costs and benefits remains unclear. To address this question, we compared the effects of expected and unexpected uncertainty on decision-making in the same reinforcement learning task. Across two large behavioral datasets, we found that humans choose more variably between options but simultaneously learn less imprecisely their values in response to unexpected uncertainty. Using simulations of learning agents, we demonstrate that these opposite adjustments reflect adaptive tuning of exploration and learning precision to the structure of uncertainty. Together, these findings indicate that humans regulate not only how much they explore uncertain options but also how precisely they learn the values of these options.

Salient omissions-pupil dilation in response to unexpected omissions of sound and touch

Introduction

Recent theories describe perception as an inferential process based on internal predictive models adjusted by means of prediction violations (prediction error). To study and demonstrate predictive processing in the brain the use of unexpected stimulus omissions has been suggested as a promising approach as the evoked brain responses are uncontaminated by responses to stimuli. Here, we aimed to investigate the pupil's response to unexpected stimulus omissions in order to better understand surprise and orienting of attention resulting from prediction violation. So far only few studies have used omission in pupillometry research and results have been inconsistent.

Methods

This study adapted an EEG paradigm that has been shown to elicit omission responses in auditory and somatosensory modalities. Healthy adults pressed a button at their own pace, which resulted in the presentation of sounds or tactile stimuli in either 88%, 50% or 0% (motor-control) of cases. Pupil size was recorded continuously and averaged to analyze the pupil dilation response associated with each condition.

Results

Results revealed that omission responses were observed in both modalities in the 88%-condition compared to motor-control. Similar pupil omission responses were observed between modalities, suggesting modality-unspecific activation of the underlying brain circuits.

Discussion

In combination with previous omission studies using EEG, the findings demonstrate predictive models in brain processing and point to the involvement of subcortical structures in the omission response. Our pupillometry approach is especially suitable to study sensory prediction in vulnerable populations within the psychiatric field.

A pupillometric investigation of state regulation in adults scoring high versus low on ADHD symptomatology

According to the state regulation deficit (SRD) account, ADHD is associated with difficulties regulating tonic arousal levels, which may be due to inefficient effort allocation. We aimed to test the SRD account by using a target detection task with three different event rates (ER; 700 ms, 1800 ms, 6000 ms), in order to manipulate the tonic arousal state and its effects on performance and pupil indices in adults with high (n = 40) versus low (n = 36) ADHD symptom levels. In an additional condition, a fast ER (700 ms) was accompanied by auditory white noise (WN), to further increase tonic arousal level. The ER manipulation had a clear effect on RT and variability of RT. These effects were more pronounced for the high-ADHD group, especially for variability of RT with decreasing ER, suggestive of deficient upregulation of a tonic arousal state in that group, in line with their self-reported SRDs in daily life. Adding WN to the fast condition led to more errors, however similarly for both groups. Contrary to our predictions, the ER manipulation had no effect on tonic pupil size (as a measure of tonic arousal). Phasic pupil amplitude (as a measure of cognitive effort) linearly increased with decreasing ER, suggesting more effort allocation during slower ERs. WN decreased phasic pupil amplitude, but had no impact on tonic pupil size. Importantly, however, no ADHD-related differences were present for the pupil indices. In conclusion, adults with elevated levels of ADHD symptoms reported more SRDs in daily life and showed a performance pattern that suggests difficulties in upregulating but not downregulating the tonic arousal state. Surprisingly, these findings were not accompanied by group differences in pupillometric indices. This casts some doubts on the relationship between these measures of autonomic nervous system activity and state regulation, in particular in the context of ADHD symptomatology.

Zoom behavior during visual search modulates pupil diameter and reflects adaptive control states

Adaptive gain theory proposes that the dynamic shifts between exploration and exploitation control states are modulated by the locus coeruleus-norepinephrine system and reflected in tonic and phasic pupil diameter. This study tested predictions of this theory in the context of a societally important visual search task: the review and interpretation of digital whole slide images of breast biopsies by physicians (pathologists). As these medical images are searched, pathologists encounter difficult visual features and intermittently zoom in to examine features of interest. We propose that tonic and phasic pupil diameter changes during image review may correspond to perceived difficulty and dynamic shifts between exploration and exploitation control states. To examine this possibility, we monitored visual search behavior and tonic and phasic pupil diameter while pathologists (N = 89) interpreted 14 digital images of breast biopsy tissue (1,246 total images reviewed). After viewing the images, pathologists provided a diagnosis and rated the level of difficulty of the image. Analyses of tonic pupil diameter examined whether pupil dilation was associated with pathologists' difficulty ratings, diagnostic accuracy, and experience level. To examine phasic pupil diameter, we parsed continuous visual search data into discrete zoom-in and zoom-out events, including shifts from low to high magnification (e.g., 1× to 10×) and the reverse. Analyses examined whether zoom-in and zoom-out events were associated with phasic pupil diameter change. Results demonstrated that tonic pupil diameter was associated with image difficulty ratings and zoom level, and phasic pupil diameter showed constriction upon zoom-in events, and dilation immediately preceding a zoom-out event. Results are interpreted in the context of adaptive gain theory, information gain theory, and the monitoring and assessment of physicians' diagnostic interpretive processes.

Brainstem serotonin neurons selectively gate retinal information flow to thalamus

Retinal ganglion cell (RGC) types relay parallel streams of visual feature information. We hypothesized that neuromodulators might efficiently control which visual information streams reach the cortex by selectively gating transmission from specific RGC axons in the thalamus. Using fiber photometry recordings, we found that optogenetic stimulation of serotonergic axons in primary visual thalamus of awake mice suppressed ongoing and visually evoked calcium activity and glutamate release from RGC boutons. Two-photon calcium imaging revealed that serotonin axon stimulation suppressed RGC boutons that responded strongly to global changes in luminance more than those responding only to local visual stimuli, while the converse was true for suppression induced by increases in arousal. Converging evidence suggests that differential expression of the 5-HT1B receptor on RGC presynaptic terminals, but not differential density of nearby serotonin axons, may contribute to the selective serotonergic gating of specific visual information streams before they can activate thalamocortical neurons.

Differentiating between Bayesian parameter learning and structure learning based on behavioural and pupil measures

Within predictive processing two kinds of learning can be distinguished: parameter learning and structure learning. In Bayesian parameter learning, parameters under a specific generative model are continuously being updated in light of new evidence. However, this learning mechanism cannot explain how new parameters are added to a model. Structure learning, unlike parameter learning, makes structural changes to a generative model by altering its causal connections or adding or removing parameters. Whilst these two types of learning have recently been formally differentiated, they have not been empirically distinguished. The aim of this research was to empirically differentiate between parameter learning and structure learning on the basis of how they affect pupil dilation. Participants took part in a within-subject computer-based learning experiment with two phases. In the first phase, participants had to learn the relationship between cues and target stimuli. In the second phase, they had to learn a conditional change in this relationship. Our results show that the learning dynamics were indeed qualitatively different between the two experimental phases, but in the opposite direction as we originally expected. Participants were learning more gradually in the second phase compared to the first phase. This might imply that participants built multiple models from scratch in the first phase (structure learning) before settling on one of these models. In the second phase, participants possibly just needed to update the probability distribution over the model parameters (parameter learning).

Sensory salience processing moderates attenuated gazes on faces in autism spectrum disorder: a case-control study

BACKGROUND

Attenuated social attention is a key marker of autism spectrum disorder (ASD). Recent neuroimaging findings also emphasize an altered processing of sensory salience in ASD. The locus coeruleus-norepinephrine system (LC-NE) has been established as a modulator of this sensory salience processing (SSP). We tested the hypothesis that altered LC-NE functioning contributes to different SSP and results in diverging social attention in ASD.

METHODS

We analyzed the baseline eye-tracking data of the EU-AIMS Longitudinal European Autism Project (LEAP) for subgroups of autistic participants (n = 166, age = 6-30 years, IQ = 61-138, gender [female/male] = 41/125) or neurotypical development (TD; n = 166, age = 6-30 years, IQ = 63-138, gender [female/male] = 49/117) that were matched for demographic variables and data quality. Participants watched brief movie scenes (k = 85) depicting humans in social situations (human) or without humans (non-human). SSP was estimated by gazes on physical and motion salience and a corresponding pupillary response that indexes phasic activity of the LC-NE. Social attention is estimated by gazes on faces via manual areas of interest definition. SSP is compared between groups and related to social attention by linear mixed models that consider temporal dynamics within scenes. Models are controlled for comorbid psychopathology, gaze behavior, and luminance.

RESULTS

We found no group differences in gazes on salience, whereas pupillary responses were associated with altered gazes on physical and motion salience. In ASD compared to TD, we observed pupillary responses that were higher for non-human scenes and lower for human scenes. In ASD, we observed lower gazes on faces across the duration of the scenes. Crucially, this different social attention was influenced by gazes on physical salience and moderated by pupillary responses.

LIMITATIONS

The naturalistic study design precluded experimental manipulations and stimulus control, while effect sizes were small to moderate. Covariate effects of age and IQ indicate that the findings differ between age and developmental subgroups.

CONCLUSIONS

Pupillary responses as a proxy of LC-NE phasic activity during visual attention are suggested to modulate sensory salience processing and contribute to attenuated social attention in ASD.

Changes in pupil dilation and P300 amplitude indicate the possible involvement of the locus coeruleus-norepinephrine (LC-NE) system in psychological flow

Psychological flow is a state of full task immersion. The present study was conducted to test the hypothesis that psychological flow is positively related to activity of the phasic locus coeruleus-norepinephrine (LC-NE) system, which supports decisions on whether to engage in or disengage from the current activity. Subjective flow was assessed among 36 participants who engaged in a gamified version of the n-back task with various difficulty levels (0, 1, 2, and 3 back). During the tasks, continuous pupil diameter and EEG were recorded. We found that psychological flow and two presumed indicators of the phasic LC-NE activity (pupil dilation and EEG P300 amplitude) fit inverted U-shapes with increasing subjective task difficulty. Moreover, a positive linear relationship between psychological flow and pupil dilation (not with P300) was found. In conclusion, this study indicates the involvement of the LC-NE system in the peak experience of flow.

Seeing an Auditory Object: Pupillary Light Response Reflects Covert Attention to Auditory Space and Object

Attention to the relevant object and space is the brain's strategy to effectively process the information of interest in complex environments with limited neural resources. Numerous studies have documented how attention is allocated in the visual domain, whereas the nature of attention in the auditory domain has been much less explored. Here, we show that the pupillary light response can serve as a physiological index of auditory attentional shift and can be used to probe the relationship between space-based and object-based attention as well. Experiments demonstrated that the pupillary response corresponds to the luminance condition where the attended auditory object (e.g., spoken sentence) was located, regardless of whether attention was directed by a spatial (left or right) or nonspatial (e.g., the gender of the talker) cue and regardless of whether the sound was presented via headphones or loudspeakers. These effects on the pupillary light response could not be accounted for as a consequence of small (although observable) biases in gaze position drifting. The overall results imply a unified audiovisual representation of spatial attention. Auditory object-based attention contains the space representation of the attended auditory object, even when the object is oriented without explicit spatial guidance.

Human voices escape the auditory attentional blink: Evidence from detections and pupil responses

Attentional selection of a second target in a rapid stream of stimuli embedding two targets tends to be briefly impaired when two targets are presented in close temporal proximity, an effect known as an attentional blink (AB). Two target sounds (T1 and T2) were embedded in a rapid serial auditory presentation of environmental sounds with a short (Lag 3) or long lag (Lag 9). Participants were to first identify T1 (bell or sine tone) and then to detect T2 (present or absent). Individual stimuli had durations of either 30 or 90 ms, and were presented in streams of 20 sounds. The T2 varied in category: human voice, cello, or dog sound. Previous research has introduced pupillometry as a useful marker of the intensity of cognitive processing and attentional allocation in the visual AB paradigm. Results suggest that the interplay of stimulus factors is critical for target detection accuracy and provides support for the hypothesis that the human voice is the least likely to show an auditory AB (in the 90 ms condition). For the other stimuli, accuracy for T2 was significantly worse at Lag 3 than at Lag 9 in the 90 ms condition, suggesting the presence of an auditory AB. When AB occurred (at Lag 3), we observed smaller pupil dilations, time-locked to the onset of T2, compared to Lag 9, reflecting lower attentional processing when 'blinking' during target detection. Taken together, these findings support the conclusion that human voices escape the AB and that the pupillary changes are consistent with the so-called T2 attentional deficit. In addition, we found some indication that salient stimuli like human voices could require a less intense allocation of attention, or noradrenergic potentiation, compared to other auditory stimuli.

Short bursts of transcutaneous auricular vagus nerve stimulation enhance evoked pupil dilation as a function of stimulation parameters

Transcutaneous auricular vagus nerve stimulation (taVNS) is a neurostimulatory technique hypothesised to enhance central noradrenaline. Currently, there is scarce evidence in support of a noradrenergic mechanism of taVNS and limited knowledge on its stimulation parameters (i.e., intensity and pulse width). Therefore, the present study aimed to test whether taVNS enhances pupil dilation, a noradrenergic biomarker, as a function of stimulation parameters. Forty-nine participants received sham (i.e., left ear earlobe) and taVNS (i.e., left ear cymba concha) stimulation in two separate sessions, in a counterbalanced order. We administered short bursts (5s) of seven stimulation settings varying as a function of pulse width and intensity and measured pupil size in parallel. Each stimulation setting was administered sixteen times in separate blocks. We expected short bursts of stimulation to elicit phasic noradrenergic activity as indexed by event-related pupil dilation and event-related temporal derivative. We hypothesised higher stimulation settings, quantified as the total charge per pulse (pulse width x intensity), to drive greater event-related pupil dilation and temporal derivative in the taVNS compared to sham condition. Specifically, we expected stimulation settings in the taVNS condition to be associated with a linear increase in event-related pupil dilation and temporal derivative. We found stimulation settings to linearly increase both pupil measures. In line with our hypothesis, the observed dose-dependent effect was stronger in the taVNS condition. We also found taVNS to elicit more intense and unpleasant sensations than sham stimulation. These results support the hypothesis of a noradrenergic mechanism of taVNS. However, future studies should disentangle whether stimulation elicited sensations mediate the effect of taVNS on evoked pupil dilation.

Activation of brain arousal networks coincident with eye blinks during resting state

Eye-blinking has been implicated in arousal and attention. Here we test the hypothesis that blinking-moments represent arousal surges associated with activation of the ascending arousal network (AAN) and its thalamic projections. For this purpose, we explored the temporal relationship between eye-blinks and fMRI BOLD activity in AAN and thalamic nuclei, as well as whole brain cluster corrected activations during eyes-open, resting-state fMRI scanning. We show that BOLD activations in the AAN nuclei peaked prior to the eye blinks and in thalamic nuclei peaked prior to and during the blink, consistent with the role of eye blinking in arousal surges. Additionally, we showed visual cortex peak activation prior to the eye blinks, providing further evidence of the visual cortex's role in arousal, and document cerebellar peak activation post eye blinks, which might reflect downstream engagement from arousal surges.

Effects of Natural Scene Inversion on Visual-evoked Brain Potentials and Pupillary Responses: A Matter of Effortful Processing of Unfamiliar Configurations

The inversion of a picture of a face hampers the accuracy and speed at which observers can perceptually process it. Event-related potentials and pupillary responses, successfully used as biomarkers of face inversion in the past, suggest that the perception of visual features, that are organized in an unfamiliar manner, recruits demanding additional processes. However, it remains unclear whether such inversion effects generalize beyond face stimuli and whether indeed more mental effort is needed to process inverted images. Here we aimed to study the effects of natural scene inversion on visual evoked potentials and pupil dilations. We simultaneously measured responses of 47 human participants to presentations of images showing upright or inverted natural scenes. For inverted scenes, we observed relatively stronger occipito-temporo-parietal N1 peak amplitudes and larger pupil dilations (on top of an initial orienting response) than for upright scenes. This study revealed neural and physiological markers of natural scene inversion that are in line with inversion effects of other stimulus types and demonstrates the robustness and generalizability of the phenomenon that unfamiliar configurations of visual content require increased processing effort.

A Narrative Literature Review About the Role of Microsaccades in Sports

In many daily and sport situations, people have to simultaneously perceive and process multiple objects and scenes in a short amount of time. A wrong decision may lead to a disadvantage for a team or for a single athlete, and during daily life (i.e., driving, surgery), it could have more dangerous consequences. Considering the results of different studies, the ability to distribute visual attention depends on different levels of expertise and environment-related constraints. This article is a narrative review of the current scientific evidence in the field of eye movements in sports, focusing on the role of microsaccades in sporting task situations. Over the past 10 years, microsaccades have become one of the most increasing areas of research in visual and oculomotor studies and even in the area of sport science. Here, we review the latest findings and discuss the relationships between microsaccades and attention, perception, and action in sports.

A novel head-fixed assay for social touch in mice uncovers aversive responses in two autism models

Social touch, an important aspect of social interaction and communication, is essential to kinship across animal species. How animals experience and respond to social touch has not been thoroughly investigated, in part due to the lack of appropriate assays. Previous studies that examined social touch in freely moving rodents lacked the necessary temporal and spatial control over individual touch interactions. We designed a novel head-fixed assay for social touch in mice, in which the experimenter has complete control to elicit highly stereotyped bouts of social touch between two animals. The user determines the number, duration, context, and type of social touch interactions, while monitoring with high frame rate cameras an array of complex behavioral responses. We focused on social touch to the face because of their high translational relevance to humans. We validated this assay in two different models of autism spectrum disorder (ASD), the Fmr1 knockout model of Fragile X Syndrome and maternal immune activation mice. We observed increased avoidance, hyperarousal, and more aversive facial expressions to social touch, but not to object touch, in both ASD models compared to controls. Because this new social touch assay for head-fixed mice can be used to record neural activity during repeated bouts of social touch it should be of interest to neuroscientists interested in uncovering the underlying circuits.

Traumatic brain injury: Mechanisms, manifestations, and visual sequelae

Traumatic brain injury (TBI) results when external physical forces impact the head with sufficient intensity to cause damage to the brain. TBI can be mild, moderate, or severe and may have long-term consequences including visual difficulties, cognitive deficits, headache, pain, sleep disturbances, and post-traumatic epilepsy. Disruption of the normal functioning of the brain leads to a cascade of effects with molecular and anatomical changes, persistent neuronal hyperexcitation, neuroinflammation, and neuronal loss. Destructive processes that occur at the cellular and molecular level lead to inflammation, oxidative stress, calcium dysregulation, and apoptosis. Vascular damage, ischemia and loss of blood brain barrier integrity contribute to destruction of brain tissue. This review focuses on the cellular damage incited during TBI and the frequently life-altering lasting effects of this destruction on vision, cognition, balance, and sleep. The wide range of visual complaints associated with TBI are addressed and repair processes where there is potential for intervention and neuronal preservation are highlighted.

Psychophysiological and behavioral responses to descriptive labels in modern art museums

Educational tools in art exhibitions seem crucial to improve the cultural and aesthetic experience, particularly of non-expert visitors, thus becoming a strategic goal for museums. However, there has not been much research regarding the impact of labels on the quality of visitors' aesthetic experience. Therefore, here we compared the impact on the cognitive and emotional experience of naïve visitors between essential and descriptive labels, through multiple objective and subjective measurements, focusing on the controversial modern art museum context. We found that, after detailed descriptions, observers spend more time inspecting artworks, their eyes wander more looking for the described elements, their skin conductance and pupil size increase, and overall, they find the content less complex and more arousing. Our findings show that people do receive important benefits from reading detailed information about artworks. This suggests that elaborating effective labels should be a primary goal for museums interested in attracting a non-expert public.

Time-specific Components of Pupil Responses Reveal Alternations in Effort Allocation Caused by Memory Task Demands During Speech Identification in Noise

Daily communication may be effortful due to poor acoustic quality. In addition, memory demands can induce effort, especially for long or complex sentences. In the current study, we tested the impact of memory task demands and speech-to-noise ratio on the time-specific components of effort allocation during speech identification in noise. Thirty normally hearing adults (15 females, mean age 42.2 years) participated. In an established auditory memory test, listeners had to listen to a list of seven sentences in noise, and repeat the sentence-final word after presentation, and, if instructed, recall the repeated words. We tested the effects of speech-to-noise ratio (SNR; -4 dB, +1 dB) and recall (Recall; Yes, No), on the time-specific components of pupil responses, trial baseline pupil size, and their dynamics (change) along the list. We found three components in the pupil responses (early, middle, and late). While the additional memory task (recall versus no recall) lowered all components' values, SNR (-4 dB versus +1 dB SNR) increased the middle and late component values. Increasing memory demands (Recall) progressively increased trial baseline and steepened decrease of the late component's values. Trial baseline increased most steeply in the condition of +1 dB SNR with recall. The findings suggest that adding a recall to the auditory task alters effort allocation for listening. Listeners are dynamically re-allocating effort from listening to memorizing under changing memory and acoustic demands. The pupil baseline and the time-specific components of pupil responses provide a comprehensive picture of the interplay of SNR and recall on effort.

Independent bilateral-eye stimulation for gaze pattern recognition based on steady-state pupil light reflex

Objective:recently, pupil oscillations synchronized with steady visual stimuli were used as input for an interface. The proposed system, inspired by a brain-computer interface based on steady-state visual evoked potentials, does not require contact with the participant. However, the pupil oscillation mechanism limits the stimulus frequency to 2.5 Hz or less, making it hard to enhance the information transfer rate (ITR).Approach:here, we compared multiple conditions for stimulation to increase the ITR of the pupil vibration-based interface, which were called monocular-single, monocular-superposed, and binocular-independent conditions. The binocular-independent condition stimulates each eye at different frequencies respectively and mixes them by using the visual stereoscopic perception of users. The monocular-superposed condition stimulates both eyes by a mixed signal of two different frequencies. We selected the shape of the stimulation signal, evaluated the amount of spectral leakage in the monocular-superposed and binocular-independent conditions, and compared the power spectrum density at the stimulation frequency. Moreover, 5, 10, and 15 patterns of stimuli were classified in each condition.Main results:a square wave, which causes an efficient pupil response, was used as the stimulus. Spectral leakage at the beat frequency was higher in the monocular-superposed condition than in the binocular-independent one. The power spectral density of stimulus frequencies was greatest in the monocular-single condition. Finally, we could classify the 15-stimulus pattern, with ITRs of 14.4 (binocular-independent, using five frequencies), 14.5 (monocular-superimposed, using five frequencies), and 23.7 bits min^-1(monocular-single, using 15 frequencies). There were no significant differences for the binocular-independent and monocular-superposed conditions.Significance:this paper shows a way to increase the number of stimuli that can be simultaneously displayed without decreasing ITR, even when only a small number of frequencies are available. This could lead to the provision of an interface based on pupil oscillation to a wider range of users.