Cognitive and Ocular Factors Jointly Determine Pupil Responses under Equiluminance

Cholinergic-related pupil activity reflects level of emotionality during motor performance

Pupil size covaries with the diffusion rate of the cholinergic and noradrenergic neurons throughout the brain, which are essential to arousal. Recent findings suggest that slow pupil fluctuations during locomotion are an index of sustained activity in cholinergic axons, whereas phasic dilations are related to the activity of noradrenergic axons. Here, we investigated movement induced arousal (i.e., by singing and swaying to music), hypothesising that actively engaging in musical behaviour will provoke stronger emotional engagement in participants and lead to different qualitative patterns of tonic and phasic pupil activity. A challenge in the analysis of pupil data is the turbulent behaviour of pupil diameter due to exogenous ocular activity commonly encountered during motor tasks and the high variability typically found between individuals. To address this, we developed an algorithm that adaptively estimates and removes pupil responses to ocular events, as well as a functional data methodology, derived from Pfaffs' generalised arousal, that provides a new statistical dimension on how pupil data can be interpreted according to putative neuromodulatory signalling. We found that actively engaging in singing enhanced slow cholinergic-related pupil dilations and having the opportunity to move your body while performing amplified the effect of singing on pupil activity. Phasic pupil oscillations during motor execution attenuated in time, which is often interpreted as a measure of sense of agency over movement.

Bidirectional brain-body interactions during natural story listening

Narratives can synchronize neural and physiological signals between individuals, but the relationship between these signals, and the underlying mechanism, is unclear. We hypothesized a top-down effect of cognition on arousal and predicted that auditory narratives will drive not only brain signals but also peripheral physiological signals. We find that auditory narratives entrained gaze variation, saccade initiation, pupil size, and heart rate. This is consistent with a top-down effect of cognition on autonomic function. We also hypothesized a bottom-up effect, whereby autonomic physiology affects arousal. Controlled breathing affected pupil size, and heart rate was entrained by controlled saccades. Additionally, fluctuations in heart rate preceded fluctuations of pupil size and brain signals. Gaze variation, pupil size, and heart rate were all associated with anterior-central brain signals. Together, these results suggest bidirectional causal effects between peripheral autonomic function and central brain circuits involved in the control of arousal.

The HPA and SAM axis mediate the impairment of creativity under stress

With the ever-changing social environment, individual creativity is facing a severe challenge induced by stress. However, little is known regarding the underlying mechanisms by which acute stress affects creative cognitive processing. The current research explored the impacts of the neuroendocrine response on creativity under stress and its underlying cognitive flexibility mechanisms. The enzyme-linked immuno sorbent assay was employed to assess salivary cortisol, which acted as a marker of stress-induced activation of the hypothalamic-pituitary-adrenal (HPA) axis. Eye blink rate (EBR) and pupil diameter were measured as respective indicators of dopamine and noradrenaline released by the activation of the sympathetic-adrenal-medullary (SAM) axis. The Wisconsin card task (WCST) measured cognitive flexibility, while the alternative uses task (AUT) and the remote association task (RAT) measured separately divergent and convergent thinking in creativity. Results showed higher cortisol increments following acute stress induction in the stress group than control group. Ocular results showed that the stress manipulation significantly increased EBR and pupil diameter compared to controls, reflecting increased SAM activity. Further analysis revealed that stress-released cortisol impaired the originality component of the AUT, reducing cognitive flexibility as measured by perseverative errors on the WCST task. Serial mediation analyses showed that both EBR and pupil diameter were also associated with increased perseverative errors leading to poor originality on the AUT. These findings confirm that physiological arousal under stress can impair divergent thinking through the regulation of different neuroendocrine pathways, in which the deterioration of flexible switching plays an important mediating role.

Changes in pupil size track self-control failure

People are more likely to perform poorly on a self-control task following a previous task requiring self-control (ego-depletion), but the mechanism for this effect remains unclear. We used pupillometry to test the role of attentional effort in ego-depletion. We hypothesized that an elevated pupil diameter (PD)-a common physiological measure of effort-during an initial task requiring self-control should be negatively associated with performance on a subsequent control task. To test this hypothesis, participants were first assigned to either a high- or low-demand attention task (manipulation; a standard ego-depletion paradigm), after which all participants completed the same Stroop task. We then separately extracted both sustained (low-frequency) and phasic (high-frequency) changes in PD from both tasks to evaluate possible associations with lapses of cognitive control on the Stroop task. We first show that in the initial task, sustained PD was larger among participants who were assigned to the demanding attention condition. Furthermore, ego-depletion effects were serially mediated by PD: an elevated PD response emerged rapidly among the experimental group during the manipulation, persisted as an elevated baseline response during the Stroop task, and predicted worse accuracy on incongruent trials, revealing a potential indirect pathway to ego-depletion via sustained attention. Secondary analyses revealed another, independent and direct pathway via high levels of transient attentional control: participants who exhibited large phasic responses during the manipulation tended to perform worse on the subsequent Stroop task. We conclude by exploring the neuroscientific implications of these results within the context of current theories of self-control.

Linear integration of multisensory signals in the pupil

The pupil of the eye responds to various salient signals from different modalities, but there is no consensus on how these pupillary responses are integrated when multiple signals appear simultaneously. Both linear and nonlinear integration have been found previously. The current study aimed to reexamine the nature of pupillary integration, and specifically focused on the early, transient pupillary responses due to its close relationship with orienting. To separate the early pupillary responses out of the pupil time series, we adopted a pupil oscillation paradigm in which sensory stimuli were periodically presented. The simulation analysis confirmed that the amplitude of the pupil oscillation, induced by stimuli repeatedly presented at relatively high rates, can precisely reflect the early, transient pupillary responses without involving the late and sustained pupillary responses. The experimental results then showed that the amplitude of pupil oscillation induced by a series of simultaneous audiovisual stimuli equaled to a linear summation of the oscillatory amplitudes when unisensory stimuli were presented alone. Moreover, the tonic arousal levels, indicated by the baseline pupil size, cannot shift the summation from linear to nonlinear. These findings together support the additive nature of multisensory pupillary integration for the early, orienting-related pupillary responses. The additive nature of pupillary integration further implies that multiple pupillary responses may be independent of each other, irrespective of their potential cognitive and neural drivers.

A disinhibitory circuit mechanism explains a general principle of peak performance during mid-level arousal

Perceptual decision-making is highly dependent on the momentary arousal state of the brain, which fluctuates over time on a scale of hours, minutes, and even seconds. The textbook relationship between momentary arousal and task performance is captured by an inverted U-shape, as put forward in the Yerkes-Dodson law. This law suggests optimal performance at moderate levels of arousal and impaired performance at low or high arousal levels. However, despite its popularity, the evidence for this relationship in humans is mixed at best. Here, we use pupil-indexed arousal and performance data from various perceptual decision-making tasks to provide converging evidence for the inverted U-shaped relationship between spontaneous arousal fluctuations and performance across different decision types (discrimination, detection) and sensory modalities (visual, auditory). To further understand this relationship, we built a neurobiologically plausible mechanistic model and show that it is possible to reproduce our findings by incorporating two types of interneurons that are both modulated by an arousal signal. The model architecture produces two dynamical regimes under the influence of arousal: one regime in which performance increases with arousal and another regime in which performance decreases with arousal, together forming an inverted U-shaped arousal-performance relationship. We conclude that the inverted U-shaped arousal-performance relationship is a general and robust property of sensory processing. It might be brought about by the influence of arousal on two types of interneurons that together act as a disinhibitory pathway for the neural populations that encode the available sensory evidence used for the decision.

Attention Mobilization as a Modulator of Listening Effort: Evidence From Pupillometry

Listening to speech in noise can require substantial mental effort, even among younger normal-hearing adults. The task-evoked pupil response (TEPR) has been shown to track the increased effort exerted to recognize words or sentences in increasing noise. However, few studies have examined the trajectory of listening effort across longer, more natural, stretches of speech, or the extent to which expectations about upcoming listening difficulty modulate the TEPR. Seventeen younger normal-hearing adults listened to 60-s-long audiobook passages, repeated three times in a row, at two different signal-to-noise ratios (SNRs) while pupil size was recorded. There was a significant interaction between SNR, repetition, and baseline pupil size on sustained listening effort. At lower baseline pupil sizes, potentially reflecting lower attention mobilization, TEPRs were more sustained in the harder SNR condition, particularly when attention mobilization remained low by the third presentation. At intermediate baseline pupil sizes, differences between conditions were largely absent, suggesting these listeners had optimally mobilized their attention for both SNRs. Lastly, at higher baseline pupil sizes, potentially reflecting overmobilization of attention, the effect of SNR was initially reversed for the second and third presentations: participants initially appeared to disengage in the harder SNR condition, resulting in reduced TEPRs that recovered in the second half of the story. Together, these findings suggest that the unfolding of listening effort over time depends critically on the extent to which individuals have successfully mobilized their attention in anticipation of difficult listening conditions.

Combining Cardiovascular and Pupil Features Using k-Nearest Neighbor Classifiers to Assess Task Demand, Social Context, and Sentence Accuracy During Listening

In daily life, both acoustic factors and social context can affect listening effort investment. In laboratory settings, information about listening effort has been deduced from pupil and cardiovascular responses independently. The extent to which these measures can jointly predict listening-related factors is unknown. Here we combined pupil and cardiovascular features to predict acoustic and contextual aspects of speech perception. Data were collected from 29 adults (mean  =  64.6 years, SD  =  9.2) with hearing loss. Participants performed a speech perception task at two individualized signal-to-noise ratios (corresponding to 50% and 80% of sentences correct) and in two social contexts (the presence and absence of two observers). Seven features were extracted per trial: baseline pupil size, peak pupil dilation, mean pupil dilation, interbeat interval, blood volume pulse amplitude, pre-ejection period and pulse arrival time. These features were used to train k-nearest neighbor classifiers to predict task demand, social context and sentence accuracy. The k-fold cross validation on the group-level data revealed above-chance classification accuracies: task demand, 64.4%; social context, 78.3%; and sentence accuracy, 55.1%. However, classification accuracies diminished when the classifiers were trained and tested on data from different participants. Individually trained classifiers (one per participant) performed better than group-level classifiers: 71.7% (SD  =  10.2) for task demand, 88.0% (SD  =  7.5) for social context, and 60.0% (SD  =  13.1) for sentence accuracy. We demonstrated that classifiers trained on group-level physiological data to predict aspects of speech perception generalized poorly to novel participants. Individually calibrated classifiers hold more promise for future applications.

Catecholaminergic neuromodulation and selective attention jointly shape perceptual decision-making

Perceptual decisions about sensory input are influenced by fluctuations in ongoing neural activity, most prominently driven by attention and neuromodulator systems. It is currently unknown if neuromodulator activity and attention differentially modulate perceptual decision-making and/or whether neuromodulatory systems in fact control attentional processes. To investigate the effects of two distinct neuromodulatory systems and spatial attention on perceptual decisions, we pharmacologically elevated cholinergic (through donepezil) and catecholaminergic (through atomoxetine) levels in humans performing a visuo-spatial attention task, while we measured electroencephalography (EEG). Both attention and catecholaminergic enhancement improved decision-making at the behavioral and algorithmic level, as reflected in increased perceptual sensitivity and the modulation of the drift rate parameter derived from drift diffusion modeling. Univariate analyses of EEG data time-locked to the attentional cue, the target stimulus, and the motor response further revealed that attention and catecholaminergic enhancement both modulated pre-stimulus cortical excitability, cue- and stimulus-evoked sensory activity, as well as parietal evidence accumulation signals. Interestingly, we observed both similar, unique, and interactive effects of attention and catecholaminergic neuromodulation on these behavioral, algorithmic, and neural markers of the decision-making process. Thereby, this study reveals an intricate relationship between attentional and catecholaminergic systems and advances our understanding about how these systems jointly shape various stages of perceptual decision-making.

Brainstem fMRI signaling of surprise across different types of deviant stimuli

Detection of deviant stimuli is crucial to orient and adapt our behavior. Previous work shows that deviant stimuli elicit phasic activation of the locus coeruleus (LC), which releases noradrenaline and controls central arousal. However, it is unclear whether the detection of behaviorally relevant deviant stimuli selectively triggers LC responses or other neuromodulatory systems (dopamine, serotonin, and acetylcholine). We combine human functional MRI (fMRI) recordings optimized for brainstem imaging with pupillometry to perform a mapping of deviant-related responses in subcortical structures. Participants have to detect deviant items in a "local-global" paradigm that distinguishes between deviance based on the stimulus probability and the sequence structure. fMRI responses to deviant stimuli are distributed in many cortical areas. Both types of deviance elicit responses in the pupil, LC, and other neuromodulatory systems. Our results reveal that the detection of task-relevant deviant items recruits the same multiple subcortical systems across computationally different types of deviance.

A Brain-To-Brain Mechanism for Social Transmission of Threat Learning

Survival and adaptation in environments require swift and efficacious learning about what is dangerous. Across species, much of such threat learning is acquired socially, e.g., through the observation of others' ("demonstrators'") defensive behaviors. However, the specific neural mechanisms responsible for the integration of information shared between demonstrators and observers remain largely unknown. This dearth of knowledge is addressed by performing magnetoencephalography (MEG) neuroimaging in demonstrator-observer dyads. A set of stimuli are first shown to a demonstrator whose defensive responses are filmed and later presented to an observer, while neuronal activity is recorded sequentially from both individuals who never interacted directly. These results show that brain-to-brain coupling (BtBC) in the fronto-limbic circuit (including insula, ventromedial, and dorsolateral prefrontal cortex) within demonstrator-observer dyads predict subsequent expressions of learning in the observer. Importantly, the predictive power of BtBC magnifies when a threat is imminent to the demonstrator. Furthermore, BtBC depends on how observers perceive their social status relative to the demonstrator, likely driven by shared attention and emotion, as bolstered by dyadic pupillary coupling. Taken together, this study describes a brain-to-brain mechanism for social threat learning, involving BtBC, which reflects social relationships and predicts adaptive, learned behaviors.

Methods in cognitive pupillometry: Design, preprocessing, and statistical analysis

Cognitive pupillometry is the measurement of pupil size to investigate cognitive processes such as attention, mental effort, working memory, and many others. Currently, there is no commonly agreed-upon methodology for conducting cognitive-pupillometry experiments, and approaches vary widely between research groups and even between different experiments from the same group. This lack of consensus makes it difficult to know which factors to consider when conducting a cognitive-pupillometry experiment. Here we provide a comprehensive, hands-on guide to methods in cognitive pupillometry, with a focus on trial-based experiments in which the measure of interest is the task-evoked pupil response to a stimulus. We cover all methodological aspects of cognitive pupillometry: experimental design, preprocessing of pupil-size data, and statistical techniques to deal with multiple comparisons when testing pupil-size data. In addition, we provide code and toolboxes (in Python) for preprocessing and statistical analysis, and we illustrate all aspects of the proposed workflow through an example experiment and example scripts.

Eye Movements Decrease during Effortful Speech Listening

Hearing impairment affects many older adults but is often diagnosed decades after speech comprehension in noisy situations has become effortful. Accurate assessment of listening effort may thus help diagnose hearing impairment earlier. However, pupillometry-the most used approach to assess listening effort-has limitations that hinder its use in practice. The current study explores a novel way to assess listening effort through eye movements. Building on cognitive and neurophysiological work, we examine the hypothesis that eye movements decrease when speech listening becomes challenging. In three experiments with human participants from both sexes, we demonstrate, consistent with this hypothesis, that fixation duration increases and spatial gaze dispersion decreases with increasing speech masking. Eye movements decreased during effortful speech listening for different visual scenes (free viewing, object tracking) and speech materials (simple sentences, naturalistic stories). In contrast, pupillometry was less sensitive to speech masking during story listening, suggesting pupillometric measures may not be as effective for the assessments of listening effort in naturalistic speech-listening paradigms. Our results reveal a critical link between eye movements and cognitive load, suggesting that neural activity in the brain regions that support the regulation of eye movements, such as frontal eye field and superior colliculus, are modulated when listening is effortful.SIGNIFICANCE STATEMENT Assessment of listening effort is critical for early diagnosis of age-related hearing loss. Pupillometry is most used but has several disadvantages. The current study explores a novel way to assess listening effort through eye movements. We examine the hypothesis that eye movements decrease when speech listening becomes effortful. We demonstrate, consistent with this hypothesis, that fixation duration increases and gaze dispersion decreases with increasing speech masking. Eye movements decreased during effortful speech listening for different visual scenes (free viewing, object tracking) and speech materials (sentences, naturalistic stories). Our results reveal a critical link between eye movements and cognitive load, suggesting that neural activity in brain regions that support the regulation of eye movements are modulated when listening is effortful.

The Costs of Paying Overt and Covert Attention Assessed With Pupillometry

Attention can be shifted with or without an accompanying saccade (i.e., overtly or covertly, respectively). Thus far, it is unknown how cognitively costly these shifts are, yet such quantification is necessary to understand how and when attention is deployed overtly or covertly. In our first experiment (N = 24 adults), we used pupillometry to show that shifting attention overtly is more costly than shifting attention covertly, likely because planning saccades is more complex. We pose that these differential costs will, in part, determine whether attention is shifted overtly or covertly in a given context. A subsequent experiment (N = 24 adults) showed that relatively complex oblique saccades are more costly than relatively simple saccades in horizontal or vertical directions. This provides a possible explanation for the cardinal-direction bias of saccades. The utility of a cost perspective as presented here is vital to furthering our understanding of the multitude of decisions involved in processing and interacting with the external world efficiently.

Effects of Stimulus Luminance, Stimulus Color and Intra-Stimulus Color Contrast on Visual Field Mapping in Neurologically Impaired Adults Using Flicker Pupil Perimetry

Purpose

We improve pupillary responses and diagnostic performance of flicker pupil perimetry through alterations in global and local color contrast and luminance contrast in adult patients suffering from visual field defects due to cerebral visual impairment (CVI).

Methods

Two experiments were conducted on patients with CVI (Experiment 1: 19 subjects, age M and SD 57.9 ± 14.0; Experiment 2: 16 subjects, age M and SD 57.3 ± 14.7) suffering from absolute homonymous visual field (VF) defects. We altered global color contrast (stimuli consisted of white, yellow, cyan and yellow-equiluminant-to-cyan colored wedges) in Experiment 1, and we manipulated luminance and local color contrast with bright and dark yellow and multicolor wedges in a 2-by-2 design in Experiment 2. Stimuli consecutively flickered across 44 stimulus locations within the inner 60 degrees of the VF and were offset to a contrasting (opponency colored) dark background. Pupil perimetry results were compared to standard automated perimetry (SAP) to assess diagnostic accuracy.

Results

A bright stimulus with global color contrast using yellow (p= 0.009) or white (p= 0.006) evoked strongest pupillary responses as opposed to stimuli containing local color contrast and lower brightness. Diagnostic accuracy, however, was similar across global color contrast conditions in Experiment 1 (p= 0.27) and decreased when local color contrast and less luminance contrast was introduced in Experiment 2 (p= 0.02). The bright yellow condition resulted in highest performance (AUC M = 0.85 ± 0.10, Mdn = 0.85).

Conclusion

Pupillary responses and pupil perimetry's diagnostic accuracy both benefit from high luminance contrast and global but not local color contrast.

Zoom behavior during visual search modulates pupil diameter and reflects adaptive control states

Adaptive gain theory proposes that the dynamic shifts between exploration and exploitation control states are modulated by the locus coeruleus-norepinephrine system and reflected in tonic and phasic pupil diameter. This study tested predictions of this theory in the context of a societally important visual search task: the review and interpretation of digital whole slide images of breast biopsies by physicians (pathologists). As these medical images are searched, pathologists encounter difficult visual features and intermittently zoom in to examine features of interest. We propose that tonic and phasic pupil diameter changes during image review may correspond to perceived difficulty and dynamic shifts between exploration and exploitation control states. To examine this possibility, we monitored visual search behavior and tonic and phasic pupil diameter while pathologists (N = 89) interpreted 14 digital images of breast biopsy tissue (1,246 total images reviewed). After viewing the images, pathologists provided a diagnosis and rated the level of difficulty of the image. Analyses of tonic pupil diameter examined whether pupil dilation was associated with pathologists' difficulty ratings, diagnostic accuracy, and experience level. To examine phasic pupil diameter, we parsed continuous visual search data into discrete zoom-in and zoom-out events, including shifts from low to high magnification (e.g., 1× to 10×) and the reverse. Analyses examined whether zoom-in and zoom-out events were associated with phasic pupil diameter change. Results demonstrated that tonic pupil diameter was associated with image difficulty ratings and zoom level, and phasic pupil diameter showed constriction upon zoom-in events, and dilation immediately preceding a zoom-out event. Results are interpreted in the context of adaptive gain theory, information gain theory, and the monitoring and assessment of physicians' diagnostic interpretive processes.

Learning progress mediates the link between cognitive effort and task engagement

While a substantial body of work has shown that cognitive effort is aversive and costly, a separate line of research on intrinsic motivation suggests that people spontaneously seek challenging tasks. According to one prominent account of intrinsic motivation, the learning progress motivation hypothesis, the preference for difficult tasks reflects the dynamic range that these tasks yield for changes in task performance (Kaplan & Oudeyer, 2007). Here we test this hypothesis, by asking whether greater engagement with intermediately difficult tasks, indexed by subjective ratings and objective pupil measurements, is a function of trial-wise changes in performance. In a novel paradigm, we determined each individual's capacity for task performance and used difficulty levels that are low, intermediately challenging or high for that individual. We demonstrated that challenging tasks resulted in greater liking and engagement scores compared with easy tasks. Pupil size tracked objective task difficulty, where challenging tasks were associated with greater pupil responses than easy tasks. Most importantly, pupil responses were predicted by trial-to-trial changes in average accuracy as well as learning progress (derivative of average accuracy), while greater pupil responses also predicted greater subjective engagement scores. Together, these results substantiate the learning progress motivation hypothesis stating that the link between task engagement and cognitive effort is mediated the dynamic range for changes in task performance.

Differentiating between Bayesian parameter learning and structure learning based on behavioural and pupil measures

Within predictive processing two kinds of learning can be distinguished: parameter learning and structure learning. In Bayesian parameter learning, parameters under a specific generative model are continuously being updated in light of new evidence. However, this learning mechanism cannot explain how new parameters are added to a model. Structure learning, unlike parameter learning, makes structural changes to a generative model by altering its causal connections or adding or removing parameters. Whilst these two types of learning have recently been formally differentiated, they have not been empirically distinguished. The aim of this research was to empirically differentiate between parameter learning and structure learning on the basis of how they affect pupil dilation. Participants took part in a within-subject computer-based learning experiment with two phases. In the first phase, participants had to learn the relationship between cues and target stimuli. In the second phase, they had to learn a conditional change in this relationship. Our results show that the learning dynamics were indeed qualitatively different between the two experimental phases, but in the opposite direction as we originally expected. Participants were learning more gradually in the second phase compared to the first phase. This might imply that participants built multiple models from scratch in the first phase (structure learning) before settling on one of these models. In the second phase, participants possibly just needed to update the probability distribution over the model parameters (parameter learning).

The contribution of temporal analysis of pupillometry measurements to cognitive research

Reaction time (RT) is one of the most frequently used measures to detect cognitive processes. When tasks require more cognitive processes/resources, reaction is slower. However, RTs may provide only restricted information regarding the temporal characteristics of cognitive processes. Pupils respond reflexively to light but also to cognitive activation. The more cognitive resources a task requires, the more the pupil dilates. However, despite being able to use temporal changes in pupil size (advanced devices measure changes in pupil diameter with sampling rates of above 1000 samples per second), most past studies using pupil dilation have not investigated temporal changes in pupil response. In the current paper, we discuss the advantage of the temporal approach to analyze pupil changes compared to a more traditional perspective, specifically, singular value methods such as mean value and peak amplitude value. Using data from two recent studies conducted in our laboratory, we demonstrate the differences in findings arising from the various analyses. In particular, we focus on the advantage of temporal analysis in detecting hidden effects, investigating temporal characterizations of the effects, and validating the experimental manipulation.

The Trade-Off Between Luminance and Color Contrast Assessed With Pupil Responses

Purpose

A scene consisting of a white stimulus on a black background incorporates strong luminance contrast. When both stimulus and background receive different colors, luminance contrast decreases but color contrast increases. Here, we sought to characterize the pattern of stimulus salience across varying trade-offs of color and luminance contrasts by using the pupil light response.

Methods

Three experiments were conducted with 17, 16, and 17 healthy adults. For all experiments, a flickering stimulus (2 Hz; alternating color to black) was presented superimposed on a background with a complementary color to the stimulus (i.e., opponency colors in human color perception: blue and yellow for Experiment 1, red and green for Experiment 2, and equiluminant red and green for Experiment 3). Background luminance varied between 0% and 45% to trade off luminance and color contrast with the stimulus. By comparing the locus of the optimal trade-off between color and luminance across different color axes, we explored the generality of the trade-off.

Results

The strongest pupil responses were found when a substantial amount of color contrast was present (at the expense of luminance contrast). Pupil response amplitudes increased by 15% to 30% after the addition of color contrast. An optimal pupillary responsiveness was reached at a background luminance setting of 20% to 35% color contrast across several color axes.

Conclusions

These findings suggest that a substantial component of pupil light responses incorporates color processing. More sensitive pupil responses and more salient stimulus designs can be achieved by adding subtle levels of color contrast between stimulus and background.

Translational Relevance

More robust pupil responses will enhance tests of the visual field with pupil perimetry.

Sensory suppression and increased neuromodulation during actions disrupt memory encoding of unpredictable self-initiated stimuli

Actions modulate sensory processing by attenuating responses to self- compared to externally generated inputs, which is traditionally attributed to stimulus-specific motor predictions. Yet, suppression has been also found for stimuli merely coinciding with actions, pointing to unspecific processes that may be driven by neuromodulatory systems. Meanwhile, the differential processing for self-generated stimuli raises the possibility of producing effects also on memory for these stimuli; however, evidence remains mixed as to the direction of the effects. Here, we assessed the effects of actions on sensory processing and memory encoding of concomitant, but unpredictable sounds, using a combination of self-generation and memory recognition task concurrently with EEG and pupil recordings. At encoding, subjects performed button presses that half of the time generated a sound (motor-auditory; MA) and listened to passively presented sounds (auditory-only; A). At retrieval, two sounds were presented and participants had to respond which one was present before. We measured memory bias and memory performance by having sequences where either both or only one of the test sounds were presented at encoding, respectively. Results showed worse memory performance - but no differences in memory bias -, attenuated responses, and larger pupil diameter for MA compared to A sounds. Critically, the larger the sensory attenuation and pupil diameter, the worse the memory performance for MA sounds. Nevertheless, sensory attenuation did not correlate with pupil dilation. Collectively, our findings suggest that sensory attenuation and neuromodulatory processes coexist during actions, and both relate to disrupted memory for concurrent, albeit unpredictable sounds.

Neural responses to sensory novelty with and without conscious access

Detection of novel stimuli that violate statistical regularities in the sensory scene is of paramount importance for the survival of biological organisms. Event-related potentials, phasic increases in pupil size, and evoked changes in oscillatory power have been proposed as markers of sensory novelty detection. However, how conscious access to novelty modulates these different brain responses is not well understood. Here, we studied the neural responses to sensory novelty in the auditory modality with and without conscious access. We identified individual thresholds for conscious auditory discrimination and presented to our participants sequences of tones, where the last stimulus could be another standard, a subthreshold target or a suprathreshold target. Participants were instructed to report whether the last tone of each sequence was the same or different from those preceding it. Results indicate that attentional orientation to behaviorally relevant stimuli and overt decision-making mechanisms, indexed by the P3 event-related response and reaction times, best predict whether a novel stimulus will be consciously accessed. Theta power and pupil size do not predict conscious access to novelty, but instead reflect information maintenance and unexpected sensory uncertainty. These results highlight the interplay between bottom-up and top-down mechanisms and how the brain weights neural responses to novelty and uncertainty during perception and goal-directed behavior.

Auditory Target Detection Enhances Visual Processing and Hippocampal Functional Connectivity

Though dividing one's attention between two input streams typically impairs performance, detecting a behaviorally relevant stimulus can sometimes enhance the encoding of unrelated information presented at the same time. Previous research has shown that selection of this kind boosts visual cortical activity and memory for concurrent items. An important unanswered question is whether such effects are reflected in processing quality and functional connectivity in visual regions and in the hippocampus. In this fMRI study, participants were asked to memorize a stream of naturalistic images and press a button only when they heard a predefined target tone (400 or 1,200 Hz, counterbalanced). Images could be presented with a target tone, with a distractor tone, or without a tone. Auditory target detection increased activity throughout the ventral visual cortex but lowered it in the hippocampus. Enhancements in functional connectivity between the ventral visual cortex and the hippocampus were also observed following auditory targets. Multi-voxel pattern classification of image category was more accurate on target tone trials than on distractor and no tone trials in the fusiform gyrus and parahippocampal gyrus. This effect was stronger in visual cortical clusters whose activity was more correlated with the hippocampus on target tone than on distractor tone trials. In agreement with accounts suggesting that subcortical noradrenergic influences play a role in the attentional boost effect, auditory target detection also caused an increase in locus coeruleus activity and phasic pupil responses. These findings outline a network of cortical and subcortical regions that are involved in the selection and processing of information presented at behaviorally relevant moments.

Pupillometry as an integrated readout of distinct attentional networks

The course of pupillary constriction and dilation provides an easy-to-access, inexpensive, and noninvasive readout of brain activity. We propose a new taxonomy of factors affecting the pupil and link these to associated neural underpinnings in an ascending hierarchy. In addition to two well-established low-level factors (light level and focal distance), we suggest two further intermediate-level factors, alerting and orienting, and a higher-level factor, executive functioning. Alerting, orienting, and executive functioning - including their respective underlying neural circuitries - overlap with the three principal attentional networks, making pupil size an integrated readout of distinct states of attention. As a now widespread technique, pupillometry is ready to provide meaningful applications and constitutes a viable part of the psychophysiological toolbox.

A unified model of the task-evoked pupil response

The pupil dilates and reconstricts following task events. It is popular to model this task-evoked pupil response as a linear transformation of event-locked impulses, whose amplitudes are used as estimates of arousal. We show that this model is incorrect and propose an alternative model based on the physiological finding that a common neural input drives saccades and pupil size. The estimates of arousal from our model agreed with key predictions: Arousal scaled with task difficulty and behavioral performance but was invariant to small differences in trial duration. Moreover, the model offers a unified explanation for a wide range of phenomena: entrainment of pupil size and saccades to task timing, modulation of pupil response amplitude and noise with task difficulty, reaction time-dependent modulation of pupil response timing and amplitude, a constrictory pupil response time-locked to saccades, and task-dependent distortion of this saccade-locked pupil response.

Coupling of pupil- and neuronal population dynamics reveals diverse influences of arousal on cortical processing

Fluctuations in arousal, controlled by subcortical neuromodulatory systems, continuously shape cortical state, with profound consequences for information processing. Yet, how arousal signals influence cortical population activity in detail has so far only been characterized for a few selected brain regions. Traditional accounts conceptualize arousal as a homogeneous modulator of neural population activity across the cerebral cortex. Recent insights, however, point to a higher specificity of arousal effects on different components of neural activity and across cortical regions. Here, we provide a comprehensive account of the relationships between fluctuations in arousal and neuronal population activity across the human brain. Exploiting the established link between pupil size and central arousal systems, we performed concurrent magnetoencephalographic (MEG) and pupillographic recordings in a large number of participants, pooled across three laboratories. We found a cascade of effects relative to the peak timing of spontaneous pupil dilations: Decreases in low-frequency (2-8 Hz) activity in temporal and lateral frontal cortex, followed by increased high-frequency (>64 Hz) activity in mid-frontal regions, followed by monotonic and inverted U relationships with intermediate frequency-range activity (8-32 Hz) in occipito-parietal regions. Pupil-linked arousal also coincided with widespread changes in the structure of the aperiodic component of cortical population activity, indicative of changes in the excitation-inhibition balance in underlying microcircuits. Our results provide a novel basis for studying the arousal modulation of cognitive computations in cortical circuits.

Pupillometry and the vigilance decrement: Task-evoked but not baseline pupil measures reflect declining performance in visual vigilance tasks

Baseline and task‐evoked pupil measures are known to reflect the activity of the nervous system's central arousal mechanisms. With the increasing availability, affordability and flexibility of video‐based eye tracking hardware, these measures may one day find practical application in real‐time biobehavioural monitoring systems to assess performance or fitness for duty in tasks requiring vigilant attention. But real‐world vigilance tasks are predominantly visual in their nature and most research in this area has taken place in the auditory domain. Here, we explore the relationship between pupil size—both baseline and task‐evoked—and behavioural performance measures in two novel vigilance tasks requiring visual target detection: (1) a traditional vigilance task involving prolonged, continuous and uninterrupted performance (n = 28) and (2) a psychomotor vigilance task (n = 25). In both tasks, behavioural performance and task‐evoked pupil responses declined as time spent on task increased, corroborating previous reports in the literature of a vigilance decrement with a corresponding reduction in task‐evoked pupil measures. Also in line with previous findings, baseline pupil size did not show a consistent relationship with performance measures. Our data offer novel insights into the complex interplay of brain systems involved in vigilant attention and question the validity of the assumption that baseline (prestimulus) pupil size and task‐evoked (poststimulus) pupil measures reflect the tonic and phasic firing modes of the locus coeruleus.

The confounding effects of eye blinking on pupillometry, and their remedy

Pupillometry, thanks to its strong relationship with cognitive factors and recent advancements in measuring techniques, has become popular among cognitive or neural scientists as a tool for studying the physiological processes involved in mental or neural processes. Despite this growing popularity of pupillometry, the methodological understanding of pupillometry is limited, especially regarding potential factors that may threaten pupillary measurements' validity. Eye blinking can be a factor because it frequently occurs in a manner dependent on many cognitive components and induces a pulse-like pupillary change consisting of constriction and dilation with substantive magnitude and length. We set out to characterize the basic properties of this "blink-locked pupillary response (BPR)," including the shape and magnitude of BPR and their variability across subjects and blinks, as the first step of studying the confounding nature of eye blinking. Then, we demonstrated how the dependency of eye blinking on cognitive factors could confound, via BPR, the pupillary responses that are supposed to reflect the cognitive states of interest. By building a statistical model of how the confounding effects of eye blinking occur, we proposed a probabilistic-inference algorithm of de-confounding raw pupillary measurements and showed that the proposed algorithm selectively removed BPR and enhanced the statistical power of pupillometry experiments. Our findings call for attention to the presence and confounding nature of BPR in pupillometry. The algorithm we developed here can be used as an effective remedy for the confounding effects of BPR on pupillometry.

PuPl: an open-source tool for processing pupillometry data

We present PuPl (Pu pillometry P ipel iner), an Octave-compatible library of Matlab functions for processing pupillometry data with an easy-to-use graphical user interface (GUI). PuPl's preprocessing tools include blink correction, data smoothing, and gaze correction. PuPl can also define and sort trials, and segment data to isolate event-related pupil dilation responses. PuPl's flexible tabular export tools enable a wide variety of statistical analyses. Furthermore, PuPl can translate GUI interactions into a Matlab script, enabling easy creation and reconfiguration of reusable data processing pipelines. Finally, PuPl is designed to be extensible, and users can easily contribute functionality as best practices for pupillometry evolve. Here we demonstrate PuPl by replicating published results using publicly available data. PuPl can be downloaded from github.com/kinleyid/pupl .

Subjective optimality in finite sequential decision-making

Many decisions in life are sequential and constrained by a time window. Although mathematically derived optimal solutions exist, it has been reported that humans often deviate from making optimal choices. Here, we used a secretary problem, a classic example of finite sequential decision-making, and investigated the mechanisms underlying individuals' suboptimal choices. Across three independent experiments, we found that a dynamic programming model comprising subjective value function explains individuals' deviations from optimality and predicts the choice behaviors under fewer and more opportunities. We further identified that pupil dilation reflected the levels of decision difficulty and subsequent choices to accept or reject the stimulus at each opportunity. The value sensitivity, a model-based estimate that characterizes each individual's subjective valuation, correlated with the extent to which individuals' physiological responses tracked stimuli information. Our results provide model-based and physiological evidence for subjective valuation in finite sequential decision-making, rediscovering human suboptimality in subjectively optimal decision-making processes.

Working memory relates to individual differences in speech category learning: Insights from computational modeling and pupillometry

Across two experiments, we examine the relationship between individual differences in working memory (WM) and the acquisition of non-native speech categories in adulthood. While WM is associated with individual differences in a variety of learning tasks, successful acquisition of speech categories is argued to be contingent on WM-independent procedural-learning mechanisms. Thus, the role of WM in speech category learning is unclear. In Experiment 1, we show that individuals with higher WM acquire non-native speech categories faster and to a greater extent than those with lower WM. In Experiment 2, we replicate these results and show that individuals with higher WM use more optimal, procedural-based learning strategies and demonstrate more distinct speech-evoked pupillary responses for correct relative to incorrect trials. We propose that higher WM may allow for greater stimulus-related attention, resulting in more robust representations and optimal learning strategies. We discuss implications for neurobiological models of speech category learning.

Acute exercise effects on inhibitory control and the pupillary response in young adults

Previous research has established an impact of acute exercise on cognitive performance, which has inspired investigations into neurobiological mechanisms that may underlie the observed benefits. Pupillary responses have been posited to reflect activation of such underlying neurobiological mechanisms. The current study recruited healthy young adults to investigate the effects of a single bout of moderate-to-vigorous intensity aerobic exercise on subsequent performance and pupillary responses during an inhibitory control task. Results showed that an acute bout of exercise was related to shorter reaction times and increased tonic pupil dilation during an inhibitory control task. Although pupillary responses did not mediate the acute exercise effect on inhibitory control, higher cardiorespiratory fitness was associated with greater phasic pupil dilation following exercise relative to seated rest. The current study supported the plausibility of the pupillary response as a marker of LC-NE system activation that is sensitive to acute exercise. Whether pupillary responses could account for transient benefits of acute exercise on brain and cognition remains unclear.

Spectral signature and behavioral consequence of spontaneous shifts of pupil-linked arousal in human

Arousal levels perpetually rise and fall spontaneously. How markers of arousal—pupil size and frequency content of brain activity—relate to each other and influence behavior in humans is poorly understood. We simultaneously monitored magnetoencephalography and pupil in healthy volunteers at rest and during a visual perceptual decision-making task. Spontaneously varying pupil size correlates with power of brain activity in most frequency bands across large-scale resting state cortical networks. Pupil size recorded at prestimulus baseline correlates with subsequent shifts in detection bias (c) and sensitivity (d’). When dissociated from pupil-linked state, prestimulus spectral power of resting state networks still predicts perceptual behavior. Fast spontaneous pupil constriction and dilation correlate with large-scale brain activity as well but not perceptual behavior. Our results illuminate the relation between central and peripheral arousal markers and their respective roles in human perceptual decision-making.

Stimulus-specific plasticity in human visual gamma-band activity and functional connectivity

Under natural conditions, the visual system often sees a given input repeatedly. This provides an opportunity to optimize processing of the repeated stimuli. Stimulus repetition has been shown to strongly modulate neuronal-gamma band synchronization, yet crucial questions remained open. Here we used magnetoencephalography in 30 human subjects and find that gamma decreases across ≈10 repetitions and then increases across further repetitions, revealing plastic changes of the activated neuronal circuits. Crucially, increases induced by one stimulus did not affect responses to other stimuli, demonstrating stimulus specificity. Changes partially persisted when the inducing stimulus was repeated after 25 minutes of intervening stimuli. They were strongest in early visual cortex and increased interareal feedforward influences. Our results suggest that early visual cortex gamma synchronization enables adaptive neuronal processing of recurring stimuli. These and previously reported changes might be due to an interaction of oscillatory dynamics with established synaptic plasticity mechanisms.

Separable pupillary signatures of perception and action during perceptual multistability

The pupil provides a rich, non-invasive measure of the neural bases of perception and cognition and has been of particular value in uncovering the role of arousal-linked neuromodulation, which alters both cortical processing and pupil size. But pupil size is subject to a multitude of influences, which complicates unique interpretation. We measured pupils of observers experiencing perceptual multistability-an ever-changing subjective percept in the face of unchanging but inconclusive sensory input. In separate conditions, the endogenously generated perceptual changes were either task-relevant or not, allowing a separation between perception-related and task-related pupil signals. Perceptual changes were marked by a complex pupil response that could be decomposed into two components: a dilation tied to task execution and plausibly indicative of an arousal-linked noradrenaline surge, and an overlapping constriction tied to the perceptual transient and plausibly a marker of altered visual cortical representation. Constriction, but not dilation, amplitude systematically depended on the time interval between perceptual changes, possibly providing an overt index of neural adaptation. These results show that the pupil provides a simultaneous reading on interacting but dissociable neural processes during perceptual multistability, and suggest that arousal-linked neuromodulator release shapes action but not perception in these circumstances.

Auditory spatial attention gradients and cognitive control as a function of vigilance

Selection and effort are central to attention, yet it is unclear whether they draw on a common pool of cognitive resources, and if so, whether there are differences for early versus later stages of cognitive processing. This study assessed effort by quantifying the vigilance decrement, and spatial processing at early and later stages as a function of time-on-task. Participants performed an auditory spatial attention task, with occasional "catch" trials requiring no response. Psychophysiological measures included bilateral cerebral blood flow (transcranial Doppler), pupil dilation, and blink rate. The shape of attention gradients using reaction time indexed early processing, and did not significantly vary over time. Later stimulus-response conflict was comparable over time, except for a reduction to left hemispace stimuli. Target and catch trial accuracy decreased with time, with a more abrupt decrease for catch versus target trials. Diffusion decision modeling found progressive decreases in information accumulation rate and non-decision time, and the adoption of more liberal response criteria. Cerebral blood flow increased from baseline and then decreased over time, particularly in the left hemisphere. Blink rate steadily increased over time, while pupil dilation increased only at the beginning and then returned towards baseline. The findings suggest dissociations between resources for selectivity and effort. Measures of high subjective effort and temporal declines in catch trial accuracy and cerebral blood flow velocity suggest a standard vigilance decrement was evident in parallel with preserved selection. Different attentional systems and classes of computations that may account for dissociations between selectivity versus effort are discussed.

The costs (and benefits) of effortful listening on context processing: A simultaneous electrophysiology, pupillometry, and behavioral study

There is an apparent disparity between the fields of cognitive audiology and cognitive electrophysiology as to how linguistic context is used when listening to perceptually challenging speech. To gain a clearer picture of how listening effort impacts context use, we conducted a pre-registered study to simultaneously examine electrophysiological, pupillometric, and behavioral responses when listening to sentences varying in contextual constraint and acoustic challenge in the same sample. Participants (N = 44) listened to sentences that were highly constraining and completed with expected or unexpected sentence-final words ("The prisoners were planning their escape/party") or were low-constraint sentences with unexpected sentence-final words ("All day she thought about the party"). Sentences were presented either in quiet or with +3 dB SNR background noise. Pupillometry and EEG were simultaneously recorded and subsequent sentence recognition and word recall were measured. While the N400 expectancy effect was diminished by noise, suggesting impaired real-time context use, we simultaneously observed a beneficial effect of constraint on subsequent recognition memory for degraded speech. Importantly, analyses of trial-to-trial coupling between pupil dilation and N400 amplitude showed that when participants' showed increased listening effort (i.e., greater pupil dilation), there was a subsequent recovery of the N400 effect, but at the same time, higher effort was related to poorer subsequent sentence recognition and word recall. Collectively, these findings suggest divergent effects of acoustic challenge and listening effort on context use: while noise impairs the rapid use of context to facilitate lexical semantic processing in general, this negative effect is attenuated when listeners show increased effort in response to noise. However, this effort-induced reliance on context for online word processing comes at the cost of poorer subsequent memory.

Circuit mechanisms for the chemical modulation of cortex-wide network interactions and behavioral variability

Influential theories postulate distinct roles of catecholamines and acetylcholine in cognition and behavior. However, previous physiological work reported similar effects of these neuromodulators on the response properties (specifically, the gain) of individual cortical neurons. Here, we show a double dissociation between the effects of catecholamines and acetylcholine at the level of large-scale interactions between cortical areas in humans. A pharmacological boost of catecholamine levels increased cortex-wide interactions during a visual task, but not rest. An acetylcholine boost decreased interactions during rest, but not task. Cortical circuit modeling explained this dissociation by differential changes in two circuit properties: the local excitation-inhibition balance (more strongly increased by catecholamines) and intracortical transmission (more strongly reduced by acetylcholine). The inferred catecholaminergic mechanism also predicted noisier decision-making, which we confirmed for both perceptual and value-based choice behavior. Our work highlights specific circuit mechanisms for shaping cortical network interactions and behavioral variability by key neuromodulatory systems.

Pupillary Responses to Faces Are Modulated by Familiarity and Rewarding Context

Observing familiar (known, recognisable) and socially relevant (personally important) faces elicits activation in the brain’s reward circuit. Although smiling faces are often used as social rewards in research, it is firstly unclear whether familiarity and social relevance modulate the processing of faces differently, and secondly whether this processing depends on the feedback context, i.e., if it is different when smiles are delivered depending on performance or in the absence of any action (passive viewing). In this preregistered study, we compared pupillary responses to smiling faces differing in subjective familiarity and social relevance. They were displayed in a passive viewing task and in an active task (a speeded visual short-term memory task). The pupils were affected only in the active task and only by subjective familiarity. Contrary to expectations, smaller dilations were observed in response to more familiar faces. Behavioural ratings supported the superior rewarding context of the active task, with higher reward ratings for the game than the passive task. This study offers two major insights. Firstly, familiarity plays a role in the processing of social rewards, as known and unknown faces influence the autonomic responses differently. Secondly, the feedback context is crucial in reward research as positive stimuli are rewarding when they are dependent on performance.

Pupil Dilation and the Slow Wave ERP Reflect Surprise about Choice Outcome Resulting from Intrinsic Variability in Decision Confidence

Central to human and animal cognition is the ability to learn from feedback in order to optimize future rewards. Such a learning signal might be encoded and broadcasted by the brain's arousal systems, including the noradrenergic locus coeruleus. Pupil responses and the positive slow wave component of event-related potentials reflect rapid changes in the arousal level of the brain. Here, we ask whether and how these variables may reflect surprise: the mismatch between one's expectation about being correct and the outcome of a decision, when expectations fluctuate due to internal factors (e.g., engagement). We show that during an elementary decision task in the face of uncertainty both physiological markers of phasic arousal reflect surprise. We further show that pupil responses and slow wave event-related potential are unrelated to each other and that prediction error computations depend on feedback awareness. These results further advance our understanding of the role of central arousal systems in decision-making under uncertainty.

Ocular measures during associative learning predict recall accuracy

The ability to form associations between stimuli and commit those associations to memory is a cornerstone of human cognition. Dopamine and noradrenaline are critical neuromodulators implicated in a range of cognitive functions, including learning and memory. Eye blink rate (EBR) and pupil diameter have been shown to index dopaminergic and noradrenergic activity. Here, we examined how these ocular measures relate to accuracy in a paired-associate learning task where participants (N = 73) learned consistent object-location associations over eight trials consisting of pre-trial fixation, encoding, delay, and retrieval epochs. In order to examine how within-subject changes and between-subject changes in ocular metrics related to accuracy, we mean centered individual metric values on each trial based on within-person and across-subject means for each epoch. Within-participant variation in EBR was positively related to accuracy in both encoding and delay epochs: faster EBR within the individual predicted better retrieval. Differences in EBR across participants was negatively related to accuracy in the encoding epoch and in early trials of the pre-trial fixation: faster EBR, relative to other subjects, predicted poorer retrieval. Visual scanning behavior in pre-trial fixation and delay epochs was also positively related to accuracy in early trials: more scanning predicted better retrieval. We found no relationship between pupil diameter and accuracy. These results provide novel evidence supporting the utility of ocular metrics in illuminating cognitive and neurobiological mechanisms of paired-associate learning.

The effect of monetary reward on listening effort and sentence recognition

Recently we showed that higher reward results in increased pupil dilation during listening (listening effort). Remarkably, this effect was not accompanied with improved speech reception. Still, increased listening effort may reflect more in-depth processing, potentially resulting in a better memory representation of speech. Here, we investigated this hypothesis by also testing the effect of monetary reward on recognition memory performance. Twenty-four young adults performed speech reception threshold (SRT) tests, either hard or easy, in which they repeated sentences uttered by a female talker masked by a male talker. We recorded the pupil dilation response during listening. Participants could earn a high or low reward and the four conditions were presented in a blocked fashion. After each SRT block, participants performed a visual sentence recognition task. In this task, the sentences that were presented in the preceding SRT task were visually presented in random order and intermixed with unfamiliar sentences. Participants had to indicate whether they had previously heard the sentence or not. The SRT and sentence recognition were affected by task difficulty but not by reward. Contrary to our previous results, peak pupil dilation did not reflect effects of reward. However, post-hoc time course analysis (GAMMs) revealed that in the hard SRT task, the pupil response was larger for high than low reward. We did not observe an effect of reward on visual sentence recognition. Hence, the current results provide no conclusive evidence that the effect of monetary reward on the pupil response relates to the memory encoding of speech.

Pupil Dilation Is Sensitive to Semantic Ambiguity and Acoustic Degradation

Speech comprehension is challenged by background noise, acoustic interference, and linguistic factors, such as the presence of words with more than one meaning (homonyms and homophones). Previous work suggests that homophony in spoken language increases cognitive demand. Here, we measured pupil dilation—a physiological index of cognitive demand—while listeners heard high-ambiguity sentences, containing words with more than one meaning, or well-matched low-ambiguity sentences without ambiguous words. This semantic-ambiguity manipulation was crossed with an acoustic manipulation in two experiments. In Experiment 1, sentences were masked with 30-talker babble at 0 and +6 dB signal-to-noise ratio (SNR), and in Experiment 2, sentences were heard with or without a pink noise masker at –2 dB SNR. Speech comprehension was measured by asking listeners to judge the semantic relatedness of a visual probe word to the previous sentence. In both experiments, comprehension was lower for high- than for low-ambiguity sentences when SNRs were low. Pupils dilated more when sentences included ambiguous words, even when no noise was added (Experiment 2). Pupil also dilated more when SNRs were low. The effect of masking was larger than the effect of ambiguity for performance and pupil responses. This work demonstrates that the presence of homophones, a condition that is ubiquitous in natural language, increases cognitive demand and reduces intelligibility of speech heard with a noisy background.

Choices change the temporal weighting of decision evidence

Many decisions result from the accumulation of decision-relevant information (evidence) over time. Even when maximizing decision accuracy requires weighting all the evidence equally, decision-makers often give stronger weight to evidence occurring early or late in the evidence stream. Here, we show changes in such temporal biases within participants as a function of intermittent judgments about parts of the evidence stream. Human participants performed a decision task that required a continuous estimation of the mean evidence at the end of the stream. The evidence was either perceptual (noisy random dot motion) or symbolic (variable sequences of numbers). Participants also reported a categorical judgment of the preceding evidence half-way through the stream in one condition or executed an evidence-independent motor response in another condition. The relative impact of early versus late evidence on the final estimation flipped between these two conditions. In particular, participants' sensitivity to late evidence after the intermittent judgment, but not the simple motor response, was decreased. Both the intermittent response as well as the final estimation reports were accompanied by nonluminance-mediated increases of pupil diameter. These pupil dilations were bigger during intermittent judgments than simple motor responses and bigger during estimation when the late evidence was consistent than inconsistent with the initial judgment. In sum, decisions activate pupil-linked arousal systems and alter the temporal weighting of decision evidence. Our results are consistent with the idea that categorical choices in the face of uncertainty induce a change in the state of the neural circuits underlying decision-making.NEW & NOTEWORTHY The psychology and neuroscience of decision-making have extensively studied the accumulation of decision-relevant information toward a categorical choice. Much fewer studies have assessed the impact of a choice on the processing of subsequent information. Here, we show that intermittent choices during a protracted stream of input reduce the sensitivity to subsequent decision information and transiently boost arousal. Choices might trigger a state change in the neural machinery for decision-making.

Phasic activity of the locus-coeruleus is not a mediator of the relationship between fitness and inhibition in college-aged adults

Aerobic fitness is consistently and robustly associated with superior performance on assessments of cognitive control. One potential mechanism underlying this phenomenon is activation of the locus-coeruleus. Specifically, individuals with greater aerobic fitness may be better able to sustain engagement in a cognitively demanding task via a superior ability to meet the metabolic demands of this neural system. Accordingly, the present investigation examined 1) the relationship between aerobic fitness and phasic activation of the locus-coeruleus (indexed using pupillometry) and 2) the potential mediating influence of locus-coeruleus activity on the relationship between aerobic fitness and cognitive task performance. Participants performed an inhibition task while their pupillary responses were measured using an infrared eye tracker. A VO_2max test was then performed to determine individuals' aerobic fitness levels. Consistent with previous research, higher levels of aerobic fitness were related to shorter reaction time. However, phasic activity of the locus-coeruleus did not mediate this relationship - nor did it relate to aerobic fitness level. These results suggest that aerobic fitness does not relate to differences in locus-coeruleus activity in the context of cognitive control in college-aged adults.

Aerobic fitness relates to superior exact and approximate arithmetic processing in college-aged adults

BACKGROUND

Aerobic fitness relates to superior math achievement, but the underlying reasons remain unclear. This study tested how more efficient processing (efficiency hypothesis) or enhanced allocation of cognitive resources (resources hypothesis) underly fitness-related differences in arithmetic cognition in a sample of 138 college-aged adults.

METHOD

Participants completed an arithmetic task while pupillary measures were recorded prior to an aerobic fitness test.

RESULTS

Higher aerobic fitness was associated with shorter reaction time for all problems and greater pupillary reactivity for problems requiring approximate and exact arithmetic.

CONCLUSIONS

Superior aerobic fitness relates to greater cognitive resources available to execute exact and approximate arithmetic faster. Fitness-related differences in math achievement may be driven by the cognitive resources underlying arithmetic strategy. These differences may extend beyond educational achievement and affect the motivation to engage in health behaviors based on quantitative information. Thus, improving cardiovascular fitness has the potential to also ameliorate health numeracy.

'Defrosting' music chills with naltrexone: The role of endogenous opioids for the intensity of musical pleasure

The endogenous opioid system has been implicated during experiences of pleasure (i.e., from food or sex). Music can elicit intense emotional and bodily sensations of pleasure, called 'Chills'. We investigated the effects of an opioid antagonist (50 mg naltrexone) or placebo (40 μg d3-vitamin) while listening to self-selected music or other 'control' music selected by another participant. We used a novel technique of continuous measurement of pleasantness with an eye tracker system, where participants shifted their eyes along a visual analogue scale, in the semblance of a thermometer so that, as the music unfolded, gaze positions indicated the self-reported hedonic experience. Simultaneously, we obtained pupil diameters. Self-reported pleasure remained unchanged by naltrexone, which - however - selectively decreased pupillary diameters during 'Chills'. Hence, the endogenous μ-opioid signaling is not necessary for subjective enjoyment of music but an opioid blockade dampens pupil responses to peak pleasure, consistent with decreased arousal to the music.

Modeling pupil responses to rapid sequential events

Pupil size is an easily accessible, noninvasive online indicator of various perceptual and cognitive processes. Pupil measurements have the potential to reveal continuous processing dynamics throughout an experimental trial, including anticipatory responses. However, the relatively sluggish (~2 s) response dynamics of pupil dilation make it challenging to connect changes in pupil size to events occurring close together in time. Researchers have used models to link changes in pupil size to specific trial events, but such methods have not been systematically evaluated. Here we developed and evaluated a general linear model (GLM) pipeline that estimates pupillary responses to multiple rapid events within an experimental trial. We evaluated the modeling approach using a sample dataset in which multiple sequential stimuli were presented within 2-s trials. We found: (1) Model fits improved when the pupil impulse response function (PuRF) was fit for each observer. PuRFs varied substantially across individuals but were consistent for each individual. (2) Model fits also improved when pupil responses were not assumed to occur simultaneously with their associated trial events, but could have non-zero latencies. For example, pupil responses could anticipate predictable trial events. (3) Parameter recovery confirmed the validity of the fitting procedures, and we quantified the reliability of the parameter estimates for our sample dataset. (4) A cognitive task manipulation modulated pupil response amplitude. We provide our pupil analysis pipeline as open-source software (Pupil Response Estimation Toolbox: PRET) to facilitate the estimation of pupil responses and the evaluation of the estimates in other datasets.