Pupil dilation and response slowing distinguish deliberate explorative choices in the probabilistic learning task

Atypical pupil-linked arousal induced by low-risk probabilistic choices, and intolerance of uncertainty in adults with ASD

Adults with autism spectrum disorder (ASD) experience stress when operating in a probabilistic environment, even if it is familiar, but the underlying mechanisms remain unclear. Their decision-making may be affected by the uncertainty aversion implicated in ASD and associated with increased autonomic arousal. Previous studies have shown that in neurotypical (NT) people, decisions with predictably better outcomes are less stressful and elicit smaller pupil-linked arousal than those involving exploration. Here, in a sample of 46 high-functioning ASD and NT participants, using mixed-effects model analysis, we explored pupil-linked arousal and behavioral performance in a probabilistic reward learning task with a stable advantage of one choice option over the other. We found that subjects with ASD learned and preferred advantageous probabilistic choices at the same rate and to the same extent as NT participants, both in terms of choice ratio and response time. Although both groups exhibited similar predictive behaviors, learning to favor advantageous choices led to increased pupillary arousal for these choices in the ASD group, while it caused a decrease in pupillary arousal in the NT group. Moreover, greater pupil-linked arousal during decisions with higher expected value correlated with greater degree of self-reported intolerance of uncertainty in everyday life. Our results suggest that in a nonvolatile probabilistic environment, objectively good predictive abilities in people with ASD are coupled with elevated physiological stress and subjective uncertainty regarding the decisions with the best possible but still uncertain outcome that contributes to their intolerance of uncertainty.

Pupil Size Encodes Uncertainty during Exploration

Exploration is an important part of decision making and is crucial to maximizing long-term rewards. Past work has shown that people use different forms of uncertainty to guide exploration. In this study, we investigate the role of the pupil-linked arousal system in uncertainty-guided exploration. We measured participants' (n = 48) pupil dilation while they performed a two-armed bandit task. Consistent with previous work, we found that people adopted a hybrid of directed, random, and undirected exploration, which are sensitive to relative uncertainty, total uncertainty, and value difference between options, respectively. We also found a positive correlation between pupil size and total uncertainty. Furthermore, augmenting the choice model with subject-specific total uncertainty estimates decoded from the pupil size improved predictions of held-out choices, suggesting that people used the uncertainty estimate encoded in pupil size to decide which option to explore. Together, the data shed light on the computations underlying uncertainty-driven exploration. Under the assumption that pupil size reflects locus coeruleus-norepinephrine neuromodulatory activity, these results also extend the theory of the locus coeruleus-norepinephrine function in exploration, highlighting its selective role in driving uncertainty-guided random exploration.

Losses resulting from deliberate exploration trigger beta oscillations in frontal cortex

We examined the neural signature of directed exploration by contrasting MEG beta (16-30 Hz) power changes between disadvantageous and advantageous choices in the two-choice probabilistic reward task. We analyzed the choices made after the participants have learned the probabilistic contingency between choices and their outcomes, i.e., acquired the inner model of choice values. Therefore, rare disadvantageous choices might serve explorative, environment-probing purposes. The study brought two main findings. Firstly, decision making leading to disadvantageous choices took more time and evidenced greater large-scale suppression of beta oscillations than its advantageous alternative. Additional neural resources recruited during disadvantageous decisions strongly suggest their deliberately explorative nature. Secondly, an outcome of disadvantageous and advantageous choices had qualitatively different impact on feedback-related beta oscillations. After the disadvantageous choices, only losses-but not gains-were followed by late beta synchronization in frontal cortex. Our results are consistent with the role of frontal beta oscillations in the stabilization of neural representations for selected behavioral rule when explorative strategy conflicts with value-based behavior. Punishment for explorative choice being congruent with its low value in the reward history is more likely to strengthen, through punishment-related beta oscillations, the representation of exploitative choices consistent with the inner utility model.

Value-driven modulation of visual perception by visual and auditory reward cues: The role of performance-contingent delivery of reward

Perception is modulated by reward value, an effect elicited not only by stimuli that are predictive of performance-contingent delivery of reward (PC) but also by stimuli that were previously rewarded (PR). PC and PR cues may engage different mechanisms relying on goal-driven versus stimulus-driven prioritization of high value stimuli, respectively. However, these two modes of reward modulation have not been systematically compared against each other. This study employed a behavioral paradigm where participants' visual orientation discrimination was tested in the presence of task-irrelevant visual or auditory reward cues. In the first phase (PC), correct performance led to a high or low monetary reward dependent on the identity of visual or auditory cues. In the subsequent phase (PR), visual or auditory cues were not followed by reward delivery anymore. We hypothesized that PC cues have a stronger modulatory effect on visual discrimination and pupil responses compared to PR cues. We found an overall larger task-evoked pupil dilation in PC compared to PR phase. Whereas PC and PR cues both increased the accuracy of visual discrimination, value-driven acceleration of reaction times (RTs) and pupillary responses only occurred for PC cues. The modulation of pupil size by high reward PC cues was strongly correlated with the modulation of a combined measure of speed and accuracy. These results indicate that although value-driven modulation of perception can occur even when reward delivery is halted, stronger goal-driven control elicited by PC reward cues additionally results in a more efficient balance between accuracy and speed of perceptual choices.