How does reward compete with goal-directed and stimulus-driven shifts of attention?

From learned value to sustained bias: how reward conditioning changes attentional priority

Introduction

Attentional bias to reward-associated stimuli can occur even when it interferes with goal-driven behavior. One theory posits that dopaminergic signaling in the striatum during reward conditioning leads to changes in visual cortical and parietal representations of the stimulus used, and this, in turn, sustains attentional bias even when reward is discontinued. However, only a few studies have examined neural activity during both rewarded and unrewarded task phases.

Methods

In the current study, participants first completed a reward-conditioning phase, during which responses to certain stimuli were associated with monetary reward. These stimuli were then included as non-predictive cues in a spatial cueing task. Participants underwent functional brain imaging during both task phases.

Results

The results show that striatal activity during the learning phase predicted increased visual cortical and parietal activity and decreased ventro-medial prefrontal cortex activity in response to conditioned stimuli during the test. Striatal activity was also associated with anterior cingulate cortex activation when the reward-conditioned stimulus directed attention away from the target.

Discussion

Our findings suggest that striatal activity during reward conditioning predicts the degree to which reward history biases attention through learning-induced changes in visual and parietal activities.

Attention biases the process of risky decision-making: Evidence from eye-tracking

Attention determines what kind of option information is processed during risky choices owing to the limitation of visual attention. This paper reviews research on the relationship between higher-complexity risky decision-making and attention as illustrated by eye-tracking to explain the process of risky decision-making by the effect of attention. We demonstrate this process from three stages: the pre-phase guidance of options on attention, the process of attention being biased, and the impact of attention on final risk preference. We conclude that exogenous information can capture attention directly to salient options, thereby altering evidence accumulation. In particular, for multi-attribute risky decision-making, attentional advantages increase the weight of specific attributes, thus biasing risk preference in different directions. We highlight the significance of understanding how people use available information to weigh risks from an information-processing perspective via process data.

The influence of single-session reward-based attentional bias modification on attentional biases towards threat as measured by the N2pc component

Attentional biases toward threatening faces have repeatedly been studied in the context of social anxiety, with etiological theories suggesting exacerbated biases as a possible cause for the latter. To counteract these postulated effects, research has focused on the concept of attentional bias manipulation (ABM), in which spatial contingencies between succeeding stimuli are traditionally employed in training paradigms designed to deliberately shift automatic attention processes away from threat-related stimuli. The ABM research field has been faced with various methodological challenges, such as inconsistent results, low reliabilities of dependent variables and a high susceptibility to moderating factors. We aimed to combine several recent approaches to address these issues. Drawing upon theories of value-driven attention, we explored reward-based contingencies in a Dot Probe task to improve the training's efficacy, combined with neurophysiological measures for greater reliability compared to reaction times, while evaluating the moderating effect of explicitness in the instruction. In a healthy sample (N = 60) and within a single session, we found a general attentional bias toward angry faces present across all conditions as indicated by the N2pc, which was, however, marked by large intrinsic lateralization effects, with submeasures exhibiting opposing polarities. This prompted us to explore an alternative, intrahemispheric calculation method. The new N2pc variant showed the attentional bias to have disappeared at the end of the training session within the explicit instruction group. Reliabilities of the main dependent variables were varied from excellent to questionable, which, together with the exploratory nature of the analysis, leaves this result as preliminary.

Visual reflexive attention as a useful measure of development

Cognitive psychology began over three-quarters of a century ago and we have learned a great deal in that time, including concerning the development of cognitive abilities such as perception, attention, and memory, all of which develop across infancy and childhood. Attention is one aspect of cognition that is vital to success in a variety of life activities and, arguably, the foundation of memory, learning, problem solving, decision making, and other cognitive activities. The cognitive abilities of later childhood and adulthood generally appear to depend on the reflexes, abilities, and skills of infancy. Research in developmental cognitive science can help us understand adult cognition and know when to intervene when cognitive function is at risk. This area of research can be challenging because, even in typical development, the course of cognitive development for a particular child does not always improve monotonically. In addition, the typical trajectory of this development has been understood differently from different historical perspectives. Neither the history of thought that has led to our current understanding of attention (including its various types) nor the importance of developmental aspects of attention are frequently covered in training early career researchers, especially those whose primary area of research in not attention. My goal is to provide a review that will be useful especially to those new to research in the subfield of attention. Sustained attention in adults and children has been well-studied, but a review of the history of thought on the development of reflexive attention with a focus on infancy is overdue. Therefore, I draw primarily on historical and modern literature and clarify confusing terminology as it has been used over time. I conclude with examples of how cognitive development research can contribute to scientific and applied progress.

Electrophysiological evidence for the effects of pain on the different stages of reward evaluation under a purchasing situation

Pain and reward have crucial roles in determining human behaviors. It is still unclear how pain influences different stages of reward processing. This study aimed to assess the physical pain’s impact on reward processing with event-related potential (ERP) method. In the present study, a flash sale game (reward-seeking task) was carried out, in which the participants were instructed to press a button as soon as possible to obtain the earphone (a reward) after experiencing either electric shock or not and finally evaluated the outcome of their response. High-temporal-resolution electroencephalogram data were simultaneously recorded to reveal the neural mechanism underlying the pain effect. The ERP analyses revealed that pain affected the feedback processing reflected by feedback-related negativity (FRN) and P300. Specifically, participants in the nopain situation exhibited greater FRN discrepancy between success and failure feedbacks relative to that in the pain situation. Moreover, the P300 amplitude was enhanced in the nopain condition compared to the pain condition regardless of the feedback valence. These results demonstrate that the pain reduced the sensitivity to the reward valence at the early stage and weakened the motivational salience at the late stage. Altogether, this study extends the understanding of the effect of pain on reward processing from the temporal perspective under a purchasing situation.

Task relevance and negative reward modulate the disengagement deficit of patients with spatial neglect

Though motivational value is a recognized trigger of approach and avoidance behavior, less is known about the potential of reward to capture attention. We here explored whether positive or negative reward modulates the characteristic deficit of patients with left spatial neglect to disengage attention from an ipsilesional distracter. We built our study on recent observations showing that the disengagement deficit is exaggerated for distracters with target-defining features, indicating that task-relevance captures attention. Patients with left neglect and matched healthy controls were asked to react to lateralized, colored targets preceded by a peripheral cue. Crucially, the cue either possessed the color of the target and was thus task-relevant, or was followed by a positive, negative, or neutral symbolic reward. Neglect patients only exhibited a disengagement deficit when cues were task-relevant or were followed by a negative reward. This finding indicates that attentional selection is driven by task-relevance and negative reward, possibly through interactions between limbic and attention networks.

Dynamic modulation of neural feedback processing and attention during spatial probabilistic learning

Learned stimulus-reward associations can modulate behavior and the underlying neural processing of information. We investigated the cascade of these neurocognitive mechanisms involved in the learning of spatial stimulus-reward associations. Using electroencephalogram recordings while participants performed a probabilistic spatial reward learning task, we observed that the feedback-related negativity component was more negative in response to loss feedback compared to gain feedback but showed no modulation by learning. The late positive component became larger in response to losses as the learning set progressed but smaller in response to gains. In addition, feedback-locked alpha frequency oscillations measured over occipital sites were predictive of N2pc amplitudes—a marker of spatial attention orienting—observed on the next trial. This relationship was found to become stronger with learning set progression. Taken together, we elucidated neurocognitive dynamics underlying feedback processing during spatial reward learning, and the subsequent effects of these learned spatial stimulus-reward associations on spatial attention.

•

We can learn which spatial location relates to the highest probability of reward

•

Neural processing of feedback valence was not influenced by learning

•

LPC amplitude was dynamically modulated by learning, reflecting context updating

•

Feedback-locked alpha power was predictive of ensuing orientation of attention

Reward-driven modulation of spatial attention in the human frontal eye-field

Attentional selection and the decision of where to make an eye-movement are driven by various factors such as the representation of salience, task goal, and stimulus relevance, as well as expectations or predictions based on past experience. Brain systems implicated in these processes recruit cortico-subcortical areas including the Frontal Eye-Field (FEF), parietal cortex, or superior colliculus. How these areas interact to govern attention remains elusive. Priority maps of space have been observed in several brain regions, but the neural substrates where different sources of information are combined and integrated to guide attentional selection has not been elucidated. We investigated here the neural mechanisms subserving how reward cues influence the voluntary deployment of attention, in conditions where stimulus-driven capture and task-related goals compete for attention selection. Using fMRI in a visual search task in n = 23 participants, we found a selective modulation of FEF by the reward value of distractors during attentional shifts, particularly after high-predictive cueing to invalid locations. Reward information also modulated FEF connectivity to superior colliculus, striatum, and visual cortex. We conclude that FEF may occupy a central position within brain circuits integrating different sources of top-down biases for the generation of spatial saliency maps and guidance of selective attention.

The past, present, and future of selection history

The last ten years of attention research have witnessed a revolution, replacing a theoretical dichotomy (top-down vs. bottom-up control) with a trichotomy (biased by current goals, physical salience, and selection history). This third new mechanism of attentional control, selection history, is multifaceted. Some aspects of selection history must be learned over time whereas others reflect much more transient influences. A variety of different learning experiences can shape the attention system, including reward, aversive outcomes, past experience searching for a target, target‒non-target relations, and more. In this review, we provide an overview of the historical forces that led to the proposal of selection history as a distinct mechanism of attentional control. We then propose a formal definition of selection history, with concrete criteria, and identify different components of experience-driven attention that fit within this definition. The bulk of the review is devoted to exploring how these different components relate to one another. We conclude by proposing an integrative account of selection history centered on underlying themes that emerge from our review.

Fear of Missing Out Predicts Distraction by Social Reward Signals Displayed on a Smartphone in Difficult Driving Situations

Smartphones are particularly likely to elicit driver distraction with obvious negative repercussions on road safety. Recent selective attention models lead to expect that smartphones might be very effective in capturing attention due to their social reward history. Hence, individual differences in terms of Fear of Missing Out (FoMO) – i.e., of the apprehension of missing out on socially rewarding experiences – should play an important role in driver distraction. This factor has already been associated with self-reported estimations of greater attention paid to smartphones while driving, but the potential link between FoMO and smartphone-induced distraction has never been tested empirically. Therefore, we conducted a preliminary study to investigate whether FoMO would modulate attentional capture by reward distractors displayed on a smartphone. First, participants performed a classical visual search task in which neutral stimuli (colored circles) were associated with high or low social reward outcomes. Then, they had to detect a pedestrian or a roe deer in driving scenes with various levels of fog density. The social reward stimuli were displayed as distractors on the screen of a smartphone embedded in the pictures. The results showed a significant three-way interaction between FoMO, social reward distraction, and task difficulty. More precisely, under attention-demanding conditions (i.e., high-fog density), individual FoMO scores predicted attentional capture by social reward distractors, with longer reaction times (RTs) for high rather than low social reward distractors. These results highlight the importance to consider reward history and FoMO when investigating smartphone-based distraction. Limitations are discussed, notably regarding our sample characteristics (i.e., mainly young females) that might hamper the generalization of our findings to the overall population. Future research directions are provided.

Differing Time Courses of Reward-Related Attentional Processing: An EEG Source-Space Analysis

Since our environment typically contains more information than can be processed at any one time due to the limited capacity of our visual system, we are bound to differentiate between relevant and irrelevant information. This process, termed attentional selection, is usually categorized into bottom-up and top-down processes. However, recent research suggests reward might also be an important factor in guiding attention. Monetary reward can bias attentional selection in favor of task-relevant targets and reduce the efficiency of visual search when a reward-associated, but task-irrelevant distractor is present. This study is the first to investigate reward-related target and distractor processing in an additional singleton task using neurophysiological measures and source space analysis. Based on previous studies, we hypothesized that source space analysis would find enhanced neural activity in regions of the value-based attention network, such as the visual cortex and the anterior cingulate. Additionally, we went further and explored the time courses of the underlying attentional mechanisms. Our neurophysiological results showed that rewarding distractors led to a stronger attentional capture. In line with this, we found that reward-associated distractors (compared with reward-associated targets) enhanced activation in frontal regions, indicating the involvement of top-down control processes. As hypothesized, source space analysis demonstrated that reward-related targets and reward-related distractors elicited activation in regions of the value-based attention network. However, these activations showed time-dependent differences, indicating that the neural mechanisms underlying reward biasing might be different for task-relevant and task-irrelevant stimuli.

Different effects of reward value and saliency during bumblebee visual search for multiple rewarding targets

Several animals, including bees, use visual search to distinguish targets of interest and ignore distractors. While bee flower choice is well studied, we know relatively little about how they choose between multiple rewarding flowers in complex floral environments. Two factors that could influence bee visual search for multiple flowers are the saliency (colour contrast against the background) and the reward value of flowers. We here investigated how these two different factors contribute to bee visual search. We trained bees to independently recognize two rewarding flower types that, in different experiments, differed in either saliency, reward value or both. We then measured their choices and attention to these flowers in the presence of distractors in a test without reinforcement. We found that bees preferred more salient or higher rewarding flowers and ignored distractors. When the high-reward flowers were less salient than the low-reward flowers, bees were nonetheless equally likely to choose high-reward flowers, for the reward and saliency values we used. Bees were also more likely to attend to these high-reward flowers, spending higher inspection times around them and exhibiting faster search times when choosing them. When flowers differed in reward, we also found an effect of the training order with low-reward targets being more likely to be chosen if they had been encountered during the more immediate training session prior to the test. Our results parallel recent findings from humans demonstrating that reward value can attract attention even when targets are less salient and irrelevant to the current task.

Examining cognitive control and reward interactions in adolescent externalizing symptoms

During adolescence, rapid development and reorganization of the dopaminergic system supports increasingly sophisticated reward learning and the ability to exert behavioral control. Disruptions in the ability to exert control over previously rewarded behavior may underlie some forms of adolescent psychopathology. Specifically, symptoms of externalizing psychopathology may be associated with difficulties in flexibly adapting behavior in the context of reward. However, the direct interaction of cognitive control and reward learning in adolescent psychopathology symptoms has not yet been investigated. The present study used a Research Domain Criteria framework to investigate whether behavioral and neuronal indices of inhibition to previously rewarded stimuli underlie individual differences in externalizing symptoms in N = 61 typically developing adolescents. Using a task that integrates the Monetary Incentive Delay and Go-No-Go paradigms, we observed a positive association between externalizing symptoms and activation of the left middle frontal gyrus during response inhibition to cues with a history of reward. These associations were robust to controls for internalizing symptoms and neural recruitment during inhibition of cues with no reward history. Our findings suggest that inhibitory control over stimuli with a history of reward may be a useful marker for future inquiry into the development of externalizing psychopathology in adolescence.

Reward history impacts attentional orienting and inhibitory control on untrained tasks

It has been robustly shown that stimuli with reward history receive attentional priority. However, the majority of this research tests reward history effects on attentional bias using similar tasks for both the reward learning phase and the unrewarded testing phase, which limits our understanding of how the effects of reward history generalize beyond the trained tasks and mental sets. Across two new experiments, the current study addresses these issues by first associating reward with a stimulus in a visual search paradigm, and then testing value-driven effects of that stimulus in untrained and unrewarded tasks, including a cueing paradigm, a go/no-go task, and a delay discounting task. Results of Experiment 1 demonstrate that history of reward association in a visual search task generalizes to value-driven attentional bias in a different attention paradigm (i.e., cueing), indicating these effects are indeed attributable to imbued value that can transfer to other tasks beyond that in which the reward was trained. The results of Experiment 2 demonstrate that in addition to eliciting attentional orienting on untrained tasks, reward history can lead to better inhibitory control in the go/no-go task. We find no evidence for reward history effects in the delay discounting task. Together, these experiments demonstrate that when the reward association task is in the attention domain, reward history modulates attentional priority, and this effect generalizes to untrained and unrewarded tasks that utilize both spatial and nonspatial attention.

Attention Capture of Non-target Emotional Faces: An Evidence From Reward Learning

The aim of this study was to explore whether reward learning would affect the processing of targets when an emotional stimulus was task irrelevant. In the current study, using a visual search paradigm to establish an association between emotional faces and reward, an emotional face appeared as a task-irrelevant distractor during the test after reward learning, and participants were asked to judge the orientation of a line on the face. In experiment 1, no significant difference was found between the high reward-fear distractor condition and the no reward-neutral condition, but the response times of the high reward-fear condition were significantly longer than those of the low reward-happy condition. In experiment 2, there was no significant difference in participants' performance between high reward-happy and no reward-neutral responses. In addition, response times of the low reward-fear condition wear significantly longer than those of the high reward-happy and no reward-neutral conditions. The results show that reward learning affects attention bias of task-irrelevant emotional faces even when reward is absent. Moreover, the high reward selection history is more effective in weakening the emotional advantage of the processing advantage than the low reward.

Reward sensitivity predicts dopaminergic response in spatial neglect

It has recently been revealed that spatial neglect can be modulated by motivational factors including anticipated monetary reward. A number of dopaminergic agents have been evaluated as treatments for neglect, but the results have been mixed, with no clear anatomical or cognitive predictors of dopaminergic responsiveness. Given that the effects of incentive motivation are mediated by dopaminergic pathways that are variably damaged in stroke, we tested the hypothesis that the modulatory influences of reward and dopaminergic drugs on neglect are themselves related. We employed a single-dose, double-blind, crossover design to compare the effects of Co-careldopa and placebo on a modified visual cancellation task in patients with neglect secondary to right hemisphere stroke. Whilst confirming that reward improved visual search in this group, we showed that dopaminergic stimulation only enhances visual search in the absence of reward. When patients were divided into REWARD-RESPONDERs and REWARD-NON-RESPONDERs, we found an interaction, such that only REWARD-NON-RESPONDERs showed a positive response to reward after receiving Co-careldopa, whereas REWARD-RESPONDERs were not influenced by drug. At a neuroanatomical level, responsiveness to incentive motivation was most associated with intact dorsal striatum. These findings suggest that dopaminergic modulation of neglect follows an 'inverted U' function, is dependent on integrity of the reward system, and can be measured as a behavioural response to anticipated reward.

Measuring attention to reward as an individual trait: the value-driven attention questionnaire (VDAQ)

Reward history is a powerful determinant of what we pay attention to. This influence of reward on attention varies substantially across individuals, being related to a variety of personality variables and clinical conditions. Currently, the ability to measure and quantify attention-to-reward is restricted to the use of psychophysical laboratory tasks, which limits research into the construct in a variety of ways. In the present study, we introduce a questionnaire designed to provide a brief and accessible means of assessing attention-to-reward. Scores on the questionnaire correlate with other measures known to be related to attention-to-reward and predict performance on multiple laboratory tasks measuring the construct. In demonstrating this relationship, we also provide evidence that attention-to-reward as measured in the lab, an automatic and implicit bias in information processing, is related to overt behaviors and motivations in everyday life as assessed via the questionnaire. Variation in scores on the questionnaire is additionally associated with a distinct biomarker in brain connectivity, and the questionnaire exhibits acceptable test-retest reliability. Overall, the Value-Driven Attention Questionnaire (VDAQ) provides a useful proxy-measure of attention-to-reward that is much more accessible than typical laboratory assessments.

Do Reward-Related Distractors Impair Cognitive Performance? Perhaps Not

Over a hundred prior studies show that reward-related distractors capture attention. It is less clear, however, whether and when reward-related distractors affect performance on tasks that require cognitive control. In this experiment, we examined whether reward-related distractors impair performance during a demanding arithmetic task. Participants (N = 81) solved math problems, while they were exposed to task-irrelevant stimuli that were previously associated with monetary rewards (vs. not). Although we found some evidence for reward learning in the training phase, results from the test phase showed no evidence that reward-related distractors harm cognitive performance. This null effect was invariant across different versions of our task. We examined the results further with Bayesian analyses, which showed positive evidence for the null. Altogether, the present study showed that reward-related distractors did not harm performance on a mental arithmetic task. When considered together with previous studies, the present study suggests that the negative impact of reward-related distractors on cognitive control is not as straightforward as it may seem, and that more research is needed to clarify the circumstances under which reward-related distractors harm cognitive control.

Dollars do not determine detection: Monetary value associated with unexpected objects does not affect the likelihood of inattentional blindness

Conscious perception often fails when an object appears unexpectedly and our attention is focused elsewhere (inattentional blindness). Although various factors have been identified that modulate the likelihood of this failure of awareness, it is not clear whether the monetary reward value associated with an object can affect whether or not this object is detected under conditions of inattention. We hypothesised that unexpectedly appearing objects that contain a feature linked to high value, as established via reward learning in a previous task, would subsequently be detected more frequently than objects containing a feature linked to low value. A total of 537 participants first learned the association between a perceptual feature (colour) and subsequent reward values (high, low, or none reward). Afterwards, participants were randomly assigned to a static (Experiment 1) or dynamic (Experiment 2) inattentional blindness task including an unexpected object associated with high, low, or none reward. However, no significant effect of the previously learned value on the subsequent likelihood of detection was observed. We speculate that artificial monetary value, which is known to affect attentional capture, is not strong enough to determine whether or not an object is consciously perceived.

Involuntary sensory enhancement of gain- and loss-associated tones: A general relevance principle

In a recent event-related potential (ERP) study (Folyi et al., 2016), we have demonstrated that sensory processing of task-irrelevant tones is enhanced when they were previously associated with positive or negative (by the means of monetary gains and losses, respectively) affective meaning relative to tones with neutral meaning, as indexed by the enhancement of the auditory N1-amplitude. In the present study, (1) in line with the hypothesis of affective counter-regulation, we investigated whether positive versus negative tones can receive differential attentional enhancement, depending on motivational context (Experiment 1); and (2) whether the early facilitation of positive and negative tones can operate strictly outside of the focus of voluntary attention (Experiment 2). In Experiment 1, we replicated the basic N1 valence effect, but found no moderation by motivational context. In Experiment 2, we found a small valence effect on the N1. By combining data from the three experiments (i.e., our previous experiment and the present ones; N = 72), we found a clear enhancement of N1-amplitudes for valenced tones without moderation by experiment. This pattern of results suggests comparable early attentional enhancement of valenced tones in general: (a) despite different level of concurrent task-relevant attentional and motivational demands in these experiments; and (b) without prioritizing one valence category over another, supporting our claim that the general relevance of the tones with high motivational value that governs early attentional facilitation.

Influence of reward learning on visual attention and eye movements in a naturalistic environment: A virtual reality study

Rewards constitute crucial signals that motivate approach behavior and facilitate the perceptual processing of objects associated with favorable outcomes in past encounters. Reward-related influences on perception and attention have been reliably observed in studies where a reward is paired with a unidimensional low-level visual feature, such as the color or orientation of a line in visual search tasks. However, our environment is drastically different and composed of multidimensional and changing visual features, encountered in complex and dynamic scenes. Here, we designed an immersive virtual reality (VR) experiment using a 4-frame CAVE system to investigate the impact of rewards on attentional orienting and gaze patterns in a naturalistic and ecological environment. Forty-one healthy participants explored a virtual forest and responded to targets appearing on either the left or right side of their path. To test for reward-induced biases in spatial orienting, targets on one side were associated with high reward, whereas those on the opposite side were paired with a low reward. Eye-movements recording showed that left-side high rewards led to subsequent increase of eye gaze fixations towards this side of the path, but no such asymmetry was found after exposure to right-sided high rewards. A milder spatial bias was also observed after left-side high rewards during subsequent exploration of a virtual castle yard, but not during route turn choices along the forest path. Our results indicate that reward-related influences on attention and behavior may be better learned in left than right space, in line with a right hemisphere dominance, and could generalize to another environment to some extent, but not to spatial choices in another decision task, suggesting some domain- or context-specificity. This proof-of-concept study also outlines the advantages and the possible drawbacks of the use of the 3D CAVE immersive platform for VR in neuroscience.

Can Monetary Reward Modulate Social Attention?

Selective visual attention is a primary cognitive function, which allows the selection of the most relevant stimuli in the environment by prioritizing their processing. Several studies showed that this process can be influenced by both social signals, such as gaze direction (i.e., the Gaze Cueing Effect, GCE) and by the motivational valence of gratifying stimuli, such as monetary rewards. The aim of this study was to explore whether GCE could be modulated by a monetary reward. To this end, we created an experiment in which participants performed a gaze cuing task before and after an implicit learning task aiming to induce an association between gaze direction and monetary reward (experimental condition), or after a perceptual task (control condition). Statistical analyses were conducted following both a frequentist and a Bayesian approach. Results supported previous findings showing the presence of the GCE, i.e., faster responses in congruent trials when the target appeared in the gazed-at location. Interestingly, our results did not reveal significant differences among the conditions. Therefore, contrary to what was reported by previous attentional orienting studies with non-social stimuli, monetary reward does not seem to be able to modulate (or interfere with) the orienting of attention mediated by gaze direction as measured by the GCE. Taken together our results suggest that social signals such as gaze direction have a greater impact than monetary reward in orienting selective attention.

Value-driven attentional capture in neglect

OBJECTIVE

Recent studies suggest that motivational cues such as rewards may be a powerful determinant of attentional selection, both in healthy subjects and in brain-damaged patients suffering from neglect. However, the exact brain mechanisms underlying these effects and their relation to other well-known attentional systems are still poorly known.

METHODS

We designed a visual search paradigm to examine how value-based attentional priority could modulate spatial orienting in patients with pathological biases due to neglect after right hemispheric stroke. Targets were preceded by exogenous valid or invalid spatial cues, in the presence or absence of distractors that were associated with high reward values subsequent to an initial reinforcement training phase.

RESULTS

We found that the learned reward value of distractors interfered with spatial reorienting toward the left (neglected) side when neglect patients were invalidly cued to the right side. Moreover, the presence of reward-associated distractors in the contralesional field interfered most with the detection of task-relevant targets on the same side, and this interference was exaggerated with more severe neglect. Voxelwise anatomical lesion analysis indicated that damage to the right angular gyrus, as well as lateral occipital and inferior temporal areas of the right hemisphere, were associated with stronger value-driven attentional effects.

CONCLUSIONS

Visual stimuli previously associated with rewards receive higher attentional priority during visual search despite pathological spatial biases due to neglect, and thus interfere with orienting to contralesional targets, presumably by competing with top-down mechanisms controlling exogenous spatial attention. Reward signals may bias neural activity evoked by visual stimuli, independent of conscious control, through a common priority map integrating several different attentional influences. These results do not only provide novel insights to link spatial orienting and motivational signals within current models of attention, but also open new perspectives that may usefully be exploited for neurological rehabilitation strategies in patients suffering from attentional deficits and neglect.

Cross-modal integration during value-driven attentional capture

A growing body of evidence suggests that reward may be a powerful determinant of attentional selection. To date, the study of value-based attentional capture has been mainly focused on the visual sensory modality. It is yet unknown how reward information is communicated and integrated across the different senses in order to resolve between competing choices during selective attention. Our study investigated the interference produced by an auditory reward-associated distractor when a semantically-related visual target was concurrently presented. We measured both manual and saccadic response times towards a target image (drum or trumpet), while an irrelevant sound (congruent or incongruent instrument) was heard. Each sound was previously associated with either a high or a low reward. We found that manual responses were slowed by a high-reward auditory distractor when sound and image were semantically congruent. A similar effect was observed for saccadic responses, but only for participants aware of the past reward contingencies. Auditory events associated with reward value were thus capable of involuntarily capturing attention in the visual modality. This reward effect can mitigate cross-modal semantic integration and appears to be differentially modulated by awareness for saccadic vs. manual responses. Together, our results extend previous work on value-driven attentional biases in perception by showing that these may operate across sensory modalities and override cross-modal integration for semantically-related stimuli. This study sheds new light on the potential implication of brain regions underlying value-driven attention across sensory modalities.

Reward-associated distractors can harm cognitive performance

When people carry out cognitive tasks, they sometimes suffer from distractions, that is, drops in performance that occur close in time to task-irrelevant stimuli. In this research, we examine how the pursuit of rewards contributes to distractions. In two experiments, participants performed a math task (in which they could earn monetary rewards vs. not) while they were exposed to task-irrelevant stimuli (that were previously associated with monetary rewards vs. not). In Experiment 1, irrelevant cues that were previously associated with rewards (vs. not) impaired performance. In Experiment 2, this effect was only replicated when these reward-associated distractors appeared relatively early during task performance. While the results were thus somewhat mixed, they generally support the idea that reward associations can augment the negative effect of distractors on performance.

Language Learning Enhanced by Massive Multiple Online Role-Playing Games (MMORPGs) and the Underlying Behavioral and Neural Mechanisms

Massive Multiple Online Role-Playing Games (MMORPGs) have increased in popularity among children, juveniles, and adults since MMORPGs' appearance in this digital age. MMORPGs can be applied to enhancing language learning, which is drawing researchers' attention from different fields and many studies have validated MMORPGs' positive effect on language learning. However, there are few studies on the underlying behavioral or neural mechanism of such effect. This paper reviews the educational application of the MMORPGs based on relevant macroscopic and microscopic studies, showing that gamers' overall language proficiency or some specific language skills can be enhanced by real-time online interaction with peers and game narratives or instructions embedded in the MMORPGs. Mechanisms underlying the educational assistant role of MMORPGs in second language learning are discussed from both behavioral and neural perspectives. We suggest that attentional bias makes gamers/learners allocate more cognitive resources toward task-related stimuli in a controlled or an automatic way. Moreover, with a moderating role played by activation of reward circuit, playing the MMORPGs may strengthen or increase functional connectivity from seed regions such as left anterior insular/frontal operculum (AI/FO) and visual word form area to other language-related brain areas.

How Does Awareness Modulate Goal-Directed and Stimulus-Driven Shifts of Attention Triggered by Value Learning?

In order to behave adaptively, attention can be directed in space either voluntarily (i.e., endogenously) according to strategic goals, or involuntarily (i.e., exogenously) through reflexive capture by salient or novel events. The emotional or motivational value of stimuli can also strongly influence attentional orienting. However, little is known about how reward-related effects compete or interact with endogenous and exogenous attention mechanisms, particularly outside of awareness. Here we developed a visual search paradigm to study subliminal value-based attentional orienting. We systematically manipulated goal-directed or stimulus-driven attentional orienting and examined whether an irrelevant, but previously rewarded stimulus could compete with both types of spatial attention during search. Critically, reward was learned without conscious awareness in a preceding phase where one among several visual symbols was consistently paired with a subliminal monetary reinforcement cue. Our results demonstrated that symbols previously associated with a monetary reward received higher attentional priority in the subsequent visual search task, even though these stimuli and reward were no longer task-relevant, and despite reward being unconsciously acquired. Thus, motivational processes operating independent of conscious awareness may provide powerful influences on mechanisms of attentional selection, which could mitigate both stimulus-driven and goal-directed shifts of attention.

How motivation and reward learning modulate selective attention

Motivational stimuli such as rewards elicit adaptive responses and influence various cognitive functions. Notably, increasing evidence suggests that stimuli with particular motivational values can strongly shape perception and attention. These effects resemble both selective top-down and stimulus-driven attentional orienting, as they depend on internal states but arise without conscious will, yet they seem to reflect attentional systems that are functionally and anatomically distinct from those classically associated with frontoparietal cortical networks in the brain. Recent research in human and nonhuman primates has begun to reveal how reward can bias attentional selection, and where within the cognitive system the signals providing attentional priority are generated. This review aims at describing the different mechanisms sustaining motivational attention, their impact on different behavioral tasks, and current knowledge concerning the neural networks governing the integration of motivational influences on attentional behavior.