The attribution of value-based attentional priority in individuals with depressive symptoms

Trichotomy revisited: A monolithic theory of attentional control

The control of attention was long held to reflect the influence of two competing mechanisms of assigning priority, one goal-directed and the other stimulus-driven. Learning-dependent influences on the control of attention that could not be attributed to either of those two established mechanisms of control gave rise to the concept of selection history and a corresponding third mechanism of attentional control. The trichotomy framework that ensued has come to dominate theories of attentional control over the past decade, replacing the historical dichotomy. In this theoretical review, I readily affirm that distinctions between the influence of goals, salience, and selection history are substantive and meaningful, and that abandoning the dichotomy between goal-directed and stimulus-driven mechanisms of control was appropriate. I do, however, question whether a theoretical trichotomy is the right answer to the problem posed by selection history. If we reframe the influence of goals and selection history as different flavors of memory-dependent modulations of attentional priority and if we characterize the influence of salience as a consequence of insufficient competition from such memory-dependent sources of priority, it is possible to account for a wide range of attention-related phenomena with only one mechanism of control. The monolithic framework for the control of attention that I propose offers several concrete advantages over a trichotomy framework, which I explore here.

Aberrant reward learning, but not negative reinforcement learning, is related to depressive symptoms: an attentional perspective

BACKGROUND

Aberrant reward functioning is implicated in depression. While attention precedes behavior and guides higher-order cognitive processes, reward learning from an attentional perspective - the effects of prior reward-learning on subsequent attention allocation - has been mainly overlooked.

METHODS

The present study explored the effects of reward-based attentional learning in depression using two separate, yet complimentary, studies. In study 1, participants with high (HD) and low (LD) levels of depression symptoms were trained to divert their gaze toward one type of stimuli over another using a novel gaze-contingent music reward paradigm - music played when fixating the desired stimulus type and stopped when gazing the alternate one. Attention allocation was assessed before, during, and following training. In study 2, using negative reinforcement, the same attention allocation pattern was trained while substituting the appetitive music reward for gazing the desired stimulus type with the removal of an aversive sound (i.e. white noise).

RESULTS

In study 1 both groups showed the intended shift in attention allocation during training (online reward learning), while generalization of learning at post-training was only evident among LD participants. Conversely, in study 2 both groups showed post-training generalization. Results were maintained when introducing anxiety as a covariate, and when using a more powerful sensitivity analysis. Finally, HD participants showed higher learning speed than LD participants during initial online learning, but only when using negative, not positive, reinforcement.

CONCLUSIONS

Deficient generalization of learning characterizes the attentional system of HD individuals, but only when using reward-based positive reinforcement, not negative reinforcement.

On the reliability of value-modulated attentional capture: An online replication and multiverse analysis

Stimuli predicting rewards are more likely to capture attention, even when they are not relevant to our current goals. Individual differences in value-modulated attentional capture (VMAC) have been associated with various psychopathological conditions in the scientific literature. However, the claim that this attentional bias can predict individual differences requires further exploration of the psychometric properties of the most common experimental paradigms. The current study replicated the VMAC effect in a large online sample (N = 182) and investigated the internal consistency, with a design that allowed us to measure the effect during learning (rewarded phase) and after acquisition, once feedback was omitted (unrewarded phase). Through the rewarded phase there was gradual increase of the VMAC effect, which did not decline significantly throughout the unrewarded phase. Furthermore, we conducted a reliability multiverse analysis for 288 different data preprocessing specifications across both phases. Specifications including more blocks in the analysis led to better reliability estimates in both phases, while specifications that removed more outliers also improved reliability, suggesting that specifications with more, but less noisy, trials led to better reliability estimates. Nevertheless, in most instances, especially those considering fewer blocks of trials, reliability estimates fell below the minimum recommended thresholds for research on individual differences. Given the present results, we encourage researchers working on VMAC to take into account reliability when designing studies aimed at capturing individual differences and provide recommendations to improve methodological practices.

Rewarding outcomes enhance attentional capture and delay attentional disengagement

Attentional capture and disengagement are distinct process involved in attentional orienting. Most current studies have examined either the process of attentional capture or disengagement by manipulating stimuli associated with either positive (gains) or negative outcomes (losses). However, few studies have investigated whether attentional capture and disengagement are modulated by reward and loss outcomes. In the current study, we want to examine whether positive or negative outcomes could modulate distinguishing process of attentional capture and disengagement. Here, we manipulated different colored singleton stimuli associated with reward or loss outcomes; these stimuli were either presented at the center of screen or at the peripheral location. The participants' task was to search the target and identify the orientation of line segment in target as quickly as possible. The results showed that people had difficulty disengaging from a central reward-distractor, in comparison to loss- and neutral-distractor when target was presented at peripheral location. Similarly, peripheral reward-distractor captured more attention than loss- and neutral-distractor when target was presented at the center of screen after central fixation disappeared. Through our discoveries, we can conclude that positive rewards can increase attentional capture and delay attentional disengagement in healthy people.

Combined influence of valence and statistical learning on the control of attention II: Evidence from within-domain additivity

Attention is biased in favor of stimuli that signal either threat or reward; this experience-dependent attentional bias develops via associative learning and persists into extinction. Physically salient yet task-irrelevant stimuli are also prioritized by the attention system, but the attentional priority of a physically salient distractor can be suppressed when it appears in a location in which it has been frequently encountered in the past. Similar effects of statistical learning on distractor suppression have been observed for distractors appearing in a predictable color. A pair of recent studies demonstrate that statistically learned distractor suppression and valence-based attentional biases combine additively, suggesting independent influences of learning on attentional priority. One limitation of these prior studies, however, is that the effects of statistical learning were defined with respect to spatial attention and the effects of associative learning with respect to feature-based attention. A strong version of the independence account would predict additive influences on attention even when both sources of priority are represented within a single domain of attentional control, which we tested in the present study. The attentional priority of a distractor was elevated when its color was previously associated with electric shock and reduced when its shape was frequently encountered as a distractor in a prior training phase, with these two influences on priority combining additively. Our findings provide strong evidence for the idea that statistical learning and valance-based associative learning exert independent influences on the control of attention, which has implications for contemporary theories of selection history.

Altered neural correlates of optimal decision-making in individuals with depressive status

Making optimal decisions by computing risk and benefit is necessary for humans. However, whether individuals with depressive status could utilize the optimal strategy to guide decision and its neural correlates remain unclear. The current study explored these issues by combining a decision task and high temporal-resolution electroencephalogram (EEG). The decision task involved an eight-box trial in which participants successively decided whether to open a box containing a potential reward or punishment, deciding to stop guaranteed they would retain the rewards already accumulated. Theoretically, the optimal strategy in the task was to stop at the fourth box, which had the largest expected value. We found that individuals with depressive status stopped fewer trials at the fourth box, relative to healthy controls, indicating their impaired optimal strategy during decision-making. Moreover, compared to healthy controls, individuals with depressive status showed weaker P2 amplitude and weaker beta-band oscillation at the frontocentral scalp when deciding whether to open the fourth box. Additionally, for healthy controls but not for individuals with depressive status, the P2 amplitude fully mediated the relationship between participants' degree of expected benefit (as reflected by the recreational risk-taking scale) and the frequency of trials stopped at the fourth box. Overall, this study revealed that the P2 amplitude and beta-band oscillation might explain the altered optimal decision-making in individuals with depressive status.

Diminishing sensitivity and absolute difference in value-driven attention

Kim and Beck (2020b) demonstrated that value-driven attention is based on relative value rather than absolute value, suggesting that prospect theory is relevant to our understanding of value-driven attention. To further this understanding, the present study investigated the impacts of diminishing sensitivity on value-driven attention. According to diminishing sensitivity, changes in outcomes have greater impacts nearer the reference point of 0 than farther from the point. Thus, the difference between $1 and $100 looms larger than that between $901 and $1000, due to their different ratios (100/1 > 1000/901). However, according to the absolute difference hypothesis, the differences should have similar impacts due to the absolute differences being the same (100 – 1 = 1000 – 901). Experiment 1 investigated whether diminishing sensitivity operates in the modified value-driven attention paradigm while controlling the impact of absolute differences. In the training phase, 100-point and 1000-point color targets had references of 1-point and 901-point color targets, respectively. In the test phase, 100-point color distractors attracted attention more than 1000-point color distractors, supporting the diminishing sensitivity hypothesis. Experiment 2 examined the absolute difference hypothesis while controlling the impact of diminishing sensitivity. Contrary to the absolute difference hypothesis, the test phase showed that 1000-point color distractors (compared with 10-point colors for a 990 absolute difference in the training phase) failed to attract attention more than 100-point color distractors (compared with 1-point colors, for a 99 absolute difference). These results suggest that diminishing sensitivity rather than absolute difference influences value-driven attention, further supporting the relevance of prospect theory to value-driven attention.

The past, present, and future of selection history

The last ten years of attention research have witnessed a revolution, replacing a theoretical dichotomy (top-down vs. bottom-up control) with a trichotomy (biased by current goals, physical salience, and selection history). This third new mechanism of attentional control, selection history, is multifaceted. Some aspects of selection history must be learned over time whereas others reflect much more transient influences. A variety of different learning experiences can shape the attention system, including reward, aversive outcomes, past experience searching for a target, target‒non-target relations, and more. In this review, we provide an overview of the historical forces that led to the proposal of selection history as a distinct mechanism of attentional control. We then propose a formal definition of selection history, with concrete criteria, and identify different components of experience-driven attention that fit within this definition. The bulk of the review is devoted to exploring how these different components relate to one another. We conclude by proposing an integrative account of selection history centered on underlying themes that emerge from our review.

Dynamic Interplay between Reward and Voluntary Attention Determines Stimulus Processing in Visual Cortex

Reward enhances stimulus processing in the visual cortex, but the mechanisms through which this effect occurs remain unclear. Reward prospect can both increase the deployment of voluntary attention and increase the salience of previously neutral stimuli. In this study, we orthogonally manipulated reward and voluntary attention while human participants performed a global motion detection task. We recorded steady-state visual evoked potentials to simultaneously measure the processing of attended and unattended stimuli linked to different reward probabilities, as they compete for attentional resources. The processing of the high rewarded feature was enhanced independently of voluntary attention, but this gain diminished once rewards were no longer available. Neither the voluntary attention nor the salience account alone can fully explain these results. Instead, we propose how these two accounts can be integrated to allow for the flexible balance between reward-driven increase in salience and voluntary attention.

Awareness is necessary for attentional biases by location-reward association

Many studies have reported attentional biases based on feature-reward associations. However, the effects of location-reward associations on attentional selection remain less well-understood. Unlike feature cases, a previous study that induced participants' awareness of the location-reward association by instructing them to look for a high-reward location has suggested the critical role of goal-driven manipulations in such associations. In this study, we investigated whether the reward effect occurred without goal-driven manipulations if participants were spontaneously aware of the location-reward association. We conducted three experiments using a visual search task that included four circles where participants received rewards; one possible target location was associated with a high reward, and another with a low reward. In Experiment 1, the target was presented among distractors, and participants had to search for the target. The results showed a faster reaction time in the high-reward rather than the low-reward locations only in participants aware of the location-reward association, even if they were not required to look for the association. Moreover, in Experiment 2, we replicated the main findings of Experiment 1, even when the target had an abrupt visual onset to restrict goal-driven manipulations. Furthermore, Experiment 3 confirmed that the effect observed in Experiment 2 could not be attributed to the initial eye position. These findings suggest that goal-driven manipulations are unnecessary for inducing reward biases to high-reward locations. We concluded that awareness of the association rather than goal-driven manipulations is crucial for the location-reward effect.

A randomized controlled trial of gaze-contingent music reward therapy for major depressive disorder

BACKGROUND

Heightened attention allocation toward negative-valanced information and reduced attention allocation toward positive-valanced information represent viable targets for attention bias modification in major depressive disorder. Accordingly, we conducted a randomized controlled trial testing the efficacy of a novel gaze-contingent attention bias modification procedure for major depressive disorder.

METHOD

Sixty patients with major depressive disorder were randomly assigned to either eight training sessions of feedback-based gaze-contingent music reward therapy designed to divert patients' gaze toward positive over sad stimuli, or to a control condition which entailed eight sessions of gaze-noncontingent music. Clinician-rated and self-reported measures of depression, and proportion of dwell-time on sad faces, were assessed pretreatment, posttreatment, and at a 3-month follow-up.

RESULTS

Gaze-contingent music reward therapy produced a greater reduction in dwell-time on sad faces compared with the control condition, but it failed to generalize to novel faces. Both groups manifested similarly significant reductions in depression symptoms from pre- to posttreatment that were maintained at follow-up. Exploratory analyses suggest that first-episode patients may benefit more from this therapy than patients with a history of multiple episodes.

CONCLUSIONS

Gaze-contingent music reward therapy can modify attention biases in depression, but clear differential clinical effects did not emerge. Theoretical and practical implications are discussed.

Compulsivity is measurable across distinct psychiatric symptom domains and is associated with familial risk and reward-related attentional capture

BACKGROUND

Compulsivity can be seen across various mental health conditions and refers to a tendency toward repetitive habitual acts that are persistent and functionally impairing. Compulsivity involves dysfunctional reward-related circuitry and is thought to be significantly heritable. Despite this, its measurement from a transdiagnostic perspective has received only scant research attention. Here we examine both the psychometric properties of a recently developed compulsivity scale, as well as its relationship with compulsive symptoms, familial risk, and reward-related attentional capture.

METHODS

Two-hundred and sixty individuals participated in the study (mean age = 36.0 [SD = 10.8] years; 60.0% male) and completed the Cambridge-Chicago Compulsivity Trait Scale (CHI-T), along with measures of psychiatric symptoms and family history thereof. Participants also completed a task designed to measure reward-related attentional capture (n = 177).

RESULTS

CHI-T total scores had a normal distribution and acceptable Cronbach's alpha (0.84). CHI-T total scores correlated significantly and positively (all p < 0.05, Bonferroni corrected) with Problematic Usage of the Internet, disordered gambling, obsessive-compulsive symptoms, alcohol misuse, and disordered eating. The scale was correlated significantly with history of addiction and obsessive-compulsive related disorders in first-degree relatives of participants and greater reward-related attentional capture.

CONCLUSIONS

These findings suggest that the CHI-T is suitable for use in online studies and constitutes a transdiagnostic marker for a range of compulsive symptoms, their familial loading, and related cognitive markers. Future work should more extensively investigate the scale in normative and clinical cohorts, and the role of value-modulated attentional capture across compulsive disorders.

Relating value-driven attention to psychopathology

Reward-associated objects receive preferential attention, reflecting a bias in information processing that develops automatically following associative learning. Mounting evidence suggests that such value-driven attention operates abnormally in certain psychopathologies, with attentional biases for reward-associated objects being either exaggerated or blunted compared to healthy controls. Here, I review the evidence linking value-driven attention to psychopathology, including drug addiction, depression, attention-deficit hyperactivity disorder (ADHD), compulsivity, and impulsive and risky decision-making. I conclude by offering an integrative framework for conceptualizing the link between value-driven attention and psychopathology, along with suggestions for future research into this burgeoning area of investigation, including research on object attachment.

The influence of the noradrenergic/stress system on perceptual biases for reward

Previous research has established a role for the norepinephrine (NE)/stress system in individual differences in biases to attend to reward or punishment. Outstanding questions concern its role in the flexibility with which such biases can be changed. The goal of this preregistered study was to examine the role of the NE/stress system in the degree to which biases can be trained along the axis of valence in the direction of reward. Participants genotyped for a common deletion variant of ADRA2b (linked to altered NE availability) experienced either an acute stress induction or a control procedure. Following stress induction, a "bias probe" task was presented before and after training. In the bias probe task, participants made forced choice judgments (happy or angry) on emotional faces with varying degrees of ambiguity. For bias training, participants viewed unambiguously angry faces in a task exploiting visual adaptation effects. The results revealed an overall shift from a slightly positive bias in categorizing faces pretraining to a more positive bias after training. Carriers of the deletion variant overall showed a more positive bias than did the noncarriers. Follow-up analyses showed that pretraining bias was a significant predictor of bias change, with those who showed a more negative bias preadaptation changing more in a positive direction. Critically, this effect was observed under control but not under stress conditions. These results suggest that the NE/stress system plays an important role in influencing trait-like biases as well as short-term changes in the tendency to perceive ambiguous stimuli as being more rewarding than threatening.

Semantic generalization of value-based attentional priority

This study aimed to determine whether attentional prioritization of stimuli associated with reward transfers across conceptual knowledge independently of physical features. Participants successively performed two color-word Stroop tasks. In the learning phase, neutral words were associated with high, low, or no monetary reward. In the generalization phase (in which no reward was delivered), synonyms of words previously paired with reward served as Stroop stimuli. Results are consistent with semantic generalization of stimulus-reward associations, with synonyms of high-value words impairing color-naming performance, although this effect was particular to participants who were unaware of the reward contingencies.

Reward-related distracters and working memory filtering

Reward-related stimuli capture attention, even when they are task irrelevant. A consequence of attentional prioritization of reward-related stimuli is that they may also have preferential access to working memory like other forms of emotional information. However, whether reward-related distracters leak into working memory remains unknown. Here, using a well-validated change detection task of visual working memory capacity and filtering, we conducted two studies to directly assess the impact of reward-related distracters on working memory. In both studies, the distracters consisted of colored bars or circles that were previously associated with monetary reward. In Experiment 1, results indicated that previously rewarded distracters did not impact behavioral measures of working memory filtering efficiency compared to neutral distracters. In Experiment 2, using ERPs, we measured the contralateral delay activity (CDA), a psychophysiological index of the number of items retained in working memory, to further assess filtering efficiency. We observed that the CDA for high reward distracters was similar to low reward and neutral distracters. However, in early trials, behavioral measures revealed that previously rewarded stimuli negatively impacted working memory capacity, an effect not observed with neutral distracters. This effect, though, was not found for the CDA in early trials. In summary, our findings across two studies suggest that attentional capture by task-irrelevant reward may have minimal impact on visual working memory-findings that have important implications for delineating the boundaries of reward-cognition interactions.

Selection history in context: Evidence for the role of reinforcement learning in biasing attention

Attention is biased towards learned predictors of reward. The influence of reward history on attentional capture has been shown to be context-specific: When particular stimulus features are associated with reward, these features only capture attention when viewed in the context in which they were rewarded. Selection history can also bias attention, such that prior target features gain priority independently of reward history. The contextual specificity of this influence of selection history on attention has not been examined. In the present study, we demonstrate that the consequences of repetitive selection on attention robustly generalize across context, such that prior target features capture attention even in contexts in which they were never seen previously. Our findings suggest that the learning underlying attention driven by outcome-independent selection history differs qualitatively from the learning underlying value-driven attention, consistent with a distinction between associative and reinforcement learning mechanisms.

Reward-related attentional capture is associated with severity of addictive and obsessive-compulsive behaviors

A cue that signals reward can capture attention and elicit approach behaviors in people and animals. The current study examined whether attentional capture by reward-related cues is associated with severity of addiction-related and obsessive–compulsive behaviors. Participants were recruited via Mechanical Turk and included 143 adults (M_age = 34 years, SD = 8.5; 43% female) who had endorsed at least 1 addiction-related or obsessive–compulsive behavior in the past month. All assessment components were delivered via the Internet and included questionnaires to assess severity of compulsivity-related problems across addiction-related and obsessive–compulsive behaviors, as well as a visual search task to measure reward-related attentional capture. Reward-related attentional capture was associated with severity of compulsivity, transdiagnostically. These findings have implications for understanding the mechanisms that underlie compulsive behaviors and suggest that reward-related attentional capture is a promising transdiagnostic cognitive risk marker for compulsivity.

Measuring attention to reward as an individual trait: the value-driven attention questionnaire (VDAQ)

Reward history is a powerful determinant of what we pay attention to. This influence of reward on attention varies substantially across individuals, being related to a variety of personality variables and clinical conditions. Currently, the ability to measure and quantify attention-to-reward is restricted to the use of psychophysical laboratory tasks, which limits research into the construct in a variety of ways. In the present study, we introduce a questionnaire designed to provide a brief and accessible means of assessing attention-to-reward. Scores on the questionnaire correlate with other measures known to be related to attention-to-reward and predict performance on multiple laboratory tasks measuring the construct. In demonstrating this relationship, we also provide evidence that attention-to-reward as measured in the lab, an automatic and implicit bias in information processing, is related to overt behaviors and motivations in everyday life as assessed via the questionnaire. Variation in scores on the questionnaire is additionally associated with a distinct biomarker in brain connectivity, and the questionnaire exhibits acceptable test-retest reliability. Overall, the Value-Driven Attention Questionnaire (VDAQ) provides a useful proxy-measure of attention-to-reward that is much more accessible than typical laboratory assessments.

Lithium monotherapy associated longitudinal effects on resting state brain networks in clinical treatment of bipolar disorder

OBJECTIVES

Lithium is one of the most effective and specific treatments for bipolar disorder (BP), but the neural mechanisms by which lithium impacts symptoms remain unclear. Past research has been limited by a reliance on cross-sectional designs, which does not allow for identification of within-person changes due to lithium and has not examined communication between brain regions (ie, networks). In the present study, we prospectively investigated the lithium monotherapy associated effects in vivo on the brain connectome in medication-free BP patients. In particular, we examined the within-person impact of lithium treatment on connectome indices previously linked to mania and depression in bipolar disorder.

METHODS

Thirty-nine medication-free subjects - 26 BP (13 (hypo)manic and 13 depressed) and 13 closely matched healthy controls (HC) - were included. fMRI data were obtained at 3 timepoints: baseline, after 2 weeks, and after 8 weeks (total of 117 scans: 78 BP and 39 HC scans). BP subjects were clinically treated with lithium for 8 weeks while HC were scanned at the same time points but not treated. Graph theory metrics and repeated measures GLM were used to analyze lithium treatment associated effects.

RESULTS

Consistent with hypotheses, lithium treatment was associated with a normalizing effect on mania-related connectome indices. Furthermore, shifts in both mania- and depression-related connectome indices were proportional to symptom change. Finally, lithium treatment-associated impact on amygdala function differed depending on baseline mood.

CONCLUSIONS

Present findings provide deeper insight into the therapeutic neural mechanisms associated with lithium treatment.

Motivation and cognitive control in depression

Depression is linked to deficits in cognitive control and a host of other cognitive impairments arise as a consequence of these deficits. Despite of their important role in depression, there are no mechanistic models of cognitive control deficits in depression. In this paper we propose how these deficits can emerge from the interaction between motivational and cognitive processes. We review depression-related impairments in key components of motivation along with new cognitive neuroscience models that focus on the role of motivation in the decision-making about cognitive control allocation. Based on this review we propose a unifying framework which connects motivational and cognitive control deficits in depression. This framework is rooted in computational models of cognitive control and offers a mechanistic understanding of cognitive control deficits in depression.

Reward history but not search history explains value-driven attentional capture

In past years, an extensive amount of research has focused on how past experiences guide future attention. Humans automatically attend to stimuli previously associated with reward and stimuli that have been experienced during visual search, even when it is disadvantageous in present situations. Recently, the relationship between "reward history" and "search history" has been discussed critically. We review results from research on value-driven attentional capture (VDAC) with a focus on these two experience-based attentional selection processes and their distinction. To clarify inconsistencies, we examined VDAC within a design that allows a direct comparison with other mechanisms of attentional selection. Eighty-four healthy adults were trained to incidentally associate colors with reward (10 cents, 2 cents) or with no reward. In a subsequent visual search task, distraction by reward-associated and unrewarded stimuli was contrasted. In the training phase, reward signals facilitated performance. When these value-signaling stimuli appeared as distractors in the test phase, they continuously shaped attentional selection, despite their task irrelevance. Our findings clearly cannot be attributed to a history of target search. We conclude that once an association is established, value signals guide attention automatically in new situations, which can be beneficial or not, depending on the congruency with current goals.

The intrinsic neural architecture of inhibitory control: The role of development and emotional experience

Inhibitory control is a key determinant of goal-directed behavior. Its susceptibility to reward implies that its variations may not only reflect cognitive ability, but also sensitivity to goal-relevant information. Since cognitive ability and motivational sensitivity vary as a function of age and mood, we hypothesized that their relevance for predicting individual differences in inhibition would similarly vary. Here, we tested this prediction with respect to the brain's intrinsic functional architecture. Specifically, we reasoned that age and affective functioning would both moderate the relationship between inhibition and resting state expression of the dynamic neural organization patterns linked to engaging in cognitive effort versus those involved in manipulating motivationally salient information. First, we used task fMRI data from the Human Connectome Project (N = 359 participants) to identify the brain organization patterns unique to effortful cognitive processing versus manipulation of motivationally relevant information. We then assessed the association between inhibitory control and relative expression of these two neural patterns in an independent resting state dataset from the Nathan Kline Institute-Rockland lifespan sample (N = 247). As hypothesized, the relation between inhibition and intrinsic functional brain architecture varied as a function of age and affective functioning. Among those with superior affective functioning, better inhibitory control in adolescence and early adulthood was associated with stronger resting state expression of the brain pattern that typified processing of motivationally salient information. The opposite effect emerged beyond the age of 49. Among individuals with poorer affective functioning, a significant link between inhibition and brain architecture emerged only before the age of 28. In this group, superior inhibition was associated with stronger resting state expression of the neural pattern that typified effortful cognitive processing. Our results thus imply that motivational relevance makes a unique contribution to superior cognitive functioning during earlier life stages. However, its relevance to higher-order mentation decreases with aging and increased prevalence of mood-related problems, which raises the possibility that patterns of neurobehavioral responsiveness to motivational salience may constitute sensitive markers of successful lifespan development.

Dissociable neural mechanisms underlie value-driven and selection-driven attentional capture

Stimuli associated with reward acquire the ability to automatically capture attention. It is also the case that, with sufficient training, former targets can acquire the ability to capture attention in the absence of extrinsic rewards. It remains unclear whether these two experience-dependent attentional biases share a common underlying mechanism. The present study examined the influence of selection history on attentional capture, and compared its neural correlates with those of value-driven attentional capture reported in Anderson et al. (2014a). Participants completed a four-day training in visual search for a specific colour target. In a subsequent test phase, they performed visual search for a shape-defined target in which colour was task-irrelevant. Response times were slower when a former target-colour distractor was present than when it was absent, replicating attentional capture by unrewarded former targets. Neuroimaging results revealed preferential activation by a former target-colour distractor in sensory areas. A more right lateralised pattern of activation was observed, compared to attentional capture by reward cues. No distractor-evoked activity was found in the caudate tail. These results imply that attentional capture by selection history is primarily driven by plasticity in sensory areas, and that reward history and selection history influence attention via dissociable underlying mechanisms.

Neurobiology of value-driven attention

What we pay attention to is influenced by reward learning. Converging evidence points to the idea that associative reward learning changes how visual stimuli are processed in the brain, rendering learned reward cues difficult to ignore. Behavioral evidence distinguishes value-driven attention from other established control mechanisms, suggesting a distinct underlying neurobiological process. Recently, studies have begun to explore the neural substrates of this value-driven attention mechanism. Here, I review the progress that has been made in this area, and synthesize the findings to provide an integrative account of the neurobiology of value-driven attention. The proposed account can explain both attentional capture by previously rewarded targets and the modulatory effect of reward on priming, as well as the decoupling of reward history and prior task relevance in value-driven attention.

Reduced Value-Driven Attentional Capture Among Children with ADHD Compared to Typically Developing Controls

The current study examined whether children with ADHD were more distracted by a stimulus previously associated with reward, but currently goal-irrelevant, than their typically-developing peers. In addition, we also probed the associated cognitive and motivational mechanisms by examining correlations with other behavioral tasks. Participants included 8-12 year-old children with ADHD (n = 30) and typically developing controls (n = 26). Children were instructed to visually search for color-defined targets and received monetary rewards for accurate responses. In a subsequent search task in which color was explicitly irrelevant, we manipulated whether a distractor item appeared in a previously reward-associated color. We examined whether children responded more slowly on trials with the previously-rewarded distractor present compared to trials without this distractor, a phenomenon referred to as value-driven attentional capture (VDAC), and whether children with and without ADHD differed in the extent to which they displayed VDAC. Correlations among working memory performance, immediate reward preference (delay discounting) and attentional capture were also examined. Children with ADHD were significantly less affected by the presence of the previously rewarded distractor than were control participants. Within the ADHD group, greater value-driven attentional capture was associated with poorer working memory. Although both ADHD and control participants were initially distracted by previously reward-associated stimuli, the magnitude of distraction was larger and persisted longer among control participants.

Test-retest reliability of value-driven attentional capture

Attention is biased toward learned predictors of reward. The degree to which attention is automatically drawn to arbitrary reward cues has been linked to a variety of psychopathologies, including drug dependence, HIV-risk behaviors, depressive symptoms, and attention deficit/hyperactivity disorder. In the context of addiction specifically, attentional biases toward drug cues have been related to drug craving and treatment outcomes. Given the potential role of value-based attention in psychopathology, the ability to quantify the magnitude of such bias before and after a treatment intervention in order to assess treatment-related changes in attention allocation would be desirable. However, the test-retest reliability of value-driven attentional capture by arbitrary reward cues has not been established. In the present study, we show that an oculomotor measure of value-driven attentional capture produces highly robust test-retest reliability for a behavioral assessment, whereas the response time (RT) measure more commonly used in the attentional bias literature does not. Our findings provide methodological support for the ability to obtain a reliable measure of susceptibility to value-driven attentional capture at multiple points in time, and they highlight a limitation of RT-based measures that should inform the use of attentional-bias tasks as an assessment tool.

On the distinction between value-driven attention and selection history: Evidence from individuals with depressive symptoms

When predictive of extrinsic reward as targets, stimuli rapidly acquire the ability to automatically capture attention. Attentional biases for former targets of visual search also can develop without reward feedback but typically require much longer training. These learned biases towards former targets often are conceptualized within a single framework and might differ merely in degree. That is, both are the result of the reinforcement of selection history, with extrinsic reward for correct report of the target providing greater reinforcement than correct report alone. A direct test of this shared mechanisms hypothesis is lacking, however. Recent evidence demonstrates that depressed individuals present with blunted value-driven attentional biases. Based on the shared mechanisms hypothesis, we predicted that depressed individuals would similarly show blunted attentional biases for former targets following unrewarded training. To the contrary, however, we found that the effects of selection history on attention were robust and equivalent between individuals experiencing depressive symptoms and control participants, whereas attentional capture by previously reward-associated stimuli was blunted in depressed individuals. Our results suggest a qualitative distinction between the effects of reward history and the effects of selection history on attention, with depressive symptoms impairing the former while leaving the latter unaffected.

Relating Attentional Biases for Stimuli Associated with Social Reward and Punishment to Autistic Traits

Evidence for impaired attention to social stimuli in autism has been mixed. The role of social feedback in shaping attention to other, non-social stimuli that are predictive of such feedback has not been examined in the context of autism. In the present study, participants searched for a color-defined target during a training phase, with the color of the target predicting the emotional reaction of a face that appeared after each trial. Then, participants performed visual search for a shape-defined target while trying to ignore the color of stimuli. On a subset of trials, one of the non-targets was rendered in the color of a former target from training. Autistic traits were measured for each participant using the Autism Quotient (AQ). Our findings replicate robust attentional capture by stimuli learned to predict valenced social feedback. There was no evidence that autistic traits are associated with blunted attention to predictors of social outcomes. Consistent with an emerging body of literature, our findings cast doubt on strong versions of the claim that autistic traits can be explained by a blunted influence of social information on the attention system. We extend these findings to non-social stimuli that predict socially relevant information.

Selection history: How reward modulates selectivity of visual attention

Visual attention enables us to selectively prioritize or suppress information in the environment. Prominent models concerned with the control of visual attention differentiate between goal-directed, top-down and stimulus-driven, bottom-up control, with the former determined by current selection goals and the latter determined by physical salience. In the current review, we discuss recent studies that demonstrate that attentional selection does not need to be the result of top-down or bottom-up processing but, instead, is often driven by lingering biases due to the "history" of former attention deployments. This review mainly focuses on reward-based history effects; yet other types of history effects such as (intertrial) priming, statistical learning and affective conditioning are also discussed. We argue that evidence from behavioral, eye-movement and neuroimaging studies supports the idea that selection history modulates the topographical landscape of spatial "priority" maps, such that attention is biased toward locations having the highest activation on this map.

Genesis and Maintenance of Attentional Biases: The Role of the Locus Coeruleus-Noradrenaline System

Emotionally arousing events are typically better remembered than mundane ones, in part because emotionally relevant aspects of our environment are prioritized in attention. Such biased attentional tuning is itself the result of associative processes through which we learn affective and motivational relevance of cues. We propose that the locus coeruleus-noradrenaline (LC-NA) system plays an important role in the genesis of attentional biases through associative learning processes as well as their maintenance. We further propose that individual differences in and disruptions of the LC-NA system underlie the development of maladaptive biases linked to psychopathology. We provide support for the proposed role of the LC-NA system by first reviewing work on attentional biases in development and its link to psychopathology in relation to alterations and individual differences in NA availability. We focus on pharmacological manipulations to demonstrate the effect of a disrupted system as well as the ADRA2b polymorphism as a tool to investigate naturally occurring differences in NA availability. We next review associative learning processes that-modulated by the LC-NA system-result in such implicit attentional biases. Further, we demonstrate how NA may influence aversive and appetitive conditioning linked to anxiety disorders as well as addiction and depression.

On the feature specificity of value-driven attention

When an otherwise inconspicuous stimulus is learned to predict a reward, this stimulus will automatically capture visual attention. This learned attentional bias is not specific to the precise object previously associated with reward, but can be observed for different stimuli that share a defining feature with the reward cue. Under certain circumstances, value-driven attentional biases can even transfer to new contexts in which the reward cues were not previously experienced, and can also be evident for different exemplars of a stimulus category, suggesting some degree of tolerance in the scope of the underlying bias. Whether a match to a reward-predictive feature is necessary to support value-driven attention, or whether similar-looking features also receive some degree of elevated priority following associative reward learning, remains an open question. Here, I examine the impact of learned associations between reward and red- and green-colored stimuli on the processing of other colors. The findings show that even though other colors experienced during training were non-predictive with respect to reward, the speed with which targets possessing these colors were identified in a subsequent test phase was affected by their similarity to the high-value color. Thus, value-driven attentional biases for stimulus features are imprecise, as would be predicted by a sensory gain model of value-driven attention.

On the value-dependence of value-driven attentional capture

Findings from an increasingly large number of studies have been used to argue that attentional capture can be dependent on the learned value of a stimulus, or value-driven. However, under certain circumstances attention can be biased to select stimuli that previously served as targets, independent of reward history. Value-driven attentional capture, as studied using the training phase-test phase design introduced by Anderson and colleagues, is widely presumed to reflect the combined influence of learned value and selection history. However, the degree to which attentional capture is at all dependent on value learning in this paradigm has recently been questioned. Support for value-dependence can be provided through one of two means: (1) greater attentional capture by prior targets following rewarded training than following unrewarded training, and (2) greater attentional capture by prior targets previously associated with high compared to low value. Using a variant of the original value-driven attentional capture paradigm, Sha and Jiang (Attention, Perception, and Psychophysics, 78, 403-414, 2016) failed to find evidence of either, and raised criticisms regarding the adequacy of evidence provided by prior studies using this particular paradigm. To address this disparity, here we provided a stringent test of the value-dependence hypothesis using the traditional value-driven attentional capture paradigm. With a sufficiently large sample size, value-dependence was observed based on both criteria, with no evidence of attentional capture without rewards during training. Our findings support the validity of the traditional value-driven attentional capture paradigm in measuring what its name purports to measure.

Going for It

What we pay attention to is influenced by reward learning. Previously reward-associated stimuli are difficult to ignore, automatically drawing our attention even when we know they are no longer beneficial to us. Recent research has suggested that these value-dependent attentional biases affect more than just perception, biasing an individual to act in such a way as to pursue the attended stimulus. Here, I review this evidence and argue for a direct link between attentional biases and shifts in action-related priorities. Given this link, abnormal or otherwise inappropriate reward-related attentional biases are hypothesized to contribute to undesired habits and poor economic choices.

Resting State Brain Network Disturbances Related to Hypomania and Depression in Medication-Free Bipolar Disorder

Research on resting functional brain networks in bipolar disorder (BP) has been unable to differentiate between disturbances related to mania or depression, which is necessary to understand the mechanisms leading to each state. Past research has also been unable to elucidate the impact of BP-related network disturbances on the organizational properties of the brain (eg, communication efficiency). Thus, the present work sought to isolate network disturbances related to BP, fractionate these into components associated with manic and depressive symptoms, and characterize the impact of disturbances on network function. Graph theory was used to analyze resting functional magnetic resonance imaging data from 60 medication-free patients meeting the criteria for BP and either a current hypomanic (n=30) or depressed (n=30) episode and 30 closely age/sex-matched healthy controls. Correction for multiple comparisons was carried out. Compared with controls, BP patients evidenced hyperconnectivity in a network involving right amygdala. Fractionation revealed that (hypo)manic symptoms were associated with hyperconnectivity in an overlapping network and disruptions in the brain's 'small-world' network organization. Depressive symptoms predicted hyperconnectivity in a network involving orbitofrontal cortex along with a less resilient global network organization. Findings provide deeper insight into the differential pathophysiological processes associated with hypomania and depression, along with the particular impact these differential processes have on network function.

Mechanisms of habitual approach: Failure to suppress irrelevant responses evoked by previously reward-associated stimuli

Reward learning has a powerful influence on the attention system, causing previously reward-associated stimuli to automatically capture attention. Difficulty ignoring stimuli associated with drug reward has been linked to addiction relapse, and the attention system of drug-dependent patients seems especially influenced by reward history. This and other evidence suggests that value-driven attention has consequences for behavior and decision-making, facilitating a bias to approach and consume the previously reward-associated stimulus even when doing so runs counter to current goals and priorities. Yet, a mechanism linking value-driven attention to behavioral responding and a general approach bias is lacking. Here we show that previously reward-associated stimuli escape inhibitory processing in a go/no-go task. Control experiments confirmed that this value-dependent failure of goal-directed inhibition could not be explained by search history or residual motivation, but depended specifically on the learned association between particular stimuli and reward outcome. When a previously high-value stimulus is encountered, the response codes generated by that stimulus are automatically afforded high priority, bypassing goal-directed cognitive processes involved in suppressing task-irrelevant behavior. (PsycINFO Database Record

Value-driven attentional capture in the auditory domain

It is now well established that the visual attention system is shaped by reward learning. When visual features are associated with a reward outcome, they acquire high priority and can automatically capture visual attention. To date, evidence for value-driven attentional capture has been limited entirely to the visual system. In the present study, I demonstrate that previously reward-associated sounds also capture attention, interfering more strongly with the performance of a visual task. This finding suggests that value-driven attention reflects a broad principle of information processing that can be extended to other sensory modalities and that value-driven attention can bias cross-modal stimulus competition.

The attention habit: how reward learning shapes attentional selection

There is growing consensus that reward plays an important role in the control of attention. Until recently, reward was thought to influence attention indirectly by modulating task-specific motivation and its effects on voluntary control over selection. Such an account was consistent with the goal-directed (endogenous) versus stimulus-driven (exogenous) framework that had long dominated the field of attention research. Now, a different perspective is emerging. Demonstrations that previously reward-associated stimuli can automatically capture attention even when physically inconspicuous and task-irrelevant challenge previously held assumptions about attentional control. The idea that attentional selection can be value driven, reflecting a distinct and previously unrecognized control mechanism, has gained traction. Since these early demonstrations, the influence of reward learning on attention has rapidly become an area of intense investigation, sparking many new insights. The result is an emerging picture of how the reward system of the brain automatically biases information processing. Here, I review the progress that has been made in this area, synthesizing a wealth of recent evidence to provide an integrated, up-to-date account of value-driven attention and some of its broader implications.

Reward, attention, and HIV-related risk in HIV+ individuals

Human immunodeficiency virus (HIV) is often contracted through engaging in risky reward-motivated behaviors such as needle sharing and unprotected sex. Understanding the factors that make an individual more vulnerable to succumbing to the temptation to engage in these risky behaviors is important to limiting the spread of HIV. One potential source of this vulnerability concerns the degree to which an individual is able to resist paying attention to irrelevant reward information. In the present study, we examine this possible link by characterizing individual differences in value-based attentional bias in a sample of HIV+ individuals with varying histories of risk-taking behavior. Participants learned associations between experimental stimuli and monetary reward outcome. The degree of attentional bias for these reward-associated stimuli, reflected in their ability to capture attention when presented as task-irrelevant distractors, was then assessed both immediately and six months following reward learning. Value-driven attentional capture was related to substance abuse history and non-planning impulsiveness during the time leading up to contraction of HIV as measured via self-report. These findings suggest a link between the ability to ignore reward-associated information and prior HIV-related risk-taking behavior. Additionally, particular aspects of HIV-associated neurocognitive disorders were related to attentional bias, including motor deficits commonly associated with HIV-induced damage to the basal ganglia.

Social reward shapes attentional biases

Paying attention to stimuli that predict a reward outcome is important for an organism to survive and thrive. When visual stimuli are associated with tangible, extrinsic rewards such as money or food, these stimuli acquire high attentional priority and come to automatically capture attention. In humans and other primates, however, many behaviors are not motivated directly by such extrinsic rewards, but rather by the social feedback that results from performing those behaviors. In the present study, I examine whether positive social feedback can similarly influence attentional bias. The results show that stimuli previously associated with a high probability of positive social feedback elicit value-driven attentional capture, much like stimuli associated with extrinsic rewards. Unlike with extrinsic rewards, however, such stimuli also influence task-specific motivation. My findings offer a potential mechanism by which social reward shapes the information that we prioritize when perceiving the world around us.

Valuable Orientations Capture Attention

Visual attention has long been known to be drawn to stimuli that are physically salient or congruent with task-specific goals. Several recent studies have shown that attention is also captured by stimuli that are neither salient nor task-relevant, but that are rendered in a color that has previously been associated with reward. We investigated whether another feature dimension-orientation-can be associated with reward via learning and thereby elicit value-driven attentional capture. In a training phase, participants received a monetary reward for identifying the color of Gabor patches exhibiting one of two target orientations. A subsequent test phase in which no reward was delivered required participants to search for Gabor patches exhibiting one of two spatial frequencies (orientation was now irrelevant to the task). Previously rewarded orientations robustly captured attention. We conclude that reward learning can imbue features other than color-in this case, specific orientations-with persistent value.