Differential neural response to positive and negative feedback in planning and guessing tasks

Differences in Anatomical Structures and Resting-State Brain Networks Between Elite Wrestlers and Handball Athletes

BACKGROUND/OBJECTIVES

Advancements in biomedical imaging technologies over the past few decades have made it increasingly possible to measure the long-term effects of exercise on the central nervous system. This study aims to compare the brain morphology and functional connectivity of wrestlers and handball players, exploring sport-specific neural adaptations.

METHODS

Here, we examined 26 elite male athletes (13 wrestlers and 13 handball players) using anatomical and resting-state functional magnetic resonance imaging (fMRI) measurements. Connectivity maps are derived using the seed-based correlation analysis of resting-state fMRI, while voxel-based morphometry (VBM) is employed to identify anatomical differences. Additionally, the cortical thickness and global volumetric values of the segmented images are examined to determine the distinctions between elite wrestlers and handball players using non-parametric statistical tests.

RESULTS

Wrestlers exhibited greater grey matter volume (GMV) in the right middle temporal gyrus, left middle frontal gyrus, and right posterior cingulate gyrus (uncorr., p < 0.001). On the other hand, wrestlers showed increased functional connectivity in the left superior temporal gyrus, left parahippocampal gyrus, the left anterior orbital gyrus, and right superior frontal gyrus-medial frontal region (P(FWE) < 0.05). In addition, wrestlers showed greater cortical thickness in several brain regions.

CONCLUSIONS

The increased GMV, cortical thickness, and functional connectivity observed in wrestlers highlight the presence of sport-specific neural adaptations. While this research provides valuable insights into the neuroplastic effects of various athletic disciplines, further studies involving additional sports and control groups are needed for a more comprehensive understanding.

State-specific alterations in the neural computations underlying inhibitory control in women remitted from bulimia nervosa

The neurocomputational processes underlying bulimia nervosa and its primary symptoms, out-of-control overeating and purging, are poorly understood. Research suggests that the brains of healthy individuals form a dynamic internal model to predict whether control is needed in each moment. This study tested the hypothesis that this computational process of inhibitory control is abnormally affected by metabolic state (being fasted or fed) in bulimia nervosa. A Bayesian ideal observer model was fit to behavioral data acquired from 22 women remitted from bulimia nervosa and 20 group-matched controls who completed a stop-signal task during two counterbalanced functional MRI sessions, one after a 16 h fast and one after a meal. This model estimates participants' trial-by-trial updating of the probability of a stop signal based on their experienced trial history. Neural analyses focused on control-related Bayesian prediction errors, which quantify the direction and degree of "surprise" an individual experiences on any given trial. Regardless of group, metabolic state did not affect behavioral performance on the task. However, metabolic state modulated group differences in neural activation. In the fed state, women remitted from bulimia nervosa had attenuated prediction-error-dependent activation in the left dorsal caudate. This fed-state activation was lower among women with more frequent past binge eating and self-induced vomiting. When they are in a fed state, individuals with bulimia nervosa may not effectively process unexpected information needed to engage inhibitory control. This may explain the difficulties these individuals have stopping eating after it begins.

Regional Gray Matter Volume Is Associated with Growth Mindset: A Voxel-Based Morphometry Study

A growth mindset refers to an individual's beliefs about the malleable nature of intelligence. It plays an important role in motivation and achievement. However, few studies have examined the brain mechanisms involved in the growth mindset. In this study, voxel-based morphometry was used to investigate the relationship between growth mindset and gray matter volume (GMV) in healthy adults' sample from 114 men and 275 women who completed the Growth Mindset Inventory and intelligence test and underwent an anatomical magnetic resonance imaging scan. Whole-brain correlation analyses showed a positive relationship between growth mindset scores and regional GMV of the medial orbitofrontal cortex (mOFC) after controlling for age, sex, and total intracranial volume. This result was robust after controlling for intelligence quotient. The mOFC was primarily related to reward processing, supporting the social-cognitive theory of motivation on growth mindset.

Effect of reward and punishment on no-risk decision-making in young men: an EEG study

Decision-making is a process that allows adapting behavior in response to feedback to achieve a goal. Previous studies have suggested that the cerebral cortex shows different activation patterns in response to feedback. However, the effects of reward and punishment on learning contexts and decision-making are not clear. Thus, this experiment compared the effects of reward and punishment on behavior and the electroencephalographic activity of cortical areas related to decision-making in a no-risk context. Twenty healthy males were asked to perform a decision-making task under two conditions in which the goal was to finish in the shortest time possible. In the reward condition, the more points the participant accumulated the sooner the task ended, while in the punishment condition, the more points accumulated the longer the task lasted. Lower reaction times were found in the reward condition, characterized by a higher absolute power of the slow bands in almost all the cortices recorded. Changes in the interhemispheric correlation were also obtained in the comparison of the two feedback conditions. Results suggest that changes in the type of feedback affect cortical functionality and behavioral execution during decision-making, with the reward being related to a quick emotional response strategy and punishment associated with slower and, likely, more reasoned responses.

Advances in understanding meso-cortico-limbic-striatal systems mediating risky reward seeking

The risk of an aversive consequence occurring as the result of a reward-seeking action can have a profound effect on subsequent behavior. Such aversive events can be described as punishers, as they decrease the probability that the same action will be produced again in the future and increase the exploration of less risky alternatives. Punishment can involve the omission of an expected rewarding event ("negative" punishment) or the addition of an unpleasant event ("positive" punishment). Although many individuals adaptively navigate situations associated with the risk of negative or positive punishment, those suffering from substance use disorders or behavioral addictions tend to be less able to curtail addictive behaviors despite the aversive consequences associated with them. Here, we discuss the psychological processes underpinning reward seeking despite the risk of negative and positive punishment and consider how behavioral assays in animals have been employed to provide insights into the neural mechanisms underlying addictive disorders. We then review the critical contributions of dopamine signaling to punishment learning and risky reward seeking, and address the roles of interconnected ventral striatal, cortical, and amygdala regions to these processes. We conclude by discussing the ample opportunities for future study to clarify critical gaps in the literature, particularly as related to delineating neural contributions to distinct phases of the risky decision-making process.

Understanding heterosexual women's erotic flexibility: the role of attention in sexual evaluations and neural responses to sexual stimuli

Many women experience desires, arousal and behavior that run counter to their sexual orientation (orientation inconsistent, 'OI'). Are such OI sexual experiences cognitively and neurobiologically distinct from those that are consistent with one's sexual orientation (orientation consistent, 'OC')? To address this question, we employed a mindful attention intervention-aimed at reducing judgment and enhancing somatosensory attention-to examine the underlying attentional and neurobiological processes of OC and OI sexual stimuli among predominantly heterosexual women. Women exhibited greater neural activity in response to OC, compared to OI, sexual stimuli in regions associated with implicit visual processing, volitional appraisal and attention. In contrast, women exhibited greater neural activity to OI, relative to OC, sexual stimuli in regions associated with complex visual processing and attentional shifting. Mindfully attending to OC sexual stimuli reduced distraction, amplified women's evaluations of OC stimuli as sexually arousing and deactivated the superior cerebellum. In contrast, mindfully attending to OI sexual stimuli amplified distraction, decreased women's evaluations of OI stimuli as sexually arousing and augmented parietal and temporo-occipital activity. Results of the current study constrain hypotheses of female erotic flexibility, suggesting that sexual orientation may be maintained by differences in attentional processing that cannot be voluntarily altered.

The Rostrolateral Prefrontal Cortex Mediates a Preference for High-Agency Environments

The ability to exert flexible instrumental control over one's environment is a defining feature of adaptive decision-making. Here, we investigated neural substrates mediating a preference for environments with greater instrumental divergence, the distance between outcome probability distributions associated with alternative actions. A formal index of agency, instrumental divergence allows an organism to flexibly obtain the currently most desired outcome as preferences change. As such, it may have intrinsic utility, guiding decisions toward environments that maximize instrumental power. Consistent with this notion, we found that a measure of expected value that treats instrumental divergence as a reward surrogate provided a better account of male and female human participants' choice preferences than did a conventional model, sensitive only to monetary reward. Using model-based fMRI, we found that activity in the rostrolateral and ventromedial PFC, regions associated with abstract cognitive inferences and subjective value computations, respectively, scaled with the divergence-based account of expected value. Implications for a neural common currency of information theoretic and motivational variables are discussed.SIGNIFICANCE STATEMENT Agency is a central concept in philosophy and psychology. While research thus far has focused on cognitive and perceptual measures of agency, recent work demonstrating a strong preference for high-agency environments indicates a salient motivational dimension. Here, using instrumental divergence, the distance between outcome distributions associated with alternative actions, as a formal index of agency, we found that brain regions associated with directed exploration and subjective value computations, respectively, were selectively modulated by a model that treated agency as a reward surrogate, over models that assigned utility only to monetary payoffs. In a subset of regions, such effects were predicted by the influence of instrumental divergence on economic choice preferences. Our results elucidate neural mechanisms mediating the utility of agency.

Beyond Reward Prediction Errors: Human Striatum Updates Rule Values During Learning

Humans naturally group the world into coherent categories defined by membership rules. Rules can be learned implicitly by building stimulus-response associations using reinforcement learning or by using explicit reasoning. We tested if the striatum, in which activation reliably scales with reward prediction error, would track prediction errors in a task that required explicit rule generation. Using functional magnetic resonance imaging during a categorization task, we show that striatal responses to feedback scale with a "surprise" signal derived from a Bayesian rule-learning model and are inconsistent with RL prediction error. We also find that striatum and caudal inferior frontal sulcus (cIFS) are involved in updating the likelihood of discriminative rules. We conclude that the striatum, in cooperation with the cIFS, is involved in updating the values assigned to categorization rules when people learn using explicit reasoning.

A neuroscientific perspective on basic psychological needs

OBJECTIVE

Self-determination theory's (SDT) most basic propositions are, first, that all people possess an inherent set of psychological needs and, second, that autonomy, competence, and relatedness are the three critical psychological satisfactions needed to maintain and promote personal growth and well-being. In this article, we identify the neural basis of the psychological needs and, in doing so, seek to advance the integration of SDT and neuroscience.

METHOD

We examine the neural underpinnings of SDT-based motivational states and traits for autonomy, competence, and relatedness. To study motivational states, participants are exposed to situational conditions known to affect their psychological needs, and neuroscience methods (e.g., fMRI) are used to examine changes in their brain activity. To study motivational traits, participants complete self-report trait measures that are then correlated with their brain activity observed during need-satisfying activities.

RESULTS

For both motivational states and traits and across all three needs, intrinsic satisfaction is associated with striatum-based reward processing, anterior insula-based subjective feelings, and the integration of these subjective feelings with reward-based processing.

CONCLUSIONS

Psychological need satisfaction is associated with striatum activity, anterior insula activity, and the functional coactivation between these two brain areas. Given these findings, it is now clear that several opportunities exist to integrate SDT motivational constructs with neuroscientific study, so we suggest eight new questions for future research.

Abstinent Heroin Addicts Tend to Take Risks: ERP and Source Localization

Abnormal decision making is a behavioral characteristic of drug addiction. Indeed, drug addicts prefer immediate rewards at the expense of future interests. Assessing the neurocognitive basis of decision-making related to drug dependence, combining event-related potential (ERP) analysis and source localization techniques, may provide new insights into understanding decision-making deficits in drug addicts and further guide withdrawal treatment. In this study, EEG was performed in 20 abstinent heroin addicts (AHAs) and 20 age-, education- and gender-matched healthy controls (HCs) while they participated in a simple two-choice gambling task (99 vs. 9). Our behavioral results showed that AHAs tend to select higher-risk choices compared with HCs (i.e., more "99" choices than "9"). ERP results showed that right hemisphere preponderance of stimulus-preceding negativity was disrupted in AHAs, but not in HCs. Feedback-related negativity of difference wave was higher in AHAs than HCs, with the P300 amplitude associated with risk magnitude and valence. Using source localization that allows identification of abnormal brain activity in consequential cognitive stages, including the reward expectation and outcome evaluation stages, we found abnormalities in both behavioral and neural responses on gambling in AHAs. Taken together, our findings suggest AHAs have risk-prone tendency and dysfunction in adaptive decision making, since they continue to choose risky options even after accruing considerable negative scores, and fail to shift to a safer strategy to avoid risk. Such abnormal decision-making bias to risk and immediate reward seeking may be accompanied by abnormal reward expectation and evaluation in AHAs, which explains their high risk-seeking and impulsivity.

Why to cooperate is better than to compete: brain and personality components

Background

Cooperation and competition were compared in the present study. Brain correlates (electroencephalography, EEG frequency band, delta, theta, alpha, and beta) and hemodynamic measure of functional near-infrared spectroscopy (fNIRS, O2Hb) were acquired during a joined cooperative (Experiment 1) or competitive (Experiment 2) task. Subjects were required to match each other’s cognitive performance (cooperation) or to make better than others (competition) in terms of accuracy (error rate, ER) and response time (RT). In addition, a personality trait measure (behavioral activation system, BAS) was used to distinguish subjects based on their rewarding attitude. Self-perception of social ranking and real performance were considered in response to subjects’ performance (that was artificially manipulated to show an increasing or decreasing profile during the task).

Results

An increased left prefrontal cortical (PFC) responsiveness was found for subjects who had higher BAS rating in case of both cooperation and competition conditions. Moreover, subjects with higher BAS ratings showed greater frontal left activity during the cooperative task. These subjects also concomitantly perceived an increasing in social ranking and improved their performance.

Conclusions

Present results demonstrated that some trait components (BAS) and cooperative condition induce a positive self-representation in term of ranking and a best way to perform the task, as underlined by self-perception and cognitive outcomes. Indeed the higher BAS trait proved to be related with the representation of higher social ranking and with the perception of improved cognitive outcomes, with also a significant increased left PFC activity in cooperative contexts.

Frontal-subcortical circuitry in social attachment and relationships: A cross-sectional fMRI ALE meta-analysis

Researchers have explored the concept of attachment in multiple ways, from animal studies examining imprinting to abnormal attachment in psychopathology. However, until recently, few have considered how neural circuitry develops the effective social bonds that are subsequently replicated in relationships across the lifespan. This current cross-sectional study undertook a fMRI Activation Likelihood Estimation (ALE) meta-analyses to examine the neurocircuitry that governs emotional and behavioural functions critical for building effective social relationships in children and adults. Results suggest that dissociable dorsal cognitive ("cool") and ventral - affective ("hot") frontal-subcortical circuits (FSC) work together to govern social relationships, with repeated social consequences leading to potentially adaptive - or maladaptive - relationships that can become routinized in the cerebellum. Implications for forming stable, functional, social bonds are considered, followed by recommendations for those who struggle with cool and hot FSC functioning that can hinder the development of adaptive prosocial relationships.

Modulation of ventral striatal activity by cognitive effort

Effort discounting theory suggests that the value of a reward should be lower if it was effortful to obtain, whereas contrast theory suggests that the contrast between the costly effort and the reward makes the reward seem more valuable. To test these alternative hypotheses, we used functional magnetic resonance imaging (fMRI) as participants engaged in feedback-based learning that required low or high cognitive effort to obtain positive feedback, while the objective amount of information provided by feedback remained constant. In the low effort condition, a single image was presented with four response options. In the high effort condition, two images were presented, each with two response options, and correct feedback was presented only when participants responded correctly to both of the images. Accuracy was significantly lower for the high effort condition, and all participants reported that the high effort condition was more difficult. A region of the ventral striatum selected for sensitivity to feedback value also showed increased activation to feedback presentation associated with the high effort condition relative to the low effort condition, when controlling for activation from corresponding control conditions where feedback was random. These results suggest that increased cognitive effort produces corresponding increases in positive feedback-related ventral striatum activity, in line with the predictions made by contrast theory. The accomplishment of obtaining a hard-earned intrinsic reward, such as positive feedback, may be particularly likely to promote reward-related brain activity.

Reduced Neural Recruitment for Bayesian Adjustment of Inhibitory Control in Methamphetamine Dependence

Delineating the processes that contribute to the progression and maintenance of substance dependence is critical to understanding and preventing addiction. Several previous studies have shown inhibitory control deficits in individuals with stimulant use disorder. We used a Bayesian computational approach to examine potential neural deficiencies in the dynamic predictive processing underlying inhibitory function among recently abstinent methamphetamine-dependent individuals (MDIs), a population at high risk of relapse. Sixty-two MDIs were recruited from a 28-day inpatient treatment program at the San Diego Veterans Affairs Medical Center and compared with 34 healthy control subjects. They completed a stop-signal task during functional magnetic resonance imaging. A Bayesian ideal observer model was used to predict individuals' trial-to-trial probabilistic expectations of inhibitory response, P(stop), to identify group differences specific to Bayesian expectation and prediction error computation. Relative to control subjects, MDIs were more likely to make stop errors on difficult trials and had attenuated slowing following stop errors. MDIs further exhibited reduced sensitivity as measured by the neural tracking of a Bayesian measure of surprise (unsigned prediction error), which was evident across all trials in the left posterior caudate and orbitofrontal cortex (Brodmann area 11), and selectively on stop error trials in the right thalamus and inferior parietal lobule. MDIs are less sensitive to surprising task events, both across trials and upon making commission errors, which may help explain why these individuals may not engage in switching strategy when the environment changes, leading to adverse consequences.

Striatal Associative Learning Signals Are Tuned to In-groups

An important feature of adaptive social behavior is the ability to flexibly modify future actions based on the successes or failures of past experiences. The ventral striatum (VS) occupies a central role in shaping behavior by using feedback to evaluate actions and guide learning. The current studies tested whether feedback indicating the need to update social knowledge would engage the VS, thereby facilitating subsequent learning. We also examined the sensitivity of these striatal signals to the value associated with social group membership. Across two fMRI studies, participants answered questions testing their knowledge about the preferences of personally relevant social groups who were high (in-group) or low (out-group) in social value. Participants received feedback indicating whether their responses were correct or incorrect on a trial-by-trial basis. After scanning, participants were given a surprise memory test examining memory for the different types of feedback. VS activity in response to social feedback correlated with subsequent memory, specifying a role for the VS in encoding and updating social knowledge. This effect was more robust in response to in-group than out-group feedback, indicating that the VS tracks variations in social value. These results provide novel evidence of a neurobiological mechanism adaptively tuned to the motivational relevance of the surrounding social environment that focuses learning efforts on the most valuable social outcomes and triggers adjustments in behavior when necessary.

The Value of Being Wrong: Intermittent Feedback Delivery Alters the Striatal Response to Negative Feedback

Whereas positive feedback is both rewarding and informative, negative feedback can be construed as either punishing (because it is indicative of poor performance) or informative (because it may lead to goal attainment). In this neuroimaging experiment, we highlighted the informational value of negative feedback by intermixing trials with and without feedback. When performance feedback is expected, positive feedback triggers an increase in striatal activity, whereas negative feedback elicits a decrease in striatal activity. We predicted that, in contrast, when feedback receipt is unpredictable, the striatal response to negative feedback would increase. Participants performed a paired-associate learning task during fMRI scanning. In one condition ("blocked feedback"), the receipt of feedback was predictable--participants knew whether or not they would receive feedback for their responses. In another condition ("mixed feedback"), the receipt of feedback was unpredictable--on a random 50% of trials, participants received feedback, and they otherwise received no feedback. Negative feedback in the mixed feedback condition elicited more striatal activity than negative feedback in the blocked feedback condition. In contrast, feedback omission evoked more striatal activity when feedback delivery was expected, compared to when it was unpredictable. This pattern emerged from an increase in caudate activity in response to negative feedback in the mixed feedback condition and a decrease in ventral striatal activity in response to no feedback in this condition. These results suggest that, by emphasizing the informational value of negative feedback, an unpredictable feedback context alters the striatal response to negative feedback and to the omission of feedback.

Discovering functional units in continuous speech

Language learning requires that listeners discover acoustically variable functional units like phonetic categories and words from an unfamiliar, continuous acoustic stream. Although many category learning studies have examined how listeners learn to generalize across the acoustic variability inherent in the signals that convey the functional units of language, these studies have tended to focus upon category learning across isolated sound exemplars. However, continuous input presents many additional learning challenges that may impact category learning. Listeners may not know the timescale of the functional unit, its relative position in the continuous input, or its relationship to other evolving input regularities. Moving laboratory-based studies of isolated category exemplars toward more natural input is important to modeling language learning, but very little is known about how listeners discover categories embedded in continuous sound. In 3 experiments, adult participants heard acoustically variable sound category instances embedded in acoustically variable and unfamiliar sound streams within a video game task. This task was inherently rich in multisensory regularities with the to-be-learned categories and likely to engage procedural learning without requiring explicit categorization, segmentation, or even attention to the sounds. After 100 min of game play, participants categorized familiar sound streams in which target words were embedded and generalized this learning to novel streams as well as isolated instances of the target words. The findings demonstrate that even without a priori knowledge, listeners can discover input regularities that have the best predictive control over the environment for both non-native speech and nonspeech signals, emphasizing the generality of the learning.

Sex-dependent effects on tasks assessing reinforcement learning and interference inhibition

Increasing evidence suggests that the prefrontal cortex (PFC) is influenced by sex steroids and that some cognitive functions dependent on the PFC may be sexually differentiated in humans. Past work has identified a male advantage on certain complex reinforcement learning tasks, but it is unclear which latent task components are important to elicit the sex difference. The objective of the current study was to investigate whether there are sex differences on measures of response inhibition and valenced feedback processing, elements that are shared by previously studied reinforcement learning tasks. Healthy young adults (90 males, 86 females) matched in general intelligence completed the Probabilistic Selection Task (PST), a Simon task, and the Stop-Signal task. On the PST, females were more accurate than males in learning from positive (but not negative) feedback. On the Simon task, males were faster than females, especially in the face of incongruent stimuli. No sex difference was observed in Stop-Signal reaction time. The current findings provide preliminary support for a sex difference in the processing of valenced feedback and in interference inhibition.

Feedback valence affects auditory perceptual learning independently of feedback probability

Previous studies have suggested that negative feedback is more effective in driving learning than positive feedback. We investigated the effect on learning of providing varying amounts of negative and positive feedback while listeners attempted to discriminate between three identical tones; an impossible task that nevertheless produces robust learning. Four feedback conditions were compared during training: 90% positive feedback or 10% negative feedback informed the participants that they were doing equally well, while 10% positive or 90% negative feedback informed them they were doing equally badly. In all conditions the feedback was random in relation to the listeners’ responses (because the task was to discriminate three identical tones), yet both the valence (negative vs. positive) and the probability of feedback (10% vs. 90%) affected learning. Feedback that informed listeners they were doing badly resulted in better post-training performance than feedback that informed them they were doing well, independent of valence. In addition, positive feedback during training resulted in better post-training performance than negative feedback, but only positive feedback indicating listeners were doing badly on the task resulted in learning. As we have previously speculated, feedback that better reflected the difficulty of the task was more effective in driving learning than feedback that suggested performance was better than it should have been given perceived task difficulty. But contrary to expectations, positive feedback was more effective than negative feedback in driving learning. Feedback thus had two separable effects on learning: feedback valence affected motivation on a subjectively difficult task, and learning occurred only when feedback probability reflected the subjective difficulty. To optimize learning, training programs need to take into consideration both feedback valence and probability.

The role of prediction and outcomes in adaptive cognitive control

Humans adaptively perform actions to achieve their goals. This flexible behaviour requires two core abilities: the ability to anticipate the outcomes of candidate actions and the ability to select and implement actions in a goal-directed manner. The ability to predict outcomes has been extensively researched in reinforcement learning paradigms, but this work has often focused on simple actions that are not embedded in hierarchical and sequential structures that are characteristic of goal-directed human behaviour. On the other hand, the ability to select actions in accordance with high-level task goals, particularly in the presence of alternative responses and salient distractors, has been widely researched in cognitive control paradigms. Cognitive control research, however, has often paid less attention to the role of action outcomes. The present review attempts to bridge these accounts by proposing an outcome-guided mechanism for selection of extended actions. Our proposal builds on constructs from the hierarchical reinforcement learning literature, which emphasises the concept of reaching and evaluating informative states, i.e., states that constitute subgoals in complex actions. We develop an account of the neural mechanisms that allow outcome-guided action selection to be achieved in a network that relies on projections from cortical areas to the basal ganglia and back-projections from the basal ganglia to the cortex. These cortico-basal ganglia-thalamo-cortical 'loops' allow convergence - and thus integration - of information from non-adjacent cortical areas (for example between sensory and motor representations). This integration is essential in action sequences, for which achieving an anticipated sensory state signals the successful completion of an action. We further describe how projection pathways within the basal ganglia allow selection between representations, which may pertain to movements, actions, or extended action plans. The model lastly envisages a role for hierarchical projections from the striatum to dopaminergic midbrain areas that enable more rostral frontal areas to bias the selection of inputs from more posterior frontal areas via their respective representations in the basal ganglia.

Effects of achievement goals on challenge seeking and feedback processing: behavioral and FMRI evidence

We conducted behavioral and functional magnetic resonance imaging (fMRI) research to investigate the effects of two types of achievement goals--mastery goals and performance-approach goals--on challenge seeking and feedback processing. The results of the behavioral experiment indicated that mastery goals were associated with a tendency to seek challenge, both before and after experiencing difficulty during task performance, whereas performance-approach goals were related to a tendency to avoid challenge after encountering difficulty during task performance. The fMRI experiment uncovered a significant decrease in ventral striatal activity when participants received negative feedback for any task type and both forms of achievement goals. During the processing of negative feedback for the rule-finding task, performance-approach-oriented participants showed a substantial reduction in activity in the dorsolateral prefrontal cortex (DLPFC) and the frontopolar cortex, whereas mastery-oriented participants showed little change. These results suggest that performance-approach-oriented participants are less likely to either recruit control processes in response to negative feedback or focus on task-relevant information provided alongside the negative feedback. In contrast, mastery-oriented participants are more likely to modulate aversive valuations to negative feedback and focus on the constructive elements of feedback in order to attain their task goals. We conclude that performance-approach goals lead to a reluctant stance towards difficulty, while mastery goals encourage a proactive stance.

Basal ganglia engagement during feedback processing after a substantial delay

The striatum has been shown to play an important role in learning from performance-related feedback that is presented shortly after each response. However, less is known about the neural mechanisms supporting learning from feedback that is substantially delayed from the original response. Since the consequences of one's actions often do not become known until after a delay, it is important to understand whether delayed feedback can produce neural responses similar to those elicited by immediate-feedback presentation. We investigated this issue by using functional magnetic resonance imaging (fMRI) as participants performed a paired-associate learning task with 180 distinct trials. Feedback indicating response accuracy was presented immediately, after a delay of 25 min, or not at all. Both immediate and delayed feedback led to significant gains in accuracy on a posttest, relative to no feedback. Replicating previous work, we found that the caudate nuclei showed greater activation for positive feedback than for negative feedback when the feedback was presented immediately. In addition, delayed feedback also led to differential caudate activity to positive versus negative feedback. Delayed negative feedback also produced significant activation of the putamen and globus pallidus (the lentiform nucleus), relative to no feedback and delayed positive feedback. This suggests that the caudate nucleus is sensitive to the affective nature of feedback, across different time scales, while the lentiform nucleus may be particularly involved in processing the information carried by negative feedback after a substantial delay.

How may the basal ganglia contribute to auditory categorization and speech perception?

Listeners must accomplish two complementary perceptual feats in extracting a message from speech. They must discriminate linguistically-relevant acoustic variability and generalize across irrelevant variability. Said another way, they must categorize speech. Since the mapping of acoustic variability is language-specific, these categories must be learned from experience. Thus, understanding how, in general, the auditory system acquires and represents categories can inform us about the toolbox of mechanisms available to speech perception. This perspective invites consideration of findings from cognitive neuroscience literatures outside of the speech domain as a means of constraining models of speech perception. Although neurobiological models of speech perception have mainly focused on cerebral cortex, research outside the speech domain is consistent with the possibility of significant subcortical contributions in category learning. Here, we review the functional role of one such structure, the basal ganglia. We examine research from animal electrophysiology, human neuroimaging, and behavior to consider characteristics of basal ganglia processing that may be advantageous for speech category learning. We also present emerging evidence for a direct role for basal ganglia in learning auditory categories in a complex, naturalistic task intended to model the incidental manner in which speech categories are acquired. To conclude, we highlight new research questions that arise in incorporating the broader neuroscience research literature in modeling speech perception, and suggest how understanding contributions of the basal ganglia can inform attempts to optimize training protocols for learning non-native speech categories in adulthood.

Gray matter volume and rapid decision-making in major depressive disorder

BACKGROUND

Reduced motivation and blunted decision-making are key features of major depressive disorder (MDD). Patients with MDD show abnormal decision-making when given negative feedback regarding a reward. The brain mechanisms underpinning this behavior remain unclear. In the present study, we examined the association between rapid decision-making with negative feedback and brain volume in MDD.

METHODS

Thirty-six patients with MDD and 54 age-, sex- and IQ-matched healthy subjects were studied. Subjects performed a rapid decision-making monetary task in which participants could make high- or low-risk choices. We compared between the 2 groups the probability that a high-risk choice followed negative feedback. In addition, we used voxel-based morphometry (VBM) to compare between group differences in gray matter volume, and the correlation between the probability for high-risk choices and brain volume.

RESULTS

Compared to the healthy group, the MDD group showed significantly lower probabilities for high-risk choices following negative feedback. VBM analysis revealed that the MDD group had less gray matter volume in the right medial prefrontal cortex and orbitofrontal cortex (OFC) compared to the healthy group. The right OFC volume was negatively correlated with the probability that a high-risk choice followed negative feedback in patients with MDD. We did not observe these trends in healthy subjects.

CONCLUSIONS

Patients with MDD show reduced motivation for monetary incentives when they were required to make rapid decisions following negative feedback. We observed a correlation between this reduced motivation and gray matter volume in the medial and ventral prefrontal cortex, which suggests that these brain regions are likely involved in the pathophysiology of aberrant decision-making in MDD.

Neural correlates of sexual arousal in heterosexual and homosexual women and men

Most men have a category-specific pattern of genital and subjective sexual arousal, responding much more strongly to erotic stimuli depicting their preferred sex than to erotic stimuli depicting their nonpreferred sex. In contrast, women tend to have a less specific arousal pattern. To better understand this sex difference, we used neuroimaging to explore its neural correlates. Heterosexual and homosexual women viewed erotic photographs of either men or women. Evoked neural activity was monitored via fMRI and compared with responses to the same stimuli in heterosexual and homosexual men. Overall, a network of limbic (as well as the anterior cingulate) and visual processing regions showed significantly less category-specific activity in women than men. This was primarily driven by weaker overall activations to preferred-sex stimuli in women, though there was also some evidence of stronger limbic activations to nonpreferred-sex stimuli in women. Primary results were similar for heterosexual and homosexual participants. Women did show some evidence of category-specific responses in the visual processing regions, although even in these regions they exhibited less differential activity than men. In the anterior cingulate, a region with high concentrations of sex-hormone receptors, subjective and neural category specificity measures correlated positively for women but negatively for men, suggesting a possible sex difference in the role of the anterior cingulate. Overall, results suggest that men tend to show more differentiated neural responses than do women to erotic photographs of one sex compared to the other sex, though women may not be entirely indifferent to which sex is depicted.

The amygdalostriatal and corticostriatal effective connectivity in anticipation and evaluation of facial attractiveness

Decision-making consists of several stages of information processing, including an anticipation stage and an outcome evaluation stage. Previous studies showed that the ventral striatum (VS) is pivotal to both stages, bridging motivation and action, and it works in concert with the ventral medial prefrontal cortex (vmPFC) and the amygdala. However, evidence concerning how the VS works together with the vmPFC and the amygdala came mainly from neuropathology and animal studies; little is known about the dynamics of this network in the functioning human brain. Here we used fMRI combined with dynamic causal modeling (DCM) to investigate the information flow along amygdalostriatal and corticostriatal pathways in a facial attractiveness guessing task. Specifically, we asked participants to guess whether a blurred photo of female face was attractive and to wait for a few seconds ("anticipation stage") until an unblurred photo of feedback face, which was either attractive or unattractive, was presented ("outcome evaluation stage"). At the anticipation stage, the bilateral amygdala and VS showed higher activation for the "attractive" than for the "unattractive" guess. At the outcome evaluation stage, the vmPFC and the bilateral VS were more activated by feedback faces whose attractiveness was congruent with the initial guess than by incongruent faces; however, this effect was only significant for attractive faces, not for unattractive ones. DCM showed that at the anticipation stage, the choice-related information entered the amygdalostriatal pathway through the amygdala and was projected to the VS. At the evaluation stage, the outcome-related information entered the corticostriatal pathway through the vmPFC. Bidirectional connectivities existed between the vmPFC and VS, with the VS-to-vmPFC connectivity weakened by unattractive faces. These findings advanced our understanding of the reward circuitry by demonstrating the pattern of information flow along the amygdalostriatal and corticostriatal pathways at different stages of decision-making.

Disturbed microstructural integrity of the frontostriatal fiber pathways and executive dysfunction in children with attention deficit hyperactivity disorder

BACKGROUND

Attention deficit hyperactivity disorder (ADHD) is recognized as an early-onset neuropsychiatric disorder with executive dysfunctions and neurobiological deficits. The authors compared executive functions and microstructural integrity of the frontostriatal circuit in children with ADHD and typically developing children. Method We assessed 25 children with ADHD and 25 age-, sex-, handedness- and intelligence-matched typically developing children by using psychiatric interviews, the Wechsler Intelligence Scale for Children - third edition, and the tasks involving executive functions in the Cambridge Neuropsychological Test Automated Battery. The frontostriatal tracts were reconstructed by diffusion spectrum imaging tractography and were subdivided into four functionally distinct segments, including dorsolateral, medial prefrontal, orbitofrontal and ventrolateral tracts. Tract-specific and matched case-control analyses were used and generalized fractional anisotropy values were computed.

RESULTS

Children with ADHD had lower generalized fractional anisotropy of all the bilateral frontostriatal fiber tracts and poorer performance in verbal and spatial working memory, set-shifting, sustained attention, cognitive inhibition and visuospatial planning. The symptom severity of ADHD and the executive functioning performance significantly correlated with integrity of the frontostriatal tracts, particularly the left orbitofrontal and ventrolateral tracts. Children with ADHD also demonstrated loss of the leftward asymmetry in the dorsolateral and medial prefrontal tracts that was present in typically developing children.

CONCLUSIONS

Our findings demonstrate disturbed structural connectivity of the frontostriatal circuitry in children with ADHD and add new evidence of associations between integrity of the frontostriatal tracts and measures of core symptoms of ADHD and a wide range of executive dysfunctions in both groups.

Effects of social context and predictive relevance on action outcome monitoring

Outcome monitoring is crucial for subsequent adjustments in behavior and is associated with a specific electrophysiological response, the feedback-related negativity (FRN). Besides feedback generated by one's own action, the performance of others may also be relevant for oneself, and the observation of outcomes for others' actions elicits an observer FRN (oFRN). To test how these components are influenced by social setting and predictive value of feedback information, we compared event-related potentials, as well as their topographies and neural generators, for performance feedback generated by oneself and others in a cooperative versus competitive context. Our results show that (1) the predictive relevance of outcomes is crucial to elicit an FRN in both players and observers, (2) cooperation increases FRN and P300 amplitudes, especially in individuals with high traits of perspective taking, and (3) contrary to previous findings on gambling outcomes, oFRN components are generated for both cooperating and competing observers, but with smaller amplitudes in the latter. Neural source estimation revealed medial prefrontal activity for both FRN and oFRN, but with additional generators for the oFRN in the dorsolateral and ventral prefrontal cortex, as well as the temporoparietal junction. We conclude that the latter set of brain regions could mediate social influences on action monitoring by representing agency and social relevance of outcomes and are, therefore, recruited in addition to shared prediction error signals generated in medial frontal areas during action outcome observation.

Willed action and its impairments

Actions are goal-directed behaviours that usually involve movem ent. There is evidence that intentional self-generated actions (willed actions) are controlled differently from routine, stereotyped actions that are externally triggered by environmental stimuli. We review evidence from investigations using positron emission tomography (PET), recordings of movement-related cortical potentials (MRCPs) or transcranial magnetic stimulation (TMS), and conclude that willed actions are controlled by a network of frontal cortical (dorsolateral prefrontal cortex, supplementary motor area, anterior cingulate) and subcortical (thalamus and basal ganglia) areas. We also consider evidence suggesting that some of the cognitive and motor deficits of patients with frontal lesions, Parkinson's disease, or schizophrenia as well as apathy and abulia and rarer phenomena such as primary obsessional slowness can be considered as reflecting im pairment of willed actions. We propose that the concept of a willed action system based on the frontostriatal circuits provides a useful framework for integrating the cognitive, motor, and motivational deficits found in these disorders. Problems remaining to be resolved include: identification of the component processes of willed actions; the specific and differential role played by each of the frontal cortical and subcortical areas in the control of willed actions; the specific mechanisms of impairm ent of willed actions in Parkinson's disease, schizophrenia, and frontal damage; and the precise role of the neurotransmitter dopamine in the willed action system.

Information content and reward processing in the human striatum during performance of a declarative memory task

Negative feedback can signal poor performance, but it also provides information that can help learners reach the goal of task mastery. The primary aim of this study was to test the hypothesis that the amount of information provided by negative feedback during a paired-associate learning task influences feedback-related processing in the caudate nucleus. To do this, we manipulated the number of response options: With two options, positive and negative feedback provide equal amounts of information, whereas with four options, positive feedback provides more information than does negative feedback. We found that positive and negative feedback activated the caudate similarly when there were two response options. With four options, the caudate’s response to negative feedback was reduced. A secondary goal was to investigate the link between brain-based measures of feedback-related processing and behavioral indices of learning. Analysis of the posttest measures showed that trials with positive feedback were associated with higher posttest confidence ratings. Additionally, when positive feedback was delivered, caudate activity was greater for trials with high than with low posttest confidence. This experiment demonstrated the context sensitivity of feedback processing and provided evidence that feedback processing in the striatum can contribute to the strengthening of the representations available within declarative memory.

The rewarding value of good motor performance in the context of monetary incentives

Whether an agent receives positive task feedback or a monetary reward, neural activity in their striatum increases. In the latter case striatal activity reflects extrinsic reward processing, while in the former, striatal activity reflects the intrinsically rewarding effects of performing well. There can be a "hidden cost of reward", which is a detrimental effect of extrinsic on intrinsic reward value. This raises the question how these two types of reward interact. To address this, we applied a monetary incentive delay task: in all trials participants received feedback depending on their performance. In half of the trials they could additionally receive monetary reward if they performed well. This resulted in high performance trials, which were monetarily rewarded and high performance trials that were not. This made it possible to dissociate the neural correlates of performance feedback from the neural correlates of monetary reward that comes with high performance. Performance feedback alone elicits activation increases in the ventral striatum. This activation increases due to additional monetary reward. Neural response in the dorsal striatum on the other hand is only significantly increased by feedback when a monetary incentive is present. The quality of performance does not significantly influence dorsal striatum activity. In conclusion, our results indicate that the dorsal striatum is primarily sensitive to optional or actually received external rewards, whereas the ventral striatum may be coding intrinsic reward due to positive performance feedback. Thus the ventral striatum is suggested to be involved in the processing of intrinsically motivated behavior.

Contributions of the ventromedial prefrontal cortex to goal-directed action selection

In this article, it will be argued that one of the key contributions of the ventromedial prefrontal cortex (vmPFC) to goal-directed action selection lies both in retrieving the value of goals that are the putative outcomes of the decision process and in establishing a relative preference ranking for these goals by taking into account the value of each of the different goals under consideration in a given decision-making scenario. These goal-value signals are then suggested to be used as an input into the on-line computation of action values mediated by brain regions outside of the vmPFC, such as parts of the parietal cortex, supplementary motor cortex, and dorsal striatum. Collectively, these areas can be considered to be constituent elements of a multistage decision process whereby the values of different goals must first be represented and ranked before the value of different courses of action available for the pursuit of those goals can be computed.

Functional specialization within the striatum along both the dorsal/ventral and anterior/posterior axes during associative learning via reward and punishment

The goal of the present study was to elucidate the role of the human striatum in learning via reward and punishment during an associative learning task. Previous studies have identified the striatum as a critical component in the neural circuitry of reward-related learning. It remains unclear, however, under what task conditions, and to what extent, the striatum is modulated by punishment during an instrumental learning task. Using high-resolution functional magnetic resonance imaging (fMRI) during a reward- and punishment-based probabilistic associative learning task, we observed activity in the ventral putamen for stimuli learned via reward regardless of whether participants were correct or incorrect (i.e., outcome). In contrast, activity in the dorsal caudate was modulated by trials that received feedback--either correct reward or incorrect punishment trials. We also identified an anterior/posterior dissociation reflecting reward and punishment prediction error estimates. Additionally, differences in patterns of activity that correlated with the amount of training were identified along the anterior/posterior axis of the striatum. We suggest that unique subregions of the striatum--separated along both a dorsal/ventral and anterior/posterior axis--differentially participate in the learning of associations through reward and punishment.

The neural encoding of guesses in the human brain

Human perception depends heavily on the quality of sensory information. When objects are hard to see we often believe ourselves to be purely guessing. Here we investigated whether such guesses use brain networks involved in perceptual decision making or independent networks. We used a combination of fMRI and pattern classification to test how visibility affects the signals, which determine choices. We found that decisions regarding clearly visible objects are predicted by signals in sensory brain regions, whereas different regions in parietal cortex became predictive when subjects were shown invisible objects and believed themselves to be purely guessing. This parietal network was highly overlapping with regions, which have previously been shown to encode free decisions. Thus, the brain might use a dedicated network for determining choices when insufficient sensory information is available.

Aging and decision making under uncertainty: behavioral and neural evidence for the preservation of decision making in the absence of learning in old age

Decision making under uncertainty is an essential component of everyday life. Recent psychological studies suggest that older adults, despite age-related neurological decline, can make advantageous decisions when information about the contingencies of the outcomes is available. In this study, a two-choice prediction paradigm has been used, in conjunction with functional magnetic resonance imaging (fMRI), to investigate the effects of normal aging on neural substrates underlying uncertain decision making in the absence of learning that have not been addressed in previous neuroimaging studies. Neuroimaging results showed that both the healthy older and young adults recruited a network of brain regions comprising the right dorsolateral prefrontal cortex, bilateral inferior parietal lobule, medial frontal cortex, and right lateral orbitofrontal cortex during the prediction task. As was hypothesized, the performance of older adults in the prediction task was not impaired compared to young adults. Although no significant age-related increases in brain activity have been found, we observed an age-related decrease in activity in the right inferior parietal lobule. We speculate that the observed age-related decrease in parietal activity could be explained by age-related differences in decision making behavior revealed by questionnaire results and maximizing scores. Together, this study demonstrates behavioral and neural evidence for the preservation of decision making in older adults when information about the contingencies of the outcome is available.

The reward circuit: linking primate anatomy and human imaging

Although cells in many brain regions respond to reward, the cortical-basal ganglia circuit is at the heart of the reward system. The key structures in this network are the anterior cingulate cortex, the orbital prefrontal cortex, the ventral striatum, the ventral pallidum, and the midbrain dopamine neurons. In addition, other structures, including the dorsal prefrontal cortex, amygdala, hippocampus, thalamus, and lateral habenular nucleus, and specific brainstem structures such as the pedunculopontine nucleus, and the raphe nucleus, are key components in regulating the reward circuit. Connectivity between these areas forms a complex neural network that mediates different aspects of reward processing. Advances in neuroimaging techniques allow better spatial and temporal resolution. These studies now demonstrate that human functional and structural imaging results map increasingly close to primate anatomy.

Neural substrates of contingency learning and executive control: dissociating physical, valuative, and behavioral changes

Contingency learning is fundamental to cognition. Knowledge about environmental contingencies allows behavioral flexibility, as executive control processes accommodate the demands of novel or changing environments. Studies of experiential learning have focused on the relationship between actions and the values of associated outcomes. However, outcome values have often been confounded with the physical changes in the outcomes themselves. Here, we dissociated contingency learning into valuative and non-valuative forms, using a novel version of the two-alternative choice task, while measuring the neural effects of contingency changes using functional magnetic resonance imaging (fMRI). Changes in value-relevant contingencies evoked activation in the lateral prefrontal cortex (LPFC), posterior parietal cortex (PPC), and dorsomedial prefrontal cortex (DMPFC) consistent with prior results (e.g., reversal-learning paradigms). Changes in physical contingencies unrelated to value or to action produced similar activations within the LPFC, indicating that LPFC may engage in generalized contingency learning that is not specific to valuation. In contrast, contingency changes that required behavioral shifts evoked activation localized to the DMPFC, supplementary motor, and precentral cortices, suggesting that these regions play more specific roles within the executive control of behavior.

Behavioral and neural changes after gains and losses of conditioned reinforcers

Human behaviors can be more powerfully influenced by conditioned reinforcers, such as money, than by primary reinforcers. Moreover, people often change their behaviors to avoid monetary losses. However, the effect of removing conditioned reinforcers on choices has not been explored in animals, and the neural mechanisms mediating the behavioral effects of gains and losses are not well understood. To investigate the behavioral and neural effects of gaining and losing a conditioned reinforcer, we trained rhesus monkeys for a matching pennies task in which the positive and negative values of its payoff matrix were realized by the delivery and removal of a conditioned reinforcer. Consistent with the findings previously obtained with non-negative payoffs and primary rewards, the animal's choice behavior during this task was nearly optimal. Nevertheless, the gain and loss of a conditioned reinforcer significantly increased and decreased, respectively, the tendency for the animal to choose the same target in subsequent trials. We also found that the neurons in the dorsomedial frontal cortex, dorsal anterior cingulate cortex, and dorsolateral prefrontal cortex often changed their activity according to whether the animal earned or lost a conditioned reinforcer in the current or previous trial. Moreover, many neurons in the dorsomedial frontal cortex also signaled the gain or loss occurring as a result of choosing a particular action as well as changes in the animal's behaviors resulting from such gains or losses. Thus, primate medial frontal cortex might mediate the behavioral effects of conditioned reinforcers and their losses.

Bipolar disorder and neurophysiologic mechanisms

Recent studies have suggested that some variants of bipolar disorder (BD) may be due to hyperconnectivity between orbitofrontal (OFC) and temporal pole (TP) structures in the dominant hemisphere. Some initial MRI studies noticed that there were corpus callosum abnormalities within specific regional areas and it was hypothesized that developmentally this could result in functional or effective connectivity changes within the orbitofrontal-basal ganglia-thalamocortical circuits. Recent diffusion tensor imaging (DTI) white matter fiber tractography studies may well be superior to region of interest (ROI) DTI in understanding BD. A "ventral semantic stream" has been discovered connecting the TP and OFC through the uncinate and inferior longitudinal fasciculi and the elusive TP is known to be involved in theory of mind and complex narrative understanding tasks. The OFC is involved in abstract valuation in goal and sub-goal structures and the TP may be critical in binding semantic memory with person-emotion linkages associated with narrative. BD patients have relative attenuation of performance on visuoconstructional praxis consistent with an atypical localization of cognitive functions. Multiple lines of evidence suggest that some BD alleles are being selected for which could explain the enhanced creativity in higher-ability probands. Associations between ROI's that are not normally connected could explain the higher incidence of artistic aptitude, writing ability, and scientific achievements among some mood disorder subjects.

Iowa Gambling task impairment is not specific to ventromedial prefrontal lesions

Prior research suggests that the Iowa Gambling task is performed poorly by individuals with lesions in the ventromedial prefrontal cortex (VMPFC). The current study investigated whether impaired performance in individuals with frontal lobe damage is determined by the existence of VMPFC lesions. A total of 14 participants with VMPFC lesions and 6 participants with frontal lesions not involving the VMPFC region were compared. Both the VMPFC and non-VMPFC groups made significantly more disadvantageous card selections than healthy comparison participants. While these findings suggest that frontal lesions impair Iowa Gambling task performance, they do not support the claim of a specific association between Iowa Gambling task impairment and VMPFC lesions.