Reward and punishment act as distinct factors in guiding behavior

Don't Give-Up: Why some intervention schemes encourage suboptimal behavior

Many social challenges stem from individuals' tendency to prefer immediately rewarding but suboptimal behaviors ("Give-Up" options) over more costly endeavors that yield much better outcomes in the long run ("Try" options). For example, many people forgo the long-term benefits of formal education, healthy diets, learning new technologies, and even finding true love. This paper examines various incentivization programs that combine external rewards and punishments to discourage such counterproductive behaviors, which often result in only temporary behavioral change. Our findings suggest that some interventions' limited impact may be due to their focus on only shifting behaviors from "Give-Up" (e.g., dropping out of college, avoiding the gym) to "Try" (e.g., attending college, exercising regularly), without promoting sufficient exploration of these "Try" options. Yet exploration of the long-term benefits of "Trying" may be crucial to increase the chances of long-term learning and commitment. Using a simplified abstraction of this dilemma, our results show a high tendency to choose "Give-Up" options prior to intervention. Examination of four different incentivization strategies suggests that only rewarding exploration of new "Try" options is a straightforward strategy to increase exploration and optimal choice. Punishing both the selection of "Give-Up" options and the choice to exploit suboptimal "Try" options produced similar results. Other common guidance strategies were less effective, as these strategies simply tended to replace one suboptimal behavior with another. Surprisingly, punishments seemed to be a relatively more successful incentive than rewards. We discuss how these insights can help guide policy aiming to improve long-term outcomes through incentivization.

Impaired Punishment Learning in Conduct Disorder

OBJECTIVE

Conduct disorder (CD) has been associated with deficits in the use of punishment to guide reinforcement learning (RL) and decision making. This may explain the poorly planned and often impulsive antisocial and aggressive behavior in affected youths. Here, we used a computational modeling approach to examine differences in RL abilities between CD youths and typically developing controls (TDCs). Specifically, we tested 2 competing hypotheses that RL deficits in CD reflect either reward dominance (also known as reward hypersensitivity) or punishment insensitivity (also known as punishment hyposensitivity).

METHOD

The study included 92 CD youths and 130 TDCs (aged 9-18 years, 48% girls) who completed a probabilistic RL task with reward, punishment, and neutral contingencies. Using computational modeling, we investigated the extent to which the 2 groups differed in their learning abilities to obtain reward and/or to avoid punishment.

RESULTS

RL model comparisons showed that a model with separate learning rates per contingency explained behavioral performance best. Importantly, CD youths showed lower learning rates than TDCs specifically for punishment, whereas learning rates for reward and neutral contingencies did not differ. Moreover, callous-unemotional (CU) traits did not correlate with learning rates in CD.

CONCLUSION

CD youths have a highly selective impairment in probabilistic punishment learning, regardless of their CU traits, whereas reward learning appears to be intact. In summary, our data suggest punishment insensitivity rather than reward dominance in CD. Clinically, the use of punishment-based intervention techniques to achieve effective discipline in patients with CD may be a less helpful strategy than reward-based techniques.

Decision-making style explains the withdrawal behavior of shy individuals: evidence from Chinese college students

Few studies have examined the mechanisms linking motivated behavior and reward-punishment stimuli in shy individuals. This study was designed to probe these mechanisms by examining shy and non-shy college student responses to both monetary rewards and penalties in the Iowa Gambling Task (IGT). Specifically, out of the 280 undergraduates surveyed in East China, 45 participants (18 boys) identified as shy and 45 (19 boys) identified as non-shy based on their shyness questionnaire scores were selected to participate in the IGT. Results revealed that shy participants selected favorable low-risk seeking decks (deck C) more frequently and adverse high-risk seeking decks (deck B) less frequently and were more inclined to change deck selection after incurring a net loss. Furthermore, the net score of shy students was higher than that of nonshy students. Results demonstrated that shy people were the winners of IGT games, indicating that they are more likely to exhibit risk-averse behaviors when making decisions. The results are discussed from the perspective of the decision-making style and practical implications of shy individuals.

Comparing monetary gain and loss in the monetary incentive delay task: EEG evidence

What is more effective to guide behavior: The desire to gain or the fear to lose? Electroencephalography (EEG) studies have yielded inconsistent answers. In a systematic exploration of the valence and magnitude parameters in monetary gain and loss processing, we used time-domain and time-frequency-domain analyses to uncover the underlying neural processes. A group of 24 participants performed a monetary incentive delay (MID) task in which cue-induced anticipation of a high or low magnitude of gain or loss was manipulated trial-wise. Behaviorally, the anticipation of both gain and loss expedited responses, with gain anticipation producing greater facilitation than loss anticipation. Analyses of cue-locked P2 and P3 components revealed the significant valence main effect and valence × magnitude interaction: amplitude differences between high and low incentive magnitudes were larger with gain vs. loss cues. However, the contingent negative variation component was sensitive to incentive magnitude but did not vary with incentive valence. In the feedback phase, the RewP component exhibited reversed patterns for gain and loss trials. Time-frequency analyses revealed a large increase in delta/theta-ERS oscillatory activity in high- vs. low-magnitude conditions and a large decrease of alpha-ERD oscillatory activity in gain vs. loss conditions in the anticipation stage. In the consumption stage, delta/theta-ERS turned out stronger for negative than positive feedback, especially in the gain condition. Overall, our study provides new evidence for the neural oscillatory features of monetary gain and loss processing in the MID task, suggesting that participants invested more attention under gain and high-magnitude conditions vs. loss and low-magnitude conditions.

Is superstitious responding a matter of detectability? A replication of Killeen (1978)

Organisms may sometimes behave as if a contingency exists between behavior and consequences, even if this is not actually the case. Killeen (1978) suggested that such superstition occurs because of factors that bias subjects to behave "superstitiously" rather than because of failures of discrimination. We systematically replicated Killeen's experiment and compared contingency discrimination between different consequences. Six pigeons responded in a matching-to-sample procedure in which a response-independent or response-dependent stimulus change, food delivery, or blackout occurred. The pigeons reported whether the consequence was response dependent or response independent by choosing between two side keys. Discrimination was strongest after stimulus changes, weaker after blackouts, and weakest after food deliveries. These differences persisted even after additional training, suggesting asymmetries that may reflect differences in the disruptive effects of different consequences on remembering and/or behavioral mnemonics. Importantly, the pigeons were not biased to report response-dependent consequences unless that response was consistent with locational biases; that is, they behaved "superstitiously" when there was a reason to be biased to do so. These findings corroborate Killeen's and demonstrate that behavior may deviate from contingencies not necessarily because subjects cannot discriminate those contingencies but because they are biased to behave otherwise.

Error-related signaling in nucleus accumbens D2 receptor-expressing neurons guides inhibition-based choice behavior in mice

Learned associations between environmental cues and the outcomes they predict (cue-outcome associations) play a major role in behavioral control, guiding not only which responses we should perform, but also which we should inhibit, in order to achieve a specific goal. The encoding of such cue-outcome associations, as well as the performance of cue-guided choice behavior, is thought to involve dopamine D1 and D2 receptor-expressing medium spiny neurons (D1-/D2-MSNs) of the nucleus accumbens (NAc). Here, using a visual discrimination task in male mice, we assessed the role of NAc D1-/D2-MSNs in cue-guided inhibition of inappropriate responding. Cell-type specific neuronal silencing and in-vivo imaging revealed NAc D2-MSNs to contribute to inhibiting behavioral responses, with activation of NAc D2-MSNs following response errors playing an important role in optimizing future choice behavior. Our findings indicate that error-signaling by NAc D2-MSNs contributes to the ability to use environmental cues to inhibit inappropriate behavior.

Primary rewards and aversive outcomes have comparable effects on attentional bias

Attention is biased toward stimuli previously associated with reward. The same is true for aversive conditioning; stimuli previously associated with an aversive outcome also bias attention, suggesting that motivational salience guides attention. Most research that supports this conclusion has manipulated monetary gain-a secondary reinforcer-for reward learning, and electric shocks-a primary punisher-for aversive conditioning, making it difficult to directly compare their influence on attention. Therefore, in the present study, we matched for reinforcer dimensions by using primary taste as reinforcers/punishers and assessed their influence on attention. In a training phase, participants learned to associate three colors with sweet juice (reward), salt water (aversive), and no outcome (neutral), respectively. The two primary reinforcers were equated for valence based on choices made in a prior decision-making task. In a later test phase, these three colors were used for targets and distractors in a task in which participants oriented to a shape-defined target. An attentional bias in favor of the aversively conditioned and reward-associated colors was evident when comparing to the neutral color. Importantly, a direct comparison of rewarded and aversive stimuli revealed no significant differences. These results suggest that when matched for reinforcer dimensions and valence, reward and aversive outcomes bias attention in a similar manner and their effects are comparable, providing further evidence in support of the motivational salience account of learning-dependent attention. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Perceptions of compliance in recreational fisheries: Case study of the Peel-Harvey blue swimmer crab fishery

Effective recreational fisheries management requires a balance between fisher enjoyment and compliance with regulations and fisher perceptions can be useful to understand whether the balance is right. Our study collected fisher insights via an online perceptions survey into compliance within the recreational shore-based Peel-Harvey blue swimmer crab fishery in Western Australia. Overwhelmingly, participants self-reported as complying with regulations; a positive finding for a licence-free fishery. Further, to enable increased quantity and size of available stock and thus overall enjoyment of the fishery, survey participants suggested longer fishery closure periods; harsher noncompliance penalties; more natural and physical surveillance; and greater educational signage in popular fishing areas. These insights challenge existing literature whereby tough regulations are often rejected by fishers and may lead to noncompliance. In a view to achieve a shared goal of a sustainable fishery, we explore survey perceptions against situational crime prevention to optimize compliance, embracing regulator-led ‘cooperative compliance’ outcomes. Our results are useful not only to this fishery but apply more broadly to other fisheries within and beyond Western Australia.

Serotonin modulates asymmetric learning from reward and punishment in healthy human volunteers

Instrumental learning is driven by a history of outcome success and failure. Here, we examined the impact of serotonin on learning from positive and negative outcomes. Healthy human volunteers were assessed twice, once after acute (single-dose), and once after prolonged (week-long) daily administration of the SSRI citalopram or placebo. Using computational modelling, we show that prolonged boosting of serotonin enhances learning from punishment and reduces learning from reward. This valence-dependent learning asymmetry increases subjects' tendency to avoid actions as a function of cumulative failure without leading to detrimental, or advantageous, outcomes. By contrast, no significant modulation of learning was observed following acute SSRI administration. However, differences between the effects of acute and prolonged administration were not significant. Overall, these findings may help explain how serotonergic agents impact on mood disorders.

Assessing behavioural profiles following neutral, positive and negative feedback

Previous data suggest zero-value, neutral outcomes (draw) are subjectively assigned negative rather than positive valence. The combined observations of faster rather than slower reaction times, subsequent actions defined by shift rather than stay behaviour, reduced flexibility, and, larger rather than smaller deviations from optimal performance following draws all align with the consequences of explicitly negative outcomes such as losses. We further tested the relationships between neutral, positive and negative outcomes by manipulating value salience and observing their behavioural profiles. Despite speeded reaction times and a non-significant bias towards shift behaviour similar to losses when draws were assigned the value of 0 (Experiment 1), the degree of shift behaviour approached an approximation of optimal performance when the draw value was explicitly positive (+1). This was in contrast to when the draw value was explicitly negative (-1), which led to a significant increase in the degree of shift behaviour (Experiment 2). Similar modifications were absent when the same value manipulations were applied to win or lose trials (Experiment 3). Rather than viewing draws as neutral and valence-free outcomes, the processing cascade generated by draws produces a complex behavioural profile containing elements found in response to both explicitly positive and explicitly negative results.

Breaking the bonds of reinforcement: Effects of trial outcome, rule consistency and rule complexity against exploitable and unexploitable opponents

In two experiments, we used the simple zero-sum game Rock, Paper and Scissors to study the common reinforcement-based rules of repeating choices after winning (win-stay) and shifting from previous choice options after losing (lose-shift). Participants played the game against both computer opponents who could not be exploited and computer opponents who could be exploited by making choices that would at times conflict with reinforcement. Against unexploitable opponents, participants achieved an approximation of random behavior, contrary to previous research commonly finding reinforcement biases. Against exploitable opponents, the participants learned to exploit the opponent regardless of whether optimal choices conflicted with reinforcement or not. The data suggest that learning a rule that allows one to exploit was largely determined by the outcome of the previous trial.

Contributions of gains and losses to attentional capture and disengagement: evidence from the gap paradigm

It is known that movements of visual attention are influenced by features in a scene, such as colors, that are associated with value or with loss. The present study examined the detailed nature of these attentional effects by employing the gap paradigm-a technique that has been used to separately reveal changes in attentional capture and shifting, and changes in attentional disengagement. In four experiments, participants either looked toward or away from stimuli with colors that had been associated either with gains or with losses. We found that participants were faster to look to colors associated with gains and slower to look away from them, revealing effects of gains on both attentional capture and attentional disengagement. On the other hand, participants were both slower to look to features associated with loss, and faster to look away from such features. The pattern of results suggested, however, that the latter finding was not due to more rapid disengagement from loss-associated colors, but instead to more rapid shifting of attention away from such colors. Taken together, the results reveal a complex pattern of effects of gains and losses on the disengagement, capture, and shifting of visual attention, revealing a remarkable flexibility of the attention system.

A micro-genesis account of longer-form reinforcement learning in structured and unstructured environments

We explored the possibility that in order for longer-form expressions of reinforcement learning (win-calmness, loss-restlessness) to manifest across tasks, they must first develop because of micro-transactions within tasks. We found no evidence of win-calmness or loss-restlessness when wins could not be maximised (unexploitable opponents), nor when the threat of win minimisation was presented (exploiting opponents), but evidence of win-calmness (but not loss-restlessness) when wins could be maximised (exploitable opponents).

The functional neural architecture of dysfunctional reward processing in autism

Functional imaging studies have found differential neural activation patterns during reward-paradigms in patients with autism spectrum disorder (ASD) compared to neurotypical controls. However, publications report conflicting results on the directionality and location of these aberrant activations. We here quantitatively summarized relevant fMRI papers in the field using the anatomical likelihood estimation (ALE) algorithm. Patients with ASD consistently showed hypoactivations in the striatum across studies, mainly in the right putamen and accumbens. These regions are functionally involved in the processing of rewards and are enrolled in extensive neural networks involving limbic, cortical, thalamic and mesencephalic regions. The striatal hypo-activations found in our ALE meta-analysis, which pooled over contrasts derived from the included studies on reward-processing in ASD, highlight the role of the striatum as a key neural correlate of impaired reward processing in autism. These changes were present for studies using social and non-social stimuli alike. The involvement of these regions in extensive networks associated with the processing of both positive and negative emotion alike might hint at broader impairments of emotion processing in the disorder.

A single dose of escitalopram blunts the neural response in the thalamus and caudate during monetary loss

BACKGROUND

Selective serotonin reuptake inhibitors (SSRIs) show acute effects on the neural processes associated with negative affective bias in healthy people and people with depression. However, whether and how SSRIs also affect reward and punishment processing on a similarly rapid time scale remains unclear.

METHODS

We investigated the effects of an acute and clinically relevant dose (20 mg) of the SSRI escitalopram on brain response during reward and punishment processing in 19 healthy participants. In a doubleblind, placebo-controlled study using functional MRI, participants performed a well-established monetary reward task at 3 time points: at baseline; after receiving placebo or escitalopram; and after receiving placebo or escitalopram following an 8-week washout period.

RESULTS

Acute escitalopram administration reduced blood-oxygen-level-dependent (BOLD) response during punishment feedback in the right thalamus (family-wise error corrected [FWE] p = 0.013 at peak level) and the right caudate head (pFWE = 0.011 at peak level) compared to placebo. We did not detect any significant BOLD changes during reward feedback.

LIMITATIONS

We included only healthy participants, so interpretation of findings are limited to the healthy human brain and require future testing in patient populations. The paradigm we used was based on monetary stimuli, and results may not be generalizable to other forms of reward.

CONCLUSION

Our findings extend theories of rapid SSRI action on the neural processing of rewarding and aversive stimuli and suggest a specific and acute effect of escitalopram in the punishment neurocircuitry.

Variability in competitive decision-making speed and quality against exploiting and exploitative opponents

A presumption in previous work has been that sub-optimality in competitive performance following loss is the result of a reduction in decision-making time (i.e., post-error speeding). The main goal of this paper is to test the relationship between decision-making speed and quality, with the hypothesis that slowing down decision-making should increase the likelihood of successful performance in cases where a model of opponent domination can be implemented. Across Experiments 1–3, the speed and quality of competitive decision-making was examined in a zero-sum game as a function of the nature of the opponent (unexploitable, exploiting, exploitable). Performance was also examined against the nature of a credit (or token) system used as a within-experimental manipulation (no credit, fixed credit, variable credit). To compliment reaction time variation as a function of outcome, both the fixed credit and variable credit conditions were designed to slow down decision-making, relative to a no credit condition where the game could be played in quick succession and without interruption. The data confirmed that (a) self-imposed reductions in processing time following losses (post-error speeding) were causal factors in determining poorer-quality behaviour, (b) the expression of lose-shift was less flexible than the expression of win-stay, and, (c) the use of a variable credit system may enhance the perceived control participants have against exploitable opponents. Future work should seek to disentangle temporal delay and response interruption as determinants of decision-making quality against numerous styles of opponency.

Effects of a high-fat diet on impulsive choice in rats

INTRODUCTION

Obesity and binge eating disorder are associated with high levels of impulsivity, but the causal role of eating and palatable food in these associations is unclear. Studies in rodents show that a high-fat diet can increase one aspect of impulsivity (impulsive action); it is less clear, however, whether a dissociable aspect of impulsivity (impulsive choice) is similarly affected. Hence, the aim of this study was to ascertain whether chronic exposure to a high-fat diet would alter impulsive choice.

METHODS

Male rats were maintained on either a high-fat or control chow diet for two weeks ad libitum. They then underwent equi-caloric food restriction for the duration of the experiment, with each group maintained on their respective diet. To measure impulsive choice, rats were trained on a delay discounting task (DDT) in which they made discrete choices between a lever that delivered a small food reward immediately and a lever that delivered a large food reward accompanied by systematically increasing delays. Upon reaching stable performance on the DDT, rats were given acute systemic injections of amphetamine prior to testing in the DDT to determine whether increased monoamine transmission affected impulsive choice differently in the two diet groups. Lastly, subjects were tested on a progressive ratio schedule of reinforcement to assess motivation for a sucrose reward.

RESULTS

There was no significant effect of the high-fat diet on impulsive choice. Further, amphetamine decreased choice of the large, delayed reward (increased impulsive choice) to the same extent in both groups. Exposure to the high-fat diet did, however, increase motivation to obtain a sucrose reward.

CONCLUSIONS

These experiments reveal that, under conditions that do not promote weight gain, a chronic high-fat diet does not affect impulsive choice in a delay discounting task. The data are surprising in light of findings showing that this same diet alters impulsive action, and highlight the necessity of further research to elucidate relationships between palatable food consumption and impulsivity.

A new protocol for monitoring operational outcomes of environmental management in commercial forestry plantations

Environmental degradation is a global phenomenon with a high likelihood of influencing human quality of life. Effective management responses are needed to achieve societal goals of sustainability. We develop here a new monitoring protocol (Management Check: MATCH) that comprehensively evaluates management outcomes at the operational level. Using the Driver-Pressure-State-Impact-Response (DPSIR) framework, we identified pressures influencing ecosystem integrity inside conservation corridors and commercial compartments of a timber production landscape mosaic. They were 1) domestic livestock grazing (the only exogenous pressure), 2) fire management, 3) invasive alien plants (IAPs), and potential soil erosion from two sources: 4) roads, and 5) harvested timber compartments. We assessed the effects of these on wetland and stream buffers. Environmental incidents accounted for more serious management issues (e.g. oil spills). Management responses were systematically unpacked into point-form questions, which formed the building blocks of our monitoring protocol. We assessed management in twelve plantations in KwaZulu-Natal, South Africa. Answers were compared with Best Operational Practice (BOP), and reworked into a Weighted Index of Compliance (WIC) per section. We found that there was poor management of livestock grazing, but good management of IAPs, roads, and timber compartments. Management of wetland and stream buffers was very good. Fire management presented problems linked to lack of direct effects, measurable at the spatial and temporal scales of operations. We discuss operational outcomes within their respective legislative frameworks, and suggest ways of improving management operations, where needed. MATCH is the first monitoring protocol to comprehensively assess environmental management of commercial forestry at the operational level, and to clearly translate operational activities into measurable progress towards strategic goals. In doing so, MATCH breaks down silos and builds bridges for efficient environmental management in dynamic socio-ecological systems. Moreover, the principles developed here can be applied to build tools that help manage major risks in other economic sectors too. Overall, MATCH strengthened strategic and informed action, which is necessary at multiple levels of an organization, to combat major societal risks, such as environmental degradation.

Multidimensional Models of Perfectionism and Procrastination: Seeking Determinants of Both

Background: Perfectionism is currently conceptualized using a multidimensional model, with extensive research establishing the presence of both maladaptive and adaptive forms. However, the potential adaptability of procrastination, largely considered as a maladaptive construct, and its possible developmental connection to perfectionism remains unclear. The purpose of this study was to examine the individual differences of the multidimensional models of both perfectionism and procrastination, as well as investigating potential links between the two constructs. Methods: A convenience sample of 206 undergraduate students participated in this study. Participants completed a questionnaire consisting of 236 questions regarding the variables under investigation. Results: The adaptive model of procrastination yielded largely insignificant results and demonstrated limited links with adaptive perfectionism, while maladaptive procrastination was consistently associated with maladaptive perfectionism, lending further evidence of a unidimensional model of procrastination. Conclusions: Many previous findings regarding the multidimensional model of perfectionism were replicated, along with new contributions focusing on the dual-process model and temporal orientation.

Switching Competitors Reduces Win-Stay but Not Lose-Shift Behaviour: The Role of Outcome-Action Association Strength on Reinforcement Learning

Predictability is a hallmark of poor-quality decision-making during competition. One source of predictability is the strong association between current outcome and future action, as dictated by the reinforcement learning principles of win–stay and lose–shift. We tested the idea that predictability could be reduced during competition by weakening the associations between outcome and action. To do this, participants completed a competitive zero-sum game in which the opponent from the current trial was either replayed (opponent repeat) thereby strengthening the association, or, replaced (opponent change) by a different competitor thereby weakening the association. We observed that win–stay behavior was reduced during opponent change trials but lose–shiftbehavior remained reliably predictable. Consistent with the group data, the number of individuals who exhibited predictable behavior following wins decreased for opponent change relative to opponent repeat trials. Our data show that future actions are more under internal control following positive relative to negative outcomes, and that externally breaking the bonds between outcome and action via opponent association also allows us to become less prone to exploitation.

The Effect of Counterfactual Information on Outcome Value Coding in Medial Prefrontal and Cingulate Cortex: From an Absolute to a Relative Neural Code

Adaptive coding of stimuli is well documented in perception, where it supports efficient encoding over a broad range of possible percepts. Recently, a similar neural mechanism has been reported also in value-based decision, where it allows optimal encoding of vast ranges of values in PFC: neuronal response to value depends on the choice context (relative coding), rather than being invariant across contexts (absolute coding). Additionally, value learning is sensitive to the amount of feedback information: providing complete feedback (both obtained and forgone outcomes) instead of partial feedback (only obtained outcome) improves learning. However, it is unclear whether relative coding occurs in all PFC regions and how it is affected by feedback information. We systematically investigated univariate and multivariate feedback encoding in various mPFC regions and compared three modes of neural coding: absolute, partially-adaptive and fully-adaptive.Twenty-eight human participants (both sexes) performed a learning task while undergoing fMRI scanning. On each trial, they chose between two symbols associated with a certain outcome. Then, the decision outcome was revealed. Notably, in one-half of the trials participants received partial feedback, whereas in the other half they got complete feedback. We used univariate and multivariate analysis to explore value encoding in different feedback conditions.We found that both obtained and forgone outcomes were encoded in mPFC, but with opposite sign in its ventral and dorsal subdivisions. Moreover, we showed that increasing feedback information induced a switch from absolute to relative coding. Our results suggest that complete feedback information enhances context-dependent outcome encoding.SIGNIFICANCE STATEMENT This study offers a systematic investigation of the effect of the amount of feedback information (partial vs complete) on univariate and multivariate outcome value encoding, within multiple regions in mPFC and cingulate cortex that are critical for value-based decisions and behavioral adaptation. Moreover, we provide the first comparison of three possible models of neural coding (i.e., absolute, partially-adaptive, and fully-adaptive coding) of value signal in these regions, by using commensurable measures of prediction accuracy. Taken together, our results help build a more comprehensive picture of how the human brain encodes and processes outcome value. In particular, our results suggest that simultaneous presentation of obtained and foregone outcomes promotes relative value representation.

Correlation between precontemplation and alpha activity in gambling disorder

PURPOSE

Gambling disorder is a psychiatric condition characterized by persistent and recurrent maladaptive gambling. In the present study, we evaluated the characteristics of resting-state electroencephalogram (EEG) recordings in patients with gambling disorder. In addition, we explored the association between the EEG characteristics of the patients and the stages of change in a transtheoretical model.

METHODS

All participants were men who visited a gambling disorder clinic in Seoul, Korea. At the assessment, questionnaires, including the Readiness to Change Questionnaire (RCQ), were administered and resting-state EEGs were carried out. Participants were grouped based on Ward's method for cluster analysis. Independent sample t-tests were used to evaluate group differences. To assess the relationship between the clinical data and the EEG recordings, we used Pearson's partial correlation analysis.

RESULTS

Overall, 63 male participants were enrolled. Cluster analysis of the alpha activity revealed two clusters. No significant differences were observed in the demographic or clinical data between the two groups except for the Beck Depression Inventory (BDI). We found that the precontemplation score of the RCQ was positively correlated with the z-score of the relative alpha power in almost all cortical regions.

CONCLUSION

This study suggests that EEG parameters, particularly alpha activity, could inform us about the subtypes or stages of change in gambling disorder. Alpha power is the predominant EEG rhythm in a relaxed, alert person; thus, alpha power serves as an index of relaxation. We expect that the level of alpha activity could be utilized as an additional parameter to help clinicians assess and treat patients with gambling disorder.

Ventral striatum's role in learning from gains and losses

Adaptive behavior requires animals to learn from experience. Ideally, learning should both promote choices that lead to rewards and reduce choices that lead to losses. Because the ventral striatum (VS) contains neurons that respond to aversive stimuli and aversive stimuli can drive dopamine release in the VS, it is possible that the VS contributes to learning about aversive outcomes, including losses. However, other work suggests that the VS may play a specific role in learning to choose among rewards, with other systems mediating learning from aversive outcomes. To examine the role of the VS in learning from gains and losses, we compared the performance of macaque monkeys with VS lesions and unoperated controls on a reinforcement learning task. In the task, the monkeys gained or lost tokens, which were periodically cashed out for juice, as outcomes for choices. They learned over trials to choose cues associated with gains, and not choose cues associated with losses. We found that monkeys with VS lesions had a deficit in learning to choose between cues that differed in reward magnitude. By contrast, monkeys with VS lesions performed as well as controls when choices involved a potential loss. We also fit reinforcement learning models to the behavior and compared learning rates between groups. Relative to controls, the monkeys with VS lesions had reduced learning rates for gain cues. Therefore, in this task, the VS plays a specific role in learning to choose between rewarding options.

Are morally good actions ever free?

Research has shown that people ascribe more responsibility to morally bad actions than both morally good and neutral ones, suggesting that people do not attribute responsibility to morally good actions. The present work demonstrates that this is not so: People ascribe more free will to morally good than neutral actions (Studies 1a-1b, Mini Meta). Studies 2a-2b distinguished the underlying motives for ascribing freedom to morally good and bad actions. Free will ascriptions for immoral actions were driven predominantly by affective responses (i.e., punitive desires, moral outrage, and perceived severity of the crime). Free will judgments for morally good actions were similarly driven by affective responses (i.e., reward desires, moral uplift, and perceived generosity), but also more pragmatic considerations (perceived utility of reward, counternormativity of the action, and required willpower). Morally good actions may be more carefully considered, leading to generally weaker, but more contextually sensitive free will judgments.

Reward Size Informs Repeat-Switch Decisions and Strongly Modulates the Activity of Neurons in Parietal Cortex

Behavior is guided by previous experience. Good, positive outcomes drive a repetition of a previous behavior or choice, whereas poor or bad outcomes lead to an avoidance. How these basic drives are implemented by the brain has been of primary interest to psychology and neuroscience. We engaged animals in a choice task in which the size of a reward outcome strongly governed the animals' subsequent decision whether to repeat or switch the previous choice. We recorded the discharge activity of neurons implicated in reward-based choice in 2 regions of parietal cortex. We found that the tendency to retain previous choice following a large (small) reward was paralleled by a marked decrease (increase) in the activity of parietal neurons. This neural effect is independent of, and of sign opposite to, value-based modulations reported in parietal cortex previously. This effect shares the same basic properties with signals previously reported in the limbic system that detect the size of the recently obtained reward to mediate proper repeat-switch decisions. We conclude that the size of the obtained reward is a decision variable that guides the decision between retaining a choice or switching, and neurons in parietal cortex strongly respond to this novel decision variable.

Comparing the effects of positive and negative feedback in information-integration category learning

Categorical learning is dependent on feedback. Here, we compare how positive and negative feedback affect information-integration (II) category learning. Ashby and O'Brien (2007) demonstrated that both positive and negative feedback are required to solve II category problems when feedback was not guaranteed on each trial, and reported no differences between positive-only and negative-only feedback in terms of their effectiveness. We followed up on these findings and conducted 3 experiments in which participants completed 2,400 II categorization trials across three days under 1 of 3 conditions: positive feedback only (PFB), negative feedback only (NFB), or both types of feedback (CP; control partial). An adaptive algorithm controlled the amount of feedback given to each group so that feedback was nearly equated. Using different feedback control procedures, Experiments 1 and 2 demonstrated that participants in the NFB and CP group were able to engage II learning strategies, whereas the PFB group was not. Additionally, the NFB group was able to achieve significantly higher accuracy than the PFB group by Day 3. Experiment 3 revealed that these differences remained even when we equated the information received on feedback trials. Thus, negative feedback appears significantly more effective for learning II category structures. This suggests that the human implicit learning system may be capable of learning in the absence of positive feedback.

Choice predicts the feedback negativity

Choosing the appropriate response given the circumstance is integral to all aspects of human behavior. One way of elucidating the mechanisms of choice is to relate behavior to neural correlates. Electrophysiological evidence implicates the ERP feedback-negativity (FN) and the P300 as promising neural correlates of reward processing, an integral component of learning. However, prior research has not adequately addressed how the development of a preference to select one option over another (choice preference) relates to the FN and the P300. We assessed whether variation in choice preference predicted the FN and P300 amplitude within subjects. We used a discrete-trials two-alternative choice procedure, where the reinforcer rate for each option was dependently scheduled by a concurrent variable interval. The reinforcer ratio for selecting each option was varied between sessions. Choice was quantified using both the generalized matching law sensitivity and the log odds of staying on the same versus switching to the other alternative (stay preference). The relationship between stay preference, FN, and P300 amplitudes was assessed using the innovative application of hierarchical Bayesian linear regression. The results demonstrate that stay preference was controlled by the reinforcer ratios and credibly predicted the FN amplitude but not P300 amplitude. The findings are consistent with the view that reinforcers may guide behavior by what they signal about future reinforcement, with the FN related to such a process.

The Effects of Negative Reinforcement on Increasing Patient Adherence to Appointments at King Abdullah University Hospital in Jordan

Appointment nonadherence is a health behavior that represents a burden to health care systems. On March 1, 2015, a new negative reinforcement intervention involving "service fees" for a visit without appointment was implemented at King Abdullah University Hospital in Jordan. To evaluate the effect of this intervention in improving patient adherence to medical appointment, a retrospective preintervention and postintervention analysis was used, including all patients (n = 65 535) who had scheduled appointments at 39 outpatient clinics. A repeated-measures analysis of variance was first performed. Then, a multivariate linear regression model was used to identify factors that might predict individuals who are likely to attend or miss their appointments and those who have a greater tendency to visit the hospital with or without appointments. Although the average percentage of appointments attended was more than missed preintervention and postintervention, the decrease in percentage of missed appointments was more pronounced postintervention. Also, the average percentage of visits without appointments was less than visits with appointments in both times, but the decrease in the percentage of visits without appointments was more prominent after. The regression analysis revealed that younger, married and male patients were more likely to miss their appointment before and after the intervention. Also, younger patients had a tendency to attend without appointments. Conversely, patients with the lower copayment rate had a tendency to adhere to appointment times. In conclusion, negative reinforcement interventions could improve patient appointment adherence rates. Accordingly, interventions designed that consider evidence and are theory-based are needed to change patient behavior.