Behavioural responses to unexpected changes in reward quality

Successive negative contrast (SNC) effects are changes in anticipatory or consummatory behaviour when animals unexpectedly receive a lower value reward than they have received previously. SNC effects are often assumed to reflect frustration and appear to be influenced by background affective state. However, alternative explanations of SNC, such as the functional-search hypothesis, do not necessarily imply an aversive affective state. We tested 18 dogs in a SNC paradigm using a patch foraging task. Dogs were tested in two conditions, once with the low value reward in all of five trials (unshifted) and once when reward value was altered between high and low (shifted). Following a reward downshift, subjects showed a SNC effect by switching significantly more often between patches compared to the unshifted condition. However, approach latency, foraging time and quantity consumed did not differ between conditions, suggesting non-affective functional search behaviour rather than frustration. There was no relationship between strength of SNC and anxiety-related behaviours as measured in a novel object test and a personality questionnaire (C-BARQ). However, associations with the C-BARQ scores for Trainability and Stranger directed aggression suggest a possible link with behavioural flexibility and coping style. While reward quality clearly affects incentive motivation, the relationship between SNC, frustration and background affective state requires further exploration.

Consummatory suppression due to incentive downshift is not a consequence of enhanced search behavior

Rats shifted from 32% to 4% sucrose solution consume less from the 4% solution than rats that experience only the 4% solution. This consummatory suppression, a phenomenon known as consummatory successive negative contrast (cSNC), is accompanied by an increase in other behaviors such as rearing, nose-down locomotion, ambulation, sampling new sources and grooming. Despite a large body of studies on the cSNC, it remains to be determined whether reduced consumption is part of the direct response to the reward downshift or a byproduct of the increase in alternative competing behaviors. The objective of the present study was to determine if consummatory suppression would occur when most competing behaviors are prevented from occurring. Rats were trained either with 32% or 4% sucrose solution for ten days in restrainers that limited almost all movement. On the next five days, all subjects received the 4% sucrose solution and a robust suppression in drinking in the downshifted animals was observed. These results suggest that consummatory suppression is a direct consequence of incentive downshift and not a byproduct of the increase in competing behaviors.

Devaluation of low-quality food during early experience by sheep

A ruminant's early experience with low-quality food (LQF) is expected to increase its acceptance and preference in adulthood. Contrarily, we found that experienced sheep (ES) exposed to mature oat hay early in life ate less of this LQF than inexperienced sheep (IS). A possibility is that ES might have devaluated the LQF through continuous comparisons against high-quality food (HQF) supplements (sunflower meal and ground corn) that were simultaneously available during early experience. In this study, we tested the devaluation hypothesis with a successive negative contrast (SNC) procedure. In a consummatory SNC procedure, 'shift' subjects are unexpectedly changed from HQF to LQF, and their consumption is then compared against the consumption of 'unshift' subjects that receive LQF all throughout the SNC procedure. The magnitude of the difference in consumption between preshift and postshift is regarded as a measure of the degree to which both foods (HQF and LQF) are perceived to differ hedonically. When sheep from our previous study were 300 days old, both ES and IS were randomly assigned to either shift (ES-S and IS-S) or unshift conditions (ES-U and IS-U; n = 6 in each group). Groups ES-S and IS-S were fed HQF (alfalfa hay) during the preshift phase, and then suddenly changed to LQF (oat hay) in the postshift phase. Groups ES-U and IS-U (controls) were fed only LQF throughout the SNC procedure. Subjects in ES-S showed a significantly lower intake of LQF than those in ES-U in the first postshift session (i.e. they showed an SNC effect), which was not observed in IS. These results agree with ES subjects having devalued LQF during early experience. We discuss the possibility that high levels of nutrient supplementation can result in devaluation of LQF (i.e. decrease in preference and acceptance), whereas restricted levels of supplementation may promote a positive experience with LQF.

Reward motivation accelerates the onset of neural novelty signals in humans to 85 milliseconds

The neural responses that distinguish novel from familiar items in recognition memory tasks are remarkably fast in both humans and nonhuman primates. In humans, the earliest onsets of neural novelty effects emerge at about ∼150–200 ms after stimulus onset [1–5]. However, in recognition memory studies with nonhuman primates, novelty effects can arise at as early as 70–80 ms [6, 7]. Here, we address the possibility that this large species difference in onset latencies is caused experimentally by the necessity of using reward reinforcement to motivate the detection of novel or familiar items in nonhuman primates but not in humans. Via magnetoencephalography in humans, we show in two experiments that the onset of neural novelty signals is accelerated from ∼200 ms to ∼85 ms if correct recognition memory for either novel or familiar items is rewarded. Importantly, this acceleration is independent of whether the detection of the novel or the familiar scenes is rewarded. Furthermore, this early novelty effect contributed to memory retrieval because neural reward responses, which were contingent upon novelty detection, followed ∼100 ms later. Thus, under the contextual influence of reward motivation, behaviorally relevant novelty signals emerge much faster than previously held possible in humans.

Anxiolytic-like effect of ejaculation upon frustration

In three experiments, we studied the consequences of ejaculation upon the frustrative or contrast response of male rats exposed to reward downshift situations (i.e., surprising changes from 32% to 4% sucrose solutions). Similar to what has been found after treatment with anxiolytic agents, consummatory suppression was partially reversed by previous ejaculations in a second postshift trial (Experiments 2 and 3), such a result not having been obtained in a first postshift trial (Experiment 1). Moreover, the effect of ejaculations upon males' behavior during a second postshift trial was transitory, disappearing when assessed during the third and fourth postshift trials (Experiment 3). These results are in accordance with both Amsel's (1958, 1992) frustration theory and Flaherty's (1996) multistage hypothesis of successive negative contrast; the diverse factors that are known to modulate contrast effects are considered, including an interpretation of the present data in terms of the anxiolytic-like effect of the ejaculation.

Selective effects of the delta-opioid receptor agonist DPDPE on consummatory successive negative contrast

Two experiments explored the role of the opioid system in a situation involving a surprising reduction in reward magnitude: consummatory successive negative contrast. Rats received access to 32% sucrose solution (preshift Trials 1-10) followed by 4% solution (postshift Trials 11-15). Independent groups received an injection of either the vehicle or the delta-receptor agonist [D-Ala2-,N-Me-Phe4,Gly-ol] enkephalin (DPDPE; 24 microg/kg). DPDPE attenuated the contrast effect when injected before Trial 11 but not when injected before Trial 12. An additional experiment showed that the attenuating effect of partial reinforcement on the recovery from contrast was reduced by DPDPE injections administered before nonreinforced preshift trials.

Frustration and sexual behavior in male rats

Frustration is an emotional state produced by the surprising omission in quantity and/or quality of an appetitive reinforcer. The aversive properties of stressors, such as electric shocks, produce responses similar to those elicited by a state of frustration. In this set of three experiments, we assessed the effects of water immersion (WIM, in Experiment 1)--that is, a physical stressor--and first (in Experiments 1 and 2) and second trials of a consummatory extinction (cE; i.e., a surprising reward omission; in Experiment 3) on the sexual behavior of male rats, as compared with nonstressed animals. The results showed a sexual deficit in the animals subjected to either WIM or cE, relative to control subjects, although these experimental conditions differed in the component of the male sexual response that was affected. The present results accord with the fear = frustration hypothesis, and with Amsel's frustration theory.

Consequences of Surprising Reward Omissions

A surprising reward omission (SRO) occurs when an appetitive reinforcer is not presented (or it is reduced in magnitude or quality) even though there are signals for its impending presentation. Evidence supporting the hypothesis that SROs produce an aversive emotional reaction with physiological and behavioral consequences is reviewed. SROs are followed by pituitary–adrenal activation; changes in immune function; odor emissions in rodents; distress vocalizations in rodents and primates; and increases in locomotion, aggressive behavior, drinking, and eating. SROs can support the acquisition of new escape responses and invigorate previously acquired responses. The review identifies common aspects of these phenomena and areas in which more research is needed.

Cyproheptadine prevents the initial occurrence of successive negative contrast

Rats shifted from 32% to 4% sucrose make fewer licks for 4% sucrose than rats having only experienced the lower reward. In Experiment 1, the occurrence of this contrast effect was prevented by the administration of the nonspecific serotonin antagonist cyproheptadine (3.0 or 6.0 mg/kg). These results of Experiments 2 and 3 demonstrated that the contrast-reducing action of cyproheptadine was not mediated by the antiserotonergic properties of the drug since systemic administration of the serotonin synthesis inhibitor, PCPA (150 or 300 mg/kg), failed to influence either the occurrence of contrast or the attenuation of contrast by cyproheptadine. The results of Experiment 4 indicated that the contrast-reducing action of cyproheptadine was not mediated by the antihistaminergic properties of the drug since the antihistamine, pyrilamine (6 or 12 mg/kg), also failed to prevent the occurrence of contrast. Finally, the contrast-reducing action of cyproheptadine was not due to rate-dependent and/or appetite stimulating effects since cyproheptadine did not serve to increase lick frequency in rate-dependent controls.

Effect of anxiolytics and antidepressants on extinction and negative contrast

Anxiolytics, particularly the benzodiazepines and barbiturates tend to retard, but not prevent, extinction, promote recovery from negative contrast, and elevate S- responding in discrimination training. Anxiolytics, administered during acquisition, tend to eliminate the partial reinforcement extinction effect, but this result is substantially influenced by parametric considerations. Behaviors that are energized in extinction may have a different pharmacological profile than behaviors that decline. Conclusions regarding the effects of antidepressants must be more tentative but, in general, acutely administered antidepressants are relatively ineffective in all of these paradigms. However, antidepressants may enhance the efficiency of responding on DRL schedules whereas anxiolytics tend to disrupt such behavior.

Are conditioned stimuli determinants of oriented exploratory behavior in the rat?

To test Bindra and Palfai's hypothesis about enhancing and inhibitory motivational effects of a conditioned stimulus on exploratory behavior, rats in a first experiment were submitted to pairings of a tone with (a) water, (b) intermittent deliveries of water after a period of constant pairing. In a control condition, the tone was presented alone. The tone was subsequently presented during oriented exploration of a novel stimulus, in the conditioning context. There was no difference in exploratory performance between conditions. In a second experiment with another kind of stimulus change and a larger number of training trials, exploration did not increase when occurring during CS presentation. The lack of facilitation which is possibly the product of competition between exploration and magazine-directed responses, can also be interpreted as indicating that the effects of a conditioned stimulus are reinforcer specific and that the diffuse activity it generates in a situation different from the training one is not equivalent, as concerns the processes involved, to oriented exploratory behavior.

Influence of ethanol on contrast in consummatory behavior

Negative contrast that occurs when rats are shifted from 32% to 4% sucrose was reduced by IP injections of ethanol (1.0 g/kg) on postshift day 2, but not on postshift day 1. Smaller doses (0.25 and 0.5 g/kg) were ineffective, while larger doses (1.5 and 2 g/kg) produced sedation. A dose of 0.75 g/kg had effects similar to the 1.0 g/kg dose when administered on post-shift day 2. These results parallel those obtained with chlordiazepoxide and differ somewhat from amobarbital treatment.