Reward and reinforcement produced by drinking sucrose: two processes that may depend on different neurotransmitters

Individual differences in locomotor reactivity to a novel environment and sensitivity to opioid drugs in the rat. II. Agonist-induced antinociception and antagonist-induced suppression of fluid consumption

RATIONALE

In an animal model for vulnerability to drug abuse, rats that are more reactive to a novel environment (high responders, HRs) are more sensitive to behavioral effects of psychostimulants than are less reactive rats (low responders, LRs). In a companion article, we reported that HRs and LRs differ in sensitivity to morphine-induced locomotor sensitization.

OBJECTIVE

We tested whether LRs and HRs also differ in sensitivity to opioid-induced antinociception and opioid antagonist-induced suppression of fluid consumption.

METHODS

LRs and HRs were categorized based on motor responses to novelty during a 30-min session. Responses to nociceptive stimuli of varied intensities were measured using the tail-flick and hot-plate tests alone or following cumulative doses of morphine (1.0-12 mg/kg), buprenorphine (0.025-0.6 mg/kg), or etorphine (0.25-6.0 microg/kg). Potential changes in endogenous opioid-mediated reward systems were tested using naltrexone-induced (0.01-30 mg/kg) suppression of drinking either water following 24-h deprivation or sweetened condensed milk in a non-deprived state. These effects were further examined following 2 weeks of daily access to sweetened condensed milk.

RESULTS

At the lowest stimulus intensity tested, HRs had significantly shorter tail-flick response latencies than LRs. Additionally, HRs were less responsive to cumulative doses of morphine than LRs. There were no overall group differences in the hot-plate test. Following 2 weeks of daily access to sweetened condensed milk, HRs were more sensitive to naltrexone-induced suppression of consumption.

CONCLUSIONS

Under the proper conditions, differences in sensitivity to opioid drugs between HRs and LRs at least partially extend to antinociceptive and appetitive reward systems and are suggestive of more extensive differences in phenotype. As with the effects of repeated morphine exposure on locomotor activity, the effect of repeated exposure to appetitive reward associated with sweetened milk appears to be more robust in LRs than HRs.

Intraventricular insulin and leptin reverse place preference conditioned with high-fat diet in rats

The authors hypothesized that insulin and leptin, hormones that convey metabolic and energy balance status to the central nervous system (CNS), decrease the reward value of food, as assessed by conditioned place preference (CPP). CPP to high-fat diet was blocked in ad-lib fed rats given intraventricular insulin or leptin throughout training and test or acutely before the test. Insulin or leptin given only during the training period did not block CPP. Thus, elevated insulin and leptin do not prevent learning a food's reward value, but instead block its retrieval. Food-restricted rats receiving cerebrospinal fluid, insulin, or leptin had comparable CPPs. Results indicate that the CNS roles of insulin and leptin may include processes involving memory and reward.

Endogenous opioids and feeding behavior: a 30-year historical perspective

This invited review, based on the receipt of the Third Gayle A. Olson and Richard D. Olson Prize for the publication of the outstanding behavioral article published in the journal Peptides in 2002, examines the 30-year historical perspective of the role of the endogenous opioid system in feeding behavior. The review focuses on the advances that this field has made over the past 30 years as a result of the timely discoveries that were made concerning this important neuropeptide system, and how these discoveries were quickly applied to the analysis of feeding behavior and attendant homeostatic processes. The discoveries of the opioid receptors and opioid peptides, and the establishment of their relevance to feeding behavior were pivotal in studies performed in the 1970s. The 1980s were characterized by the establishment of opioid receptor subtype agonists and antagonists and their relevance to the modulation of feeding behavior as well as by the use of general opioid antagonists in demonstrating the wide array of ingestive situations and paradigms involving the endogenous opioid system. The more recent work from the 1990s to the present, utilizes the advantages created by the cloning of the opioid receptor genes, the development of knockout and knockdown techniques, the systematic utilization of a systems neuroscience approach, and establishment of the reciprocity of how manipulations of opioid peptides and receptors affect feeding behavior with how feeding states affect levels of opioid peptides and receptors. The role of G-protein effector systems in opioid-mediated feeding responses, which was the subject of the prize-winning article, is then reviewed.

Emotion regulation and touch in infants: the role of cholecystokinin and opioids

Behavioral-pharmacological research in infant rats supports the role of cholecystokinin (CCK) and opioid peptides in mediating early learning of new associations with aspects of the nest and dam, such as maternal odor, milk, and contact. The current paper reviews research that examines the hypothesis that these neuropeptide systems are further involved in mediating emotion regulation in infants, thus playing a role in the emergence of stress-reactivity and other motivational systems. The beneficial effects of maternal proximity, handling, and touch on the development of emotion regulation have been demonstrated in both human and animal models. Interventions that promote tactile stimulation of the infant ("touch therapy") and infant-mother contact ("skin-to-skin contact" or "kangaroo care") have been shown to improve the infant's ability to self-regulate, and to moderate the effects of some risk factors. Theoretical perspectives and empirical findings regarding emotion regulation in infants are first discussed. This is followed by a review of work providing evidence in animal models (and suggestive evidence in humans) for the importance of CCK and opioid neuropeptides in affecting infant emotion regulation and the impact of touch-based interventions, in particular in the context of infant-mother attraction, contact, separation, and attachment.

Attenuation of sucrose reinforcement in dopamine D1 receptor deficient mice

Dopaminergic systems are thought to mediate the rewarding and reinforcing effects of palatable food. However, the relative contribution of different dopamine receptor subtypes is not clear. We used dopamine D1 receptor deficient mice (D1 -/-) and their wild-type and heterozygous littermates to study the role of the D1 receptor in palatable food reinforced behaviour using operant responding and free access paradigms. Non-deprived mice were trained to press a lever for sucrose pellets under three schedules of reinforcement including fixed ratios (FR-1 and FR-4) and a progressive ratio (PR). Responding on one lever was reinforced by the delivery of a sucrose pellet or solution while responding on a second lever had no programmed consequences. Initially, D1 mutant mice took longer to learn to discriminate between the two levers and had significantly lower operant responding for sucrose pellets and solution than wild-type and heterozygous mice under all schedules of reinforcement. Food deprivation enhanced responding on the active lever in all mice although it remained significantly lower in D1 -/- mice than in control mice. Following extinction of sucrose reinforcement and reversal of the levers, D1 -/- mice showed deficits in extinguishing and reversing previously learned responses. Home cage intake and preference of sucrose pellets and solutions when given under free-choice access paradigms were similar among the groups. These results suggest that the dopamine D1 receptor plays a role in the motivation to work for reward (palatable food) but not in reward perception and is critical in learning new but relevant information and discontinuing previously learned responses.

Chronic access to a sucrose solution enhances the development of conditioned place preferences for fentanyl and amphetamine in male Long-Evans rats

Consumption of palatable food and fluids alters the behavioral consequences of psychoactive drugs. To further investigate the effects of intake of palatable nutrients on the rewarding properties of these drugs, the effects of chronic intake of a sweet sucrose solution on the development of conditioned place preferences (CPP) to a mu-opioid agonist, fentanyl, and to a stimulant drug, amphetamine, were examined. Male Long-Evans rats consumed laboratory chow and water or chow, water, and a 32% sucrose solution. CPP testing was conducted in a three-chamber apparatus. In Experiment 1 (over four conditioning days), rats received saline, 0.004, or 0.016 mg/kg sc fentanyl citrate before being placed on the nonpreferred side of the apparatus and saline (subcutaneously) before being placed on the preferred side during a separate session on the same day. When given access to all three chambers, rats injected with 0.016 mg/kg fentanyl spent significantly more time on the drug-paired side than rats injected with saline. Furthermore, sucrose-fed rats displayed a significantly greater CPP than chow-fed rats. After conditioning, rats were tested for fentanyl-induced antinociception using the tail-flick test. Using a cumulative dose procedure, fentanyl (0.003, 0.010, 0.030, and 0.100 mg/kg sc) led to dose-dependent increases in tail-flick latencies. Rats fed with sucrose displayed significantly greater responses to fentanyl than those in the chow group. In Experiment 2, rats spent significantly more time on the drug-paired side of the CPP apparatus following injections of 0.33 or 1.0 mg/kg amphetamine than after saline injections. Additionally, following injection of 0.33 mg/kg amphetamine, sucrose-fed rats spent significantly more time on the drug-paired side of the chamber than chow-fed rats.

Motivational views of reinforcement: implications for understanding the behavioral functions of nucleus accumbens dopamine

Although the Skinnerian 'Empirical Law of Effect' does not directly consider the fundamental properties of stimuli that enable them to act as reinforcers, such considerations are critical for determining if nucleus accumbens dopamine systems mediate reinforcement processes. Researchers who have attempted to identify the critical characteristics of reinforcing stimuli or activities have generally arrived at an emphasis upon motivational factors. A thorough review of the behavioral literature indicates that, across several different investigators offering a multitude of theoretical approaches, motivation is seen by many as being fundamental to the process of reinforcement. The reinforcer has been described as a goal, a commodity, an incentive, or a stimulus that is being approached, self-administered, attained or preserved. Reinforcers also have been described as activities that are preferred, deprived or in some way being regulated. It is evident that this 'motivational' or 'regulatory' view of reinforcement has had enormous influence over the hypothesis that DA directly mediates 'reward' or 'reinforcement' processes. Indeed, proponents of the DA/reward hypothesis regularly cite motivational theorists and employ their language. Nevertheless, considerable evidence indicates that low/moderate doses of DA antagonists, and depletions of DA in nucleus accumbens, can suppress instrumental responding for food while, at the same time, these conditions leave fundamental aspects of reinforcement (i.e. primary or unconditioned reinforcement; primary motivation or primary incentive properties of natural reinforcers) intact. Several complex features of the literature on dopaminergic involvement in reinforcement are examined below, and it is argued that the assertions that DA mediates 'reward' or 'reinforcement' are inaccurate and grossly oversimplified. Thus, it appears as though it is no longer tenable to assert that drugs of abuse are simply turning on the brain's natural 'reward system'. In relation to the hypothesis that DA systems are involved in 'wanting', but not 'liking', it is suggested in the present review that 'wanting' has both directional aspects (e.g. appetite to consume food) and activational aspects (e.g. activation for initiating and sustaining instrumental actions; tendency to work for food). The present paper reviews findings in support of the hypothesis that low doses of DA antagonists and accumbens DA depletions do not impair appetite to consume food, but do impair activational aspects of motivation. This suggestion is consistent with the studies showing that low doses of DA antagonists and accumbens DA depletions alter the relative allocation of instrumental responses, making the animals less likely to engage in instrumental responses that have a high degree of work-related response costs. In addition, this observation is consistent with studies demonstrating that accumbens DA depletions make rats highly sensitive to ratio requirements on operant schedules. Although accumbens DA is not seen as directly mediating appetite to consume food, principles of behavioral economics indicate that accumbens DA could be involved in the elasticity of demand for food in terms of the tendency to pay work-related response costs. Future research must focus upon how specific aspects of task requirements (i.e. ratio requirements, intermittence of reinforcement, temporal features of response requirements, dependence upon conditioned stimuli) interact with the effects of accumbens DA depletions, and which particular factors determine sensitivity to the effects of DA antagonism or depletion.

Nucleus accumbens shell and core dopamine: differential role in behavior and addiction

Drug addiction can be conceptualized as a disturbance of behavior motivated by drug-conditioned incentives. This abnormality has been explained by Incentive-Sensitization and Allostatic-Counteradaptive theories as the result of non-associative mechanisms acting at the stage of the expression of incentive motivation and responding for drug reinforcement. Each one of these theories, however, does not account per se for two basic properties of the motivational disturbance of drug addiction: (1). focussing on drug- at the expenses of non-drug-incentives; (2). virtual irreversibility. To account for the above aspects we have proposed an associative learning hypothesis. According to this hypothesis the basic disturbance of drug addiction takes place at the stage of acquisition of motivation and in particular of Pavlovian incentive learning. Drugs share with non-drug rewards the property of stimulating dopamine (DA) transmission in the nucleus accumbens shell but this effect does not undergo habituation upon repeated drug exposure, as instead is the case of non-drug rewards. Repetitive, non-decremental stimulation of DA transmission by drugs in the nucleus accumbens septi (NAc) shell abnormally strengthens stimulus-drug associations. Thus, stimuli contingent upon drug reward acquire powerful incentive properties after a relatively limited number of predictive associations with the drug and become particularly resistant to extinction. Non-contingent occurrence of drug-conditioned incentive cues or contexts strongly facilitates and eventually reinstates drug self-administration. Repeated drug exposure also induces a process of sensitization of drug-induced stimulation of DA transmission in the NAc core. The precise significance of this adaptive change for the mechanism of drug addiction is unclear given the complexity and uncertainties surrounding the role of NAc core DA in responding but might be more directly related to instrumental performance.

Dopamine D2L receptor knockout mice display deficits in positive and negative reinforcing properties of morphine and in avoidance learning

The dopamine D2 receptor (D2) is implicated in drug addiction, learning and memory. Two isoforms of the D2 receptor, termed D2L (long form) and D2S (short form), have been identified. We previously generated mice lacking D2L (D2L-/-), but expressing functional D2S. In this study, we investigated the role of D2L in the positive and negative reinforcing properties of abused drugs and electrical stimuli, using D2L-/- mice as a model system. Mice were trained in three associative learning tasks: conditioned place preference to morphine and cocaine, conditioned place aversion to naloxone-precipitated morphine withdrawal, and active avoidance. D2L-/- mice, like wild type mice, developed a place preference to cocaine. In contrast to wild type mice, D2L-/- mice did not develop a place preference to morphine, nor did they attain a place aversion to morphine withdrawal. D2L-/- mice also failed to acquire avoidance behavior in response to electrical stimuli. There were no significant differences between D2L-/- and wild type mice in mu-opioid receptor density, morphine-induced locomotor stimulation and morphine withdrawal symptoms. These results suggest that D2L may have a greater impact than D2S on the rewarding aspects of morphine, and the aversive properties of morphine withdrawal and electrical stimulus. These findings also suggest that the presence of D2L is critical in the acquisition (learning) and/or retention (memory) of context-stimulus associations in certain situations. On the other hand, D2L is not essential for the rewarding aspects of cocaine and for the development of morphine dependence. Thus, these studies reveal distinct functional roles of D2L and/or D2S in drug addiction and avoidance learning, which may lead to a better understanding of the neurobiological basis underlying these behaviors.

Conditioned appetitive stimulus increases extracellular dopamine in the nucleus accumbens of the rat

This study used in vivo microdialysis to examine the release of dopamine (DA) in the nucleus accumbens (nAc) during the performance of a previously learned, signalled sucrose reward task, and during conditioning of a neutral tone stimulus to this reward. Behavioural measures (magazine entries) confirmed that stimuli associated with sucrose presentation became secondary rewarding stimuli, and DA release was also monitored during subsequent presentation of these stimuli alone. Perhaps surprisingly, during magazine entry for consumption of sucrose, i.e. in conditions similar to routine training, dialysate DA levels in the nAc did not increase. In contrast, during conditioning of the tone with light-sucrose, dopamine levels increased consistently and significantly. Interestingly, DA levels were somewhat, but significantly, increased when tone alone was presented in a test session, i.e. two hours after conditioning, and even more so when tone was combined with the light previously associated with sucrose. In this latter case the number of magazine entries increased to a level similar to that seen during conditioning. Presentation of light alone resulted in a similar level of magazine entries to tone alone, but no significant increase in DA. In summary, these studies confirm that a neutral stimulus can acquire the behavioural properties of reward when conditioned. The neurochemical data, on the other hand, suggest that increases of DA in nAc are more likely to be related to new associative learning than to established incentive or consumatory processes. The increase in DA release in the test session may be related either to the secondary reinforcing properties acquired by the stimulus, or to the change in contingencies, or to the aversive effects of the omission of reward.

Dopamine production in the caudate putamen restores feeding in dopamine-deficient mice

Dopamine-deficient (DD) mice cannot synthesize dopamine (DA) in dopaminergic neurons due to selective inactivation of the tyrosine hydroxylase gene in those neurons. These mice become hypoactive and hypophagic and die of starvation by 4 weeks of age. We used gene therapy to ascertain where DA replacement in the brain restores feeding and other behaviors in DD mice. Restoration of DA production within the caudate putamen restores feeding on regular chow and nest-building behavior, whereas restoration of DA production in the nucleus accumbens restores exploratory behavior. Replacement of DA to either region restores preference for sucrose or a palatable diet without fully rescuing coordination or initiation of movement. These data suggest that a fundamental difference exists between feeding for sustenance and the ability to prefer rewarding substances.

Opioidergic contribution to conditioned place preference induced by corn oil in mice

We previously reported that voluntary intake of corn oil in the light box showed place preference in the conditioned place preference (CPP) test in mice. In the present study, we investigated the contribution of opioidergic systems to the corn oil-induced CPP in mice. Acquisition of the place preference by corn oil intake was blocked by i.p. injections of an opioid mu antagonist, naloxone (0.1 and 0.3 mg/kg), and delta antagonists, 7-benzylidenenaltrexone (0.5 mg/kg) and naltriben (0.5 mg/kg) 15 min before conditioning. The opioid kappa agonist U-50488H (1 and 3 mg/kg i.p.) also blocked corn oil-induced CPP. Naloxone (1 mg/kg, i.p.) and naltriben (0.5 mg/kg, i.p.) did not affect corn oil intake in the home cage. However, 7-benzylidenenaltrexone (0.5 mg/kg, i.p.) and U-50488H (1 mg/kg i.p.) decreased and increased the corn oil intake, respectively. These results suggested that the rewarding effects of corn oil in the CPP test are at least partially mediated via opioidergic systems through mu and delta receptors. Further, we showed that an opioid kappa agonist reduced the rewarding effects of corn oil in the CPP test in mice, although it increased corn oil intake.

Differential actions of dopamine receptor antagonism in rats upon food intake elicited by either mercaptoacetate or exposure to a palatable high-fat diet

Selective dopamine receptor antagonists have been shown to reduce food intake of rats under such regulatory challenge conditions as food deprivation and 2-deoxy-D-glucose-induced glucoprivation, and under such palatable conditions as acute exposure to sucrose solutions. Food intake is increased following either pretreatment with the free fatty acid oxidation inhibitor, mercaptoacetate (MA), or acute exposure to a palatable high-fat source. The present study examined whether equimolar doses (50-800 nmol/kg, s.c.) of either the selective D(1) receptor antagonist, SCH23390, or the selective D(2) receptor antagonist, raclopride, would alter food intake elicited by either MA (70 mg/kg, i.p.) or acute exposure to a high-fat diet (67% ground rat chow, 33% vegetable shortening). SCH23390 significantly and dose-dependently reduced MA-induced feeding with the two higher (400 and 800 nmol/kg) doses eliminating this response after the first 2 h and the two lower (50 and 200 nmol/kg) doses preventing the occurrence of significant MA-induced feeding. Raclopride eliminated MA-induced feeding at the highest dose, and produced dose-dependent reductions at lower doses. A different pattern of dopamine antagonist effects emerged for high-fat intake. The identical dose range of SCH23390 failed to alter high-fat intake. In contrast, whereas the highest (800 nmol/kg) dose of raclopride significantly reduced high-fat intake after 1 h, the middle (200 and 400 nmol/kg) doses of raclopride significantly increased high-fat intake after 2 h. These data are discussed in terms of the modulatory actions of dopamine upon food intake, of the differential actions of dopamine receptor subtypes upon intake under challenge and palatable conditions, and of the potential participation of presynaptic and postsynaptic receptor populations in these responses.

Effect of food restriction on acquisition and expression of a conditioned odor discrimination in mice

Level of food restriction was manipulated in mice to assess its importance for the acquisition and expression of a conditioned odor discrimination. In training, animals were exposed to odors (either rose or lemon) presented on a piece of filter paper in a pot covered in bedding. For half of the conditioning trials, group paired received one odor (CS+) with sucrose, the unconditioned stimulus (us), under the bedding. For the remaining trials, they received the other odor (CS-) alone. Group CS-alone was also exposed to both odors, but neither odor was paired with sugar on any of the conditioning trials. During training, Group Paired mice that were food-restricted tended to dig more readily and longer in the odors, especially in the CS+ odor, than animals that were not restricted. Both restricted and nonrestricted PAIRED GROUPS dug more in the CS+ than in the CS- by the end of training, but the CS-alone mice dug very little in either. Following training, mice were exposed to both odors simultaneously in a discrimination test. Half the mice in each training food restriction condition were tested under food restriction, and half were not. Only PAIRED animals that were food-restricted in the test expressed an odor discrimination, digging only in the CS+. This occurred regardless of their previous restriction state in training. These data suggest that both food-restricted and nonrestricted mice can acquire an odor discrimination; however, expression of this odor discrimination depends on food restriction.

Pharmacology of sucrose-reinforced place-preference conditioning: effects of naltrexone

Two experiments investigated the role of the opioid system in sucrose-reinforced conditioned place preferences (CPPs) in rats. Experiment 1 examined the effects of a general opioid antagonist, naltrexone, on the expression of a CPP acquired in the absence of the drug. Subjects were trained to associate one compartment of a two-compartment chamber with sucrose and the other compartment with water. Rats displayed a preference for the sucrose-associated compartment in a choice test without sugar or water available following vehicle saline treatment. Naltrexone doses of 2.5 and 5.0 mg/kg reduced this preference for the sucrose-associated compartment. Experiment 2 examined the effects of naltrexone on the acquisition as well as the expression of CPPS. Different groups of rats received daily injections of either saline, 0.1, 1.0, or 5.0 mg/kg of naltrexone prior to each training session, and then these groups were given a choice test for the CPP after saline or naltrexone injections. Although naltrexone treatment attenuated the expression of CPPs in each group relative to saline treatment, there were no group differences during these tests in the magnitude of the preferences. Moreover, all groups displayed equal acquisition of CPPs despite the fact that naltrexone dose dependently decreased sucrose intake during the training phase. Together, the results indicate that the opioid system modulates the expression but not the acquisition of sucrose-reinforced CPPs.

Pharmacology of flavor preference conditioning in sham-feeding rats: effects of dopamine receptor antagonists

Opioid and dopamine systems are both implicated in the response to sweet solutions. Our laboratory previously reported that the opioid antagonist, naltrexone, reduced the intake of sweet solutions, yet had little or no effect on sucrose-conditioned flavor preferences in sham-feeding rats. The present study examined the role of dopamine D(1) and D(2) receptors in the expression of flavor preferences conditioned by the sweet taste of sucrose. All sessions were conducted under sham-feeding conditions to minimize postingestive influences. Training was accomplished by adding a novel flavor (CS+) to a 16% sucrose solution, a different flavor (CS-) to a less-preferred 0.2% saccharin solution in alternating, one-bottle sessions. Preferences were assessed in two-bottle tests with the CS+ and CS- flavors presented in mixed sucrose (8%)-saccharin (0.1%) solutions following systemic doses of 0, 50, 200, 400, or 800 nmol/kg of the D(2) antagonist, raclopride (Experiment 1) or the D(1) antagonist, SCH23390 (Experiment 2) under either food-restricted or unrestricted conditions. Rats significantly preferred the CS+ solutions in vehicle tests, and displayed equipotent and dose-dependent reductions in total intake and CS+ preference following either D(1) or D(2) receptor antagonism. Similar results were obtained with SCH23390 and raclopride in Experiment 3 conducted with water-restricted rats. These data indicate that dopaminergic D(1) and D(2) receptors play pivotal and functionally equivalent roles in the expression of flavor preferences conditioned by the sweet taste of sucrose.

Sexual motivation--an inquiry into events determining the occurrence of sexual behavior

For the individual engaged in it, sexual behavior has no finality or purpose other than its own execution. Data are presented showing that the execution of sexual reflexes can promote learning, i.e. it functions as reinforcement. Furthermore, positive affect is generated. Based on these principles, a model of sexual motivation has been elaborated. The conceptual framework is the incentive motivation theory previously proposed by Bindra D, A motivational view of learning, performance, and behavior modification, Psychol Rev 1974: 81:199-213; A Theory of Intelligent Behavior, New York: Wiley, 1976; How adaptive behavior is produced: a perceptual-motivational alternative to response reinforcement, Behav Brain Sci 1978; 1:41-52. Although the model is intended for application to most mammals, the rat is used as example. Essentially, sexual approach behaviors are activated by appropriate incentives (conditioned in the male, unconditioned in the female). Approach is, in the inexperienced male, followed by the execution of copulatory reflexes as a consequence of accidentally obtained tactile stimulation of the perineal region. In the female, copulatory acts are activated by tactile stimulation of the flanks and hinds provided by the mounting male. The role of conditioning for the execution of copulatory reflexes and for the acquisition of incentive value of neutral stimuli is analyzed. It is also shown that the incentive properties of sexual acts are not substantially different from those of other incentives. Sexual exhaustion is suggested to be either a case of negative alliesthesia or of stimulus habituation and the Coolidge effect is, in consequence, an example of dishabituation. Studies in women and men support this proposal. It is emphasized that sexual behavior is best understood as being entirely mechanistic albeit not deterministic.

Sexual experience sensitizes mating-related nucleus accumbens dopamine responses of female Syrian hamsters

We examined the effects of prior sexual experience on extracellular concentrations of dopamine in the nucleus accumbens of female hamsters. Nucleus accumbens dopamine was measured by in vivo microdialysis during mating in female Syrian hamsters that had previously been given six prior sexual encounters with a male, three prior encounters, or were sexually naive. High levels of sexual behavior were observed in all three groups, which were accompanied by increases in dialysate dopamine during periods when the male was present. However, females that received six prior sexual encounters had significantly elevated and prolonged increases in dialysate dopamine compared with those of the sexually naive females or females with only three prior sexual encounters with a male. The data indicate that the mesolimbic system can be sensitized by repeated experiences associated with a motivated behavior.

Measuring reward with the conditioned place preference paradigm: a comprehensive review of drug effects, recent progress and new issues

This review gives an overview of recent findings and developments in research on brain mechanisms of reward and reinforcement from studies using the place preference conditioning paradigm, with emphasis on those studies that have been published within the last decade. Methodological issues of the paradigm (such as design of the conditioning apparatus, biased vs unbiased conditioning, state dependency effects) are discussed. Results from studies using systemic and local (intracranial) drug administration, natural reinforcers, and non-drug treatments and from studies examining the effects of lesions are presented. Papers reporting on conditioned place aversion (CPA) experiments are also included. A special emphasis is put on the issue of tolerance and sensitization to the rewarding properties of drugs. Transmitter systems that have been investigated with respect to their involvement in brain reward mechanisms include dopamine, opioids, acetylcholine, GABA, serotonin, glutamate, substance P, and cholecystokinin, the motivational significance of which has been examined either directly, by using respective agonist or antagonist drugs, or indirectly, by studying the effects of these drugs on the reward induced by other drugs. For a number of these transmitters, detailed studies have been conducted to delineate the receptor subtype(s) responsible for the mediation of the observed drug effects, particularly in the case of dopamine, the opioids, serotonin and glutamate. Brain sites that have been implicated in the mediation of drug-induced place conditioning include the 'traditional' brain reward sites, ventral tegmental area and nucleus accumbens, but the medial prefrontal cortex, ventral pallidum, amygdala and the pedunculopontine tegmental nucleus have also been shown to play important roles in the mediation of place conditioning induced by drugs or natural reinforcers. Thus, although the paradigm has also been criticized because of some inherent methodological problems, it is clear that during the past decade place preference conditioning has become a valuable and firmly established and very widely used tool in behavioural pharmacology and addiction research.

What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?

What roles do mesolimbic and neostriatal dopamine systems play in reward? Do they mediate the hedonic impact of rewarding stimuli? Do they mediate hedonic reward learning and associative prediction? Our review of the literature, together with results of a new study of residual reward capacity after dopamine depletion, indicates the answer to both questions is 'no'. Rather, dopamine systems may mediate the incentive salience of rewards, modulating their motivational value in a manner separable from hedonia and reward learning. In a study of the consequences of dopamine loss, rats were depleted of dopamine in the nucleus accumbens and neostriatum by up to 99% using 6-hydroxydopamine. In a series of experiments, we applied the 'taste reactivity' measure of affective reactions (gapes, etc.) to assess the capacity of dopamine-depleted rats for: 1) normal affect (hedonic and aversive reactions), 2) modulation of hedonic affect by associative learning (taste aversion conditioning), and 3) hedonic enhancement of affect by non-dopaminergic pharmacological manipulation of palatability (benzodiazepine administration). We found normal hedonic reaction patterns to sucrose vs. quinine, normal learning of new hedonic stimulus values (a change in palatability based on predictive relations), and normal pharmacological hedonic enhancement of palatability. We discuss these results in the context of hypotheses and data concerning the role of dopamine in reward. We review neurochemical, electrophysiological, and other behavioral evidence. We conclude that dopamine systems are not needed either to mediate the hedonic pleasure of reinforcers or to mediate predictive associations involved in hedonic reward learning. We conclude instead that dopamine may be more important to incentive salience attributions to the neural representations of reward-related stimuli. Incentive salience, we suggest, is a distinct component of motivation and reward. In other words, dopamine systems are necessary for 'wanting' incentives, but not for 'liking' them or for learning new 'likes' and 'dislikes'.

Continued trends in the conditioned place preference literature from 1992 to 1996, inclusive, with a cross-indexed bibliography

In light of the overwhelming response to the previous publication in Neuroscience and Biobehavioral Reviews (1993, 17, 21-41) regarding trends in place conditioning (either preference or aversion), the present work constitutes a five-year follow-up to review the empirical research in this behavioral paradigm from 1992 to 1996, inclusively. The behavioral technique has grown as indicated by the number of publications over the last five years which equals those authored over the 35 years covered by our last survey. The previous work used descriptive statistics to explore topical issues, whereas the present work discusses trends since that time and hopes to provide an exhaustive bibliography of the CPP literature, including articles, published abstracts, book chapters and reviews, as well as providing a cross-index of identified key words/drugs tested.

Chronic mild stress has no effect on responding by rats for sucrose under a progressive ratio schedule

Exposure of rats to chronic unpredictable mild stress (CMS) has been shown to produce a syndrome in which a wide range of consummatory behaviors are attenuated, resembling a state of anhedonia, which may be reversed by treatment with antidepressant drugs. The aim of the present study was to determine whether CMS would also affect a rat's motivation to respond for a sucrose solution, as assessed by its performance under a progressive ratio (PR) schedule of reinforcement. Control studies demonstrated that break points in nonstressed rats were sensitive to both the concentration of sucrose solution used, as well as the period of food and water deprivation used prior to testing. Exposure of rats to CMS had no effect upon break points when responding under a progressive ratio schedule for either a 1% or 7% sucrose solution, although subjects did display the typical reduction in consumption of a freely consumed 1% sucrose solution. These results are not readily understood within the theoretical framework of the CMS model of anhedonia and imply instead that both the neural and psychological correlates of motivation may be less susceptible to modulation by the effects of CMS than the free consumption of sweet solutions.

Behavioral functions of nucleus accumbens dopamine: empirical and conceptual problems with the anhedonia hypothesis

Nucleus accumbens (DA) has been implicated in a number of different behavioral functions, but most commonly it is said to be involved in "reward" or "reinforcement". In the present article, the putative reinforcement functions of accumbens DA are summarized in a manner described as the "General Anhedonia Model". According to this model, the DA innervation of the nucleus accumbens is conceived of as a crucial link in the "reward system", which evolved to mediate the reinforcing effects of natural stimuli such as food. The reward system is said to be activated by natural reinforcing stimuli, and this activation mediates the reinforcing effects of these natural stimuli. According to this view, other stimuli such as brain stimulation and drugs can activate this system, which leads to these stimuli being reinforcing as well. Interference with DA systems is said to blunt the reinforcing effects of these rewarding stimuli, leading to "extinction". This general model of the behavioral functions of accumbens DA is utilized widely as a theoretical framework for integrating research findings. Nevertheless, there are several difficulties with the General Anhedonia Model. Several studies have observed substantial differences between the effects of extinction and the effects of DA antagonism or accumbens DA depletions. Studies involving aversive conditions indicate that DA antagonists and accumbens DA depletions can interfere with avoidance behavior, and also have demonstrated that accumbens DA release is increased by stressful or aversive stimuli. Although accumbens DA is important for drug abuse phenomena, particularly stimulant self-administration, studies that involve other reinforcers are more problematic. A large body of evidence indicates that low doses of dopamine antagonists, or depletions of accumbens DA, do not impair fundamental aspects of food motivation such as chow consumption and simple instrumental responses for food. This is particularly important, in view of the fact that many behavioral researchers consider the regulation of food motivation to be a fundamental aspect of food reinforcement. Finally, studies employing cost/benefit analyses are reviewed, and in these studies considerable evidence indicates that accumbens DA is involved in the allocation of responses in relation to various reinforcers. Nucleus accumbens DA participates in the function of enabling organisms to overcome response costs, or obstacles, in order to obtain access to stimuli such as food. In summary, nucleus accumbens DA is not seen as directly mediating food reinforcement, but instead is seen as a higher order sensorimotor integrator that is involved in modulating response output in relation to motivational factors and response constraints. Interfering with accumbens DA appears to partially dissociate the process of primary reinforcement from processes regulating instrumental response initiation, maintenance and selection.

A rat model of distractibility: effects of drugs modifying dopaminergic, noradrenergic and GABAergic neurotransmission

A procedure for analyzing effects of drugs on distractibility is proposed. Rats are trained to traverse a straight runway with a sucrose solution as reinforcement. Once the response has been acquired, an additional runway ending in an empty box is connected. The time spent investigating this additional runway is the measure of distractibility. Amphetamine, 1 mg/kg i.p., increased distractibility. In rats that were never reinforced, amphetamine at a dose of 1 mg/kg reduced the time spent in the additional runway. This shows that the effects of amphetamine in the reinforced animals cannot be interpreted as enhanced exploration. Furthermore, the benzodiazepines diazepam (2 and 4 mg/kg, i.p.) and chlordiazepoxide (2.5, 5 and 10 mg/kg, i.p.), known to enhance exploration of novel environments, did not affect the time spent in the additional runway in sucrose-reinforced animals. It was concluded that the procedure indeed is a model of distractibility. The dopamine antagonist cis(Z)-flupenthixol, at a dose of 0.25 mg/kg, i.p., blocked the effects of amphetamine, 1 mg/kg. Flupenthixol itself, in doses of 0.25 and 0.5 mg/kg, did not affect the time spent in the additional runway. This suggests that enhanced dopaminergic activity indeed is responsible for the effects. This proposal is further supported by experiments showing that the noradrenaline precursor dihydroxyphenylserine (10 mg/kg + carbidopa, 50 mg/kg, both i.p.) and the noradrenergic neurotoxin DSP4 (50 mg/kg, i.p.) had no effect on distractibility. Moreover, amfonelic acid, a dopamine releaser with slight or no effect on noradrenergic neurotransmission, had effects very similar to those of amphetamine when given in doses of 0.25 and 0.5 mg/kg, i.p. A lower dose, 0.125 mg/ kg, was ineffective. Taken together, these data suggest that enhanced dopaminergic neurotransmission increases distractibility in the rat. However, both amphetamine and amfonelic acid may stimulate serotonin release. Until serotonergic drugs have been tested, a contribution of this transmitter cannot be ruled out. The distraction procedure may constitute an animal model of some kinds of disordered information processing.

Endogenous opiates: 1995

This article is the eighteenth installment of our annual review of research concerning the opiate system. It includes articles published during 1995 reporting the behavioral effects of the opiate peptides and antagonists, excluding the purely analgesic effects. The specific topics covered this year include stress: tolerance and dependence; eating; drinking; gastrointestinal, renal, and hepatic function; mental illness and mood; learning, memory, and reward; cardiovascular responses; respiration and thermoregulation; seizures and other neurological disorders; electrical-related activity; general activity and locomotion; sex, pregnancy, and development; immunological responses; and other behaviors.