1
|
Killeen PR. Economics, ecologics, and mechanics: The dynamics of responding under conditions of varying motivation. J Exp Anal Behav 2010; 64:405-31. [PMID: 16812776 PMCID: PMC1350147 DOI: 10.1901/jeab.1995.64-405] [Citation(s) in RCA: 64] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Abstract
The mechanics of behavior developed by Killeen (1994) is extended to deal with deprivation and satiation and with recovery of arousal at the beginning of sessions. The extended theory is validated against satiation curves and within-session changes in response rates. Anomalies, such as (a) the positive correlation between magnitude of an incentive and response rates in some contexts and a negative correlation in other contexts and (b) the greater prominence of incentive effects when magnitude is varied within the session rather than between sessions, are explained in terms of the basic interplay of drive and incentive motivation. The models are applied to data from closed economies in which changes of satiation levels play a key role in determining the changes in behavior. Relaxation of various assumptions leads to closed-form models for response rates and demand functions in these contexts, ones that show reasonable accord with the data and reinforce arguments for unit price as a controlling variable. The central role of deprivation level in this treatment distinguishes it from economic models. It is argued that traditional experiments should be redesigned to reveal basic principles, that ecologic experiments should be redesigned to test the applicability of those principles in more natural contexts, and that behavioral economics should consist of the applications of these principles to economic contexts, not the adoption of economic models as alternatives to behavioral analysis.
Collapse
|
2
|
Foraging enrichment for laboratory rats. Anim Welf 2004. [DOI: 10.1017/s0962728600028414] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/13/2023]
Abstract
AbstractThe provision of foraging opportunities may be a simple way of improving an animal's welfare, but this approach has been neglected for laboratory rats (Rattus norvegicus). Standard housing contains little enrichment, and food is often provided ad libitum, which may result in inactivity and obesity, especially in mature males. Foraging enrichments may offer a way to correct these deficiencies. This study compared three potential enrichments — a limited-access hopper, gnawing sticks and a foraging device — to standard housing and feeding conditions, in order to examine their effects on rat body weight, food consumption, behaviour and preferences. The subjects were 12 mature male Wistar rats. Effects were assessed from daily weighing and from video records of the rats' behaviour over 24 h periods. The rats' preferences were determined using a four-way test system in which they could choose between a standard cage and cages offering the three potential enrichments. Compared to the standard housing and feeding, the limited-access hopper had a tendency to reduce food consumption, but the time spent feeding increased. The gnawing sticks provided the rats with the opportunity to gnaw, but did not affect other behaviours or body weight. The foraging device had the benefits of reducing aggression and allowing the rats to search for and manipulate food, but resulted in significant gains in body weight. Additionally, the foraging device was the preferred feeding source. Of the four possible feeding locations, the rats spent the least amount of time in the standard cage. The foraging device provided the most benefits but requires further modification to address problems of obesity.
Collapse
|
3
|
O'Hare E, Shaw DL, Tierney KJ, E-M K, Levine AS, Shephard RA. Behavioral and Neurochemical Mechanisms of the Action of Mild Stress in the Enhancement of Feeding. Behav Neurosci 2004; 118:173-7. [PMID: 14979794 DOI: 10.1037/0735-7044.118.1.173] [Citation(s) in RCA: 12] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Rats were trained to respond under a cyclic-ratio schedule of reinforcement composed of an ascending, followed by a descending, sequence of ratio values. Subjects were trained while exposed to 70 dB white noise, then tested while exposed to 70 or 90 dB white noise. Exposure to 90 dB white noise elevated the response function (p<.02). Naloxone was then administered intraperitoneally at 0.3. 1.0. and 3.0 mg/kg under 70 dB and 90 dB white noise. Naloxone administration (1.0 and 3.0 mg/kg) significantly depressed the response function obtained under 90 dB white noise (ps<.01) but did not affect the function obtained under 70 dB white noise. These findings suggest that mild stress increases food intake through a mechanism affecting palatability enhanced by the release of endogenous opioids.
Collapse
Affiliation(s)
- E O'Hare
- School of Psychology, University of Ulster, Ulster, Northern Ireland.
| | | | | | | | | | | |
Collapse
|
4
|
Salamone JD, Correa M. Motivational views of reinforcement: implications for understanding the behavioral functions of nucleus accumbens dopamine. Behav Brain Res 2002; 137:3-25. [PMID: 12445713 DOI: 10.1016/s0166-4328(02)00282-6] [Citation(s) in RCA: 554] [Impact Index Per Article: 25.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Although the Skinnerian 'Empirical Law of Effect' does not directly consider the fundamental properties of stimuli that enable them to act as reinforcers, such considerations are critical for determining if nucleus accumbens dopamine systems mediate reinforcement processes. Researchers who have attempted to identify the critical characteristics of reinforcing stimuli or activities have generally arrived at an emphasis upon motivational factors. A thorough review of the behavioral literature indicates that, across several different investigators offering a multitude of theoretical approaches, motivation is seen by many as being fundamental to the process of reinforcement. The reinforcer has been described as a goal, a commodity, an incentive, or a stimulus that is being approached, self-administered, attained or preserved. Reinforcers also have been described as activities that are preferred, deprived or in some way being regulated. It is evident that this 'motivational' or 'regulatory' view of reinforcement has had enormous influence over the hypothesis that DA directly mediates 'reward' or 'reinforcement' processes. Indeed, proponents of the DA/reward hypothesis regularly cite motivational theorists and employ their language. Nevertheless, considerable evidence indicates that low/moderate doses of DA antagonists, and depletions of DA in nucleus accumbens, can suppress instrumental responding for food while, at the same time, these conditions leave fundamental aspects of reinforcement (i.e. primary or unconditioned reinforcement; primary motivation or primary incentive properties of natural reinforcers) intact. Several complex features of the literature on dopaminergic involvement in reinforcement are examined below, and it is argued that the assertions that DA mediates 'reward' or 'reinforcement' are inaccurate and grossly oversimplified. Thus, it appears as though it is no longer tenable to assert that drugs of abuse are simply turning on the brain's natural 'reward system'. In relation to the hypothesis that DA systems are involved in 'wanting', but not 'liking', it is suggested in the present review that 'wanting' has both directional aspects (e.g. appetite to consume food) and activational aspects (e.g. activation for initiating and sustaining instrumental actions; tendency to work for food). The present paper reviews findings in support of the hypothesis that low doses of DA antagonists and accumbens DA depletions do not impair appetite to consume food, but do impair activational aspects of motivation. This suggestion is consistent with the studies showing that low doses of DA antagonists and accumbens DA depletions alter the relative allocation of instrumental responses, making the animals less likely to engage in instrumental responses that have a high degree of work-related response costs. In addition, this observation is consistent with studies demonstrating that accumbens DA depletions make rats highly sensitive to ratio requirements on operant schedules. Although accumbens DA is not seen as directly mediating appetite to consume food, principles of behavioral economics indicate that accumbens DA could be involved in the elasticity of demand for food in terms of the tendency to pay work-related response costs. Future research must focus upon how specific aspects of task requirements (i.e. ratio requirements, intermittence of reinforcement, temporal features of response requirements, dependence upon conditioned stimuli) interact with the effects of accumbens DA depletions, and which particular factors determine sensitivity to the effects of DA antagonism or depletion.
Collapse
Affiliation(s)
- John D Salamone
- Department of Psychology, University of Connecticut, Storrs, CT 06269-1020, USA.
| | | |
Collapse
|
5
|
Hamill S, Trevitt JT, Nowend KL, Carlson BB, Salamone JD. Nucleus accumbens dopamine depletions and time-constrained progressive ratio performance: effects of different ratio requirements. Pharmacol Biochem Behav 1999; 64:21-7. [PMID: 10494993 DOI: 10.1016/s0091-3057(99)00092-1] [Citation(s) in RCA: 64] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
Two experiments were conducted to determine the effects of accumbens dopamine (DA) depletions on progressive ratio responding for food reinforcement. In one version of this schedule, ratio requirement increased by one response after each reinforcer was obtained (PROG1). In the other version, ratio requirement increased by five responses after each reinforcer was obtained (PROG5). For both versions, 60-min sessions were conducted. Accumbens DA depletions produced by local injections of 6-OHDA substantially decreased the number of responses on both schedules. The deficits in the response number induced by DA depletions persisted through the two weeks of postsurgical testing for both the PROG1 and PROG5 schedules. However, there were differences between the effects of DA depletions on the two schedules in terms of the time to complete the last ratio. Although time to complete the last ratio was significantly reduced by DA depletions only in the first week of testing on the PROG1 schedule, rats recovered on this measure by the second week after surgery. In contrast, DA-depleted rats on the PROG5 schedule showed a more persistent suppression of the time to complete the last ratio, which lasted through both weeks of postsurgical testing. Performance on schedules that generate low baseline rates of responding (e.g., continuous, fixed, and variable interval) is relatively unaffected by accumbens DA depletions; nevertheless, accumbens DA depletions substantially impair progressive ratio response output. The high work output necessary for responding on the PROG5 schedule may make these animals more sensitive to the effects of accumbens DA depletions.
Collapse
Affiliation(s)
- S Hamill
- Department of Psychology, University of Connecticut, Storrs 06269-1020, USA
| | | | | | | | | |
Collapse
|
6
|
Aberman JE, Ward SJ, Salamone JD. Effects of dopamine antagonists and accumbens dopamine depletions on time-constrained progressive-ratio performance. Pharmacol Biochem Behav 1998; 61:341-8. [PMID: 9802826 DOI: 10.1016/s0091-3057(98)00112-9] [Citation(s) in RCA: 148] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/09/2023]
Abstract
Four experiments were conducted to determine the effects of dopamine (DA) antagonists and DA depletions on progressive-ratio responding for food reinforcement. On this schedule, ratio requirement increased by one response after each reinforcer was obtained, and rats were tested in 30-min sessions. Response rates and highest ratio completed were reduced in a dose-related manner by systemic injections of the D1 antagonist SCH 23390, and also by the D2 antagonists haloperidol and raclopride. Drug-treated rats also showed reductions in time to complete the last ratio, demonstrating that they had stopped responding before the end of the session. DA depletions produced by injections of 6-OHDA directly into the nucleus accumbens substantially decreased both the number of responses and the highest ratio completed. The deficits in response number and highest ratio completed induced by DA depletions persisted through the first 3 weeks of postsurgical testing, with some recovery by the fourth week. However, the deficits resulting from dopamine depletions were largely a manifestation of a decrease in response rate; although time to complete the last ratio was significantly reduced by dopamine depletions in the first few days of testing, rats recovered on this measure by the fifth day after surgery. Although previous work has shown that performance on several schedules (e.g., continuous, low value ratios, variable interval) is relatively unaffected by accumbens DA depletions, the present data demonstrate that such depletions do produce a substantial and persistent impairment of progressive ratio response output. Rats with accumbens DA depletions appear to have deficits in maintaining the high work output necessary for responding at large ratio values. The relative sparing of responding on some simple schedules, together with the present progressive ratio results, suggest that rats with accumbens DA depletions remain directed toward the acquisition and consumption of food, but they show deficits in work output for food.
Collapse
Affiliation(s)
- J E Aberman
- Department of Psychology, University of Connecticut, Storrs 06269-1020, USA
| | | | | |
Collapse
|
7
|
Sokolowski JD, Salamone JD. The role of accumbens dopamine in lever pressing and response allocation: effects of 6-OHDA injected into core and dorsomedial shell. Pharmacol Biochem Behav 1998; 59:557-66. [PMID: 9512057 DOI: 10.1016/s0091-3057(97)00544-3] [Citation(s) in RCA: 130] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
Abstract
Three experiments investigated the behavioral effects of injections of the neurotoxic agent 6-hydroxydopamine (6-OHDA) into the core or shell of the nucleus accumbens. In the first experiment, it was observed that injections of 6-OHDA into either core or shell had no significant effect on variable interval 30-s responding. In Experiment 2, responding on a fixed ratio 5 (FR5) schedule was impaired by 6-OHDA injections in the core, but not the shell. Rats with core injections of 6-OHDA showed significant alterations in the relative distribution of interresponse times, which were indicative of reductions in the maximal rate of responding and increases in the number of pauses. In the third experiment, rats were tested using a lever-pressing/chow-feeding procedure, in which a preferred food (Bioserve pellets) was available by pressing a lever on a FR5 schedule, but a less preferred food (lab chow) was also available concurrently in the test chamber. Untreated rats usually pressed the lever at high rates to obtain the food pellets and ate little of the lab chow. After training, dopamine depletions were produced by injections of 6-OHDA directly into the core or dorsomedial shell subregions. Injections of 6-OHDA into the core significantly decreased lever pressing for food pellets, increased lab chow consumption, and decreased the relative amount of food obtained by lever pressing. Dorsomedial shell injections of 6-OHDA had no significant effects on either lever pressing or lab chow consumption. Neurochemical results indicate that injections of 6-OHDA in the shell produced substantial depletions in the shell that were somewhat selective; however, injections of 6-OHDA into the core tended to deplete both core and shell. Correlational analyses revealed that decreases in FR5 lever pressing were associated with dopamine levels in the core, but not the shell. The present results indicate that substantial depletions of dopamine in the dorsomedial shell are not sufficient for suppressing reinforced lever pressing, and indicate that dopamine depletions must include the core area to impair performance on these tasks. The lack of effect of accumbens dopamine depletions on VI30 responding are consistent with the notion that accumbens dopamine depletions affect responding on schedules that generate a high rate of responding (FR5), but not those that generate a moderate rate of responding (e.g., VI30 s). The results of the concurrent FR5/chow-feeding experiment indicate that rats with accumbens dopamine depletions remain directed towards the acquisition and consumption of food. These results suggest that dopamine in the core region of accumbens sets constraints upon the selection of food-related behaviors, and that core dopamine depletions alter the relative allocation of food-related responses.
Collapse
Affiliation(s)
- J D Sokolowski
- Department of Psychology, University of Connecticut, Storrs 06269-1020, USA
| | | |
Collapse
|
8
|
Salamone JD, Cousins MS, Snyder BJ. Behavioral functions of nucleus accumbens dopamine: empirical and conceptual problems with the anhedonia hypothesis. Neurosci Biobehav Rev 1997; 21:341-59. [PMID: 9168269 DOI: 10.1016/s0149-7634(96)00017-6] [Citation(s) in RCA: 383] [Impact Index Per Article: 14.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
Nucleus accumbens (DA) has been implicated in a number of different behavioral functions, but most commonly it is said to be involved in "reward" or "reinforcement". In the present article, the putative reinforcement functions of accumbens DA are summarized in a manner described as the "General Anhedonia Model". According to this model, the DA innervation of the nucleus accumbens is conceived of as a crucial link in the "reward system", which evolved to mediate the reinforcing effects of natural stimuli such as food. The reward system is said to be activated by natural reinforcing stimuli, and this activation mediates the reinforcing effects of these natural stimuli. According to this view, other stimuli such as brain stimulation and drugs can activate this system, which leads to these stimuli being reinforcing as well. Interference with DA systems is said to blunt the reinforcing effects of these rewarding stimuli, leading to "extinction". This general model of the behavioral functions of accumbens DA is utilized widely as a theoretical framework for integrating research findings. Nevertheless, there are several difficulties with the General Anhedonia Model. Several studies have observed substantial differences between the effects of extinction and the effects of DA antagonism or accumbens DA depletions. Studies involving aversive conditions indicate that DA antagonists and accumbens DA depletions can interfere with avoidance behavior, and also have demonstrated that accumbens DA release is increased by stressful or aversive stimuli. Although accumbens DA is important for drug abuse phenomena, particularly stimulant self-administration, studies that involve other reinforcers are more problematic. A large body of evidence indicates that low doses of dopamine antagonists, or depletions of accumbens DA, do not impair fundamental aspects of food motivation such as chow consumption and simple instrumental responses for food. This is particularly important, in view of the fact that many behavioral researchers consider the regulation of food motivation to be a fundamental aspect of food reinforcement. Finally, studies employing cost/benefit analyses are reviewed, and in these studies considerable evidence indicates that accumbens DA is involved in the allocation of responses in relation to various reinforcers. Nucleus accumbens DA participates in the function of enabling organisms to overcome response costs, or obstacles, in order to obtain access to stimuli such as food. In summary, nucleus accumbens DA is not seen as directly mediating food reinforcement, but instead is seen as a higher order sensorimotor integrator that is involved in modulating response output in relation to motivational factors and response constraints. Interfering with accumbens DA appears to partially dissociate the process of primary reinforcement from processes regulating instrumental response initiation, maintenance and selection.
Collapse
Affiliation(s)
- J D Salamone
- Department of Psychology, University of Connecticut, Storrs 06269-1070, USA
| | | | | |
Collapse
|
9
|
Cousins MS, Atherton A, Turner L, Salamone JD. Nucleus accumbens dopamine depletions alter relative response allocation in a T-maze cost/benefit task. Behav Brain Res 1996; 74:189-97. [PMID: 8851929 DOI: 10.1016/0166-4328(95)00151-4] [Citation(s) in RCA: 162] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/02/2023]
Abstract
This experiment was conducted to study the role of nucleus accumbens dopamine in the performance of a novel T-maze cost/benefit procedure. Rats were trained on a T-maze task for food reinforcement. Under one of the test conditions, one arm of the maze contained a high reinforcement density (4 x 45 mg Bioserve pellets) and the other arm contained a low reinforcement density (2 x 45 mg pellets). A large vertical barrier (44 cm) was placed in the arm that contained the high density of food reinforcement. In the second test condition, a separate group of rats was trained in the same T-maze, in which there were 4 food pellets in the arm that was obstructed by the barrier, yet there were no food pellets in the unobstructed arm. After training rats received intra-accumbens of injections 6-hydroxydopamine or ascorbate vehicle. Nucleus accumbens dopamine depletions substantially decreased the number of selections of the obstructed arm with the high reinforcement density when the unobstructed arm also contained 2 food pellets. Dopamine-depleted rats in this condition showed increased selection of the no-barrier arm as well as decreased entry into the arm that contained the barrier. These effects persisted throughout the 3 weeks of post-surgical testing. Nevertheless, when the unobstructed arm contained no food pellets, and the only way to obtain food was to climb the barrier, rats with nucleus accumbens dopamine depletions showed only a modest effect on selections of the obstructed arm, which recovered by the second week of testing. Dopamine-depleted rats that were tested with food in the unobstructed arm showed significantly fewer barrier crossings than dopamine-depleted rats that were tested with no food in the unobstructed arm. Thus, the present findings are not consistent with the notion that nucleus accumbens dopamine depletion rendered the animals unable to climb the barrier, or set an absolute ceiling on the number of barrier crossings the animals could perform. Instead, the present results indicate that nucleus accumbens dopamine depletions affected the relative allocation of barrier climbing responses if alternative food sources were available.
Collapse
Affiliation(s)
- M S Cousins
- Department of Psychology, University of Connecticut, Storrs 06269-102, USA
| | | | | | | |
Collapse
|
10
|
Salamone JD, Cousins MS, Bucher S. Anhedonia or anergia? Effects of haloperidol and nucleus accumbens dopamine depletion on instrumental response selection in a T-maze cost/benefit procedure. Behav Brain Res 1994; 65:221-9. [PMID: 7718155 DOI: 10.1016/0166-4328(94)90108-2] [Citation(s) in RCA: 346] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/26/2023]
Abstract
Two experiments were conducted to study the role of dopamine in the performance of a novel cost/benefit procedure. Rats were trained on a T-maze task in which one arm contained a high reinforcement density (4 x 45 mg Bioserve pellets) and the other arm contained a low reinforcement density (2 x 45 mg pellets). Different groups of rats were trained either with unobstructed access to both arms from the start area, or under a condition in which a large vertical barrier (44 cm) was placed in the arm that contained the high density of food reinforcement. In the first experiment, rats trained under each procedure received injections of 0.1 mg/kg haloperidol and tartaric acid vehicle as a control procedure. Analysis of variance indicated that there was a significant effect of the barrier on maze arm choice, a significant effect of haloperidol, and a significant drug x barrier interaction. Haloperidol did not affect arm choice in rats tested without the barrier present, but this drug significantly reduced the number of selections of the arm with high reinforcement density when the barrier was present. In the second experiment, groups of rats were trained as described above, and then received intraaccumbens injections of 6-hydroxydopamine or ascorbate vehicle. Nucleus accumbens dopamine depletions produced by 6-hydroxydopamine decreased the number of selections of the arm with high reinforcement density when the barrier was present, but had no effect on arm choice when the barrier was not present.(ABSTRACT TRUNCATED AT 250 WORDS)
Collapse
Affiliation(s)
- J D Salamone
- Department of Psychology, University of Connecticut, Storrs 06269-1020, USA
| | | | | |
Collapse
|
11
|
Cousins MS, Salamone JD. Nucleus accumbens dopamine depletions in rats affect relative response allocation in a novel cost/benefit procedure. Pharmacol Biochem Behav 1994; 49:85-91. [PMID: 7816895 DOI: 10.1016/0091-3057(94)90460-x] [Citation(s) in RCA: 129] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
Rats were tested on days 1, 3, and 5 of a 5-day test week in an operant chamber in which they could either lever press on a fixed-ratio 5 (FR5) schedule to obtain food pellets (Bioserve) or approach and consume lab chow that was also available in the chamber (Teklad Premier). Rats typically pressed at high rates to obtain the food pellets and ate little of the lab chow. On days 2 and 4 of each week lab chow was not concurrently available, and rats could only lever press on the FR5 schedule for pellets to obtain food. Dopamine depletions produced by intraaccumbens injections of the neurotoxic agent 6-hydroxydopamine produced a dramatic decrease in lever pressing and increase in chow consumption on days when lab chow was available. Lever pressing was not significantly reduced in dopamine-depleted rats on days when chow was not available, although there was a significant correlation between lever pressing and accumbens dopamine levels. These results suggest that nucleus accumbens dopamine depletions do not produce a general deficit in food motivation. Moreover, accumbens dopamine depletions do not appear to produce severe deficits in fine motor control that impair the execution of individual motor acts involved in lever pressing. Rather, the present results are consistent with the notion that accumbens dopamine sets constraints upon which food-related response is selected in a particular situation, and that these depletions alter the relative allocation of food-related responses.
Collapse
Affiliation(s)
- M S Cousins
- Department of Psychology, University of Connecticut, Storrs 06269-1020
| | | |
Collapse
|
12
|
Abstract
Most traditional conceptions of reinforcement are based on a simple causal model in which responding is strengthened by the presentation of a reinforcer. I argue that reinforcement is better viewed as the outcome of constraint of a functioning causal system comprised of multiple interrelated causal sequences, complex linkages between causes and effects, and a set of initial conditions. Using a simplified system conception of the reinforcement situation, I review the similarities and drawbacks of traditional reinforcement models and analyze the recent contributions of cognitive, regulatory, and ecological approaches. Finally, I show how the concept of behavior systems can begin to incorporate both traditional and recent conceptions of reinforcement in an integrative approach.
Collapse
Affiliation(s)
- W Timberlake
- Psychology Department, Indiana University, Bloomington 47405
| |
Collapse
|
13
|
Abstract
Thirsty rats tested in 60-min sessions licked an empty spout for access to a water spout. We raised the behavioral price of the water lick by requiring more licks at the empty spout per lick at the water spout. At relatively high prices the rats made relatively few water licks but licked more efficiently, getting more water per lick. Controls showed that the rise in efficiency with price was not attributable to two variables previously confounded with price: the total number of water licks, and the temporal pattern of access. At a higher price the rats also licked more persistently, making more extra water licks before the shutter could occlude the spout. However, yoked controls showed that the greater persistence resulted not from price, but from the relatively stringent pattern of access that accompanied the higher price. Extra water licks diminished as the session progressed, apparently from satiety, not fatigue. The results have implications for behavioral ecology, behavioral economics, motivation, and the methodology of reward.
Collapse
Affiliation(s)
- A Buxton
- Indiana University, Bloomington 47405
| | | |
Collapse
|
14
|
Abstract
Three groups of five male and five female students were exposed to different levels of auditory stimulation (no music or music played at 70 dB or 90dB) under naturalistic conditions and were permitted to avail themselves freely of a supply of soft drinks. Increasing auditory stimulation produced an increase in total consumption. Reported prior frequencies of soft drink consumption and of exposure to loud music had no bearing on the result of the experimental manipulation, suggesting that the effect was not due to previous history.
Collapse
Affiliation(s)
- A McCarron
- Department of Psychology, University of Ulster, Jordanstown, Northern Ireland
| | | |
Collapse
|
15
|
Gunn KP. Rats' consumption rates after short breaks in food availability within meals. LEARNING AND MOTIVATION 1989. [DOI: 10.1016/0023-9690(89)90010-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|
16
|
Savory CJ. Responses of fowls to an operant feeding procedure and its potential use for reducing randomness in meal occurrence. Physiol Behav 1989; 45:373-9. [PMID: 2756025 DOI: 10.1016/0031-9384(89)90143-1] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/02/2023]
Abstract
Adult laying hens were tested with increasing and decreasing procurement costs (pecks at a disc) which allowed access to food for unlimited periods. This was done to observe changes in feeding behaviour, to see whether apparent randomness in meal occurrence can be reduced, and, if so, to identify an appropriate fixed ratio (FR) for incorporating in investigations of physiological correlates of hunger and satiety. Daily food intake stayed the same at all but the highest (160 pecks) FR. FR sizes were related negatively to total time feeding and meal frequency, and positively to intermeal interval length, meal size and rate of eating within meals. They were also related positively to meal length, but only weakly so. Frequency distributions of meal and interval lengths, and postprandial correlation coefficients, indicated that randomness in feeding did decline at higher FRs, and FR20 seems the most appropriate schedule for potential use in physiological experiments.
Collapse
Affiliation(s)
- C J Savory
- AFRC Institute for Grassland and Animal Production (Poultry Department) Roslin, Midlothian, Scotland
| |
Collapse
|
17
|
Abstract
Food intake of four adult male baboons (Papio anubis), ranging in weight from 18 to 33 kg, was monitored during daily experimental sessions lasting 22 hours. Food was available under a two-component operant schedule designed to mimic food availability in the natural ecology. The first component was a "procurement" component which consisted of pulling the manipulandum a set number of times under a fixed-ratio (FR) operant schedule. Following completion of the procurement response requirement, access to food, i.e., a meal, became available under the second "consumption" component during which each response produced a food pellet (one-gram banana-flavored pellets, 3.1 kcal/g). After a 10-minute interval in which no response occurred, the consumption component was terminated. In order to gain access to another meal, the baboon had to complete the ratio requirement of the procurement component. Increasing the ratio requirement of the procurement component from 10 to 200 had no significant effect on mean total daily intake, but significantly reduced the number of meals from 7.4 under the FR10 requirement to 3.6 under the FR200 procurement component. There were no differences among baboons in mean meal size, or intermeal-interval under each procurement requirement. Similar patterns of cumulative daily intake were observed within baboons under all ratio requirements of the procurement component, and there were few significant correlations between meal size and postmeal-interval, or premeal-interval and meal size in any baboon.
Collapse
Affiliation(s)
- R W Foltin
- Department of Psychiatry and Behavioral Sciences, Johns Hopkins University School of Medicine, Baltimore, MD 21205
| | | |
Collapse
|
18
|
Gannon KN, Smith HV, Tierney KJ. Effects of rate and distance of procurement wheel-running on saccharin-and-sucrose solution drinking by non-deprived rats. Physiol Behav 1986; 36:539-43. [PMID: 3703981 DOI: 10.1016/0031-9384(86)90328-8] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/07/2023]
Abstract
Four non-deprived rats received daily sessions of 20 min access to a saccharin-and-sucrose solution following various prior activities, in an attempt to disentangle the normally confounded roles of time spent, amount and rate of procurement responding in causing an increase in consumption once access is gained. After the normal rate of running (approx 35 m/min) was established, six conditions were run in random order, involving waiting zero and 2.5 min in an immobilised running-wheel, and running, with the wheel rotated by a motor, in four conditions formed by combining two speeds (12 and 30 m/min) with two distances (12 and 30 m), prior to access to the solution. Drinking increased with the speed of prior running, and to a lesser extent with the distance run, but was not related systematically to the time spent running. It is suggested that information from the animal's own behavior in gaining access to a commodity, particularly the rate of energy expenditure, may influence its utilisation of the commodity by affecting the rate of subsequent consummatory responding.
Collapse
|
19
|
White NM. Control of sensorimotor function by dopaminergic nigrostriatal neurons: influence on eating and drinking. Neurosci Biobehav Rev 1986; 10:15-36. [PMID: 3010199 DOI: 10.1016/0149-7634(86)90030-8] [Citation(s) in RCA: 60] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/03/2023]
Abstract
The literature on the effects of lesions of the lateral hypothalamic area (LHA) on eating and drinking is reviewed in an effort to understand the function of the neural substrate destroyed. The data suggest that damage to the dopaminergic nigrostriatal neurons that course through the LHA results in a decrease in sensorimotor facilitation; that is, an increase in the threshold for responding to stimuli that elicit orientation, approach and consumption. This increase results in decreased consumption of food and water. Evidence is also reviewed suggesting the possibility that striatal dopaminergic activity may mediate a negative feedback signal related to blood glucose level that influences responsiveness to food, and therefore eating. There is no evidence that the nigrostriatal system mediates a similar signal related to water balance and drinking. A second deficit associated with LHA lesions, caused by damage to the pallidofugal neurons that descend through this area, is a dysfunction of motor control of the head and mouth. This results in an increase in the effort required to consume food and water, also leading to decreased consumption. These two behavioral factors: an increased threshold for responding to the sensory properties of food and water and an increase in the effort required to eat and drink are used to explain the symptoms making up the lateral hypothalamic syndrome without postulating changes in physiological regulatory (set point) mechanisms.
Collapse
|
20
|
Gannon KN, Smith HV, Tierney KJ. Effect of procurement cost on the drinking of a saccharin-sucrose solution by non-deprived rats. Physiol Behav 1984; 33:917-21. [PMID: 6537521 DOI: 10.1016/0031-9384(84)90229-4] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/20/2023]
Abstract
Four non-deprived female rats were required to run in a wheel to obtain 20 min unconstrained access to a saccharin and sucrose solution. Each was run in a series of conditions in which the requirement was a proportion (0.25, 0.5, 1.0, 1.25 and 1.5) of the amount of running performed in a condition in which the wheel alone was available. A condition in which no running was required to gain access to the solution and one in which the subject was locked in the stationary wheel for the time taken to complete the highest requirement before being allowed access to the solution were also included. The results showed that as the requirement increased the amount of solution consumed also increased, and this relationship did not depend on the time taken to perform the requirement.
Collapse
|
21
|
Smith HV, Gannon KN, Tierney KJ. Effect of procurement wheel running on the rate of drinking in rats. Physiol Behav 1984; 33:927-30. [PMID: 6537522 DOI: 10.1016/0031-9384(84)90231-2] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/20/2023]
Abstract
Four rats, 22.5 hr deprived of water, were tested in 3 conditions, in which they were required to run zero, 5 or 300 one-sixth revolutions in a wheel to gain 30 min access to water in a drinking tube. The number of licks performed in the 30 min increased monotonically with the procurement cost, and was 20% greater following the larger cost than when there was no cost. However, examination of the rates of drinking throughout the 30 min revealed that differences occurred between the conditions only at the beginning of the period. In the first 3 min there was a monotonic relationship between the proportion of time spent drinking and the procurement cost, but no effect of the cost on the rate could be detected after the first 6 min. The results are consistent with the hypothesis that the effect is mediated by a transient elevation of the subject's arousal level.
Collapse
|