1
|
Ginsburg BC, Nawrocik-Madrid A, Schindler CW, Lamb RJ. Conditioned stimulus effects on paired or alternative reinforcement depend on presentation duration: Implications for conceptualizations of craving. Front Behav Neurosci 2022; 16:958643. [PMID: 35990721 PMCID: PMC9386372 DOI: 10.3389/fnbeh.2022.958643] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2022] [Accepted: 07/04/2022] [Indexed: 11/25/2022] Open
Abstract
Conditioned stimuli (CS) associated with alcohol ingestion are thought to play a role in relapse by producing a craving that in turn increases motivation to drink which increases ethanol-seeking and disrupts other ongoing behavior. Alternatively, such CS may provide information indicating a likely increase in the density of the paired unconditioned stimulus and simultaneously elicit behavior that may be incompatible with other ongoing behavior, i.e., approach toward the CS. To explore these possibilities, rats were trained to respond for ethanol or food in two different components of the same session after which a light above the ethanol-lever was lighted twice during each component and each light presentation was followed by ethanol delivery. The duration of this CS was 10 s initially and then increased to 30 s, then to 100 s, and finally returned to 30 s. The change in responding for ethanol or food was compared to a matched period immediately preceding CS presentation. The CS presentation increased responding to ethanol, and this effect increases with longer CS presentations. In contrast, the CS presentation decreased responding to food, and this effect decreases with longer CS presentations. These results appear to support the informational account of CS action rather than simply a change in the motivation to seek and consume ethanol. This suggests that craving as it is commonly understood likely represents multiple behavioral processes, not simply increased desire for alcohol and that reports of craving likely reflect labeling based upon past experiences rather than a cause of future drug-taking.
Collapse
Affiliation(s)
- Brett C. Ginsburg
- Department of Psychiatry and Behavioral Sciences, The University of Texas Health Science Center at San Antonio, San Antonio, TX, United States
| | - Acacia Nawrocik-Madrid
- Department of Psychiatry and Behavioral Sciences, The University of Texas Health Science Center at San Antonio, San Antonio, TX, United States
| | - Charles W. Schindler
- Designer Drug Unit, Intramural Research Program, National Institute on Drug Abuse, Baltimore, MD, United States
| | - R. J. Lamb
- Department of Psychiatry and Behavioral Sciences, The University of Texas Health Science Center at San Antonio, San Antonio, TX, United States
| |
Collapse
|
2
|
Shields CN, Gremel CM. Prior chronic alcohol exposure enhances Pavlovian-to-instrumental transfer. Alcohol 2021; 96:83-92. [PMID: 34363928 DOI: 10.1016/j.alcohol.2021.07.004] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2021] [Revised: 06/29/2021] [Accepted: 07/26/2021] [Indexed: 12/25/2022]
Abstract
Alcohol dependence is associated with aberrant decision-making processes, particularly in the presence of alcohol-related environmental cues. For instance, alcohol cues can trigger alcohol seeking, consumption, and even relapse behavior. Recently, works have suggested that alcohol dependence may induce more general alterations in cued processes that support adaptive behavior, including enhanced cue control of volitional behavior unrelated to alcohol use. Here we examine this hypothesis by combining prior exposure to chronic intermittent ethanol and repeated withdrawal (CIE) procedures with a Pavlovian-to-instrumental transfer (PIT) task in mice. The PIT task entails training a Pavlovian association, separately training an instrumental contingency, and a final test during which the Pavlovian cue and instrumental action are combined for the first time. We first tested two variants of the PIT procedure in ethanol-naïve mice, differing in part in the duration of Pavlovian conditioned cues (short or long). We found in the PIT test that the short cue procedure produced negative transfer, whereas the long cue procedure produced positive transfer. We then used the long cue variant to examine PIT behavior in mice previously exposed to either CIE or air vapor. We found that prior CIE exposure strengthened PIT behavior, with enhanced instrumental responding during presentation of the food-associated cue. We further found that this enhancement in CIE mice persisted even after devaluation of the food outcome. Our findings suggest that ethanol dependence can enhance the influence of reward-predictive cues on ongoing behavior. Greater non-alcohol cue control of behavior may reflect the effect of chronic ethanol exposure on neural circuitry critical for cue-guided behavior in general.
Collapse
|
3
|
Marshall AT, Munson CN, Maidment NT, Ostlund SB. Reward-predictive cues elicit excessive reward seeking in adolescent rats. Dev Cogn Neurosci 2020; 45:100838. [PMID: 32846387 PMCID: PMC7451619 DOI: 10.1016/j.dcn.2020.100838] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2020] [Revised: 07/03/2020] [Accepted: 08/12/2020] [Indexed: 12/27/2022] Open
Abstract
Impulsive behavior during adolescence may stem from developmental imbalances between motivational and cognitive-control systems, producing greater urges to pursue reward and weakened capacities to inhibit such actions. Here, we developed a Pavlovian-instrumental transfer (PIT) protocol to assay rats' ability to suppress cue-motivated reward seeking based on changes in reward expectancy. Traditionally, PIT studies focus on how reward-predictive cues motivate instrumental reward-seeking behavior (lever pressing). However, cues signaling imminent reward delivery also elicit countervailing focal-search responses (food-port entry). We first examined how reward expectancy (cue-reward probability) influences expression of these competing behaviors. Adult male rats increased rates of lever pressing when presented with cues signaling lower probabilities of reward but focused their activity at the food cup on trials with cues that signaled higher probabilities of reward. We then compared adolescent and adult male rats in their responsivity to cues signaling different reward probabilities. In contrast to adults, adolescent rats did not flexibly adjust patterns of responding based on the expected likelihood of reward delivery but increased their rate of lever pressing for both weak and strong cues. These findings indicate that control over cue-motivated behavior is fundamentally dysregulated during adolescence, providing a model for studying neurobiological mechanisms of adolescent impulsivity.
Collapse
Affiliation(s)
- Andrew T Marshall
- Department of Anesthesiology and Perioperative Care, Irvine Center for Addiction Neuroscience, University of California, Irvine, Irvine, CA, United States.
| | - Christy N Munson
- Department of Anesthesiology and Perioperative Care, Irvine Center for Addiction Neuroscience, University of California, Irvine, Irvine, CA, United States
| | - Nigel T Maidment
- Department of Psychiatry and Biobehavioral Sciences, Hatos Center for Neuropharmacology, Semel Institute for Neuroscience and Human Behavior, University of California, Los Angeles, Los Angeles, CA, United States
| | - Sean B Ostlund
- Department of Anesthesiology and Perioperative Care, Irvine Center for Addiction Neuroscience, University of California, Irvine, Irvine, CA, United States.
| |
Collapse
|
4
|
Marshall AT, Ostlund SB. Repeated cocaine exposure dysregulates cognitive control over cue-evoked reward-seeking behavior during Pavlovian-to-instrumental transfer. ACTA ACUST UNITED AC 2018; 25:399-409. [PMID: 30115761 PMCID: PMC6097769 DOI: 10.1101/lm.047621.118] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2018] [Accepted: 05/16/2018] [Indexed: 11/25/2022]
Abstract
Drug-paired cues acquire powerful motivational properties, but only lead to active drug-seeking behavior if they are potent enough to overwhelm the cognitive control processes that serve to suppress such urges. Studies using the Pavlovian-to-instrumental transfer (PIT) task have shown that rats pretreated with cocaine or amphetamine exhibit heightened levels of cue-motivated food-seeking behavior, suggesting that exposure to these drugs sensitizes the incentive motivational system. However, the PIT testing protocol can also create conflict between two competing behavioral responses to the reward-paired cue: active reward seeking (e.g., lever pressing) and passive conditioned food-cup approach behavior. We therefore investigated whether repeated cocaine exposure alters the way in which rats use cue-based reward expectations to resolve such conflict. In-depth analysis of previously published and new research confirmed that when drug-naïve rats are given a cue that signals the timing of a delayed noncontingent reward, they adaptively transition from reward seeking to conditioned approach behavior, facilitating efficient collection of the predicted reward. In contrast, cocaine-exposed rats exhibit pronounced behavioral dysregulation, increasing, rather than suppressing, their reward-seeking behavior over time, disrupting their ability to passively collect reward. Such findings speak to the important and sometimes overlooked role that cognitive control plays in determining the motivational impact of cues associated with drug and nondrug rewards.
Collapse
Affiliation(s)
- Andrew T Marshall
- Department of Anesthesiology and Perioperative Care, Irvine Center for Addiction Neuroscience, University of California, Irvine, Irvine, California 92697, USA
| | - Sean B Ostlund
- Department of Anesthesiology and Perioperative Care, Irvine Center for Addiction Neuroscience, University of California, Irvine, Irvine, California 92697, USA
| |
Collapse
|
5
|
Edgar D, Hall G, Pearce JM. Enhancement of Food-Rewarded Instrumental Responding by an Appetitive Conditioned Stimulus. ACTA ACUST UNITED AC 2018. [DOI: 10.1080/14640748108400825] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
Abstract
Four experiments are reported in which a stimulus (with a minimum duration of 60 s) signalling the delivery of “free” food was presented to rats lever-pressing for food available on a variable interval schedule. It was found that responding was enhanced in the presence of the stimulus when the baseline schedule of reinforcement was lean (Experiment I) and that the enhancement was dependent upon the pairing of the stimulus with free food (Experiments II and III). Experiment IV showed that an enhancement could be found after initial training in which stimulus-food pairings were given to subjects that were not concurrently lever pressing for food. It is argued that these results are consistent with the suggestion that an appetitive conditioned stimulus can energise appetitive instrumental behaviour.
Collapse
Affiliation(s)
- David Edgar
- Department of Psychology, University of York, Heslington, York, England
| | - Geoffrey Hall
- Department of Psychology, University of York, Heslington, York, England
| | - John M. Pearce
- Psychological Laboratory, University of Cambridge, Downing Street, Cambridge, England
| |
Collapse
|
6
|
|
7
|
Miller L, Judd S. The Effect of Signaled Response-Independent and Response-Dependent Reinforcers on Responding Maintained by a Variable-Interval Schedule. PSYCHOLOGICAL RECORD 2017. [DOI: 10.1007/bf03394468] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
8
|
Coughlin RC. The Aversive Properties of Withdrawing Positive Reinforcement: A Review of the Recent Literature. PSYCHOLOGICAL RECORD 2017. [DOI: 10.1007/bf03394098] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
9
|
Cartoni E, Balleine B, Baldassarre G. Appetitive Pavlovian-instrumental Transfer: A review. Neurosci Biobehav Rev 2016; 71:829-848. [DOI: 10.1016/j.neubiorev.2016.09.020] [Citation(s) in RCA: 199] [Impact Index Per Article: 24.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2016] [Revised: 09/23/2016] [Accepted: 09/23/2016] [Indexed: 11/26/2022]
|
10
|
The 3-second auditory conditioned stimulus is a more effective stressor than the 20-second auditory conditioned stimulus in male rats. Neuroscience 2015; 299:79-87. [DOI: 10.1016/j.neuroscience.2015.04.055] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2015] [Revised: 04/21/2015] [Accepted: 04/22/2015] [Indexed: 01/01/2023]
|
11
|
Colagiuri B, Lovibond PF. How food cues can enhance and inhibit motivation to obtain and consume food. Appetite 2014; 84:79-87. [PMID: 25278431 DOI: 10.1016/j.appet.2014.09.023] [Citation(s) in RCA: 36] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2014] [Revised: 09/24/2014] [Accepted: 09/25/2014] [Indexed: 11/19/2022]
Abstract
Learning may play an important role in over-eating. One example is Pavlovian-to-instrumental transfer (PIT), whereby reward cues facilitate responding to obtain that reward. Whilst there is increasing research indicating PIT for food in humans, these studies have exclusively tested PIT under instrumental extinction (i.e. when the food is no longer available), which may reduce their ecological validity. To address this, we conducted two experiments exploring PIT for food in humans when tested under instrumental reinforcement. Participants first underwent Pavlovian discrimination training with an auditory cue paired with a chocolate reward (CS+) and another auditory cue unpaired (CS-). In instrumental training participants learnt to press a button to receive the chocolate reward on a VR10 schedule. In the test phase, each CS was presented whilst participants maintained the opportunity to press the button to receive chocolate. In Experiment 1, the PIT test was implemented after up to 20 min of instrumental training (satiation) whereas in Experiment 2 it was implemented after only 4 min of instrumental training. In both experiments there was evidence for differential PIT, but the pattern differed according to the rate of responding at the time of the PIT test. In low baseline responders the CS+ facilitated both button press responding and consumption, whereas in high baseline responders the CS- suppressed responding. These findings suggest that both excitatory and inhibitory associations may be learnt during PIT training and that the expression of these associations depends on motivation levels at the time the cues are encountered. Particularly concerning is that a food-paired cue can elicit increased motivation to obtain and consume food even when the participant is highly satiated and no longer actively seeking food, as this may be one mechanism by which over-consumption is maintained.
Collapse
Affiliation(s)
- Ben Colagiuri
- School of Psychology, University of Sydney, Australia; School of Psychology, University of New South Wales, Australia.
| | | |
Collapse
|
12
|
Differential conditioning of conditioned enhancement and positive conditioned suppression. ACTA ACUST UNITED AC 2013. [DOI: 10.3758/bf03336757] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
13
|
Conditioned enhancement as a function of the percentage of CS-US pairings and CS duration. ACTA ACUST UNITED AC 2013. [DOI: 10.3758/bf03334258] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
14
|
|
15
|
|
16
|
The effect of the magnitude of response-independent food on conditioned enhancement. ACTA ACUST UNITED AC 2013. [DOI: 10.3758/bf03329354] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
17
|
Lolordo VM. Facilitation of food-reinforced responding by a signal for response-independent food. J Exp Anal Behav 2010; 15:49-55. [PMID: 16811489 PMCID: PMC1333780 DOI: 10.1901/jeab.1971.15-49] [Citation(s) in RCA: 71] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
Abstract
Five pigeons whose key pecking was maintained by 4-sec access to grain on a variable-interval 2-min schedule received Pavlovian differential conditioning trials superimposed upon the instrumental baseline. The conditioned stimuli were changes in the stimulus on the key from white to red, or to a white horizontal line against a dark background. The positive conditioned stimulus was 20 sec long, and was followed immediately by 8-sec access to grain. The negative conditioned stimulus, also 20 sec long, was never paired with response-independent food. All pigeons responded more rapidly in the presence of the positive conditioned stimulus than in the presence of the negative one. The positive conditioned stimulus produced an increase in response rate over the pre-conditioned stimulus period. The negative conditioned stimulus had no marked effect upon response rate. When the roles of the positive and negative stimuli were reversed, and the duration of the response-independent reinforcement was reduced to 4 sec, the new positive conditioned stimulus came to facilitate responding, and the new negative conditioned stimulus no longer produced facilitation. A second discrimination reversal produced similar outcomes. When a third reversal was initiated, and the duration of response-independent reinforcement was reduced to 2 sec, the difference between the effects of the positive and negative stimuli diminished.
Collapse
|
18
|
Abstract
During a brief conditioned stimulus (15 or 30 sec) that terminated with the response-independent delivery of banana pellets, operant responding reinforced by other food pellets according to a variable-interval schedule of reinforcement was suppressed in the squirrel monkey. Conditioned stimuli of longer duration (1, 2, and 3 min) did not reliably affect the rate of operant performance. Brief conditioned stimuli generated homogeneous response patterns of nearly complete suppression. Increasing the CS duration did not enhance responding, as previously reported, but led to alternate bursting and pausing, which suggested a loss of control by the conditioned stimulus. The results suggest that the magnitude of "positive" or "negative" conditioned suppression reflects the strength of the classical conditioning process.
Collapse
|
19
|
Kelly DD. Suppression of random-ratio and acceleration of temporally spaced responding by the same prereward stimulus in monkeys. J Exp Anal Behav 2010; 20:363-73. [PMID: 16811711 PMCID: PMC1334160 DOI: 10.1901/jeab.1973.20-363] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Abstract
A 1-min tone and light signal that preceded two free pellets of food suppressed the random-ratio responding of four rhesus monkeys, but accelerated the same subjects' responding on a differential-reinforcement-of-low-rate schedule in separate sessions. Both schedule-specific interactions occurred during the first presentations of the signal that previously had been paired with food outside the operant sessions. Thus, neither effect was adventitiously produced. In two subjects, both the direction and magnitude of the prereward change in differential-reinforcement-of-low-rate responding appeared related to baseline response rates: the more rapid the baseline responding, the less was the acceleration during the signal. Suppression and acceleration did not appear as dichotomous effects with separate parameters, but as related effects at least partly determined by the characteristics of the baseline operant performance.
Collapse
|
20
|
Boakes RA, Halliday MS, Poli M. Response additivity: effects of superimposed free reinforcement on a variable-interval baseline. J Exp Anal Behav 2010; 23:177-91. [PMID: 16811838 PMCID: PMC1333338 DOI: 10.1901/jeab.1975.23-177] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Abstract
Three experiments examined the effects of superimposing free reinforcement (Free VI 30-sec) on behavior maintained by a response dependent mult VI 2-min VI 2-min schedule of reinforcement. Experiment I used pigeons as subjects, key pecking as the response, and colors of response key as the stimuli associated with the multiple-schedule components. When free reinforcement was added during only one component (Differential condition) a large and highly significant increase in response rate developed in this component. Adding free reinforcement during both components (Nondifferential condition) produced smaller and far less-consistent effects. An entirely different pattern of results was obtained in two subsequent experiments, where similar procedures and reinforcement conditions were used with rats as subjects and bar pressing as the response. In both Experiments II and III, response rates decreased to the stimulus associated with added free reinforcement in the Differential condition. These findings are interpreted as the result of interactions between behavior maintained by response-reinforcer contingencies and behavior maintained by stimulus-reinforcer contingencies. As such, they support the main assumption of an autoshaping theory of behavioral contrast, that additivity of responding generated by the two kinds of contingency can occur only in situations favorable to autoshaping.
Collapse
|
21
|
Hake DF, Powell J. Positive reinforcement and suppression from the same occurrence of the unconditioned stimulus in a positive conditioned suppression procedure. J Exp Anal Behav 2010; 14:247-57. [PMID: 16811472 PMCID: PMC1333731 DOI: 10.1901/jeab.1970.14-247] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Abstract
Responding of rats was maintained on a variable-interval schedule of food reinforcement. The same response also produced a blinking light followed by electrical brain stimulation according to a fixed-interval schedule. This conjoint schedule produced two behavioral changes. First, instead of a steady rate of responding throughout the session, which would be characteristic of the variable interval food schedule alone, responding between occurrences of the light-brain stimulation pairings became positively accelerated and thus was more characteristic of the fixed-interval schedule of these pairings. Second, food responding was suppressed during the light that preceded brain stimulation. These results indicate that positive reinforcement and suppression resulted from the same occurrence of the light-brain stimulation combination. This finding suggests that stimuli such as conditioned reinforcers that precede an unconditioned reinforcer may have a suppressive effect upon responding in their presence that is being maintained by another reinforcer.
Collapse
|
22
|
Davison M, Sheldon L, Lobb B. Positive conditioned suppression: Transfer of performance between contingent and noncontingent reinforcement situations. J Exp Anal Behav 2010; 33:51-7. [PMID: 16812161 PMCID: PMC1332912 DOI: 10.1901/jeab.1980.33-51] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
Abstract
Five homing pigeons were trained on concurrent variable-interval schedules. A fixed-duration stimulus was occasionally presented on one key; and, in various conditions, this stimulus terminated (a) without reinforcement, (b) in noncontingent reinforcement, (c) with reinforcement contingent on a response on the key on which the stimulus was presented, and (d) with reinforcement contingent on a response on the key on which the stimulus was not presented. Initially, a stimulus terminating in noncontingent reinforcement generally produced decreased response rates on both keys during the stimulus. Contingencies, however, reliably produced increased rates during the stimulus on the key on which the contingency was arranged, relative to the rate on the concurrently available key. Contingency conditions were followed by noncontingency conditions in which the separation of rates caused by contingencies was maintained. When rates during the stimulus were compared with response rates on the same keys in the absence of the stimulus, contingency-caused rate increases and decreases were again found, but only the rate decreases were maintained in subsequent noncontingency conditions. Further data suggested that the contingency-caused rate changes were not maintained when the stimulus terminated without reinforcement, and that they were unaffected by a threefold decrease in the reinforcement rate provided by the baseline schedules. The results support the suggestion that performance in the positive conditioned suppression procedure results from concurrent and multiple schedule interactions. They further suggest that the production of either acceleration or suppression is dependent on adventitious and historical contingencies.
Collapse
|
23
|
Smith JB. Effects of response rate, reinforcement frequency, and the duration of a stimulus preceding response-independent food. J Exp Anal Behav 2010; 21:215-21. [PMID: 16811739 PMCID: PMC1333189 DOI: 10.1901/jeab.1974.21-215] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Abstract
Food-reinforced key pecking in the pigeon was maintained under a four-component multiple schedule. In two components, responding was maintained at high rates under a random-ratio schedule. In the other two components, responding was maintained at low rates under a schedule that specified a minimum interresponse time. For both high and low response rates, one of the schedule components was associated with a high reinforcement frequency and the other components with a lower reinforcement frequency. During performance under these schedules, a stimulus terminated by access to response-independent food was periodically presented. The duration of this pre-food stimulus was 5, 30, 60, or 120 sec. Changes in rate of key pecking during the pre-food stimulus were systematically related to baseline response rate and the duration of the stimulus. Both high and low response rates were increased during the 5-sec stimulus. At longer stimulus durations, low response rates were unaffected and high response rates were decreased during the stimulus. For two of three pigeons, high response rates maintained under a lower frequency of reinforcement tended to be decreased more than high response rates maintained under a higher reinforcement frequency. In general, the magnitude of decrease in high response rates was inversely related to the duration of the pre-food stimulus.
Collapse
|
24
|
Abstract
Recent research on multiple schedule interactions is reviewed. Contrary to formulations that view contrast as the result of elicited behavior controlled by the stimulus-reinforcer contingency (e.g., additivity theory), the major controlling variable is the relative rate of reinforcement, which cannot be reduced to some combination of stimulus-reinforcer and response-reinforcer effects. Other recent theoretical formulations are also reviewed and all are found to face serious counterevidence. The best description of the available data continues to be in terms of the "context of reinforcement," but Herrnstein's (1970) formulation of the basis of such context effects appears to be inadequate. An alternative conception is provided by Catania's concept of "inhibition by reinforcement," by which rate of responding is inversely related to the average rate of reinforcement in the situation. Such a conception is related to Gibbon's recent scalar-expectancy account of autoshaping and Fantino's delay-reduction model of conditioned reinforcement, suggesting that a common set of principles determines several diverse conditioning phenomena. However, the empirical status of such a description remains uncertain, because recent evidence shows that schedule interactions are temporally asymmetric, depending primarily upon the conditions of reinforcement that follow a schedule component.
Collapse
|
25
|
Holmes NM, Marchand AR, Coutureau E. Pavlovian to instrumental transfer: a neurobehavioural perspective. Neurosci Biobehav Rev 2010; 34:1277-95. [PMID: 20385164 DOI: 10.1016/j.neubiorev.2010.03.007] [Citation(s) in RCA: 174] [Impact Index Per Article: 12.4] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2009] [Revised: 03/16/2010] [Accepted: 03/31/2010] [Indexed: 11/27/2022]
Abstract
Pavlovian-to-instrumental transfer (PIT) is a key concept in developing our understanding of cue-controlled behaviours. Here we have reviewed the literature on behavioural and neurobiological factors that influence PIT. Meta-analyses of the data for individual groups in PIT studies revealed that PIT is related to both the order and amounts of instrumental and Pavlovian training, and that it is critically determined by competition between instrumental and Pavlovian responses. We directly addressed the role of response competition in PIT in two experiments which showed that extensive Pavlovian conditioning produced more Pavlovian magazine visits and weaker PIT than moderate Pavlovian conditioning (Experiment 1); and that PIT lost after extensive Pavlovian conditioning was restored by Pavlovian extinction training (Experiment 2). These findings confirm that response competition is indeed an important determinant of PIT. This has significant implications for lesion and inactivation studies that assess the neurobiological substrates of PIT, as well as attempts to demonstrate PIT in the drug self-administration paradigm where the effect is yet to be reliably shown.
Collapse
|
26
|
Schindler CW, Thorndike EB, Ma JD, Goldberg SR. Conditioned suppression with cocaine as the unconditioned stimulus. Pharmacol Biochem Behav 2000; 65:83-9. [PMID: 10638640 DOI: 10.1016/s0091-3057(99)00176-8] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Abstract
A conditioned-suppression procedure was used to study drug conditioning using cocaine as the unconditioned stimulus (UCS). Rats were first trained to nose poke for food-reinforcement during daily 60-min sessions. At least 1 week following jugular vein catheterization, a 5-min tone-light compound stimulus was presented 30 min into the food-reinforcement session. Two minutes after the onset of the stimulus, either 0 (saline), 1.0, 3.0 or 5.6 mg/kg cocaine, was administered i.v. to separate groups of rats. For another group, the stimulus was presented, and the 5.6 mg/kg dose of cocaine was injected in an unpaired fashion (i.e., at different times). After 5 days of training a test was given with the tone-light stimulus presented alone. No disruption of responding during the tone-light stimulus was observed in the saline and 1.0 mg/kg cocaine groups or for the unpaired group. When the tone-light stimulus was paired with 5.6 mg/kg cocaine; however, it produced nearly a 50% reduction in responding, which then gradually extinguished when the stimulus was presented alone for 5 days. The 3.0 mg/kg cocaine group produced intermediate suppression. When the tone-light compound stimulus was shortened to 70 s and the interstimulus interval (ISI) was 0, 30, or 60 s in three separate groups of rats, the most robust conditioned suppression was observed at the 60 s ISI. Therefore, the conditioned suppression procedure, using 3.0 or 5.6 mg/kg i.v. cocaine doses as the UCS, produced robust conditioning effects comparable to other drugs and more conventional reinforcers. The conditioned suppression procedure may be a useful model for studying the classically conditioned effects of cocaine.
Collapse
Affiliation(s)
- C W Schindler
- Preclinical Pharmacology Section, Behavioral Neuroscience Branch, NIH/NIDA Intramural Research Program, Baltimore, MD 21224, USA
| | | | | | | |
Collapse
|
27
|
See RE, Grimm JW, Kruzich PJ, Rustay N. The importance of a compound stimulus in conditioned drug-seeking behavior following one week of extinction from self-administered cocaine in rats. Drug Alcohol Depend 1999; 57:41-9. [PMID: 10617312 DOI: 10.1016/s0376-8716(99)00043-5] [Citation(s) in RCA: 57] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
Abstract
Previous studies have demonstrated that conditioned stimuli can increase responding on a drug-associated lever after extinction from drug self-administration. The present study investigated singular stimuli (tone or light) or a compound stimulus (tone + light) for their ability to increase extinguished responding following chronic cocaine self-administration. Rats self-administered cocaine for 2 weeks on a fixed ratio (FR1) schedule of reinforcement, in which lever responding resulted in varied presentation of a tone, light, or tone + light combination. The rats were then exposed to 1 week of daily extinction sessions. Presentation of the tone + light on day 8 of extinction in the absence of cocaine reinforcement resulted in a significant increase in responding, while either stimulus component alone was much weaker or failed to produce any changes from extinction rates of responding. In addition, changing the duration of the single elements of the compound did not affect the magnitude of increased responding to the compound. Following three final extinction sessions, robust lever responding for cocaine infusions on day 12 of extinction was seen across all groups. These findings suggest that compound stimuli may be critical to fully activate drug-seeking behavior in conditions of craving and relapse following prolonged extinction.
Collapse
Affiliation(s)
- R E See
- Department of Psychology and Program in Neuroscience, Washington State University, Pullman 99164-4820, USA.
| | | | | | | |
Collapse
|
28
|
|
29
|
|
30
|
Van Hest A, Van Haaren F, Kop P, Van Der Schoot F. Operant-Pavlovian interactions: Ratio-schedules and the effects of the duration and location of a stimulus preceding response-independent food. Behav Processes 1986; 13:149-58. [DOI: 10.1016/0376-6357(86)90022-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/18/1986] [Indexed: 11/29/2022]
|
31
|
de Rose JC. Behavioral contrast in fixed-interval components: effects of extinction-component duration. J Exp Anal Behav 1986; 45:175-88. [PMID: 3958663 PMCID: PMC1348226 DOI: 10.1901/jeab.1986.45-175] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/08/2023]
Abstract
Seven albino rats were exposed to a multiple schedule of reinforcement in which the two components (fixed interval and extinction) alternated such that a presentation of the extinction component followed each fixed-interval reinforcement. In baseline sessions, the duration of the extinction component was constant and always one-third of the fixed-interval value. Probe sessions contained a probe segment in which the duration of the extinction component was increased; the response rate in fixed-interval components during the probe segment was compared with the response rate in the segments preceding and following the probe. The effect of increasing the duration of the extinction component was studied under three values of fixed interval: 30 s, 120 s, and 18 s, in three successive conditions. Response rate within fixed intervals was a direct function of duration of the extinction component. Pausing at the beginning of the fixed interval decreased as extinction duration increased. These effects were larger and more consistent for the shorter fixed-interval values (18 s and 30 s). These results indicate a functional relation between relative component duration and responding. For the component providing more frequent reinforcement, this could be stated as an inverse relationship between relative component duration and response rate. This relation is similar to findings regarding the ratio of trial and intertrial duration in Pavlovian conditioning procedures, and suggests that behavioral contrast may be related to Pavlovian contingencies underlying the multiple schedule.
Collapse
|
32
|
Hemmes NS, Rubinsky HJ. Conditional acceleration and external disinhibition of operant lever pressing by prereward, neutral, and reinforcing stimuli. J Exp Anal Behav 1982; 38:157-68. [PMID: 16812294 PMCID: PMC1347811 DOI: 10.1901/jeab.1982.38-157] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
Abstract
Rats responding under a differential-reinforcement-of-low-rate schedule increased their rates of lever pressing during a 20-second click/flash stimulus that preceded the delivery of a response-independent food pellet. The increase could not be attributed to suppression of collateral behavior that has been said to mediate temporally-spaced responding. We propose that the prereward stimulus functioned as an external disinhibitor of lever pressing that had been inhibited by the constraints of the operant schedule. Support is derived from the observed disinhibitory effects of a 10-second unpaired click/flash stimulus and of unsignaled, response-independent pellets that were presented while the animals were responding under the same schedule.
Collapse
|
33
|
|
34
|
Lovibond PF. Appetitive Pavlovian-instrumental interactions: effects of inter-stimulus interval and baseline reinforcement conditions. THE QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY. B, COMPARATIVE AND PHYSIOLOGICAL PSYCHOLOGY 1981; 33:257-69. [PMID: 7198814 DOI: 10.1080/14640748108400811] [Citation(s) in RCA: 34] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/24/2023]
Abstract
Experiment I manipulated two variables which appear to influence whether a signal for food enhances or suppresses food-rewarded instrumental performance: interstimulus interval (ISI) during classical conditioning and instrumental reinforcement schedule during testing. In two groups a 10-s conditioned stimulus (CS) and food were paired (10-s and 20- to 100-s ISI), while in a third group they were unpaired. During signalled reinforcement of lever-pressing (S+), the CS suppressed responding in both paired groups. During signalled extinction (S−), responding in the 10-s ISI group was suppressed during the CS and enhanced for 60 s after CS offset; responding in the 20- to 100-s ISI group was enhanced both during the CS and for 120 s after CS offset. Experiment II examined whether the long ISI enhancement effect would occur when the baseline response rate was lowered by satiation rather than extinction. A 20- to 100-s CS and food were paired in one group and unpaired in another. After near-satiation on a CRF schedule, CS presentations caused a reduction in responding in both groups, with no significant difference between the two groups. The results of the two experiments were interpreted in terms of an interaction between the expectancy of food generated by stimuli conditioned at short and long ISIs and the expectancy of food availability controlled by the instrumental schedule.
Collapse
|
35
|
Lovibond PF. Effects of long- and variable-duration signals for food on activity, instrumental responding, and eating. LEARNING AND MOTIVATION 1980. [DOI: 10.1016/0023-9690(80)90011-9] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
|
36
|
Morris RC, Wookey PE, Kirby RM. Effects of Signalling Reinforcement Which Maintains Variable Ratio Performance of Rats and Pigeons. Psychol Rep 1979. [DOI: 10.2466/pr0.1979.44.3.843] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
The non-instrumental effects on baseline response rates of response-contingent stimuli (CSs) that signalled all reinforcement were investigated. Rats showed reliable suppression during auditory CSs. Pigeons exhibited reliable suppression with visual CSs but not with auditory CSs. This procedure affords' a method of investigating non-instrumental aspects of behaviour which is free from problems inherent in the appetitive conditioned-suppression technique.
Collapse
|
37
|
Stubbs DA, Hughes JE, Cohen SL. Positive conditioned suppression: an explanation in terms of multiple and concurrent schedules. J Exp Anal Behav 1978; 30:329-43. [PMID: 16812113 PMCID: PMC1332777 DOI: 10.1901/jeab.1978.30-329] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
Abstract
Rats performed under a baseline variable-interval schedule of food presentation. A response-independent food schedule was then superimposed on the baseline schedule for different periods of time across different conditions. The response-independent schedule operated for the whole session in some conditions, intermittently for sixty second periods in some, and intermittently for ten-second periods in others. Under these latter two sets of conditions, the response-independent food schedule was stimulus correlated and alternated with the baseline schedule according to a multiple schedule. Response-independent food presentations always suppressed responding. The degree of suppression tended to increase the longer the period of response-independent food. Control conditions, in which the superimposed schedule was response-dependent, rather than response-independent, did not produce response suppression. The results fit an analysis of positive conditioned suppression phenomena in the context of multiple and concurrent schedule effects.
Collapse
|
38
|
Green L. Are there two classes of classically-conditioned responses? THE PAVLOVIAN JOURNAL OF BIOLOGICAL SCIENCE 1978; 13:154-62. [PMID: 750966 DOI: 10.1007/bf03001388] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
It is proposed that two response classes interact during classical conditioning: (1) a specific effect which directs responding towards or away from the CS, depending upon whether a positive or negative outcome is signaled, and (2) a general, emotional effect which interferes with responding. The interaction between these two response classes can account for the varied results obtained under CER and autoshaping procedures, and must be considered in any analysis which attempts to account for the complex nature of the conditioned response.
Collapse
|
39
|
Omnipotent pexgos and the goddess parsimony. Behav Brain Sci 1978. [DOI: 10.1017/s0140525x00059690] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
40
|
Osborne SR, Killeen PR. Temporal properties of responding during stimuli that precede response-independent food. LEARNING AND MOTIVATION 1977. [DOI: 10.1016/0023-9690(77)90050-9] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
|
41
|
Green L, Rachlin H. On the directionality of key pecking during signals for appetitive and aversive events. LEARNING AND MOTIVATION 1977. [DOI: 10.1016/0023-9690(77)90051-0] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
|
42
|
Poling A, Urbain C, Thompson T. Effects of d-amphetamine and chlordiazepoxide on positive conditioned suppression. Pharmacol Biochem Behav 1977; 7:233-7. [PMID: 928479 DOI: 10.1016/0091-3057(77)90139-3] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/25/2022]
Abstract
Six rats lever-pressed under a variable-interval 80-sec food reinforcement schedule. After responding had stabilized, an 8-sec tone terminating with food delivery was superimposed on the variable-interval schedule on the average once every five minutes without regard to the animal's behavior. This positive conditioned suppression procedure consistently reduced responding during the pre-food stimulus (tone). Neither d-amphetamine (0.5, 1.0, 2.0 mg/kg) nor chlordiazepoxide (7.5, 15, 30 mg/kg) significantly affected the relative suppression produced by the tone. Instead, both drugs produced generally non-selective effects, similarly affecting response rate in the presence and absence of the tone.
Collapse
|
43
|
|
44
|
Positive and negative conditioned suppression in the pigeon: Effects of the locus and modality of the CS. LEARNING AND MOTIVATION 1976. [DOI: 10.1016/0023-9690(76)90019-9] [Citation(s) in RCA: 23] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
45
|
The effects upon food-reinforced pecking and treadle-pressing of auditory and visual signals for response-independent food. LEARNING AND MOTIVATION 1974. [DOI: 10.1016/0023-9690(74)90035-6] [Citation(s) in RCA: 43] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
|
46
|
Delprato DJ, Jackson DE. Counterconditioning and exposure-only in the treatment of specific (conditioned suppression) and generalized fear in rats. Behav Res Ther 1973; 11:453-61. [PMID: 4798233 DOI: 10.1016/0005-7967(73)90104-6] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/12/2023]
|
47
|
Kelly DD. Long-term prereward suppression in monkeys unaccompanied by cardiovascular conditioning. J Exp Anal Behav 1973; 20:93-104. [PMID: 4197506 PMCID: PMC1334106 DOI: 10.1901/jeab.1973.20-93] [Citation(s) in RCA: 18] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/09/2023]
Abstract
In Experiment I, a 3-min tone that preceded a free pellet of food suppressed variable-interval performances maintained by the same type of pellets, but failed to elicit conditioned changes in the heart rates and blood pressures of two rhesus monkeys. Initially severe, the prereward suppression became temporally discriminated to progressively later portions of the tone, and was maintained at an attenuated level for over four months. The suppression was apparently not caused by interfering autonomic respondents, nor was it superstitiously conditioned, since 21 of the initial 25 tone-food pairings took place outside of baseline sessions. In Experiment II, a 1-min light, paired with four free pellets of food, suppressed the variable-interval responding of a second pair of similarly trained monkeys. An interresponse-time analysis showed that in one subject, mild prereward suppression of responding developed through two stages. On early trials, response rate slowed by 10% throughout the prefood interval. On later trials, the animal suppressed by pausing for a like portion of the interval, most often near the end, but otherwise responded normally during the prefood signal.
Collapse
|
48
|
Hake DF, Campbell RL. Characteristics and response-displacement effects of shock-generated responding during negative reinforcement procedures: pre-shock responding and post-shock aggressive responding. J Exp Anal Behav 1972; 17:303-23. [PMID: 4624511 PMCID: PMC1333907 DOI: 10.1901/jeab.1972.17-303] [Citation(s) in RCA: 14] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/11/2023]
Abstract
Bar-pressing (Experiment I) or key-pressing (Experiments II and III) responses of monkeys were reinforced according to a fixed-interval schedule of negative reinforcement: the first response after a fixed interval of time terminated regularly spaced shocks for a fixed time designated as the reinforcement period. During extinction, shocks continued during the reinforcement period. That there were two types of responding generated by shock alone was indicated by (1) the level of responding maintained during extinction relative to conditions without shock, (2) the stability of two between-shock response patterns across reinforcement and extinction conditions, and (3) the development of these two between-shock patterns without a history of reinforcement. Subjects developed either a pre-shock or a post-shock response pattern when only the bar was available. However, when both a bite tube, an operandum requiring an aggressive topography, and a recessed key, an operandum that did not require an aggressive topography, were provided, the post-shock pattern was observed in tube biting and the pre-shock pattern was observed in key pressing. Removal of the bite tube produced post-shock key responding similar to that observed when only the bar was available. The displacement of post-shock, aggression-motivated responding confirmed the confounding effect of shock-generated responding in negative reinforcement procedures, and suggests that the use of concurrent response alternatives would reduce such confounding.
Collapse
|
49
|
Abstract
Free-operant avoidance responding was maintained by a shock avoidance schedule in three monkeys. The frequency of avoidance responses during a stimulus terminated by response-independent food pellet presentation was dependent upon the method of pellet delivery. Avoidance rates were relatively increased when food retrieval responses followed pellet delivery. Avoidance rates were decreased when retrieval responses preceded pellet delivery.
Collapse
|
50
|
Wolfle TL, Mayer DJ, Carder B, Liebeskind JC. Motivational effects of electrical stimulation in dorsal tegmentum of the rat. Physiol Behav 1971; 7:569-74. [PMID: 5131214 DOI: 10.1016/0031-9384(71)90110-7] [Citation(s) in RCA: 60] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/14/2023]
|