Self-control revisited: Some factors that affect autoshaped responding

Towards validation of delay discounting in the pigeon

A series of procedures were conducted in an attempt to assess various forms of validity related to the use of pigeons in research on delay discounting. In separate experimental arrangements, pigeons pressed a treadle, pecked a lit key, pecked a darkened key, or pecked a lit key with a hold as the required response. First, the obtained results were consistent with what would be necessary if the construct of delay discounting were being measured, which provides evidence of face validity. Second, criterion validity was assessed by comparing individual differences in rates of discounting across procedures. Third, to assess internal validity, each pigeon repeated the Treadle, Key Peck, and Dark Key procedures. Again, at both the aggregate and individual levels, the obtained indifference points did not differ systematically between replications. Finally, to assess external validity, discounting was observed regardless of the procedure, where the patterns of data at the aggregate level, and generally at the individual level, were orderly and well described by a hyperbolic function. In addition, rates of discounting were similar when pigeons pecked a lit key, a dark key, or a key with a hold; and each of those rates of discounting tended to be steeper than when treadle pressing. Generally speaking, pigeons that discounted relatively steeply on one procedure also tended to discount relatively steeply on the other procedures. The procedures evidence some of the necessary elements involved with the use of pigeons in research on delay discounting.

Suboptimal choice in rats: Incentive salience attribution promotes maladaptive decision-making

Stimuli that are more predictive of subsequent reward also function as better conditioned reinforcers. Moreover, stimuli attributed with incentive salience function as more robust conditioned reinforcers. Some theories have suggested that conditioned reinforcement plays an important role in promoting suboptimal choice behavior, like gambling. The present experiments examined how different stimuli, those attributed with incentive salience versus those without, can function in tandem with stimulus-reward predictive utility to promote maladaptive decision-making in rats. One group of rats had lights associated with goal-tracking as the reward-predictive stimuli and another had levers associated with sign-tracking as the reward-predictive stimuli. All rats were first trained on a choice procedure in which the expected value across both alternatives was equivalent but differed in their stimulus-reward predictive utility. Next, the expected value across both alternatives was systematically changed so that the alternative with greater stimulus-reward predictive utility was suboptimal in regard to primary reinforcement. The results demonstrate that in order to obtain suboptimal choice behavior, incentive salience alongside strong stimulus-reward predictive utility may be necessary; thus, maladaptive decision-making can be driven more by the value attributed to stimuli imbued with incentive salience that reliably predict a reward rather than the reward itself.

Response factors in delay discounting: evidence for Pavlovian influences on delay discounting in pigeons

Pigeons completed a delay-discounting task where in different conditions the required response was either key pecking or treadle pressing. Because of stimulus-reinforcer relations that are known to form between localized visual cues and the delivery of food (e.g., autoshaping), we predicted that there would be steeper rates of discounting with key pecking than treadle pressing. To account for possible effort differences between key pecking and treadle pressing, pigeons also completed a discounting task where multiple key pecks were required to gain access to the food. The rates of discounting for the key peck and effort-equivalence discounting procedures were similar, and both were steeper than the rate of discounting for the treadle-pressing procedure. While it is tacitly assumed that behavior in choice situations is largely under the control of operant contingencies, the present results suggest that when developing animal analogs to study discounting in a discrete-trial choice procedure, the stimulus-reinforcer relations (Pavlovian conditioning) may need to be taken into consideration.

Self-control in male and female rats

Eight male and 8 female Wistar rats were exposed to a discrete-trial procedure in which they chose between the presentation of a small (one pellet) or a large (three pellets) reinforcer. The delay to the small and large reinforcer was 6.0 s in the first condition of Experiment 1. Subjects consistently chose the large reinforcer. When the delay to the small reinforcer was decreased to 0.1 s in the next experimental condition, all subjects continued to choose the large 6.0-s delayed reinforcer. When the contingencies correlated with the two levers were reversed in the next experimental condition, the majority of subjects (5 males and 6 females) still chose the large delayed reinforcer over the small immediately presented reinforcer. The delay to the small reinforcer was maintained at 6.0 s, but the delay to the large reinforcer was varied among 9.0, 15.0, 24.0, and 36.0 s in Experiment 2, in which 4 males and 4 females participated. Most subjects consistently chose the large increasingly delayed reinforcer, although choice for the small 6.0-s delayed reinforcer developed in some females when the large reinforcer was delayed for 24.0 or 36.0 s. These choice patterns were not predicted from a literal application of a model that says choice should favor the alternative correlated with the higher (amount/delay) ratio.