Low-response-rate conditioning history and fixed-interval responding in rats

Resurgence without overall worsening of alternative reinforcement

Three experiments were conducted with pigeons to assess discriminated periods of nonreinforcement as precipitators of resurgence. Each experiment occurred in three phases. In the Training phase, key-pecking was reinforced according to variable-interval schedules that alternated between two response keys (Experiment 1) or were concurrently available on two response keys (Experiments 2a & 2b). In the Alternative-Reinforcement phase, responding to one key was extinguished, while that to the other was reinforced according to tandem schedules. These then were replaced by chained schedules with the same programmed reinforcement rate in the Resurgence-Test phase. Resurgence occurred both when the signaled period of nonreinforcement was a darkened keylight in the terminal link of the chain schedule (Experiment 1) and a darkened keylight (Experiment 2a) or keylight color change (Experiment 2b) in the initial link of the chain schedule. Thus, signaled periods of extinction, without accompanying reductions in reinforcement rate, precipitated resurgence, suggesting that resurgence is not the result of worsening of overall reinforcement conditions, but also occurs when local conditions of reinforcement are worsened.

The role of signals in two variations of differential-reinforcement-of-low-rate procedures

Differential-reinforcement-of-low-rate (DRL) schedules are used to decrease the overall rate of, but not eliminate, a target response. Two variations of DRL, spaced-responding and full-session, exist. Preliminary comparative analyses suggest that the two schedules function differently when unsignaled. We compared response rates under these two DRL variations with and without signals. In Experiment 1, five preschool students played a game in which points were earned under DRL schedules. In some sessions, a stimulus signaled when responses would be reinforced (S+) or not reinforced (S-). In others, only an S- was present. Signals (S+/S-) facilitated and maintained responding in both types of DRL schedules. In Experiment 2, we modified the signals with five different preschoolers. Instead of an S- only, we did not present any signals. Elimination and high variability of the target response were observed with the S- only and absence of S+/S-, respectively. Signaled DRL schedules are recommended for application.

Contingency analysis of caregiver behavior: Implications for parent training and future directions

Parent training is often a required component of effective treatment for a variety of common childhood problems. Although behavior analysts have developed several effective parent-training technologies, we know little about the contingencies that affect parent behavior. Child behavior is one source of control for parent behavior that likely contributes to the development of childhood problems and outcomes of parent training. We reviewed the evidence supporting child behavior as controlling antecedents and consequences for parent behavior. The implications for parent training are discussed, and recommendations for future research are suggested.

A hypothesis about how early developmental methylmercury exposure disrupts behavior in adulthood

Events that disrupt the early development of the nervous system have lifelong, irreversible behavioral consequences. The environmental contaminant, methylmercury (MeHg), impairs neural development with effects that are manifested well into adulthood and even into aging. Noting the sensitivity of the developing brain to MeHg, the current review advances an argument that one outcome of early MeHg exposure is a distortion in the processing of reinforcing consequences that results in impaired choice, poor inhibition of prepotent responding, and perseveration on discrimination reversals (in the absence of alteration of extradimensional shifts). Neurochemical correlates include increased sensitivity to dopamine agonists and decreased sensitivity to gamma-aminobutyric acid (GABA) agonists. This leads to a hypothesis that the prefrontal cortex or dopamine neurotransmission is especially sensitive to even subtle gestational MeHg exposure and suggests that public health assessments of MeHg based on intellectual performance may underestimate the impact of MeHg in public health. Finally, those interested in modeling neural development may benefit from MeHg as an experimental model.

Resurgence in Siamese fighting fish, Betta splendens

Resurgence of previously reinforced responding was investigated in male Siamese fighting fish (Betta splendens). Swimming through a ring produced 15-s mirror presentations according to, with different fish, either a fixed-ratio 1 or a variable-interval 60-s schedule of reinforcement. When responding was stable, a differential-reinforcement-of-other-behavior schedule was substituted for the mirror-presentation schedule. Following this, mirror presentations were discontinued (extinction). During this latter phase, there were transient increases in the ring-swim response relative to the frequency of such responding during the differential-reinforcement-of-other behavior schedule. Resurgence was similar for the fish exposed previously to the fixed-ratio or to the variable-interval schedule. These results extend to Siamese fighting fish a well-established behavioral phenomenon previously not observed in this species or with this response topography, and only rarely reported following the removal of a non-consumable reinforcer.

The role of increased exposure to transfer-of-stimulus-control procedures on the acquisition of intraverbal behavior

Studies that have compared the effectiveness of differing prompt types to teach intraverbal responses have yielded mixed results, suggesting that individuals' reinforcement histories with prompt types may influence which prompt will be most effective. The purpose of this study was to test whether programmed increases in exposure to specific prompt types would produce concomitant increases in the acquisition rate of intraverbal responding. We compared acquisition rates among 4 typically developing preschool-aged children when taught via either echoic or tact prompts following exposure training with 1 prompt type. For all participants, the prompt method most recently used to teach intraverbal responses required fewer trials to teach new intraverbal responses compared to a prompt method that had not been used recently. The results are discussed in terms of the effects of reinforcement history on the acquisition of verbal behavior.

Response inhibition is impaired by developmental methylmercury exposure: acquisition of low-rate lever-pressing

Developmental methylmercury (MeHg) exposure produces response perseveration on discrimination reversal procedures, disrupts sensitivity to reinforcement, and enhances sensitivity to dopamine agonists - a profile suggesting a deficit in behavioral inhibition. To examine inhibition, we examined MeHg's effects on the acquisition and persistence of low-rate lever-pressing following a history of high-rate responding. Additionally, we examined whether chronic exposure to selenium protects against MeHg's developmental neurotoxicity. Female rats were exposed in utero via maternal exposure to drinking water containing 0ppm, 0.5ppm or 5ppm of Hg as MeHg, producing approximately 0μg/kg/day, 40μg/kg/day, or 400μg/kg/day of Hg. The mothers (during gestation) and the offspring (throughout life) consumed a purified diet containing 0.06ppm or 0.6ppm of Se (as sodium selenite), forming a 2 (lifespan diet)×3 (developmental MeHg) factorial design. Adult offspring lever-pressed under two schedules of reinforcement. A differential reinforcement of high-rate (DRH) schedule imposed rigid response requirements that remained constant through the study. A high-rate percentile schedule (PCNT-H) incorporated a flexible criterion that reinforced short interresponse times using an adjusting criterion that was sensitive to recent performance. After high-rate responding stabilized, the PCNT-H schedule was abruptly inverted by reinforcing long interresponse times. Acquisition of low-rate responding was impaired in the MeHg-exposed rats because of intrusions of high-rate response bursts. DRH response rates did not change. Dietary selenium did not influence MeHg's effects. High-rate operant behavior perseverated, suggesting that gestational MeHg exposure impairs response inhibition - an effect that extends results previously reported using choice procedures or spatial and visual discrimination reversals.

Some determinants of remote behavioral history effects in humans

Undergraduates were exposed to a series of reinforcement schedules: first, to a fixed-ratio (FR) schedule in the presence of one stimulus and to a differential-reinforcement-of-low-rate (DRL) schedule in the presence of another (multiple FR DRL training), then to a fixed-interval (FI) schedule in the presence of a third stimulus (FI baseline), next to the FI schedule under the stimuli previously correlated with the FR and DRL schedules (multiple FI FI testing), and, finally, to a single session of the multiple FR DRL schedule again (multiple FR DRL testing). Response rates during the multiple FI FI schedule were higher under the former FR stimulus than under the former DRL stimulus. This effect of remote histories was prolonged when either the number of FI-baseline sessions was small or zero, or the time interval between the multiple FR DRL training and the multiple FI FI testing was short. Response rates under these two stimuli converged with continued exposure to the multiple FI FI schedule in most cases, but quickly differentiated when the schedule returned to the multiple FR DRL.

Efeitos do reforçador empregado em história de reforço recente e remota

Doze universitários, distribuídos em quatro grupos, clicaram com o mouse sobre um botão na tela de um computador. Os participantes dos Grupos 1 e 3 foram expostos à seqüência FR - DRL - FI e os dos Grupos 2 e 4 à seqüência DRL - FR - FI. Os reforçadores foram pontos trocados por dinheiro (Grupos 1 e 2) ou pontos apenas (Grupos 3 e 4). Efeitos de histórias recentes em FI foram preponderantes quando pontos foram trocados por dinheiro. História, recente ou remota, de DRL afetou o comportamento subseqüente principalmente quando o reforçador consistia de pontos apenas. Sugere-se que o reforçador empregado modula efeitos de história em FI e que sua manipulação pode esclarecer discrepâncias entre humanos e não-humanos sob programas de reforço.

Recent reinforcement-schedule research and applied behavior analysis

Reinforcement schedules are considered in relation to applied behavior analysis by examining several recent laboratory experiments with humans and other animals. The experiments are drawn from three areas of contemporary schedule research: behavioral history effects on schedule performance, the role of instructions in schedule performance of humans, and dynamic schedules of reinforcement. All of the experiments are discussed in relation to the role of behavioral history in current schedule performance. The paper concludes by extracting from the experiments some more general issues concerning reinforcement schedules in applied research and practice.

Applied implications of reinforcement history effects

Although the influence of reinforcement history is a theoretical focus of behavior analysis, the specific behavioral effects of reinforcement history have received relatively little attention in applied research and practice. We examined the potential effects of reinforcement history by reviewing nonhuman, human operant, and applied research and interpreted the findings in relation to possible applied significance. The focus is on reinforcement history effects in the context of reinforcement schedules commonly used either to strengthen behavior (e.g., interval schedules) or commonly used to decrease behavior (e.g., extinction).

Tipo de reforçador como variável moduladora dos efeitos da história em humanos

Para investigar como o tipo de reforçador afeta o comportamento em FI após diferentes histórias de reforço, universitários foram expostos a FR ou DRL, que liberavam pontos por pressionar um botão. Alguns participantes trocavam pontos por fotocópias (Condição 1), por dinheiro (Condição 2) ou apenas recebiam os pontos (Condição 3). Subseqüentemente, todos foram expostos a FI. O FR produziu taxas de respostas altas e constantes independentemente do tipo de reforçador utilizado. O FI produziu taxas altas para os participantes das Condições 1 e 2 e baixas para os participantes da Condição 3. O DRL produziu baixas taxas que aumentaram durante o FI subseqüente. Os resultados sugerem que tanto contingências históricas quanto presentes controlaram o comportamento dos participantes e que o tipo de reforçador pode favorecer o responder em taxa alta e constante sob FI após exposição a uma contingência de FR.

An analysis of reinforcement history effects

Four pigeons were exposed to two tandem variable-interval differential-reinforcement-of-low-rate schedules under different stimulus conditions. The values of the tandem schedules were adjusted so that reinforcement rates in one stimulus condition were higher than those in the other, even though response rates in the two conditions were nearly identical. Following this, a fixed-interval schedule of either shorter or longer values than, or equal to the baseline schedule, was introduced in the two stimulus conditions respectively. Response rates during those fixed-interval schedules typically were higher in the presence of the stimuli previously correlated with the lower reinforcement rates than were those in the presence of the stimuli previously correlated with the higher reinforcement rates. Such effects of the reinforcement history were most prominent when the value of the fixed-interval schedule was shorter. The results are consistent with both incentive contrast and response strength conceptualizations of related effects. They also suggest methods for disentangling the effects of reinforcement rate on subsequent responding, from the response rate with which it is confounded in many conventional schedules of reinforcement.

Effects of reinforcement history on response rate and response pattern in periodic reinforcement

Several researchers have suggested that conditioning history may have long-term effects on fixed-interval performances of rats. To test this idea and to identify possible factors involved in temporal control development, groups of rats initially were exposed to different reinforcement schedules: continuous, fixed-time, and random-interval. Afterwards, half of the rats in each group were studied on a fixed-interval 30-s schedule of reinforcement and the other half on a fixed-interval 90-s schedule of reinforcement. No evidence of long-term effects attributable to conditioning history on either response output or response patterning was found; history effects were transitory. Different tendencies in trajectory across sessions were observed for measures of early and late responding within the interreinforcer interval, suggesting that temporal control is the result of two separate processes: one involved in response output and the other in time allocation of responding and not responding.

Stimulus generalization of behavioral history

Undergraduates responded under a variable-ratio 30 schedule in the presence of a 25-mm long line and on a differential-reinforcement-of-low-rate 6-s schedule when a 13-mm long line was present. Following this, a line-length continuum generalization test was administered under a fixed-interval 6-s schedule (Experiment 1) or extinction (Experiment 2). In both experiments, obtained generalization gradients conformed to typical postdiscrimination gradients. Responses were frequent under stimuli physically similar to the 25-mm line and infrequent under stimuli physically similar to the 13-mm line. The generalization gradients were generally asymmetric with peak response rates occurring at line lengths greater than 25 mm.

Effects of differences in interreinforcer intervals between past and current schedules on fixed-interval responding

Undergraduates were exposed to a mixed fixed-ratio differential-reinforcement-of-low-rate schedule. Values of the schedule components were adjusted so that interreinforcer intervals in one component were longer than those in another component. Following this, a mixed fixed-interval 5-s fixed-interval 20-s schedule (Experiment 1) or six fixed-interval schedules in which the values ranged from 5 to 40 s (Experiment 2) were in effect. In both experiments, response rates under the fixed-interval schedules were higher when the interreinforcer intervals approximated those produced under the fixed-ratio schedule, whereas the rates were lower when the interreinforcer intervals approximated those produced under the different-reinforcement-of-low-rate schedule. The present results demonstrate that the effects of behavioral history were under control of the interreinforcer intervals as discriminative stimuli.

The long-term effect of high- and low-rate responding histories on fixed-interval responding in rats

Tell rats were given extended lever-press training on a fixed-interval (FI) 30-s food reinforcement schedule from the outset or following exposure to one or two previous reinforcement schedules. For 4 rats the previots schedule was either fixed-ratio 20, which generated high response rates, or differential-reinforcement-of-low-rate 20 s, which produced low response rates. For 4 additional rats the extended training on FI 30 s was preceded by experience with two schedules: fixed-ratio 20 followed by differential-reinforcement-of-low-rate 20 s; or the same two schedules in the reverse order. Fixed-interval response rates were initially affected by the immediately preceding schedule, but after 80 to 100 sessions, all traces of prior schedule history had disappeared. The results also showed no long-term effect of schedule history on the interfood-interval patterns of responding on the FI 30-s schedule. These results support one of the most central tenets of the experimental analysis of behavior: control by the immediate consequences of behavior.

The representative animal

The anthropocentric approach to the study of animal behavior uses representative nonhuman animals to understand human behavior. This approach raises problems concerning the comparison of the behavior of two different species. The datum of behavior analysis is the behavior of humans and representative animal phenotypes. The behavioral phenotype is the product of the ontogeny and phylogeny of each species, and this requires that contributions of genotype as well as behavioral history to experimental performance be considered. Behavior analysis tends to favor the ontogenetic over the phylogenetic component, yet both components are responsible for the performance of each individual animal. This paper raises questions about the role of genotype variables in the use of representative animals to understand human behavior. Examples indicating the role of genotype in human behavior are also discussed. The final section of the paper deals with considerations of genotype in the design of animal experiments.

Effects of reinforcement history on responding under progressive-ratio schedules of reinforcement

The effects of experimental history on responding under a progressive-ratio schedule of reinforcement were examined. Sixteen pigeons were divided into four equal groups. Groups 1 to 3 were trained to peck a key for food under a fixed-ratio, variable-ratio, or differential-reinforcement-of-low-rate schedule of reinforcement. After training, these pigeons were shifted to a progressive-ratio schedule, later were shifted back to their original schedule (with decreased rates of reinforcement), and finally were returned to the progressive-ratio schedule. Pigeons in Group 4 (control) were maintained on the progressive-ratio schedule for the entire experiment. To test for potential "latent history" effects, pigeons responding under the progressive-ratio schedule were injected with d-amphetamine and given behavioral-momentum tests of prefeeding and extinction. Experimental histories affected responding in the immediate transition to the progressive-ratio schedule; response rates of pigeons with variable-ratio and fixed-ratio histories were higher than rates of pigeons with differential-reinforcement-of-low-rate and progressive-ratio-only histories. Pigeons with differential-reinforcement-of-low-rate histories, and to a lesser degree pigeons with variable-ratio and fixed-ratio histories, also had shorter postreinforcement pauses than pigeons with only a progressive-ratio history. No consistent long-term effects of prior contingencies on responding under the progressive-ratio schedule were evident. d-Amphetamine and resistance-to-change tests failed to reveal consistent latent history effects. The data suggest that history effects are sometimes transitory and not susceptible to latent influences.