Reinforcement of least-frequent sequences of choices

When a pigeon's choices between two keys are probabilistically reinforced, as in discrete trial probability learning procedures and in concurrent variable-interval schedules, the bird tends to maximize, or to choose the alternative with the higher probability of reinforcement. In concurrent variable-interval schedules, steady-state matching, which is an approximate equality between the relative frequency of a response and the relative frequency of reinforcement of that response, has previously been obtained only as a consequence of maximizing. In the present experiment, maximizing was impossible. A choice of one of two keys was reinforced only if it formed, together with the three preceding choices, the sequence of four successive choices that had occurred least often. This sequence was determined by a Bernoulli-trials process with parameter p. Each of three pigeons matched when p was (1/2) or (1/4). Therefore, steady-state matching by individual birds is not always a consequence of maximizing. Choice probability varied between successive reinforcements, and sequential statistics revealed dependencies which were adequately described by a Bernoulli-trials process with p depending on the time since the preceding reinforcement.

Recognition by the pigeon of stimuli varying in two dimensions

Pigeons served in four experiments, each of which involved about 44,000 discrete 1.2-sec trials under steady-state conditions. The first experiment scaled a short segment of the visual wavelength continuum; this dimension was then combined in a conditional discrimination with each of three others; time after reinforcement, tone frequency, and line tilt. In the two-stimulus experiments, the birds' responses were reinforced in the presence of only one stimulus combination: "582 nm" together with "2 min after reinforcement", "3990 Hz", or "vertical line". Many other stimulus combinations also appeared equally often and went without reinforcement. The wavelength stimuli conformed to an equal-interval scale, and per cent response was generally linear with wavelength, when scaled on cumulative normal coordinates. The components of the compound stimulus were found to interact in a multiplicative fashion; when one component differed greatly from its reinforcement value, changes in the other component had relatively little effect. For the "time"-"wavelength" compound, this interaction appeared to be modified by the effects of set or attention. Certain response latency data are reported, and other combination rules are discussed.

Generalization gradient shape and summation in steady-state tests

Pigeons' pecks at one or two wavelengths were reinforced intermittently. Random series of adjacent wavelengths appeared without reinforcement. Gradients of responding around the reinforced wavelengths were allowed to stabilize over a number of sessions. The single (one reinforced stimulus) and summation (two reinforced stimuli) gradients were consistent with a statistical decision account of the generalization process.

LINC: biology's revolutionary little computer

The 1963 LINC (Laboratory INstrument Computer) stands at the center of two stories: the computerization of the biologist's laboratory and the advent of small-scale computing. The brainchild of Wesley Clark, 'the most brilliant computer designer of his generation', LINC was developed specifically to address the failure of biologists to adopt computer technology. To meet their unique needs, Clark built a machine the radical design of which defied and subverted the then dominant conventions of computer architecture.

Computer based instruments for laboratory environments

The personal computer is viewed as an all-purpose laboratory instrument and work station. Popular architectures are examined with regard to advantages and limitations, and applications discussed in terms of "stand alone" environments, situations requiring passive interfaces, and those employing intelligent configurations. A new hardware/software architecture is presented which is highly modular, and which supports rapid instrumental reconfiguration, high throughput (information capacity), and ease of use.

The pigeon's distant visual acuity as a function of viewing angle

Distant visual acuity was determined for several viewing angles in two restrained White Carneaux pigeons. The behavioral technique was a classical conditioning procedure that paired presentation of sinusoidal gratings with shock. A conditioned heart rate acceleration during the grating presentation indicated resolution of the grating. The bird's acuity was fairly uniform across a large range of their lateral visual field; performance decreased slightly for posterior stimulus placement and sharply for frontal placements. The data suggest that foveal viewing is relatively less advantageous for acuity in pigeons than in humans. The data are also consistent with the current view that pigeons are myopic in frontal vision.

The pigeon's perception of saturation

Three experiments used similar methods to investigate the pigeon's perception of saturation of monochromatic lights. This trial-wise procedure consisted of brief presentations of positive and negative stimuli in random sequence. Pecks to the positive stimuli were occasionally reinforced on a low fixed-ratio schedule. The first study determined absolute thresholds for "white" and monochromatic lights by establishing a discrimination between lights of various radiances and a dark key. Experiment II investigated generalization from a white light to various monochromatic lights under conditions that minimized the use of luminance as a cue. The third experiment examined discrimination of various monochromatic lights along a colorimetric purity continuum; responses to white light were reinforced, while responses to lights that combined white and monochromatic lights in various proportions were not. The results indicated that lights of different wavelength differ in saturation, but that all are discriminable from white. Wavelengths between 550 and 600 nm are least saturated for the pigeon, and saturation increases markedly as wavelength decreases below this region of the spectrum.

Visual acuity in the pigeon. II. Effects of target distance and retinal lesions

Visual acuity thresholds for grating targets were determined for three pigeons at target distances ranging from 13 to 73 cm. These measurements were made both while the birds were wearing goggles restricting vision to the frontal field of view and when vision was unrestricted. Using a slightly different method, performance was also compared for target distances of 6 and 13 cm while the goggles were in place. For a second group of three pigeons, acuity data were obtained before and after laser lesions of the retina's foveal region. The findings suggested that acuity was relatively poor for targets at the intermediate distances and that it improved as distance both increased and decreased from these intermediate values. The acuity improvement with increasing distance did not occur, however, when the birds were wearing frontal goggles. The data appear to be consistent with Catania's 1964 suggestion that the pigeon has separate frontal and lateral visual systems that differ in their refractive characteristics. Foveal lesions did not appear to affect acuity for distant targets, and it was concluded that, while the fovea serves the lateral field of view, its presence is not necessary to the static acuity characteristics of this system.

The visual acuity of the pigeon for distant targets

The acuity of six pigeons was measured in an apparatus that required the birds to make visual discriminations at a distance of 28.75 in. (73 cm) from the stimulus targets. The stimuli were black and white gratings of varying stripe width. A forced choice procedure was used, and both the Method of Constant Stimuli and a descending series technique determined the order of stimulus presentation. Thresholds, obtained by interpolating at the 25% error point on the psychometric functions, ranged from 1.16 to 4.0 min of arc. Thresholds measured in the same apparatus for two human observers were 0.79 and 0.82 min of arc. The descending series design produced lower per cent error rates at the widest stripe value, but otherwise there appeared to be no difference between psychophysical methods. Position preferences occurred in most of the birds; differential per cent error functions and differential latency functions to the two keys illustrate these. Retinal histology revealed shallow, centrally located foveae in the three pigeon breeds used.

The distribution of interresponse times in the pigeon during variable-interval reinforcement

Three pigeons' pecks were reinforced on 1- and 2-min variable-interval schedules, and frequency distributions of their interresponse times (IRTs) were recorded. The conditional probability that a response would fall into any IRT category was estimated by the interresponse-times-per-opportunity transformation (IRTs/op). The resulting functions were notable chiefly for the relatively low probability of IRTs in the 0.2- to 0.3-sec range; in other respects they varied within and between subjects. The overall level of the curves generally rose over the course of 32 experimental hours, but their shapes changed unsystematically. The shape of the IRT distribution was much the same for VI 1-min and VI 2-min. The variability of these distributions supports the notion that the VI schedule only loosely controls response rate, permitting wide latitude to adventitious effects. There was no systematic evidence that curves changed over sessions to conform to the distribution of reinforcements by IRT.

The reinforcement of least-frequent interresponse times

A new schedule of reinforcement was used to maintain key-pecking by pigeons. The schedule reinforced only pecks terminating interresponse times which occurred least often relative to the exponential distribution of interresponse times to be expected from an ideal random generator. Two schedule parameters were varied: (1) the rate constant of the controlling exponential distribution and (2) the probability that a response would be reinforced, given that it met the interresponse-time contingency. Response rate changed quickly and markedly with changes in the rate constant; it changed only slightly with a fourfold change in the reinforcement probability. The schedule produced stable rates and high intra- and inter-subject reliability, yet interresponse time distributions were approximately exponential. Such local interresponse time variability in the context of good overall control suggests that the schedule may be used to generate stable, predictable, yet sensitive baseline rates. Implications for the measurement of rate are discussed.

Probabilistically reinforced choice behavior in pigeons

A single principle, "momentary maximizing", may account for much of a pigeon's steady-state behavior in both probability learning and concurrent variable interval experiments. The principle states that a pigeon tends to choose the alternative that momentarily has the higher probability of reinforcement. A successive discrimination procedure, which produced matching in an earlier experiment, produced here a tendency to maximize if training were adequately extended. Maximizing was produced also by other procedures, in which no reinforcing event was presented on some trials: one procedure did and two did not provide a bird with information about the availability of reinforcement on a key after an unreinforced response on the other key. The latter two procedures were analogous to concurrent variable interval schedules in two respects: the reinforcement probability on one key increased while a bird responded on the other key; and they produced matching. But sequential statistics suggested that matching resulted from momentary maximizing. Depending on the procedure, the tendency to maximize produced different relative frequencies of pecking a key for a fixed relative frequency of reinforcement. Computer simulation of maximizing behavior in several concurrent variable interval schedules produced matching and sequential statistics similar to those produced by a real bird.