Mediated conditioning versus retrospective revaluation in humans: the influence of physical and functional similarity of cues

Revaluation of overselected stimuli: Emergence of control by underselected stimuli depends on degree of overselectivity

Stimulus overselectivity describes strong control by one stimulus element at the expense of other equally relevant elements. Research suggests that control by underselected stimuli emerges following extinction of the overselected stimulus ("revaluation") and the emergence is larger when overselectivity is greater. We compared such revaluation effects with a control compound or condition in two experiments. Human participants chose between compound S+ and S- stimuli. Then, to assess control by compound-stimulus elements, participants chose between individual elements in a testing phase without feedback. The S+ element chosen most often (the overselected element) underwent revaluation, during which choice of that element was extinguished and choice of a novel element reinforced. Thereafter, participants completed a retesting phase. Revaluation reduced choice of the overselected element. Choice of the underselected element decreased for participants with low overselectivity but increased for participants with high overselectivity. This was not the case for a control compound that did not undergo revaluation (Experiments 1 and 2) or in a control condition in which the overselected element continued to be reinforced during revaluation (Experiment 2). These findings suggest that overselectivity levels may modulate revaluation effects, and they also highlight the importance of the contingency change in postrevaluation changes in stimulus control.

Elemental and configural threat learning bias extinction generalization

Emotional experiences often contain a multitude of details that may be represented in memory as individual elements or integrated into a single representation. How details associated with a negative emotional event are represented in memory can have important implications for extinction strategies designed to reduce emotional responses. For example, is extinguishing one cue associated with an aversive outcome sufficient to reduce learned behavior to other cues present at the time of learning that were not directly extinguished? Here, we used a between-subjects multi-day threat conditioning and extinction task to assess whether participants generalize extinction from one cue to unextinguished cues. On Day 1, one group of participants learned that a compound conditioned stimulus, composed of a tone and colored square, predicted an uncomfortable shock to the wrist (Compound group). A second group learned that the tone and square separately predicted shock (Separate group). On Day 2, participants in both groups were exposed to the tone in the absence of shocks (cue extinction). On Day 3, we tested whether extinction generalized from the extinguished to the unextinguished cue, as well as to a compound composed of both cues. Results showed that configural and elemental learning had unique and opposite effects on extinction generalization. Subjects who initially learned that a compound cue predicted shock successfully generalized extinction learning from the tone to the square, but exhibited threat relapse to the compound cue. In contrast, subjects who initially learned that each cue individually predicted shock did not generalize extinction learning from the tone to the square, but threat responses to the compound were low. These results highlight the importance of whether details of an aversive event are represented as integrated or separated memories, as these representations affect the success or limits of extinction generalization.

Sleep deprivation increases threat beliefs in human fear conditioning

Sleep disturbances and anxiety disorders exhibit high comorbidity levels, but it remains unclear whether sleep problems are causes or consequences of increased anxiety. To experimentally probe the aetiological role of sleep disturbances in anxiety, we investigated in healthy participants how total sleep deprivation influences fear expression in a conditioning paradigm. In a fear conditioning procedure, one face stimulus (conditioned stimulus [CS+]) was paired with electric shock, whereas another face stimulus was not (unpaired stimulus [CS-]). Fear expression was tested the next morning using the two face stimuli from the training phase and a generalization stimulus (i.e. a morph between the CS+ and CS- stimuli). Between fear conditioning and test, participants were either kept awake in the laboratory for 12 hr (n = 20) or had a night of sleep at home (n = 20). Irrespective of stimulus type, subjective threat expectancies, but not skin conductance responses, were enhanced after sleep deprivation, relative to regular sleep. These results suggest that sleep disturbances may play a role in anxiety disorders by increasing perceived threat.

Retrospective revaluation of associative retroactive cue interference

Two fear-conditioning experiments with rats assessed whether retrospective revaluation, which has been observed in cue competition (i.e., when compounded cues are followed with an outcome), can also be observed in retroactive cue interference (i.e., when different cues are reinforced in separate phases with the same outcome). Experiment 1 found that after inducing retroactive cue interference (i.e., X-outcome followed by A-outcome), nonreinforced presentations of the interfering cue (A) decreases interference with responding to the target cue (X), just as has been observed in retrospective revaluation experiments in cue competition. Using the opposite manipulation (i.e., adding reinforced presentations of A), Experiment 2 demonstrated that after inducing retroactive cue interference, additional reinforced presentations of the interfering cue (A) increases interference with responding to the target cue (X); alternatively stated, the amount of interference increases with the amount of training with the interfering cue. Thus, both types of retrospective revaluation occur in retroactive cue competition. The results are discussed in terms of the possibility that similar associative mechanisms underlie cue competition and cue interference.

Learning history and cholinergic modulation in the dorsal hippocampus are necessary for rats to infer the status of a hidden event

Identifying statistical patterns between environmental stimuli enables organisms to respond adaptively when cues are later observed. However, stimuli are often obscured from detection, necessitating behavior under conditions of ambiguity. Considerable evidence indicates decisions under ambiguity rely on inference processes that draw on past experiences to generate predictions under novel conditions. Despite the high demand for this process and the observation that it deteriorates disproportionately with age, the underlying mechanisms remain unknown. We developed a rodent model of decision-making during ambiguity to examine features of experience that contribute to inference. Rats learned either a simple (positive patterning) or complex (negative patterning) instrumental discrimination between the illumination of one or two lights. During test, only one light was lit while the other relevant light was blocked from physical detection (covered by an opaque shield, rendering its status ambiguous). We found experience with the complex negative patterning discrimination was necessary for rats to behave sensitively to the ambiguous test situation. These rats behaved as if they inferred the presence of the hidden light, responding differently than when the light was explicitly absent (uncovered and unlit). Differential expression profiles of the immediate early gene cFos indicated hippocampal involvement in the inference process while localized microinfusions of the muscarinic antagonist, scopolamine, into the dorsal hippocampus caused rats to behave as if only one light was present. That is, blocking cholinergic modulation prevented the rat from inferring the presence of the hidden light. Collectively, these results suggest cholinergic modulation mediates recruitment of hippocampal processes related to past experiences and transfer of these processes to make decisions during ambiguous situations. Our results correspond with correlations observed between human brain function and inference abilities, suggesting our experiments may inform interventions to alleviate or prevent cognitive dysfunction. © 2015 Wiley Periodicals, Inc.

Imagine that! Cue-evoked representations guide rat behavior during ambiguous situations

Mental imagery involves the perceptual-like experience of an event that is not physically present, or detected by the senses. Fast and Blaisdell (2011) reported that rats use the representation of an associatively retrieved event to guide behavior in ambiguous situations. Rats were reinforced for lever-pressing during 1 of 2 lights but not both lights. They were then tested with 1 light illuminated while the second light was either covered by an opaque shield (ambiguous) or uncovered and unlit (explicitly absent). Rats lever-pressed less when the second light was covered compared with unlit, suggesting that a representation of the ambiguously absent light guided their behavior. However, Dwyer and Burgess (2011) offered an alternative mechanism in which the explicit absence of a cue gains associative value during training. Covering the light at test could effectively remove these associative properties, resulting in a generalization decrement of behavior. The current experiments were designed to test contrasting predictions made by these 2 accounts. Experiment 1 empirically established that generalization decrement can occur when an element of a compound cue is presented alone at test, but this decrement is attenuated, rather than enhanced, when the absent element is covered. Experiment 2 utilized a conditioned inhibition procedure to demonstrate that rat behavior during cue ambiguity is driven by an associatively retrieved representation rather than by generalization decrement. Collectively, the results argue against a purely nonrepresentational associative account of behavior and support a role for associatively retrieved representations in rats.

Retrospective revaluation: The phenomenon and its theoretical implications

Retrospective revaluation refers to an increase (or decrease) in responding to conditioned stimulus (CS X) as a result of decreasing (or increasing) the associative strength of another CS (A) with respect to the unconditioned stimulus (i.e., A-US) that was previously trained in compound with the target CS (e.g., AX-US or just AX). We discuss the conditions under which retrospective revaluation phenomena are most apt to be observed and their implications for various models of learning that are able to account for retrospective revaluation (e.g., Dickinson and Burke, 1996; Miller and Matzel, 1988; Van Hamme and Wasserman, 1994). Although retroactive revaluation is relatively parameter specific, it is seen to be a reliable phenomenon observed across many tasks and species. As it is not anticipated by many conventional models of learning (e.g., Rescorla and Wagner, 1972), it serves as a critical benchmark for evaluating traditional and newer models.

Odourant dominance in olfactory mixture processing: what makes a strong odourant?

The question of how animals process stimulus mixtures remains controversial as opposing views propose that mixtures are processed analytically, as the sum of their elements, or holistically, as unique entities different from their elements. Overshadowing is a widespread phenomenon that can help decide between these alternatives. In overshadowing, an individual trained with a binary mixture learns one element better at the expense of the other. Although element salience (learning success) has been suggested as a main explanation for overshadowing, the mechanisms underlying this phenomenon remain unclear. We studied olfactory overshadowing in honeybees to uncover the mechanisms underlying olfactory-mixture processing. We provide, to our knowledge, the most comprehensive dataset on overshadowing to date based on 90 experimental groups involving more than 2700 bees trained either with six odourants or with their resulting 15 binary mixtures. We found that bees process olfactory mixtures analytically and that salience alone cannot predict overshadowing. After normalizing learning success, we found that an unexpected feature, the generalization profile of an odourant, was determinant for overshadowing. Odourants that induced less generalization enhanced their distinctiveness and became dominant in the mixture. Our study thus uncovers features that determine odourant dominance within olfactory mixtures and allows the referring of this phenomenon to differences in neural activity both at the receptor and the central level in the insect nervous system.

Second-order conditioning and conditioned inhibition: influences of speed versus accuracy on human causal learning

In human causal learning, excitatory and inhibitory learning effects can sometimes be found in the same paradigm by altering the learning conditions. This study aims to explore whether learning in the feature negative paradigm can be dissociated by emphasising speed over accuracy. In two causal learning experiments, participants were given a feature negative discrimination in which the outcome caused by one cue was prevented by the addition of another. Participants completed training trials either in a self-paced fashion with instructions emphasising accuracy, or under strict time constraints with instructions emphasising speed. Using summation tests in which the preventative cue was paired with another causal cue, participants in the accuracy groups correctly rated the preventative cue as if it reduced the probability of the outcome. However, participants in the speed groups rated the preventative cue as if it increased the probability of the outcome. In Experiment 1, both speed and accuracy groups later judged the same cue to be preventative in a reasoned inference task. Experiment 2 failed to find evidence of similar dissociations in retrospective revaluation (release from overshadowing vs. mediated extinction) or learning about a redundant cue (blocking vs. augmentation). However in the same experiment, the tendency for the accuracy group to show conditioned inhibition and the speed group to show second-order conditioning was consistent even across sub-sets of the speed and accuracy groups with equivalent accuracy in training, suggesting that second-order conditioning is not merely a consequence of poorer acquisition. This dissociation mirrors the trade-off between second-order conditioning and conditioned inhibition observed in animal conditioning when training is extended.

Positive and negative mediation as a function of whether the absent cue was previously associated with the outcome

After presenting two cues, A and B, together, later pairings of one of the cues alone with an outcome can generate changes in the associative value of the absent cue. These changes can be in the same direction as the present cue (i.e., positive mediation) or in the opposite direction to the present cue (i.e., negative mediation). We found both mediational effects in a human contingency task. In addition, we found that the direction of the change was determined by the existence of a prior association between the absent cue and the outcome. When a prior association exists, the absent cue tends to change its value in the opposite direction to the present cue, whereas when there is no prior association, the absent cue tends to change its value in the same direction as the present cue. Recent associative models (Stout & Miller, 2007) can explain our results.

Overshadowing and CS duration: counteraction and a reexamination of the role of within-compound associations in cue competition

In the present experiments, we examined the role of within-compound associations in the interaction of the overshadowing procedure with conditioned stimulus (CS) duration, using a conditioned suppression procedure with rats. In Experiment 1, we found that, with elemental reinforced training, conditioned suppression to the target stimulus decreased as CS duration increased (i.e., the CS duration effect), whereas, with compound reinforced training (i.e., the overshadowing procedure), conditioned suppression to the target stimulus increased as CS duration increased. In subsequent experiments, we replicated these findings with sensory preconditioning and demonstrated that extinction of the overshadowing stimulus results in retrospective revaluation with short CSs and in mediated extinction with long CSs. These results highlight the role of the duration of the stimulus in behavioral control. Moreover, these results illuminate one cause (the CS duration) of whether retrospective revaluation or mediated extinction will be observed.