Habituation of reinforcer effectiveness

Habituation, Adaptation and Prediction Processes in Neurodevelopmental Disorders: A Comprehensive Review

Habituation, the simplest form of learning preserved across species and evolution, is characterized by a response decrease as a stimulus is repeated. This adaptive function has been shown to be altered in some psychiatric and neurodevelopmental disorders such as autism spectrum disorder (ASD), attention-deficit/hyperactivity disorder (ADHD) or schizophrenia. At the brain level, habituation is characterized by a decrease in neural activity as a stimulation is repeated, referred to as neural adaptation. This phenomenon influences the ability to make predictions and to detect change, two processes altered in some neurodevelopmental and psychiatric disorders. In this comprehensive review, the objectives are to characterize habituation, neural adaptation, and prediction throughout typical development and in neurodevelopmental disorders; and to evaluate their implication in symptomatology, specifically in sensitivity to change or need for sameness. A summary of the different approaches to investigate adaptation will be proposed, in which we report the contribution of animal studies as well as electrophysiological studies in humans to understanding of underlying neuronal mechanisms.

Behavioral profile of adult zebrafish acutely exposed to a selective dopamine uptake inhibitor, GBR 12909

BACKGROUND

The dopamine transporter (DAT) is the main regulator of dopamine concentration in the extrasynaptic space. The pharmacological inhibition of the DAT results in a wide spectrum of behavioral manifestations, which have been identified so far in a limited number of species, mostly in rodents.

AIM

Here, we used another well-recognized model organism, the zebrafish (Danio rerio), to explore the behavioral effects of GBR 12909, a highly-affine selective DAT blocker.

METHODS

We evaluated zebrafish locomotion, novelty-related exploration, spatial cognition, and social phenotypes in the novel tank, habituation and shoaling tests, following acute 20-min water immersion in GBR 12909.

RESULTS

Our findings show hypolocomotion, anxiety-like state, and impaired spatial cognition in fish acutely treated with GBR 12909. This behavioral profile generally parallels that of the DAT knockout rodents and zebrafish, and it overlaps with behavioral effects of other DAT-inhibiting drugs of abuse, such as cocaine and D-amphetamine.

CONCLUSION

Collectively, our data support the utility of zebrafish in translational studies on DAT targeting neuropharmacology and strongly implicate DAT aberration as an important mechanisms involved in neurological and psychiatric diseases.

Not All Effects Are Indispensable: Psychological Science Requires Verifiable Lines of Reasoning for Whether an Effect Matters

To help move researchers away from heuristically dismissing "small" effects as unimportant, recent articles have revisited arguments to defend why seemingly small effect sizes in psychological science matter. One argument is based on the idea that an observed effect size may increase in impact when generalized to a new context because of processes of accumulation over time or application to large populations. However, the field is now in danger of heuristically accepting all effects as potentially important. We aim to encourage researchers to think thoroughly about the various mechanisms that may both amplify and counteract the importance of an observed effect size. Researchers should draw on the multiple amplifying and counteracting mechanisms that are likely to simultaneously apply to the effect when that effect is being generalized to a new and likely more dynamic context. In this way, researchers should aim to transparently provide verifiable lines of reasoning to justify their claims about an effect's importance or unimportance. This transparency can help move psychological science toward a more rigorous assessment of when psychological findings matter for the contexts that researchers want to generalize to.

Outcome devaluation by specific satiety disrupts sensory-specific Pavlovian-to-instrumental transfer

Reward predictive cues can selectively motivate instrumental behaviors that predict the same rewarding outcomes, an effect known as specific Pavlovian-to-instrumental transfer (PIT). This selective effect is thought to be mediated by a representation of the sensory specific properties of an outcome, that has become associated with both the Pavlovian cue and the instrumental response during initial learning. Specific satiety is a common method of outcome devaluation that reduces an outcome's value but might also lead to the habituation of the outcome's sensory properties. Previous research has demonstrated that specific PIT is insensitive to changes in specific outcome value following taste aversion devaluation, as well as general satiety manipulations, and therefore specific satiety should not disrupt specific PIT by reducing outcome value. The present rodent experiments used a specific satiety devaluation procedure immediately prior to a specific PIT test to show that habituation of these outcome specific sensory representations can disrupt its efficacy as a stimulus and abolish the specific PIT effect. Experiment 1 employed a two-lever choice test to show that a non-devalued stimulus supports specific PIT, whereas a devalued stimulus abolished the specific PIT effect. Experiment 2 replicated this procedure while controlling for response competition by using a single-lever test to confirm that a devalued stimulus abolishes the specific PIT effect. These findings demonstrate that specific satiety can disrupt the ability of an outcome specific representation to support specific PIT. Given previous findings that specific PIT is insensitive to changes in outcome value by general satiety and taste aversion devaluation, this suggests that specific satiety devaluation might disrupt the use of sensory specific outcome representations to guide behavior via a mechanism that is independent of the outcome's current value.

Prenatal ethanol exposure impairs sensory processing and habituation to visual stimuli, effects normalized by enrichment of postnatal environmental

BACKGROUND

Individuals with fetal alcohol spectrum disorders (FASD) often show processing deficits in all sensory modalities. Using an operant light reinforcement model, we tested whether prenatal ethanol exposure (PE) alters operant responding to elicit a contingent sensory stimulus-light onset (turning on the light) and habituation to this behavior in rats. We also explored whether postnatal environmental enrichment could ameliorate PE-induced deficits.

METHODS

Pregnant Sprague Dawley rats were gavaged twice/day with 0 or 3 g/kg/treatment ethanol (15% w/v) during gestational days 8-20, mimicking second-trimester heavy PE in humans. The offspring were reared in a standard housing condition or an enriched condition. Adult male and female offspring underwent an operant light reinforcement experiment with either a short-access or a long-access procedure. A dishabituation test was also conducted to characterize the habituation process.

RESULTS

In the short-access procedure, PE led to increased operant responding to the contingent light onset in both sexes reared in the standard housing condition. Such an effect was not observed in rats reared in enriched conditions due to an overall decrease in responding. Moreover, rats reared in enriched conditions showed greater short-term habituation. In the long access procedure, PE rats showed increased responding and impaired long-term habituation. The long-access procedure facilitated both short-term and long-term habituation in control and PE rats.

CONCLUSION

Prenatal ethanol exposure increases responding to contingent light onset and impairs the long-term habituation process. The PE-induced deficits were ameliorated by rearing in the enriched environment and increasing the duration and frequency of exposure to light onset. The PE-induced effects are like increased sensation-seeking, a subtype of sensory-processing deficit that is often observed in individuals with FASD. Our findings could inform a suitable animal model for investigating the underlying mechanisms and possible intervention strategies for sensory deficits in FASD.

Repetitive Restricted Behaviors in Autism Spectrum Disorder: From Mechanism to Development of Therapeutics

Autism spectrum disorder (ASD) is a complex neurodevelopmental disorder characterized by deficits in social communication, social interaction, and repetitive restricted behaviors (RRBs). It is usually detected in early childhood. RRBs are behavioral patterns characterized by repetition, inflexibility, invariance, inappropriateness, and frequent lack of obvious function or specific purpose. To date, the classification of RRBs is contentious. Understanding the potential mechanisms of RRBs in children with ASD, such as neural connectivity disorders and abnormal immune functions, will contribute to finding new therapeutic targets. Although behavioral intervention remains the most effective and safe strategy for RRBs treatment, some promising drugs and new treatment options (e.g., supplementary and cell therapy) have shown positive effects on RRBs in recent studies. In this review, we summarize the latest advances of RRBs from mechanistic to therapeutic approaches and propose potential future directions in research on RRBs.

NAc-VTA circuit underlies emotional stress-induced anxiety-like behavior in the three-chamber vicarious social defeat stress mouse model

Emotional stress is considered a severe pathogenetic factor of psychiatric disorders. However, the circuit mechanisms remain largely unclear. Using a three-chamber vicarious social defeat stress (3C-VSDS) model in mice, we here show that chronic emotional stress (CES) induces anxiety-like behavior and transient social interaction changes. Dopaminergic neurons of ventral tegmental area (VTA) are required to control this behavioral deficit. VTA dopaminergic neuron hyperactivity induced by CES is involved in the anxiety-like behavior in the innate anxiogenic environment. Chemogenetic activation of VTA dopaminergic neurons directly triggers anxiety-like behavior, while chemogenetic inhibition of these neurons promotes resilience to the CES-induced anxiety-like behavior. Moreover, VTA dopaminergic neurons receiving nucleus accumbens (NAc) projections are activated in CES mice. Bidirectional modulation of the NAc-VTA circuit mimics or reverses the CES-induced anxiety-like behavior. In conclusion, we propose that a NAc-VTA circuit critically establishes and regulates the CES-induced anxiety-like behavior. This study not only characterizes a preclinical model that is representative of the nuanced aspect of CES, but also provides insight to the circuit-level neuronal processes that underlie empathy-like behavior.

Food reinforcement and habituation to food are processes related to initiation and cessation of eating

An individual bout of eating involves cues to start eating, as well as cues to terminate eating. One process that determines initiation of eating is food reinforcement. Foods with high reinforcing value are also likely to be consumed in greater quantities. Research suggests both cross-sectional and prospective relationships between food reinforcement and obesity, food reinforcement is positively related to energy intake, and energy intake mediates the relationship between food reinforcement and obesity. A process related to cessation of eating is habituation. Habituation is a general behavioral process that describes a reduction in physiological or affective response to a stimulus, or a reduction in the behavioral responding to obtain a stimulus. Repeated exposure to the same food during a meal can result in habituation to that food and a reduction in consumption. Habituation is also cross-sectionally and prospectively related to body weight, as people who habituate slower consume more in a meal and are more overweight. Research from our laboratory has shown that these two processes independently influence eating, as they can account for almost 60% of the variance in ad libitum intake. In addition, habituation phenotypes show reliable relationships with reinforcing value, such that people who habituate faster also find food less reinforcing. Developing a better understanding of cues to start and stop eating is fundamental to understanding how to modify eating behavior. An overview of research on food reinforcement, habituation and food intake for people with a range of weight status and without eating disorders is provided, and ideas about integrating these two processes that are related to initiation and termination of a bout of eating are discussed.

Moderate prenatal ethanol exposure leads to attention deficits in both male and female rats

BACKGROUND

Attention deficits caused by prenatal ethanol (EtOH) exposure (PE) are a prevalent condition in fetal alcohol spectrum disorders (FASDs). Importantly, the deficits are observed in individuals with FASD who have normal IQs and show no dysmorphic facial features caused by heavy PE. These observations suggest that even moderate PE could lead to attention deficits. This possibility was investigated in the present study using a rat model.

METHODS

Pregnant Sprague Dawley rats were administered EtOH (3 g/kg/day) or vehicle via intragastric gavage on gestational days 8 to 20. The blood EtOH concentration (BEC) in EtOH-treated rats was 87.7 ± 1.2 mg/dl (1 h after the gavage), similar to the BECs reported in other moderate PE studies in rodents. Moderate PE did not produce teratogenic effects on birthweight or litter size. The adult offspring underwent a 2-choice reaction time task.

RESULTS

Moderate PE led to augmented action impulsivity in both sexes, indicated by more rapid response initiation and more premature responses. Deficits were more marked in males than in females. No greater lapses of attention, assessed by incorrect or relatively slow responses, were observed in rats of either sex with moderate PE. In addition, no deficits in learning or motor function were detected after moderate PE. Interestingly, rats with moderate PE completed more trials than controls.

CONCLUSIONS

Our results confirm that moderate PE leads to attention deficits in both sexes, which is demonstrated by greater action impulsivity, but not more lapses of attention. This effect differs from that of heavy PE, as shown in our previous study, which is manifested as impaired action impulsivity and lapses of attention in both sexes.

Sign Tracking in an Enriched Environment: A Potential Ecologically Relevant Animal Model of Adaptive Behavior Change

When an object conditioned stimulus (CS) is paired with a food unconditioned stimulus (US), anticipatory goal-directed action directed at the US location (goal tracking) is accompanied by behavior directed at the object CS (sign tracking). Sign-tracking behavior appears to be compulsive and habit-like and predicts increased vulnerability to the addictive potential of drugs in animal models. A large body of the literature also suggests that environmental enrichment protects against the development of addiction-prone phenotypes. Thus, we investigated whether compulsive-like sign tracking develops in environmentally enriched rats trained directly in their enriched home environment. We demonstrate that adolescent enriched-housed male Sprague-Dawley rats readily sign track a 5% ethanol bottle CS in their home environment and at a rate higher than adolescent standard-housed rats. We also show that enriched adolescent rats sign track less than enriched adult-trained rats and that acute isolation stress affects sign- and goal-tracking performance of adolescents and adults differently. Sign tracking increased more in the adult than the adolescent rats. Whereas the younger rats showed a decrease in goal tacking after the final stressor manipulation, the adults showed increased goal tracking. Our results are consistent with recent studies, which suggest that although sign tracking performance is compulsive-like, it is not as inflexible and habit-like as previously assumed. Testing in an enriched home environment with object CSs having greater affordance than "neutral" lever CSs may provide greater ecological relevance for investigating the development and expression of adaptive and compulsive-like behaviors in translational research.

Sudden onsets reflexively drive spatial attention, but those that predict reward do more

The sudden appearance of an unexpected object elicits the automatic allocation of spatial attention. Even without eye movements, effortless, but transient, improvements in perception occur at the onset location. Much is known about the consequences of such exogenously elicited shifts of covert attention, but most research has used stimuli that carry very little, if any, additional information. In everyday life, attention is captured by sudden onsets that, due to past experience, alert us to more than just their appearance. An abundance of recent work has shed light on the interaction of associative learning and attention, leading to refinements in current models of attentional control; in this study, we tested two hypotheses concerning the efficacy of meaning-imbued onsets, specifically those that predict reward, to drive the reflexive allocation of covert spatial attention and to improve task performance more generally. First, spatially uninformative, abrupt-onset cues that are predictive of reward may elicit the involuntary allocation of attention more effectively than nonreward-predictive onsets; second, the presence of peripheral cues that are predictive of reward, regardless of validity, may impact global attentional processes in a spatially nonspecific manner. We paired monetary reward with one of two luminance-defined, abrupt-onset cues and measured each cue's ability to modulate performance in a visual task. Replicating research with nonmeaning-imbued stimuli, both kinds of abrupt onsets reflexively improved visual perception at attended, relative to unattended, locations. However, when features of the onset predicted the availability of monetary reward, enhancements in perception become less constrained, spreading rapidly to other task-relevant locations.

Preliminary Evaluations of Habituation of Operant Responding for Sensory Stimuli in Humans

Research suggests that repetitive reinforcers wane in their ability to maintain operant behavior in a manner consistent with habituation. Weaker reinforcers, including sensory stimuli common in human work, may be most impacted by repetition. The present research examined within-session operant responding patterns for visual stimuli in humans from two experiments assessing multiple characteristics of habituation. In Experiment 1, declines in reinforced responding were assessed and stimulus specificity was evaluated to test habituation's contribution to these declines. Seventy-three participants completed two visits, both including a reinforcement paradigm using pictures. With repetition, operant responding declined. The stimulus specificity manipulation did not enhance responding, suggesting that habituation did not contribute to response declines. Several methodological concerns may have contributed to the absence of a stimulus specificity effect. Experiment 2 assessed a separate habituation characteristic, rate of stimulation, to address these methodological concerns and further evaluate habituation. Twenty-eight participants completed the reinforcement paradigm over three visits. Decline in responding was partially supported, but the rate of stimulation did not alter declines. In sum, habituation's contribution to within-session declines for sensory reinforcers was not evident in either experiment. These results suggest that assessment of habituation of sensory reinforcers in humans may require parametric evaluation.

Stimulus Complexity and Mouse Strain Drive Escalation of Operant Sensation Seeking Within and Across Sessions in C57BL/6J and DBA/2J Mice

Sensation seeking is a heritable trait that is genetically correlated with substance use; the shared genetic mechanisms underlying these traits are largely unknown. The relationship of sensation seeking and substance use has practical importance because discovering genes that drive sensation seeking can reveal genes driving substance use, and quantification of sensation seeking in mice is higher throughput and less technically challenging than quantification of volitional drug use. In order to fully understand the genetic mechanisms driving sensation seeking, it is critical to first understand the nongenetic factors driving sensation seeking. In the present study, we used the operant sensation seeking paradigm to assess the effects of stimulus complexity on sensation seeking in C57BL/6J and DBA/2J mice. These strains are the founders of the BXD recombinant inbred mouse panel which enables the discovery of genes driving phenotypic variation. This study led to four principal conclusions. First, all sensory stimuli used in the study, regardless of complexity or number of stimulus modalities, served as reinforcers for C57BL/6J and DBA/2J mice. Second, for both C57BL/6J and DBA/2J mice, sensation seeking for a high complexity sensory stimulus was significantly greater than sensation seeking for a low complexity sensory stimulus. Third, for both C57BL/6J and DBA/2J mice, sensation seeking escalated significantly within-session when a multimodal sensory stimulus of medium or high complexity was used but not when a unimodal sensory stimulus of low complexity was used. Finally, both the magnitude of sensation seeking and the magnitude of within-session escalation of sensation seeking were significantly greater in mice from the DBA/2J strain relative to mice from the C57BL/6J strain. Collectively, these findings indicate that stimulus complexity and genetic background drive escalation of operant sensation seeking within and across sessions, and that the BXD recombinant inbred mouse panel can be used to discover the genetic mechanisms underlying these phenomena.

Psychopathic traits are associated with reduced fixations to the eye region of fearful faces

Impairments in processing fearful faces have been documented in both children and adults with psychopathic traits, suggesting a potential mechanism by which psychopathic individuals develop callous and manipulative interpersonal and affective traits. Recently, research has demonstrated that psychopathic traits are associated with reduced fixations to the eye regions of faces in samples of children and community-dwelling adults, however this relationship has not yet been established in an offender sample with high levels of psychopathy. In the current study, we employed eye-tracking with paradigms involving the identification and passive viewing of facial expressions of emotion, respectively, in a sample of adult male criminal offenders (n = 108) to elucidate the relationship between visual processing of fearful facial expressions and interpersonal and affective psychopathic traits. We found that the interpersonal-affective traits of psychopathy were significantly related to fewer fixations to the eyes of fear faces during the emotion recognition task. This association was driven particularly by the interpersonal psychopathic traits (e.g., egocentricity, deceitfulness), whereas fear recognition accuracy was inversely related to the affective psychopathic traits (e.g., callousness, lack of empathy). These findings highlight potential mechanisms for the subset of the interpersonal-affective traits exhibited by psychopathic individuals. (PsycINFO Database Record

Systems genetics of sensation seeking

Sensation seeking is a multifaceted, heritable trait which predicts the development of substance use and abuse in humans; similar phenomena have been observed in rodents. Genetic correlations among sensation seeking and substance use indicate shared biological mechanisms, but the genes and networks underlying these relationships remain elusive. Here, we used a systems genetics approach in the BXD recombinant inbred mouse panel to identify shared genetic mechanisms underlying substance use and preference for sensory stimuli, an intermediate phenotype of sensation seeking. Using the operant sensation seeking (OSS) paradigm, we quantified preference for sensory stimuli in 120 male and 127 female mice from 62 BXD strains and the C57BL/6J and DBA/2J founder strains. We used relative preference for the active and inactive levers to dissociate preference for sensory stimuli from locomotion and exploration phenotypes. We identified genomic regions on chromosome 4 (155.236‐155.742 Mb) and chromosome 13 (72.969‐89.423 Mb) associated with distinct behavioral components of OSS. Using publicly available behavioral data and mRNA expression data from brain regions involved in reward processing, we identified (a) genes within these behavioral QTL exhibiting genome‐wide significant cis‐eQTL and (b) genetic correlations among OSS phenotypes, ethanol phenotypes and mRNA expression. From these analyses, we nominated positional candidates for behavioral QTL associated with distinct OSS phenotypes including Gnb1 and Mef2c. Genetic covariation of Gnb1 expression, preference for sensory stimuli and multiple ethanol phenotypes suggest that heritable variation in Gnb1 expression in reward circuitry partially underlies the widely reported relationship between sensation seeking and substance use.

Tobacco smoking may delay habituation of reinforcer effectiveness in humans

BACKGROUND

The effectiveness of nonconsummatory reinforcers habituate, as their ability to maintain reinforced responding declines over repeated presentations. Preclinical research has shown that nicotine can delay habituation of reinforcer effectiveness, but this effect has not been directly demonstrated in humans.

OBJECTIVE

In preliminary translational research, we assessed effects of nicotine from tobacco smoking (vs. a no smoking control) on within-session patterns of responding for a brief visual reinforcer.

METHODS

Using a within-subjects design, 32 adult dependent smokers participated in two experimental sessions, varying by smoking condition: no smoking following overnight abstinence (verified by CO ≤ 10 ppm), or smoking of own cigarette without overnight abstinence. Adapted from preclinical studies, habituation of reinforcer effectiveness was assessed by determining the rate of decline in responding on a simple operant computer task for a visual reinforcer, available on a fixed ratio schedule.

RESULTS

Reinforced responding and duration of responding were each significantly higher in the smoking vs. no smoking condition. The within-session rate of responding declined significantly more slowly during the smoking vs. no smoking condition, consistent with delayed habituation of reinforcer effectiveness. Follow-up analyses indicated that withdrawal relief did not influence the difference in responding between conditions, suggesting the patterns of responding reflected positive, but not negative, reinforcement.

CONCLUSIONS

These results are a preliminary demonstration in humans that smoked nicotine may attenuate habituation, thereby maintaining the effectiveness of a reinforcer over a longer period of access. Further research is needed to confirm habituation and rule out alternative causes of declines in within-session responding.

Social reinforcement as alternative to sucrose reinforcement is increased by nicotine and methylphenidate in male Fischer-344 rats

BACKGROUND

Stimulant drugs such as nicotine (NIC) and methylphenidate (MPH) are hypothesized to increase the reinforcing value of sensory stimuli, thus increasing the effectiveness of such reinforcers as alternatives to sucrose reinforcers.

METHODS

Inbred Fischer-344 rats (n = 30) were assigned to three groups: saline (SAL; n = 10), nicotine (NIC; n = 10), or methylphenidate (MPH; n = 10). Testing was done in three phases: sucrose only, (SUC), sucrose and drug (SUC/DRUG), and sucrose, drug, and social reinforcement (SUC/DRUG/SOC). During the SUC phase, rats were trained on a progressive ratio 5 (PR5) reinforcement schedule for sucrose (20% solution). In the SUC/DRUG phase, animals were treated with SAL, NIC (0.4 mg/kg, n = 10 SC), or MPH (2.0 mg/kg, n = 10 IP) 30 min prior to testing. In the SUC/DRUG/SOC phase, animals continued receiving drug treatment, and social reinforcement was introduced concurrently with the sucrose reinforcer. The progressive ratio for each reinforcer ran independently of the others. Reinforcing value was measured as break point (BP), the highest number of responses resulting in a reinforcer.

RESULTS

SAL-treated animals showed no significant change in sucrose BP. MPH-treated animals showed decreased sucrose BP in the SUC/DRUG phase, with a further reduction in the SUC/DRUG/SOC phase. NIC-treated animals decreased sucrose BP only when a social alternative was offered.

CONCLUSION

Both NIC and MPH reduce the sucrose BP in the presence of a social alternative. The decrease in sucrose responding, coupled with increased social responding, suggests that the social alternative acted as an effective alternative reinforcer to sucrose. From a translational perspective, these results suggest that stimulant drugs such as NIC and MPH may increase the effectiveness of treatments that use alternative social reinforcers to decrease eating.

Attention to novelty versus repetition: Contrasting habituation profiles in Autism and Williams syndrome

BACKGROUND

Abnormalities in habituation have been documented in Autism Spectrum Disorder (ASD) and Williams syndrome (WS). Such abnormalities have been proposed to underlie the distinctive social and non-social difficulties that define ASD, including sensory features and repetitive behaviours, and the distinctive social phenotype characterizing WS.

METHODS

We measured habituation in 39 preschoolers with ASD, 20 peers with WS and 19 typically developing (TD) children using an eye-tracking protocol that measured participants' duration of attention in response to a repeating stimulus and a novel stimulus presented side by side across multiple trials.

RESULTS

Participants in the TD group and the WS group decreased their attention toward the repeating stimulus and increased their attention to the novel stimulus over time. Conversely, the ASD group showed a similar attentional response to the novel and repeating stimuli. Habituation was correlated with social functioning in the WS but not in the ASD group. Contrary to predictions, slower habituation in ASD was associated with lower severity of repetitive behaviours.

CONCLUSIONS

Habituation appears to be intact in WS and impaired in ASD. More research is needed to clarify the nature of the syndrome-specific patterns of correlations between habituation and social and non-social functioning in these neurodevelopmental disorders.

Decreased environmental complexity during development impairs habituation of reinforcer effectiveness of sensory stimuli

Previous research has shown that rats reared in simple/impoverished environments demonstrate greater repetitive responding for sensory reinforcers (e.g., light onset). Moreover, the brains of these rats are abnormally developed, compared to brains of rats reared in more complex/enriched environments. Repetitive behaviors are commonly observed in individuals with developmental disorders. Some of these repetitive behaviors could be maintained by the reinforcing effects of the sensory stimulation that they produce. Therefore, rearing rats in impoverished conditions may provide an animal model for certain repetitive behaviors associated with developmental disorders. We hypothesize that in rats reared in simple/impoverished environments, the normal habituation process to sensory reinforcers is impaired, resulting in high levels of repetitive behaviors. We tested the hypothesis using an operant sensory reinforcement paradigm in rats reared in simple/impoverished (IC), standard laboratory (SC), and complex/enrichened conditions (EC, treatments including postnatal handling and environmental enrichment). Results show that the within-session habituation of the reinforcer effectiveness of light onset was slower in the IC and SC rats than in the EC rats. A dishabituation challenge indicated that within-session decline of responses was due to habituation and not motor fatigue or sensory adaptation. In conclusion, rearing rats in simple/impoverished environments, and comparing them to rats reared in more complex/enriched environments, may constitute a useful approach for studying certain repetitive behaviors associated with developmental disorders.

Cdh13 and AdipoQ gene knockout alter instrumental and Pavlovian drug conditioning

Genome-wide association studies in humans have suggested that variants of the cadherin-13 (CDH13) gene are associated with substance use disorder, subjective response to amphetamine, and attention deficit hyperactivity disorder. To examine the role of the Cdh13 and its peptide ligand adiponectin (AdipoQ) in addiction-related behaviors, we assessed Cdh13 knockout (KO) rats and AdipoQ KO mice using intravenous cocaine self-administration and conditioned place preference (CPP) paradigms. During intravenous cocaine self-administration, male Cdh13 heterozygous (+/-) and KO (-/-) rats showed increased cue-induced reinstatement compared with wild-type (WT) rats when presented with a cocaine-paired stimulus, whereas female Cdh13 rats showed no differences across genotype. Cdh13 -/- rats showed higher responding for a saccharin reinforcer and learned the choice reaction time (RT) task more slowly than WTs. However, we found no differences between Cdh13 -/- and +/+ rats in responding for sensory reinforcement, number of premature responses in the RT task, tendency to approach a Pavlovian food cue, CPP and locomotor activation to cocaine (10 or 20 mg/kg). In AdipoQ -/- mice, there was a significant increase in CPP to methamphetamine (1 mg/kg) but not to a range of d-amphetamine doses (0.5, 1, 2 and 4 mg/kg). Taken together, these data suggest that Cdh13 and AdipoQ regulate sensitivity to psychomotor stimulants and palatable rewards without producing major changes in other behaviors. In humans, these two genes may regulate sensitivity to natural and drug rewards, thus influencing susceptibility to the conditioned drug effects and relapse.

Habituation is altered in neuropsychiatric disorders-A comprehensive review with recommendations for experimental design and analysis

Abnormalities in the simplest form of learning, habituation, have been reported in a variety of neuropsychiatric disorders as etiologically diverse as Autism Spectrum Disorder, Fragile X syndrome, Schizophrenia, Parkinson's Disease, Huntington's Disease, Attention Deficit Hyperactivity Disorder, Tourette's Syndrome, and Migraine. Here we provide the first comprehensive review of what is known about alterations in this form of non-associative learning in each disorder. Across several disorders, abnormal habituation is predictive of symptom severity, highlighting the clinical significance of habituation and its importance to normal cognitive function. Abnormal habituation is discussed within the greater framework of learning theory and how it may relate to disease phenotype either as a cause, symptom, or therapy. Important considerations for the design and interpretation of habituation experiments are outlined with the hope that these will aid both clinicians and basic researchers investigating how this simple form of learning is altered in disease.

Nicotine Acutely Enhances Reinforcement from Non-Drug Rewards in Humans

Preclinical research documents that, aside from the primary and secondary reinforcing effects of nicotine intake itself, nicotine also acutely enhances the reinforcing efficacy of non-drug reinforcers ("rewards"). Study of these effects in humans has largely been overlooked, but very recent findings suggest they may have clinical implications for more fully understanding the persistence of tobacco dependence. This overview first outlines the topic and notes some recent human studies indirectly addressing nicotine effects on related responses (e.g., subjective ratings), explaining why those findings do not directly confirm enhancement of behavioral reinforcement per se due to nicotine. Then, the methodology used in the subsequently presented studies is described, demonstrating how those studies specifically did demonstrate enhancement of reinforced responding for non-drug rewards. The main section focuses on the limited controlled research to date directly assessing nicotine's acute reinforcement-enhancing effects in humans, particularly as it relates to reinforced behavioral responding for non-drug rewards in non-human animal models. After detailing those few existing human studies, we address potential consequences of these effects for dependence and tobacco cessation efforts and then suggest directions for future research. This research indicates that nicotine per se increases responding in humans that is reinforced by some rewards (auditory stimuli via music, visual stimuli via video), but perhaps not by others (e.g., money). These reinforcement-enhancing effects in smokers are not due to dependence or withdrawal relief and can be restored by a small amount of nicotine (similar to a smoking lapse), including from e-cigarettes, a non-tobacco nicotine product. Future clinical research should examine factors determining which types of rewards are (or are not) enhanced by nicotine, consequences of the loss of these nicotine effects after quitting smoking, potential individual differences in these effects, and the possibility that nicotine via nicotine replacement therapy and non-nicotine quit medications may attenuate loss of these effects upon quitting. Further study with humans of nicotine's reinforcement-enhancing effects may provide a more complete understanding of smoking persistence and added mechanisms of cessation medication efficacy.

Dopamine receptor DOP-4 modulates habituation to repetitive photoactivation of a C. elegans polymodal nociceptor

Habituation is a highly conserved phenomenon that remains poorly understood at the molecular level. Invertebrate model systems, like Caenorhabditis elegans, can be a powerful tool for investigating this fundamental process. Here we established a high-throughput learning assay that used real-time computer vision software for behavioral tracking and optogenetics for stimulation of the C. elegans polymodal nociceptor, ASH. Photoactivation of ASH with ChR2 elicited backward locomotion and repetitive stimulation altered aspects of the response in a manner consistent with habituation. Recording photocurrents in ASH, we observed no evidence for light adaptation of ChR2. Furthermore, we ruled out fatigue by demonstrating that sensory input from the touch cells could dishabituate the ASH avoidance circuit. Food and dopamine signaling slowed habituation downstream from ASH excitation via D1-like dopamine receptor, DOP-4. This assay allows for large-scale genetic and drug screens investigating mechanisms of nociception modulation.

The tendency to sign-track predicts cue-induced reinstatement during nicotine self-administration, and is enhanced by nicotine but not ethanol

RATIONALE

Some individuals are particularly responsive to reward-associated stimuli ("cues"), including the effects of these cues on craving and relapse to drug-seeking behavior. In the cases of nicotine and alcohol, cues may acquire these abilities via the incentive-enhancing properties of the drug.

OBJECTIVES

To determine the interaction between cue-responsivity and nicotine reinforcement, we studied the patterns of nicotine self-administration in rats categorized based on their tendency to approach a food-predictive cue ("sign-trackers") or a reward-delivery location ("goal-trackers"). In a second experiment, we determined whether nicotine and ethanol altered the incentive value of a food cue.

METHODS

Rats were classified as sign- or goal-trackers during a Pavlovian conditioned approach paradigm. Rats then self-administered intravenous nicotine (0.03 mg/kg infusions) followed by extinction and cue-induced reinstatement tests. We also tested the effects of nicotine (0.4 mg/kg base s.c.) or ethanol (0.7 g/kg i.p.) on the approach to, and reinforcing efficacy of, a food cue.

RESULTS

Sign-trackers showed greater reinstatement in response to a nicotine cue. Further, nicotine enhanced sign-tracking but not goal-tracking to a food cue and also enhanced responding for the food cue during the conditioned reinforcement test. Conversely, ethanol reduced sign-tracking and increased goal-tracking, but had no effect on conditioned reinforcement.

CONCLUSIONS

Our studies demonstrate that the tendency to attribute incentive value to a food cue predicts enhanced cue-induced reinstatement. Additionally, the incentive value of food cues is differentially modulated by nicotine and ethanol, which may be related to the reinforcing effects of these drugs.

Reinforcement and Stimulant Medication Ameliorate Deficient Response Inhibition in Children with Attention-Deficit/Hyperactivity Disorder

This study examined the degree to which reinforcement, stimulant medication, and their combination impact response inhibition in children with Attention-Deficit/Hyperactivity Disorder (ADHD). Across three studies, participants with ADHD (n = 111, 25 girls) and typically-developing (TD) controls (n = 33, 6 girls) completed a standard version of the stop signal task (SST) and/or a reinforcement-manipulation SST with performance-contingent points. In two of these studies, these tasks were performed under placebo or 0.3 and 0.6 mg/kg methylphenidate (MPH) conditions. Cross-study comparisons were conducted to test hypotheses regarding the separate and combined effects of reinforcement and methylphenidate on response inhibition among children with ADHD relative to TD controls. Baseline response inhibition was worse among children with ADHD compared to controls. MPH produced dose-related improvements in response inhibition in children with ADHD; compared to non-medicated TD controls, 0.3 mg/kg MPH normalized deficient response inhibition, and 0.6 mg/kg MPH resulted in better inhibition in children with ADHD. Reinforcement improved response inhibition to a greater extent for children with ADHD than for TD children, normalizing response inhibition. The combination of MPH and reinforcement improved response inhibition among children with ADHD compared to reinforcement alone and MPH alone, also resulting in normalization of response inhibition despite repeated task exposure. Deficient response inhibition commonly observed in children with ADHD is significantly improved with MPH and/or reinforcement, normalizing inhibition relative to TD children tested under standard conditions.

Reinforcement enhances vigilance among children with ADHD: comparisons to typically developing children and to the effects of methylphenidate

Sustained attention and reinforcement are posited as causal mechanisms in Attention-Deficit/Hyperactivity Disorder (ADHD), but their interaction has received little empirical study. In two studies, we examined the impact of performance-based reinforcement on sustained attention over time, or vigilance, among 9- to 12-year-old children. Study 1 demonstrated the expected vigilance deficit among children with ADHD (n = 25; 12% female) compared to typically developing (TD) controls (n = 33; 22% female) on a standard continuous performance task (CPT). During a subsequent visit, reinforcement improved attention more among children with ADHD than controls. Study 2 examined the separate and combined effects of reinforcement and acute methylphenidate (MPH) on CPT performance in children with ADHD (n = 19; 21% female). Both reinforcement and MPH enhanced overall target detection and attenuated the vigilance decrement that occurred in no-reinforcement, placebo condition. Cross-study comparisons suggested that the combination of MPH and reinforcement eliminated the vigilance deficit in children with ADHD, normalizing sustained attention. This work highlights the clinically and theoretically interesting intersection of reinforcement and sustained attention.

Evaluating cognitive and motivational accounts of greater reinforcement effects among children with attention-deficit/hyperactivity disorder

BACKGROUND

Attention Deficit/Hyperactivity Disorder is associated with cognitive deficits and dysregulated motivation. Reinforcement improves cognitive performance, often to a greater degree among children with ADHD compared to typically-developing controls. The current study tests the degree to which cognitive (individual differences in baseline cognition) and/or motivational (individual differences in Sensitivity to Reward; SR) processes can account for diagnostic group differences in reinforcement effects.

METHODS

Participants were 58 children (25 ADHD, 33 control) ages 9-12. Children completed measures of inhibitory control (Stop Signal Task), working memory (n-back), and sustained attention (Continuous Performance Task) during a baseline week and again one week later under reinforcement and no-reinforcement conditions; composites were computed across cognitive domains. Parent-and child-reported trait SR (SPSRQ; BIS/BAS) were combined to index a child's response towards appetitive, rewarding stimuli.

RESULTS

In separate analyses, diagnostic group, individual differences in baseline cognition, and individual differences in SR all moderated the impact of reinforcement on cognition. When considered together, the Diagnostic Group × Reinforcement and Baseline Cognition × Reinforcement interactions both remained robust. In contrast, neither the Diagnostic Group × Reinforcement nor the SR × Reinforcement interactions accounted for unique variance when evaluated together.

CONCLUSIONS

Both baseline cognition and trait SR predict reinforcement effects on cognition, but only SR shares significant variance with diagnostic group. These results suggest that ADHD children's greater response to reinforcement on cognition is strongly related to their heightened trait sensitivity to rewarding stimuli, consistent with motivational models of ADHD.