A review of delay-discounting research with humans: relations to drug use and gambling

Human laboratory paradigms in alcohol research

BACKGROUND

Human laboratory studies have a long and rich history in the field of alcoholism. Human laboratory studies have allowed for advances in alcohol research in a variety of ways, including elucidating neurobehavioral mechanisms of risk, identifying phenotypically distinct subtypes of alcohol users, investigating the candidate genes underlying experimental phenotypes for alcoholism, and testing mechanisms of action of alcoholism pharmacotherapies on clinically relevant translational phenotypes, such as persons exhibiting positive-like alcohol effects or alcohol craving. Importantly, the field of human laboratory studies in addiction has progressed rapidly over the past decade and has built upon earlier findings of alcohol's neuropharmacological effects to advancing translational research on alcoholism etiology and treatment.

METHODS AND RESULTS

To that end, the new generation of human laboratory studies has focused on applying new methodologies, further refining alcoholism phenotypes, and translating these findings to studies of alcoholism genetics, medication development, and pharmacogenetics. The combination of experimental laboratory approaches with the recent developments in neuroscience and pharmacology has been particularly fruitful in furthering our understanding of the impact of individual differences in alcoholism risk and in treatment response.

CONCLUSIONS

This review of the literature focuses on human laboratory studies of subjective intoxication, alcohol craving, anxiety, and behavioral economics. Each section discusses opportunities for phenotype refinement under laboratory conditions, as well as its application to translational science of alcoholism. A summary and recommendations for future research are also provided.

Delay discounting by adolescents experimenting with cigarette smoking

AIMS

To evaluate delay discounting and self-reported impulsive behavior in a sample of adolescents experimenting with cigarette smoking compared with adolescents who had never smoked or were daily smokers.

DESIGN

A cross-sectional design was used to compare smoking-status groups.

SETTING

Columbus, Ohio, a city of approximately 780,000 people.

PARTICIPANTS

A sample of 141 male and female adolescents with a mean age of 15.37 (standard deviation = 1.09) years.

MEASUREMENTS

Primary measures included a computerized assessment of delay discounting, a self-report assessment of impulsivity [Barratt Impulsiveness Scale-adolescent (BIS-11-A)] and verifications of cigarette smoking status (breath carbon monoxide and urinary cotinine level).

FINDINGS

Smokers discounted more by delay and had higher impulsivity scores than non-smokers. Experimenters had scores intermediate to those of smokers and non-smokers on both measures. In some analyses the difference between experimenters and non-smokers was significant, with experimenters showing greater delay discounting, but in no case did experimenters differ significantly from the smokers.

CONCLUSIONS

Young people who experiment with cigarettes appear to be similar to those who smoke regularly in terms of tendency to discount future gains and report impulsive tendencies, and generally higher in these traits than non-smokers.

Behavioral toxicology of cognition: extrapolation from experimental animal models to humans: behavioral toxicology symposium overview

A variety of behavioral instruments are available for assessing important aspects of cognition in both animals and humans and, in many cases, the same instruments can be used in both. While nonhuman primates are phylogenetically closest to humans, rodents, pigeons and other animals also offer behaviors worthy of note. Delay Discounting procedures are as useful as any in studies of impulsivity and may have utility in shedding light on processes associated with drug abuse. Specific memory tests such as Visual Paired Comparisons tasks (similar to the Fagan test of infant intelligence) can be modified to allow for assessment of different aspects of memory such as spatial memory. Use of these and other specific memory tasks can be used to directly monitor aspects of cognitive development in infant animals, particularly in nonhuman primates such as monkeys, and children and to draw inferences with respect to possible neuroanatomical substrates sub-serving their functions. Tasks for assessing working memory such as Variable Delayed Response (VDR), modified VDR and Spatial Working Memory tasks are now known to be affected in Parkinson's disease (PD). These and other cognitive function tasks are being used in a monkey model of PD to assess the ability of anti-Parkinson's disease therapies to ameliorate these cognitive deficits without diminishing their therapeutic effects on motor dysfunction. Similarly, in a rat model of the cognitive deficits associated with perinatal exposure to polychlorinated biphenyls (PCBs), clear parallels with children can be seen in at least two areas of executive function: cognitive flexibility and response inhibition. In the rat model, discrimination reversal tasks were utilized to assess cognitive flexibility, a function often assessed in humans using the Wisconsin Card Sorting Task. Response inhibition was assessed using performance in a Differential Reinforcement of Low Response Rates (DRL) task. As the data continue to accumulate, it becomes more clear that our attempts to adapt animal-appropriate tasks for the study of important aspects of human cognition have proven to be very fruitful.

Characterization of a semi-rapid method for assessing delay discounting in rodents

Delay discounting is a key component of many psychiatric disorders, including drug addiction, compulsive gambling, ADHD, and obesity. However, its underlying mechanisms are not yet fully characterized. One impediment to full characterization of such mechanisms is the fact that rodent models of the task are often complicated and involve extended training of subjects, often requiring more than a month before a stable baseline is obtained. We have therefore characterized a version of the rodent delay discounting task which generates data more quickly than most other published versions. In this version of the task, learning of the operant response is established prior to introduction of the delay component, and delay is tested across subsequent daily sessions with a single delay length per day. We demonstrate here that this version generates a delay discounting curve similar to many published tasks, and is sensitive to changes in reward magnitude and to chronic treatment with cocaine. Furthermore, we present a detailed description of the within-session patterns of behavior in the task, which provides evidence of within-session learning and establishment of stable response patterns. This faster version of the delay discounting task will facilitate future studies involving pharmacological, electrophysiological, and other mechanistic studies of the underlying basis of this important disease process.

Effects of smoking abstinence on impulsive behavior among smokers high and low in ADHD-like symptoms

RATIONALE

Impulsivity, a multifaceted construct that includes inhibitory control and heightened preference for immediate reward, is central to models of drug use and abuse. Within a self-medication framework, abstinence from smoking may lead to an increase in impulsive behavior and the likelihood of relapse, particularly among persons with disorders (e.g., attention-deficit/hyperactivity disorder, ADHD) and personality traits (e.g., impulsivity) linked to impulsive behavior.

OBJECTIVES

This study aimed to examine the effects of smoking abstinence on multiple measures of impulsivity among a non-clinical sample of adult smokers selected for high and low levels of ADHD symptoms.

METHODS

In a within-subjects design, participants selected for high or low levels of self-reported ADHD symptoms (N = 56) completed sessions following overnight abstinence and when smoking as usual (order counterbalanced). Measures of impulsive behavior included response inhibition (i.e., stop signal task), interference control (i.e., attentional modification of prepulse inhibition (PPI) of startle), and impulsive choice (i.e., hypothetical delay discounting).

RESULTS

As hypothesized, abstinence decreased response inhibition and PPI. Although ADHD symptoms moderated abstinence effects on impulsive choice and response inhibition, the pattern was opposite to our predictions: the low-ADHD group responded more impulsively when abstinent, whereas the high-ADHD group was relatively unaffected by abstinence.

CONCLUSIONS

These findings highlight the importance of utilizing multiple laboratory measures to examine a multifactorial construct such as impulsive behavior and raise questions about how best to assess symptoms of ADHD and impulsivity among non-abstinent smokers.

Effects of α-2A adrenergic receptor agonist on time and risk preference in primates

RATIONALE

Subjective values of actions are influenced by the uncertainty and immediacy of expected rewards. Multiple brain areas, including the prefrontal cortex and basal ganglia, are implicated in selecting actions according to their subjective values. Alterations in these neural circuits, therefore, might contribute to symptoms of impulsive choice behaviors in disorders such as substance abuse and attention-deficit hyperactivity disorder (ADHD). In particular, the α-2A noradrenergic system is known to have a key influence on prefrontal cortical circuits, and medications that stimulate this receptor are currently in use for the treatment of ADHD.

OBJECTIVE

We tested whether the preference of rhesus monkeys for delayed and uncertain reward is influenced by the α-2A adrenergic receptor agonist, guanfacine.

METHODS

In each trial, the animal chose between a small, certain and immediate reward and another larger, more delayed reward. In half of the trials, the larger reward was certain, whereas in the remaining trials, the larger reward was uncertain.

RESULTS

Guanfacine increased the tendency for the animal to choose the larger and more delayed reward only when it was certain. By applying an econometric model to the animal's choice behavior, we found that guanfacine selectively reduced the animal's time preference, increasing their choice of delayed, larger rewards, without significantly affecting their risk preference.

CONCLUSIONS

In combination with previous findings that guanfacine improves the efficiency of working memory and other prefrontal functions, these results suggest that impulsive choice behaviors may also be ameliorated by strengthening prefrontal functions.

A behavioral economic supplement to brief motivational interventions for college drinking

Basic behavioral and neurobiological research has demonstrated that deficiencies in naturally occurring substance-free rewards are both a cause and a consequence of substance abuse that are due in part to the systematic discounting of delayed substance-free rewards. Existing brief motivational interventions (BMIs) for alcohol abuse do not target this mechanism of change. The goal of this uncontrolled pilot study was to evaluate a behavioral economic Substance-Free Activity Session (SFAS) to traditional alcohol BMIs. Participants were 13 college freshmen who reported two or more heavy drinking episodes (>5/4 drinks in an occasion for men/ women) in the past month. All participants completed a baseline assessment and a BMI that addressed alcohol use. In addition, participants received the SFAS, a 50-min individual session that attempts to increase engagement in constructive alternatives to drinking by enhancing the salience of delayed rewards (academic and career success) and the patterns of behavior (academic and extracurricular engagement) leading to these outcomes. At the 1-month follow-up assessment, participants reported significant reductions in heavy drinking, and moderate to large effect size reductions in weekly drinking and peak blood alcohol levels. The results of this pilot study provide preliminary support for the efficacy of this behavioral economic intervention session as a supplement to traditional alcohol BMIs.

Delay and probability discounting in pathological gamblers with and without a history of substance use problems

RATIONALE

Pathological gambling and substance use disorders are highly comorbid, possibly because they both stem from a similar process-impulsivity. Although much data exist regarding the association between delay discounting and these psychiatric disorders, relatively little research has examined probability discounting and its relationship with either substance use or gambling.

OBJECTIVES

The goal of the current study was to compare rates of probability and delay discounting in a large population of pathological gamblers with and without a history of substance use problems.

METHODS

Treatment-seeking pathological gamblers with (n = 117) and without (n = 119) a history of substance use problems completed questionnaires about discounting of hypothetical monetary outcomes and the Eysenck Impulsivity Questionnaire. The delay-discounting questionnaire involved choices between a smaller amount of money delivered immediately versus a larger amount delivered later, and the probability questionnaire was comprised of choices between a smaller certain versus a larger probabilistic monetary outcome. Hyperbolic functions estimated delay and probability discounting rates based on the indifference points obtained through the questionnaires.

RESULTS

Results revealed significant effects of substance use problem status on delay but not on probability discounting, with no significant correlation noted between the two discounting processes. Only delay discounting correlated with Eysenck impulsivity scores.

CONCLUSIONS

These data suggest that delay and probability discounting tap different dimensions, and delay discounting is more closely linked with substance use problem histories in pathological gamblers.

Differences in delay discounting between smokers and nonsmokers remain when both rewards are delayed

RATIONALE

When offered a choice between a small monetary reward available immediately (SmallNow) versus a larger reward available after a delay (LargeLater), smokers select the SmallNow alternative more than nonsmokers. That is, smokers discount the value of the LargeLater reward more than nonsmokers.

OBJECTIVES

To investigate whether this group difference was due to smokers overweighting the value of rewards available immediately compared with nonsmokers, we examined whether the group difference was also seen when both alternatives were delayed, i.e., when choosing between a SmallSoon reward and a LargeLater reward.

METHODS

In Experiment 1, smokers and nonsmokers completed a task including SmallNow versus LargeLater choices and SmallSoon versus LargeLater choices. In Experiment 2, smokers and nonsmokers completed the same task but with hypothetical choices.

RESULTS

Analyses using hyperbolic and double exponential (β-δ) models replicate prior findings that smokers discount the LargeLater reward more than nonsmokers when the smaller reward is available immediately. The smoker-nonsmoker difference was also seen when the smaller reward was slightly delayed, though this effect was primarily driven by heightened discounting in male smokers. However, for potentially real rewards only, this smoker-nonsmoker difference was significantly reduced when the smaller reward was delayed.

CONCLUSIONS

The smoker-nonsmoker difference in discounting is not confined to situations involving immediate rewards. Differences associated with potentially real versus hypothetical rewards and gender underscore the complexity of the smoking-delay discounting relationship.

Cognitive training for impaired neural systems in neuropsychiatric illness

Neuropsychiatric illnesses are associated with dysfunction in distributed prefrontal neural systems that underlie perception, cognition, social interactions, emotion regulation, and motivation. The high degree of learning-dependent plasticity in these networks-combined with the availability of advanced computerized technology-suggests that we should be able to engineer very specific training programs that drive meaningful and enduring improvements in impaired neural systems relevant to neuropsychiatric illness. However, cognitive training approaches for mental and addictive disorders must take into account possible inherent limitations in the underlying brain 'learning machinery' due to pathophysiology, must grapple with the presence of complex overlearned maladaptive patterns of neural functioning, and must find a way to ally with developmental and psychosocial factors that influence response to illness and to treatment. In this review, we briefly examine the current state of knowledge from studies of cognitive remediation in psychiatry and we highlight open questions. We then present a systems neuroscience rationale for successful cognitive training for neuropsychiatric illnesses, one that emphasizes the distributed nature of neural assemblies that support cognitive and affective processing, as well as their plasticity. It is based on the notion that, during successful learning, the brain represents the relevant perceptual and cognitive/affective inputs and action outputs with disproportionately larger and more coordinated populations of neurons that are distributed (and that are interacting) across multiple levels of processing and throughout multiple brain regions. This approach allows us to address limitations found in earlier research and to introduce important principles for the design and evaluation of the next generation of cognitive training for impaired neural systems. We summarize work to date using such neuroscience-informed methods and indicate some of the exciting future directions of this field.

Neurogenetics and Epigenetics in Impulsive Behaviour: Impact on Reward Circuitry

Adverse, unfavourable life conditions, particularly during early life stages and infancy, can lead to epigenetic regulation of genes involved in stress-response, behavioral disinhibition, and cognitive-emotional systems. Over time, the ultimate final outcome can be expressed through behaviors bedeviled by problems with impulse control, such as eating disorders, alcoholism, and indiscriminate social behavior. While many reward gene polymorphisms are involved in impulsive behaviors, a polymorphism by itself may not translate to the development of a particular behavioral disorder unless it is impacted by epigenetic effects. Brain-derived neurotrophic factor (BDNF) affects the development and integrity of the noradrenergic, dopaminergic, serotonergic, glutamatergic, and cholinergic neurotransmitter systems, and plasma levels of the neurotrophin are associated with both cognitive and aggressive impulsiveness. Epigenetic mechanisms associated with a multitude of environmental factors, including premature birth, low birth weight, prenatal tobacco exposure, non-intact family, young maternal age at birth of the target child, paternal history of antisocial behavior, and maternal depression, alter the developmental trajectories for several neuropsychiatric disorders. These mechanisms affect brain development and integrity at several levels that determine structure and function in resolving the final behavioral expressions.

Relations among delay discounting, addictions, and money mismanagement: implications and future directions

BACKGROUND

Delay discounting is a reduction in the subjective value of a delayed outcome. Elevated delay discounting is a type of impulsivity that is associated with harmful behaviors, including substance abuse and financial mismanagement.

METHODS

Elevated delay discounting as related to addiction and financial mismanagement was reviewed from psychological, neurobiological, and behavioral economic perspectives.

RESULTS

Addiction and financial mismanagement frequently co-occur, and elevated delay discounting may be a common mechanism contributing to both of these problematic behaviors.

CONCLUSIONS

Future research on the relationships between delay discounting, substance abuse, and financial mismanagement can provide important insights for developing improved prevention and treatment strategies.

Now for Me, Later for Us? Effects of Group Context on Temporal Discounting

Delayed rewards are less valuable than immediate rewards. This well-established finding has focused almost entirely on individual outcomes. However, are delayed rewards similarly discounted if they are shared by a group? The current article reports on three experiments exploring the effect of group context on delay discounting. Results indicate that discount rates of individual and group rewards were highly correlated, but that respondents were more willing to wait (decreased discounting) for shared outcomes than for individual outcomes. An explanatory model is proposed suggesting that decreased discount rates in group contexts may be due to the way the effects of both delay and social discounting are combined. That is, in a group context, a person values both a future reward (discounted by delay) and a present reward to another person (discounted by the social distance between them). The results are explained by a combined discount function containing a delay factor and a factor representing the social distance between the decision maker and group members. Practical implications of the fact that shared consequences can increase individual self-control are also discussed.

Delay discounting, impulsiveness, and addiction severity in opioid-dependent patients

Individuals who abuse drugs show higher delay discounting (DD) rate and impulsiveness scores compared with controls; however, it is unclear if DD rate covaries with severity of the addiction or if an individual's discounting rate can be changed by effective substance abuse treatment. This study compared methadone maintenance treatment (MMT) patients (n = 30) who had not used illegal drugs for 2 years with drug-using MMT patients (n = 30) and controls (n = 25) in terms of addiction severity, DD rate, and impulsiveness. Methadone patients abstinent from illegal drugs scored significantly lower on a number of addiction severity measures than the drug-using methadone patients. In addition, both groups of MMT patients showed significantly higher rates of DD and impulsiveness than the control group; however, no differences in DD rate or impulsiveness were found between the groups of patients. Results suggest that DD rate and impulsiveness may not covary with indicators of addiction severity in MMT patients.

Impulsivity and cognitive distortions in pathological gamblers attending the UK National Problem Gambling Clinic: a preliminary report

BACKGROUND

Pathological gambling (PG) is a form of behavioural addiction that has been associated with elevated impulsivity and also cognitive distortions in the processing of chance, probability and skill. We sought to assess the relationship between the level of cognitive distortions and state and trait measures of impulsivity in treatment-seeking pathological gamblers.

METHOD

Thirty pathological gamblers attending the National Problem Gambling Clinic, the first National Health Service clinic for gambling problems in the UK, were compared with 30 healthy controls in a case-control design. Cognitive distortions were assessed using the Gambling-Related Cognitions Scale (GRCS). Trait impulsivity was assessed using the UPPS-P, which includes scales of urgency, the tendency to be impulsive in positive or negative mood states. Delay discounting rates were taken as a state measure of impulsive choice.

RESULTS

Pathological gamblers had elevated impulsivity on several UPPS-P subscales but effect sizes were largest (Cohen's d>1.4) for positive and negative urgency. The pathological gamblers also displayed higher levels of gambling distortions, and elevated preference for immediate rewards, compared to controls. Within the pathological gamblers, there was a strong relationship between the preference for immediate rewards and the level of cognitive distortions (R2=0.41).

CONCLUSIONS

Impulsive choice in the gamblers was correlated with the level of gambling distortions, and we hypothesize that an impulsive decision-making style may increase the acceptance of erroneous beliefs during gambling play.

A mechanism for reducing delay discounting by altering temporal attention

Rewards that are not immediately available are discounted compared to rewards that are immediately available. The more a person discounts a delayed reward, the more likely that person is to have a range of behavioral problems, including clinical disorders. This latter observation has motivated the search for interventions that reduce discounting. One surprisingly simple method to reduce discounting is an "explicit-zero" reframing that states default or null outcomes. Reframing a classical discounting choice as "something now but nothing later" versus "nothing now but more later" decreases discount rates. However, it is not clear how this "explicit-zero" framing intervention works. The present studies delineate and test two possible mechanisms to explain the phenomenon. One mechanism proposes that the explicit-zero framing creates the impression of an improving sequence, thereby enhancing the present value of the delayed reward. A second possible mechanism posits an increase in attention allocation to temporally distant reward representations. In four experiments, we distinguish between these two hypothesized mechanisms and conclude that the temporal attention hypothesis is superior for explaining our results. We propose a model of temporal attention whereby framing affects intertemporal preferences by modifying present bias.

Inhibiting food reward: delay discounting, food reward sensitivity, and palatable food intake in overweight and obese women

Overeating is believed to result when the appetitive motivation to consume palatable food exceeds an individual's capacity for inhibitory control of eating. This hypothesis was supported in recent studies involving predominantly normal weight women, but has not been tested in obese populations. The current study tested the interaction between food reward sensitivity and inhibitory control in predicting palatable food intake among energy-replete overweight and obese women (N = 62). Sensitivity to palatable food reward was measured with the Power of Food Scale. Inhibitory control was assessed with a computerized choice task that captures the tendency to discount large delayed rewards relative to smaller immediate rewards. Participants completed an eating in the absence of hunger protocol in which homeostatic energy needs were eliminated with a bland preload of plain oatmeal, followed by a bogus laboratory taste test of palatable and bland snacks. The interaction between food reward sensitivity and inhibitory control was a significant predictor of palatable food intake in regression analyses controlling for BMI and the amount of preload consumed. Probing this interaction indicated that higher food reward sensitivity predicted greater palatable food intake at low levels of inhibitory control, but was not associated with intake at high levels of inhibitory control. As expected, no associations were found in a similar regression analysis predicting intake of bland foods. Findings support a neurobehavioral model of eating behavior in which sensitivity to palatable food reward drives overeating only when accompanied by insufficient inhibitory control. Strengthening inhibitory control could enhance weight management programs.

Behavioural and physiological correlates of impulsivity in the domestic dog (Canis familiaris)

Impulsivity is a trait related to inhibitory control which is expressed in a range of behaviours. Impulsive individuals show a decreased ability to tolerate delay of reinforcement, and more impulsive behaviour has been linked to decreased levels of serotonin and dopamine in a number of species. In domestic dogs, impulsivity is implicated in problem behaviours that result from a lack of self control, but currently there are no published studies that assess behavioural and physiological measures of impulsivity in relation to this trait. Impulsivity scores were calculated for 41 dogs using an owner-report assessment, the Dog Impulsivity Assessment Scale (DIAS). Twenty-three of these subjects completed an operant choice task based on a delayed reward paradigm, to assess their tolerance to delay of reinforcement. High Pressure Liquid Chromatography (HPLC) with Fluorometric Detection was used to detect levels of the metabolites of serotonin (5-HIAA) and dopamine (HVA) in the urine of 17 of the subjects. Higher impulsivity scores were found to be significantly correlated with more impulsive behaviour (reduced tolerance to delay of reinforcement) in the behaviour tests and lower levels of urinary 5-HIAA and 5-HIAA/HVA ratio. The results demonstrate convergent validity between impulsivity (as assessed by the DIAS) and behavioural and physiological parameters.

Addiction circuitry in the human brain

A major challenge in understanding substance-use disorders lies in uncovering why some individuals become addicted when exposed to drugs, whereas others do not. Although genetic, developmental, and environmental factors are recognized as major contributors to a person's risk of becoming addicted, the neurobiological processes that underlie this vulnerability are still poorly understood. Imaging studies suggest that individual variations in key dopamine-modulated brain circuits, including circuits involved in reward, memory, executive function, and motivation, contribute to some of the differences in addiction vulnerability. A better understanding of the main circuits affected by chronic drug use and the influence of social stressors, developmental trajectories, and genetic background on these circuits is bound to lead to a better understanding of addiction and to more effective strategies for the prevention and treatment of substance-use disorders.

Risk, reward, and economic decision making in aging

OBJECTIVES

Older adults' decision quality is considered to be worse than that of younger adults. This age-related difference is often attributed to reductions in risk tolerance. Little is known about the circumstances that affect older adults' decisions and whether risk attitudes directly influence economic decisions. We measure the influence of risk attitudes on age-related differences in decision making in both nonsocial and social contexts.

METHODS

Risk attitudes and economic decision making were measured in 30 healthy older adults and 29 healthy younger adults.

RESULTS

Older adults report being less impulsive, sensation seeking and risk tolerant than younger adults. Age did not affect a measure of nonsocial economic decision making. Older adults were more likely to reject unfair divisions of money during an economic social-bargaining game and more likely to make equitable divisions of money during social-giving game. These age-related differences were determined in part by individuals' self-reported risk taking.

DISCUSSION

We conclude that age-related differences in decision making are domain specific and that some social economic decision making is influenced by risk attitudes. Older adults are more risk avoidant, but this does not alter their willingness to wait for reward in a nonsocial context. Perceiving more risk is associated with an unwillingness to accept an unfair offer in social economic contexts and ultimately leads to poorer outcomes for older adults.

Effects of acute and chronic flunitrazepam on delay discounting in pigeons

Delay to delivery of a reinforcer can decrease responding for that reinforcer and increase responding for smaller reinforcers that are available concurrently and delivered without delay; acute administration of drugs can alter responding for large, delayed reinforcers, although the impact of chronic treatment on delay discounting is not well understood. In this experiment, the effects of repeated administration of the benzodiazepine flunitrazepam were studied in 6 pigeons responding on one key to receive food that was delivered immediately and on a second key to receive a larger amount of food that was delivered following delays which increased across a single session. Pigeons responded predominantly for the large reinforcer when there were no delays and when delays were short; however, as delays increased, responding for the large reinforcer decreased. Acutely, flunitrazepam (0.32, 1.0 and 3.2 mg/kg) dose-dependently increased responding for the large reinforcer, shifting the discounting curve rightward and upward. Repeated administration of flunitrazepam (0.32, 1.0 and 3.2 mg/kg, each for six sessions, separated by one session during which vehicle was administered) did not markedly alter its effects on responding for the large reinforcer, indicating that the development of tolerance to this effect of flunitrazepam is modest under these conditions.

Development and validation of the Delaying Gratification Inventory

Deficits in gratification delay are associated with a broad range of public health problems, such as obesity, risky sexual behavior, and substance abuse. However, 6 decades of research on the construct has progressed less quickly than might be hoped, largely because of measurement issues. Although past research has implicated 5 domains of delay behavior, involving food, physical pleasures, social interactions, money, and achievement, no published measure to date has tapped all 5 components of the content domain. Existing measures have been criticized for limitations related to efficiency, reliability, and construct validity. Using an innovative Internet-mediated approach to survey construction, we developed the 35-item 5-factor Delaying Gratification Inventory (DGI). Evidence from 4 studies and a large, diverse sample of respondents (N = 10,741) provided support for the psychometric properties of the measure. Specifically, scores on the DGI demonstrated strong internal consistency and test-retest reliability for the 35-item composite, each of the 5 domains, and a 10-item short form. The 5-factor structure fit the data well and had good measurement invariance across subgroups. Construct validity was supported by correlations with scores on closely related self-control measures, behavioral ratings, Big Five personality trait measures, and measures of adjustment and psychopathology, including those on the Minnesota Multiphasic Personality Inventory-2-Restructured Form. DGI scores also showed incremental validity in accounting for well-being and health-related variables. The present investigation holds implications for improving public health, accelerating future research on gratification delay, and facilitating survey construction research more generally by demonstrating the suitability of an Internet-mediated strategy.

Adults with a family history of alcohol related problems are more impulsive on measures of response initiation and response inhibition

BACKGROUND

Previous studies have found individuals with family histories of alcohol use disorders are more impulsive on some but not all laboratory behavioral measures, suggesting deficits on specific forms of impulse control. However, drawing conclusions is tenuous because these different measures have not been administered together in the same group of participants.

METHODS

In the present study, we compared healthy 21-35 year old adults with family histories of alcohol related problems (FHAP+) or without such histories (FHAP-) on behavioral measures of response inhibition, response initiation, and consequence sensitivity impulsivity. FHAP+ (n=36) and FHAP- (n=36) participants were compared on performance on the Immediate Memory Task (IMT, response initiation), GoStop Impulsivity Paradigm (GoStop, response inhibition), Two Choice Impulsivity Paradigm (TCIP, consequence sensitivity) and Single Key Impulsivity Paradigm (SKIP, consequence sensitivity).

RESULTS

FHAP+ individuals were more impulsive on the IMT and GoStop but not on the TCIP or SKIP.

CONCLUSIONS

These results suggest that response initiation and response inhibition impulsivity are increased in individuals with family histories of alcohol related problems despite not having alcohol or drug use disorders themselves. In contrast, increased consequence sensitivity impulsivity may be associated with additional risk factors such as more severe family histories of alcohol use disorders, or it may be increased as a consequence of heavy drug or alcohol use.

Temporal discounting of rewards in patients with bipolar disorder and schizophrenia

Patients with bipolar disorder (BD) and schizophrenia (SZ) often show decision-making deficits in everyday circumstances. A failure to appropriately weigh immediate versus future consequences of choices may contribute to these deficits. We used the delay discounting task in individuals with BD or SZ to investigate their temporal decision making. Twenty-two individuals with BD, 21 individuals with SZ, and 30 healthy individuals completed the delay discounting task along with neuropsychological measures of working memory and cognitive function. Both BD and SZ groups discounted delayed rewards more steeply than did the healthy group even after controlling for current substance use, age, gender, and employment. Hierarchical multiple regression analyses showed that discounting rate was associated with both diagnostic group and working memory or intelligence scores. In each group, working memory or intelligence scores negatively correlated with discounting rate. The results suggest that (a) both BD and SZ groups value smaller, immediate rewards more than larger, delayed rewards compared with the healthy group and (b) working memory or intelligence is related to temporal decision making in individuals with BD or SZ as well as in healthy individuals.

Discounting of probabilistic rewards is associated with gambling abstinence in treatment-seeking pathological gamblers

Individuals with addictive disorders, including substance abusers and pathological gamblers, discount or devalue rewards delayed in time more than controls. Theoretically, preference for probabilistic rewards is directly related to gambling, but limited empirical research has examined probabilistic discounting in individuals with pathological gambling. This study evaluated probability and delay discounting in treatment-seeking pathological gamblers and their association with gambling treatment outcomes during and after treatment. At time of treatment entry, 226 pathological gamblers completed probability and delay discounting tasks. They were then randomized to one of three treatment conditions, and gambling behavior was measured throughout treatment and at a 1-year follow-up assessment. After controlling for possibly confounding variables and treatment condition, more shallow probability discounting was associated with greater reductions in amounts wagered during treatment and likelihood of gambling abstinence at the end of treatment and throughout the follow-up period. No associations were noted between delay discounting and gambling treatment outcomes. These data suggest that probability discounting may be an important construct in understanding pathological gambling and its treatment.

Delayed reward discounting and addictive behavior: a meta-analysis

RATIONALE

Delayed reward discounting (DRD) is a behavioral economic index of impulsivity and numerous studies have examined DRD in relation to addictive behavior. To synthesize the findings across the literature, the current review is a meta-analysis of studies comparing DRD between criterion groups exhibiting addictive behavior and control groups.

OBJECTIVES

The meta-analysis sought to characterize the overall patterns of findings, systematic variability by sample and study type, and possible small study (publication) bias.

METHODS

Literature reviews identified 310 candidate articles from which 46 studies reporting 64 comparisons were identified (total N=56,013).

RESULTS

From the total comparisons identified, a small magnitude effect was evident (d= .15; p< .00001) with very high heterogeneity of effect size. Based on systematic observed differences, large studies assessing DRD with a small number of self-report items were removed and an analysis of 57 comparisons (n=3,329) using equivalent methods and exhibiting acceptable heterogeneity revealed a medium magnitude effect (d= .58; p< .00001). Further analyses revealed significantly larger effect sizes for studies using clinical samples (d= .61) compared with studies using nonclinical samples (d=.45). Indices of small study bias among the various comparisons suggested varying levels of influence by unpublished findings, ranging from minimal to moderate.

CONCLUSIONS

These results provide strong evidence of greater DRD in individuals exhibiting addictive behavior in general and particularly in individuals who meet criteria for an addictive disorder. Implications for the assessment of DRD and research priorities are discussed.

Lethal forethought: delayed reward discounting differentiates high- and low-lethality suicide attempts in old age

BACKGROUND

The decision to commit suicide may be impulsive, but lethal suicidal acts often involve planning and forethought. People who attempt suicide make disadvantageous decisions in other contexts, but nothing is known about the way they decide about the future. Can the willingness to postpone future gratification differentiate between individuals prone to serious, premeditated and less serious, unplanned suicidal acts?

METHODS

Four groups of depressed participants aged 60 and older made choices between smaller immediate and larger delayed monetary rewards: 15 who had made high-lethality suicide attempts, 14 who had made low-lethality suicide attempts, 12 who seriously contemplated suicide, and 42 people with depression, but no history of suicidal thoughts. The reference group was 31 psychiatrically healthy elders.

RESULTS

Individuals who had made low-lethality attempts displayed an exaggerated preference for immediate rewards compared with nonsuicidal depressed and healthy control subjects. Those who had carried out high-lethality suicide attempts were more willing to delay future rewards, compared with low-lethality attempters. Better planned suicide attempts were also associated with willingness to wait for larger rewards. These effects were unchanged after accounting for education, global cognitive function, substance use disorders, psychotropic medications, and possible brain injury from attempts. Discount rates were correlated with having debt, but were not significantly associated with income, hopelessness, depressive severity, premorbid IQ, age at first attempt, or choice of violent means.

CONCLUSIONS

Although clinicians often focus on impulsivity in patients at risk for suicide, these data suggest that identifying biological characteristics and treatments for nonimpulsive suicidal older people may be even more important.

Striatal hyposensitivity to delayed rewards among cigarette smokers

BACKGROUND

Brain regions that track value (including the ventral striatum) respond more during the anticipation of immediate than delayed rewards, even when the delayed rewards are larger and equally preferred to the immediate. The anticipatory response to immediate vs. delayed rewards has not previously been examined in association with cigarette smoking.

METHODS

Smokers (n=35) and nonsmokers (n=36) performed a modified monetary incentive functional Magnetic Resonance Imaging (fMRI) task (Knutson et al., 2000) that included opportunities to win either immediate or delayed rewards. The delayed rewards were larger and equally preferred to the immediate rewards.

RESULTS

Across groups, greater activation was observed in regions previously shown to track value including bilateral ventral/dorsal striatum during the anticipation of immediate relative to delayed rewards. This effect was significantly greater among smokers than nonsmokers within the right ventral striatum. This group difference was driven particularly by low striatal activation among smokers during delayed reward trials.

CONCLUSIONS

The general tendency for striatal reward anticipatory activity to be attenuated when rewards are delayed is exaggerated among smokers relative to comparison participants. Among possible explanations of this relationship are that (1) low anticipatory response to delayed rewards is a phenotypic risk factor for smoking and (2) smoking-related neuroadaptations result in reduced recruitment during the anticipation of delayed rewards.

Psychometrische Evaluation der deutschen Barratt Impulsiveness Scale – Kurzversion (BIS-15)

Zusammenfassung. Impulsivität ist ein Persönlichkeitsmerkmal, das mit schnellen, unüberlegten Handlungen ohne Beachtung möglicher negativer Konsequenzen einhergeht. Eines der am weitesten verbreiteten Verfahren zur Erfassung von Impulsivität ist die Barratt Impulsiveness Scale (BIS-11; Patton, Stanford & Barratt, 1995 ). Es wurde gezeigt, dass die drei Faktoren nicht-planende, motorische und aufmerksamkeitsbasierte Impulsivität auch ausreichend gut mit einer verkürzten Form der BIS-11 erfasst werden können (BIS-15; Spinella, 2007 ). Die vorliegende Arbeit stellt diese Kurzversion der BIS-11 in einer deutschen Übersetzung vor. Reliabilität und Faktorstruktur des Fragebogens wurden in einer Stichprobe (N = 752) von überwiegend Studierenden getestet. Die dreifaktorielle Struktur von Spinella (2007) konnte bestätigt werden. Die interne Konsistenz war gut (Cronbachs α = .81). In einer zweiten Studie (N = 51) zeigte sich konvergente Validität durch Zusammenhänge mit einem anderen Impulsivitätsmaß (UPPS). Die BIS-15 empfiehlt sich durch ihre guten psychometrischen Kennwerte und ihre ökonomische Durchführbarkeit für die Erfassung von Impulsivität im deutschen Sprachraum.

Does adolescent risk taking imply weak executive function? A prospective study of relations between working memory performance, impulsivity, and risk taking in early adolescence

Studies of brain development suggest that the increase in risk taking observed during adolescence may be due to insufficient prefrontal executive function compared to a more rapidly developing subcortical motivation system. We examined executive function as assessed by working memory ability in a community sample of youth (n = 387, ages 10 to 12 at baseline) in three annual assessments to determine its relation to two forms of impulsivity (sensation seeking and acting without thinking) and a wide range of risk and externalizing behavior. Using structural equation modeling, we tested a model in which differential activation of the dorsal and ventral striatum produces imbalance in the function of these brain regions. For youth high in sensation seeking, both regions were predicted to develop with age. However, for youth high in the tendency to act without thinking, the ventral striatum was expected to dominate. The model predicted that working memory ability would exhibit (1) early weakness in youth high in acting without thinking but (2) growing strength in those high in sensation seeking. In addition, it predicted that (3) acting without thinking would be more strongly related to risk and externalizing behavior than sensation seeking. Finally, it predicted that (4) controlling for acting without thinking, sensation seeking would predict later increases in risky and externalizing behavior. All four of these predictions were confirmed. The results indicate that the rise in sensation seeking that occurs during adolescence is not accompanied by a deficit in executive function and therefore requires different intervention strategies from those for youth whose impulsivity is characterized by early signs of acting without thinking.

Prefrontal cortex and impulsive decision making

Impulsivity refers to a set of heterogeneous behaviors that are tuned suboptimally along certain temporal dimensions. Impulsive intertemporal choice refers to the tendency to forego a large but delayed reward and to seek an inferior but more immediate reward, whereas impulsive motor responses also result when the subjects fail to suppress inappropriate automatic behaviors. In addition, impulsive actions can be produced when too much emphasis is placed on speed rather than accuracy in a wide range of behaviors, including perceptual decision making. Despite this heterogeneous nature, the prefrontal cortex and its connected areas, such as the basal ganglia, play an important role in gating impulsive actions in a variety of behavioral tasks. Here, we describe key features of computations necessary for optimal decision making and how their failures can lead to impulsive behaviors. We also review the recent findings from neuroimaging and single-neuron recording studies on the neural mechanisms related to impulsive behaviors. Converging approaches in economics, psychology, and neuroscience provide a unique vista for better understanding the nature of behavioral impairments associated with impulsivity.

Strain differences in the dose-response relationship for morphine self-administration and impulsive choice between Lewis and Fischer 344 rats

Dose-response studies are thought to be a valuable tool to predict the most genetically drug-vulnerable individuals. However, dose-response curves for morphine self-administration have not yet been examined and nor strain differences might be evident. Therefore, this study aimed to define the dose-response curve for morphine self-administration (0.25, 0.5, 1 and 2 mg/kg) in Lewis (LEW) rats and their histocompatible Fischer-344 (F344) rats. In addition, impulsivity has been suggested as one of the genetic factors contributing most to the initiation of drug use. Therefore, the impulsive choice of both rat strains in the presence or absence of the same morphine doses was also analysed. LEW rats self-administered significantly more morphine whatever the dose tested and they exhibited greater basal impulsive choice compared with F344 rats. The F344 strain showed a preference for the dose of 0.5 mg/kg, while any of the doses used had a differential reinforcing effect in the LEW strain. The basal pattern of strain differences in impulsive choice was not affected by morphine administration. These data suggest that the LEW strain has a highly drug-vulnerable phenotype and they point to the strength of impulsivity as a pre-existing behavioural trait that might make this rat strain more vulnerable to the reinforcing effects of drugs and, therefore, to develop addiction.

Relationship between weight status and delay discounting in a sample of adolescent cigarette smokers

Obesity and cigarette smoking are often cited separately as the top two preventable causes of death in the United States; however, little research has explored the factors associated with being both obese and a smoker. Delay discounting is a behavioral characteristic that may underlie both of these conditions/behaviors. Delay discounting describes the extent to which an individual discounts the value of an outcome because of a delay in its occurrence. Higher rates of discounting are often considered as an index of impulsivity and have been linked with obesity and cigarette smoking. No research to date has explored delay discounting in a sample of obese smokers. For this study, adolescent smokers classified as obese (body mass index >95th percentile) and healthy weight (body mass index between the 5th and 85th percentiles) were compared on a laboratory assessment of delay discounting. Obese smokers discounted significantly more by delay than healthy weight smokers. This difference remained statistically significant even after controlling for demographic variables that differed across groups. These findings suggest that the relationships between delay discounting and obesity and cigarette smoking may be additive, such that extreme discounting might proportionally increase the risk of becoming an obese smoker. However, future prospective study is needed to fully determine the veracity of this hypothesis.

Temporal discounting and heart rate reactivity to stress

Temporal discounting is the reduction of the value of a reinforcer as a function of increasing delay to its presentation. Impulsive individuals discount delayed consequences more rapidly than self-controlled individuals, and impulsivity has been related to substance abuse, gambling, and other problem behaviors. A growing body of literature has identified biological correlates of impulsivity, though little research to date has examined relations between delay discounting and markers of poor health (e.g., cardiovascular reactivity to stress). We evaluated the relation between one aspect of impulsivity, measured using a computerized temporal discounting task, and heart rate reactivity, measured as a change in heart rate from rest during a serial subtraction task. A linear regression showed that individuals who were more reactive to stress responded more impulsively (i.e., discounted delayed reinforcers more rapidly). When results were stratified by gender, the effect was observed for females, but not for males. This finding supports previous research on gender differences in cardiovascular reactivity and suggests that this type of reactivity may be an important correlate of impulsive behavior.

Greater discounting of delayed rewards in young adults with family histories of alcohol and drug use disorders: studies from the Oklahoma family health patterns project

BACKGROUND

Increased discounting of delayed rewards may be a premorbid characteristic and possible risk factor for alcohol and other drug use disorders; however, previous studies have found no or minimal differences in delay discounting in individuals at risk for substance use disorders based on family history. It is possible that increased delay discounting may be more closely associated with antisocial traits, evident in a subset of individuals with positive family histories of alcohol and drug use disorders, and that previous studies were underpowered for detecting subtle to modest overall group differences.

METHODS

In this study, we compared 143 young adults with family histories of alcohol and other drug use disorders (FH+) and 155 young adults with no such histories (FH-) on delay discounting and subsequently examined how delay discounting was related to antisocial traits and other selected psychological and demographic variables.

RESULTS

The FH+ group discounted delayed rewards more than the FH- group. Subsequent analyses revealed that increased delay discounting was correlated with having more parents and grandparents with alcohol and drug use disorders, more antisocial traits, more depressive tendencies and lower IQs, and lower income. After controlling for all these relationships, more antisocial traits and lower IQ still predicted greater delay discounting, and subsequent analysis revealed that the greater delay discounting in the FH+ group was mediated by this group's greater number of individuals with antisocial traits.

CONCLUSION

FH+ individuals who discount delayed rewards more may be at increased risk for developing alcohol and other drug use disorders; however, additional descriptive studies and longitudinal studies are needed.

Regulation of body weight: what is the regulated parameter?

Despite dramatic variations in day to day intake and energy expenditure, weight remains relatively stable in most animals and humans. There are clear physiological responses to over and underfeeding suggesting that the body strives to maintain a constant weight. Despite this, for most humans and experimental animals, there is a tendency for weight to increase slowly over the lifespan. Recent increases in the prevalence of both obesity and anorexia nervosa suggest that factors other than homeostatic physiological mechanisms are important in determining body weight. Clearly reward pathways are activated by palatable food and evidence is emerging that energy balance can modulate these reward pathways and alter the salience of food related stimuli. Significant inhibitory control of reward pathways also comes from a number of brain regions involved in regulation of behavior. Finally there is strong evidence of the important role that social and environmental factors play in modulating both food intake and physical activity behaviors which in turn result in alterations in weight over time. While some aspects of these regulatory systems are within the conscious awareness of people, many, perhaps even most are not. The evidence then would suggest that weight is controlled by several complex regulatory systems that respond to internal metabolic and hormonal signals, hedonic properties of food, internal forces of valuation and self-control, and social factors. Each of these systems is likely 'regulated' and is important in ultimately determining body weight. Experimental paradigms that test one variable in one of these interrelated systems should, where possible control or at least consider the other systems in an effort to provide an integrated picture of weight regulation.

Imagining the future: degraded representations of future rewards and events in schizophrenia

Over the course of life, most people work toward temporally distant rewards such as university degrees or work-related promotions. In contrast, many people with schizophrenia show deficits in behavior oriented toward long-term rewards, although they function adequately when rewards are more immediately present. Moreover, when asked about possible future events, individuals with schizophrenia show foreshortened future time perspectives relative to healthy individuals. Here, we take the view that these deficits are related and can be explained by cognitive deficits. We compared the performance of participants with schizophrenia (n = 39) and healthy participants (n = 25) on tasks measuring reward discounting and future event representations. Consistent with previous research, we found that relative to healthy participants, those with schizophrenia discounted the value of future rewards more steeply. Furthermore, when asked about future events, their responses were biased toward events in the near future, relative to healthy participants' responses. Although discounting and future representations were unrelated in healthy participants, we found significant correlations across the tasks among participants with schizophrenia, as well as correlations with cognitive variables and symptoms. Further analysis showed that statistically controlling working memory eliminated group differences in task performance. Together these results suggest that the motivational deficits characteristic of schizophrenia relate to cognitive deficits affecting the ability to represent and/or evaluate distant outcomes, a finding with important implications for promoting recovery from schizophrenia.

The genetic basis of delay discounting and its genetic relationship to alcohol dependence

Delay discounting is steeper for individuals who drink heavily or are alcohol dependent, but the reasons for this are unclear. Given the substantial genetic component for alcohol dependence it is not unreasonable to ask whether discounting and alcohol dependence have a genetic relationship. For there to be a genetic relationship, delay discounting must have a genetic component (heritability). A review of the human and animal literature suggests that this is the case. Other literature examining whether discounting is a correlated phenotype in individuals who are genetically predisposed to drink (family history positive individuals and selected lines of rats and mice) is mixed, suggesting that networks of genes are critical for the relationship to be seen. The identities of the genes in this network are not yet known, but research examining polymorphisms associated with differences in discounting is beginning to address this issue.

Psychopathic heroin addicts are not uniformly impaired across neurocognitive domains of impulsivity

BACKGROUND

Impulsivity is a hallmark characteristic of drug addiction and a prominent feature of externalizing disorders such as psychopathy that are commonly comorbid with drug addiction. In a previous study (Vassileva et al., 2007) we have shown that psychopathic heroin addicts evidence more impulsive decision-making on the Iowa Gambling Task relative to non-psychopathic heroin addicts. The goal of the current study was to investigate whether the observed impulse-control deficits in psychopathic heroin addicts would generalize to other neurocognitive domains of impulsivity, such as delay discounting and behavioral inhibition among a group of relatively "pure" heroin addicts in Bulgaria who participated in our previous study.

METHODS

We tested 92 currently abstinent male heroin addicts, classified as psychopathic or non-psychopathic based on the Hare Psychopathy Checklist - Revised (PCL-R). We administered two neurocognitive tasks of impulsivity: (1) Delayed Rewards Discounting Task, a measure of temporal discounting of rewards; and (2) Passive Avoidance Learning Task, a measure of behavioral inhibition.

RESULTS

Psychopathic heroin addicts were not impaired relative to non-psychopathic heroin addicts on the Delayed Rewards Discounting Task and the Passive Avoidance Learning Task, on the latter of which they showed better attentional capacity.

CONCLUSIONS

These results indicate that psychopathic heroin users are not uniformly impaired across neurocognitive domains of impulsivity. Combined with our previous findings, results suggest that the presence of psychopathy may exacerbate decision-making deficits in psychopathic heroin addicts, but it may not have significant effect on other neurocognitive domains of impulsivity in this population.

Heritability of delay discounting in adolescence: a longitudinal twin study

Delay discounting (DD) refers to the preference for smaller immediate rewards over larger but delayed rewards, and is considered to be a distinct component of a broader "impulsivity" construct. Although greater propensity for discounting the value of delayed gratification has been associated with a range of problem behaviors and substance abuse, particularly in adolescents, the origins of individual differences in DD remain unclear. We examined genetic and environmental influences on a real-life behavioral measure of DD using a longitudinal twin design. Adolescent participants were asked to choose between a smaller ($7) reward available immediately and a larger ($10) reward to be received in 7 days. Biometrical genetic analysis using linear structural equation modeling showed significant heritability of DD at ages 12 and 14 (30 and 51%, respectively) and suggested that the same genetic factors influenced the trait at both ages. DD was significantly associated with symptoms of conduct disorder, attention deficit hyperactivity disorder, substance use, and with higher novelty seeking and poor self-regulation. This study provides the first evidence for heritability of DD in humans and suggests that DD can be a promising endophenotype for genetic studies of addiction and externalizing disorders.

Neural correlates of choice behavior related to impulsivity and venturesomeness

Impulsivity has been associated with several psychiatric disorders including drug addiction and gambling. Impulsive subjects typically have a preference for short-term over long-term rewards and make risky choices. This study used functional magnetic resonance imaging (fMRI) to investigate the neural correlates of self-rated impulsivity and venturesomeness during tasks involving delayed and risky choice. A broader sampling approach was taken by recruiting participants with behaviors that have been linked to impulsivity (gambling N=15, and recreational drug use N=10) and those without these behaviors (N=9). Selection between delayed or probabilistic rewards was associated with activation in fronto-parietal regions in line with previous research. When selecting between delayed rewards, activity within the pregenual anterior cingulate cortex and ventrolateral prefrontal cortex correlated positively with impulsivity scores while activity within the orbitofrontal cortex, subgenual anterior cingulate cortex and caudate correlated positively with venturesomeness scores. Selection between probabilistic rewards revealed no correlation between scores and regional activations. The results from this study provide targets for future research investigating the neural substrates of impulsivity. They also provide targets for the further investigation into the pathophysiology of addiction and impulse-control disorders.

Discounting of delayed rewards and executive dysfunction in individuals infected with hepatitis C

OBJECTIVE

Determine whether adults with hepatitis C (HCV), regardless of substance use disorder, are more likely to discount delayed rewards than adults without hepatitis C, and explore the relationship between delay discounting and neuropsychological functioning.

METHODS

Procedures included clinical interviews, neuropsychological testing, and a delay discounting task.

RESULTS

Regardless of substance abuse history, adults with hepatitis C were significantly more likely to choose smaller immediate rewards over larger delayed rewards. Delay discounting correlated with performance on executive functioning tasks.

CONCLUSIONS

Increased discounting is associated with broad executive dysfunction, suggesting that HCV-associated executive dysfunction may lead to altered decision-making style.

Remember the future: working memory training decreases delay discounting among stimulant addicts

BACKGROUND

Excessive discounting of future rewards has been observed in a variety of disorders and has been linked both to valuation of the past and to memory of past events.

METHODS

To explore the functionality of discounting and memory, we examined whether training of working memory would result in less discounting of future rewards. In this study, 27 adults in treatment for stimulant use were randomly assigned to receive either working memory training or control training according to a yoked experimental design. Measures of delay discounting and several other cognitive behaviors were assessed pre- and posttraining.

RESULTS

Rates of discounting of delayed rewards were significantly reduced among those who received memory training but were unchanged among those who received control training; other cognitive assessments were not affected by memory training. Discount rates were positively correlated with memory training performance measures.

CONCLUSIONS

To our knowledge, this is the first study demonstrating that neurocognitive training on working memory decreases delay discounting. These results offer further evidence of a functional relationship between delay discounting and working memory.

Dynamics of choice during estimation of subjective value

This study characterized preferential choice in binary trials and investigated intra-session variations in response time (RT). In Experiment 1, participants (N=77) were asked to choose the preferred of two images of body wash; all unique combinations of 19 images were presented. The results showed: (a) marked and consistent individual preferences for specific stimuli; (b) RT decreased monotonically with increasing exposure to each stimulus; (c) RT decreased exponentially as a function of relative preference ranking of the 2 images in a trial; and (d) a regression model efficiently predicted trial RT as a function of exposure and relative preference. Experiment 2 (N=112) explored the effect of amount of exposure on RT, and relative preference as a function of the type of choice task (a previously completed vs. a new choice task). The results showed that: (a) within a single choice task, amount of exposure and relative preference between the stimuli predicted the systematic changes in RT observed in Exp. 1; and (b) when the choice task changed, the effects of previous amount of exposure, and relative stimulus preference did not transfer to the new task.

Maturation of limbic corticostriatal activation and connectivity associated with developmental changes in temporal discounting

Temporal discounting (TD) matures with age, alongside other markers of increased impulse control, and coherent, self-regulated behaviour. Discounting paradigms quantify the ability to refrain from preference of immediate rewards, in favour of delayed, larger rewards. As such, they measure temporal foresight and the ability to delay gratification, functions that develop slowly into adulthood. We investigated the neural maturation that accompanies the previously observed age-related behavioural changes in discounting, from early adolescence into mid-adulthood. We used functional magnetic resonance imaging of a hypothetical discounting task with monetary rewards delayed in the week to year range. We show that age-related reductions in choice impulsivity were associated with changes in activation in ventromedial prefrontal cortex (vmPFC), anterior cingulate cortex (ACC), ventral striatum (VS), insula, inferior temporal gyrus, and posterior parietal cortex. Limbic frontostriatal activation changes were specifically associated with age-dependent reductions in impulsive choice, as part of a more extensive network of brain areas showing age-related changes in activation, including dorsolateral PFC, inferior parietal cortex, and subcortical areas. The maturational pattern of functional connectivity included strengthening in activation coupling between ventromedial and dorsolateral PFC, parietal and insular cortices during selection of delayed alternatives, and between vmPFC and VS during selection of immediate alternatives. We conclude that maturational mechanisms within limbic frontostriatal circuitry underlie the observed post-pubertal reductions in impulsive choice with increasing age, and that this effect is dependent on increased activation coherence within a network of areas associated with discounting behaviour and inter-temporal decision-making.

Heterogeneous coding of temporally discounted values in the dorsal and ventral striatum during intertemporal choice

In choosing between different rewards expected after unequal delays, humans and animals often prefer the smaller but more immediate reward, indicating that the subjective value or utility of reward is depreciated according to its delay. Here, we show that neurons in the primate caudate nucleus and ventral striatum modulate their activity according to temporally discounted values of rewards with a similar time course. However, neurons in the caudate nucleus encoded the difference in the temporally discounted values of the two alternative targets more reliably than neurons in the ventral striatum. In contrast, neurons in the ventral striatum largely encoded the sum of the temporally discounted values, and therefore, the overall goodness of available options. These results suggest a more pivotal role for the dorsal striatum in action selection during intertemporal choice.