Ventral striatal activity correlates with memory confidence for old- and new-responses in a difficult recognition test

The mesolimbic system and the loss of higher order network features in schizophrenia when learning without reward

Introduction

Schizophrenia is characterized by a loss of network features between cognition and reward sub-circuits (notably involving the mesolimbic system), and this loss may explain deficits in learning and cognition. Learning in schizophrenia has typically been studied with tasks that include reward related contingencies, but recent theoretical models have argued that a loss of network features should be seen even when learning without reward. We tested this model using a learning paradigm that required participants to learn without reward or feedback. We used a novel method for capturing higher order network features, to demonstrate that the mesolimbic system is heavily implicated in the loss of network features in schizophrenia, even when learning without reward.

Methods

fMRI data (Siemens Verio 3T) were acquired in a group of schizophrenia patients and controls (n=78; 46 SCZ, 18 ≤ Age ≤ 50) while participants engaged in associative learning without reward-related contingencies. The task was divided into task-active conditions for encoding (of associations) and cued-retrieval (where the cue was to be used to retrieve the associated memoranda). No feedback was provided during retrieval. From the fMRI time series data, network features were defined as follows: First, for each condition of the task, we estimated 2nd order undirected functional connectivity for each participant (uFC, based on zero lag correlations between all pairs of regions). These conventional 2nd order features represent the task/condition evoked synchronization of activity between pairs of brain regions. Next, in each of the patient and control groups, the statistical relationship between all possible pairs of 2nd order features were computed. These higher order features represent the consistency between all possible pairs of 2nd order features in that group and embed within them the contributions of individual regions to such group structure.

Results

From the identified inter-group differences (SCZ ≠ HC) in higher order features, we quantified the respective contributions of individual brain regions. Two principal effects emerged: 1) SCZ were characterized by a massive loss of higher order features during multiple task conditions (encoding and retrieval of associations). 2) Nodes in the mesolimbic system were over-represented in the loss of higher order features in SCZ, and notably so during retrieval.

Discussion

Our analytical goals were linked to a recent circuit-based integrative model which argued that synergy between learning and reward circuits is lost in schizophrenia. The model's notable prediction was that such a loss would be observed even when patients learned without reward. Our results provide substantial support for these predictions where we observed a loss of network features between the brain's sub-circuits for a) learning (including the hippocampus and prefrontal cortex) and b) reward processing (specifically constituents of the mesolimbic system that included the ventral tegmental area and the nucleus accumbens. Our findings motivate a renewed appraisal of the relationship between reward and cognition in schizophrenia and we discuss their relevance for putative behavioral interventions.

Neural correlates of chocolate brand preference: A functional MRI study

BACKGROUND AND PURPOSE

Preferences can be developed for, or against, specific brands and services. Using two functional magnetic resonance imaging (fMRI) experiments, this study investigated two dissociable aspects of reward processing, craving and liking, in chocolate lovers. The goal was to further delineate the neural basis supporting branding effects using familiar chocolate (FC) and unfamiliar chocolate (UC) brand images.

METHODS

In the first experiment, subjects rated their subjective craving and liking on a scale of 1-5 (weak-strong) for each FC and UC image. In the second experiment, they performed a choice task between FC and UC images.

RESULTS

Both the craving and liking ratings were significantly greater for FC and were differentially correlated with choice behavior. Craving ratings predicted greater preference for UC, and liking ratings predicted greater preference for FC. A contrast of neural activity for UC versus FC choice trials revealed significantly greater activation for UC choices in the bilateral inferior frontal gyrus and right caudate head. Response times for the FC images were faster than UC images; fMRI activity in the ventromedial prefrontal cortex was significantly correlated with response times during FC trials, but not UC trials. These correlations were significantly different from each other at the group level.

CONCLUSIONS

The choices for branded chocolate products are driven by higher subjective reward ratings and lower neural processing demands.

Response-locked theta dissociations reveal potential feedback signal following successful retrieval

Successful memory retrieval relies on memory processes to access an internal representation and decision processes to evaluate and respond to the accessed representation, both of which are supported by fluctuations in theta (4-8 Hz) activity. However, the extent to which decision-making processes are engaged following a memory response is unclear. Here, we recorded scalp electroencephalography (EEG) while human participants performed a recognition memory task. We focused on response-locked data, allowing us to investigate the processes that occur prior to and following a memory response. We replicate previous work and find that prior to a memory response theta power is greater for identification of previously studied items (hits) relative to rejection of novel lures (correct rejections; CRs). Following the memory response, the theta power dissociation "flips" whereby theta power is greater for CRs relative to hits. We find that the post-response "flip" is more robust for hits that are committed quickly, potentially reflecting a positive feedback signal for strongly remembered experiences. Our findings suggest that there are potentially distinct processes occurring before and after a memory response that are modulated by successful memory retrieval.

Patterns of retrieval-related cortico-striatal connectivity are stable across the adult lifespan

Memory retrieval effects in the striatum are well documented and robust across experimental paradigms. However, the functional significance of these effects, and whether they are moderated by age, remains unclear. We used functional magnetic resonance imaging paired with an associative recognition task to examine retrieval effects in the striatum in a sample of healthy young, middle-aged, and older adults. We identified anatomically segregated patterns of enhanced striatal blood oxygen level-dependent (BOLD) activity during recollection- and familiarity-based memory judgments. Successful recollection was associated with enhanced BOLD activity in bilateral putamen and nucleus accumbens, and neither of these effects were reliably moderated by age. Familiarity effects were evident in the head of the caudate nucleus bilaterally, and these effects were attenuated in middle-aged and older adults. Using psychophysiological interaction analyses, we observed a monitoring-related increase in functional connectivity between the caudate and regions of the frontoparietal control network, and between the putamen and bilateral retrosplenial cortex and intraparietal sulcus. In all instances, monitoring-related increases in cortico-striatal connectivity were unmoderated by age. These results suggest that the striatum, and the caudate in particular, couples with the frontoparietal control network to support top-down retrieval-monitoring operations, and that the strength of these inter-regional interactions is preserved in later life.

Automatic and effortful control of interference in working memory can be distinguished by unique behavioral and functional brain representations

Goal-irrelevant information in working memory (WM) may enter the focus of attention (FOA) during a task and cause proactive interference (PI). In the current study we used fMRI to test several hypotheses concerning the boundary conditions of PI in WM using a modified verbal 2-back task. Temporal distance between item and lure presentation was manipulated to evaluate potential differences among hypothesized states of FOA, short-term memory and long-term memory. PI was present for the most proximal 3-back lures but dissipated with lure distance along with increased activation in brain regions critical for memory recollection, such as right prefrontal cortex, parietal cortex, and hippocampus. Reduced PI and less IFG activation were also observed after repeated item presentation, supporting the notion that a rehearsed encoding of item-context information reduces the need for interference control. Moreover, a trial-by-trial approach revealed activity in ACC, insula, IFG, and parietal cortex with increasing lure trial interference regardless of distance. The current results are first evidence for an observable transition of cognitive control, to include MTL regions involved in recalling task-relevant information from outside the FOA when resolving PI in WM.

Cognitive and neural principles of a memory bias on preferential choices

Value-based decisions depend on different forms of memory. However, the respective roles of memory and valuation processes that give rise to these decisions are often vaguely described and have rarely been investigated jointly. In this review article, we address the problem of memory-based decision making from a neuroeconomic perspective. We first describe the neural and cognitive processes involved in decisions requiring memory processes, with a focus on episodic memory. Based on the results of a systematic research program, we then spotlight the phenomenon of the memory bias, a general preference for choice options that can be retrieved from episodic memory more successfully. Our findings indicate that failed memory recall biases neural valuation processes as indicated by altered effective connectivity between the hippocampus and ventromedial prefrontal cortex. This bias can be attributed to meta-cognitive beliefs about the relationship between subjective value and memory as well as to uncertainty aversion. After summarizing the findings, we outline potential future research endeavors to integrate the two research traditions of memory and decision making.

Neural Systems for Memory-based Value Judgment and Decision-making

Real-life choices often require that we draw inferences about the value of options based on structured, schematic knowledge about their utility for our current goals. Other times, value information may be retrieved directly from a specific prior experience with an option. In an fMRI experiment, we investigated the neural systems involved in retrieving and assessing information from different memory sources to support value-based choice. Participants completed a task in which items could be conferred positive or negative value based on schematic associations (i.e., schema value) or learned directly from experience via deterministic feedback (i.e., experienced value). We found that ventromedial pFC (vmPFC) activity correlated with the influence of both experience- and schema-based values on participants' decisions. Connectivity between the vmPFC and middle temporal cortex also tracked the inferred value of items based on schematic associations on the first presentation of ingredients, before any feedback. In contrast, the striatum responded to participants' willingness to bet on ingredients as a function of the unsigned strength of their memory for those options' values. These results argue that the striatum and vmPFC play distinct roles in memory-based value judgment and decision-making. Specifically, the vmPFC assesses the value of options based on information inferred from schematic knowledge and retrieved from prior direct experience, whereas the striatum controls a decision to act on options based on memory strength.

Dopamine Enhances Item Novelty Detection via Hippocampal and Associative Recall via Left Lateral Prefrontal Cortex Mechanisms

The involvement of fronto-striatal circuits in item and associative memory retrieval as well as in the stabilization of memories by retrieval practice suggests that both retrieval and re-encoding of stored memories might rely on dopaminergic mechanisms in humans. We tested these hypotheses in a placebo-controlled pharmacological fMRI study using 2 mg of the D2 antagonist haloperidol administered acutely before a cued associative recall task of previously encoded picture-word pairs in 53 healthy humans of both sexes. The cued associative recall was moreover repeated 3 d later outside the scanner without pharmacological intervention. Dopaminergic modulation significantly improved associative recall performance and recognition accuracy of verbal items. Moreover, we observed a significant dopamine effect on re-encoding in terms of increased specificity of associative memories from the first to the second cued associative recall. Better association memory under haloperidol was linked with higher activity in the left lateral prefrontal cortex and right parietal cortex, suggesting that dopamine facilitates associative retrieval through increased recruitment of frontoparietal monitoring processes. In contrast, improved recognition of verbal items under haloperidol was reflected by enhanced novelty detection in the hippocampus and increased activity in saliency networks. Together, these results show distinct but concomitant positive effects of dopamine on associative recall and item recognition and suggest that the specificity of associative recall through re-encoding mechanisms is likewise augmented by dopamine.SIGNIFICANCE STATEMENT Although the neurotransmitter dopamine has been linked with learning and memory for a long time, dopaminergic effects on item recognition in humans were demonstrated only recently. The involvement of fronto-striatal monitoring processes in association retrieval suggests that associative memory might be particularly affected by dopamine. Moreover, fronto-striatal dopaminergic signals have been hypothesized to determine the updating and re-encoding of previously retrieved memories. We here demonstrate clear facilitative effects of dopamine on associative recall and item recognition mediated by prefrontal and hippocampal mechanisms respectively. Additionally, effects on re-encoding were reflected by increased specificity of associative memories. These results augment our understanding of dopaminergic processes in episodic memory retrieval and offer new perspectives on memory impairments in dopamine-related disorders and their treatment.

Dopamine is a double-edged sword: dopaminergic modulation enhances memory retrieval performance but impairs metacognition

While memory encoding and consolidation processes have been linked with dopaminergic signaling for a long time, the role of dopamine in episodic memory retrieval remained mostly unexplored. Based on previous observations of striatal activity during memory retrieval, we used pharmacological functional magnetic resonance imaging to investigate the effects of dopamine on retrieval performance and metacognitive memory confidence in healthy humans. Dopaminergic modulation by the D2 antagonist haloperidol administered acutely during the retrieval phase improved recognition accuracy of previously learned pictures significantly and was associated with increased activity in the substantia nigra/ventral tegmental area, locus coeruleus, hippocampus, and amygdala during retrieval. In contrast, confidence for new decisions was impaired by unsystematically increased activity of the striatum across confidence levels and restricted range of responsiveness in frontostriatal networks under haloperidol. These findings offer new insights into the mechanisms underlying memory retrieval and metacognition and provide a broader perspective on the presence of memory problems in dopamine-related diseases and the treatment of memory disorders.

Enhanced transformation of incidentally learned knowledge into explicit memory by dopaminergic modulation

During incidental learning statistical regularities are extracted from the environment without the intention to learn. Acquired implicit memory of these regularities can affect behavior in the absence of awareness. However, conscious insight in the underlying regularities can also develop during learning. Such emergence of explicit memory is an important learning mechanism that is assumed to involve prediction errors in the striatum and to be dopamine-dependent. Here we directly tested this hypothesis by manipulating dopamine levels during incidental learning in a modified serial reaction time task (SRTT) featuring a hidden regular sequence of motor responses in a placebo-controlled between-group study. Awareness for the sequential regularity was subsequently assessed using cued generation and additionally verified using free recall. The results demonstrated that dopaminergic modulation nearly doubled the amount of explicit sequence knowledge emerged during learning in comparison to the placebo group. This strong effect clearly argues for a causal role of dopamine-dependent processing for the development of awareness for sequential regularities during learning.

[Independence of old and new item processing in recognition judgment]

This study investigated the independence of old and new item processing in recognition judgment. Conventional recognition studies have focused on the “memory” aspects of recognition judgment, while new item processing has been treated as a “residual response” of old item processing. However, prior studies on confidence ratings and the brain research suggest the possibility that old and new items are independently processed. This study conducted recognition judgment tests with the number of learned items as independent variables, and response times for four answer categories (hit, miss, correct rejection, and false alarm) as dependent variables. Hit response times were consistently shorter than misses for all old items, while correct rejection (CR) and false alarm (FA) response times approached equivalence (CR = FA) for new items as the number of old (memorized) items increased. These results suggest that recognition judgment changes according to the number of old (memorized) items. We discuss the idea that new item and old item processing in recognition judgment occur independently.

Dissociation between the neural correlates of recollection and familiarity in the striatum and hippocampus: Across-study convergence

In tests of recognition memory, neural activity in the striatum has consistently been reported to differ according to the study status of the test item. A full understanding of the functional significance of striatal 'retrieval success' effects is impeded by a paucity of evidence concerning whether the effects differ according to the nature of the memory signal supporting the recognition judgment (recollection vs. familiarity). Here, we address this issue through an analysis of retrieval-related striatal activity in three independent fMRI studies (total N = 88). Recollection and familiarity were operationalized in a different way in each study, allowing the identification of test-independent, generic recollection- and familiarity-related effects. While activity in a bilateral dorsal striatal region, mainly encompassing the caudate nucleus, was enhanced equally by recollected and 'familiar only' test items, activity in bilateral ventral striatum and adjacent subgenual frontal cortex was enhanced only in response to items that elicited successful recollection. By contrast, relative to familiar items, activity in anterior hippocampus was enhanced for both recollected and novel test items. Thus, recollection- and familiarity-driven recognition memory judgments are associated with anatomically distinct patterns of retrieval-related striatal activity, and these patterns are at least partially independent of recollection and novelty effects in the hippocampus.

Uncertainty-dependent activity within the ventral striatum predicts task-related changes in response strategy

Recent neuroimaging work has demonstrated that the ventral striatum (VS) encodes confidence in perceptual decisions. However, it remains unclear whether perceptual uncertainty can signal the need to adapt behavior (such as by responding more cautiously) and whether such behavioral changes are related to uncertainty-dependent activity within the VS. Changes in response strategy have previously been observed following errors and are associated with both medial frontal cortex (MFC) and VS, two components of the performance-monitoring network. If uncertainty can elicit changes in response strategy (slowing), then one might hypothesize that these changes rely on the performance-monitoring network. In the present study, we investigated the link between perceptual uncertainty and task-related behavioral adaptations (response slowing and accuracy increases), as well as how such behavioral changes relate to uncertainty-dependent activity within MFC and VS. Our participants performed a two-choice perceptual decision-making task in which perceptual uncertainty was reported on each trial while behavioral and event-related functional magnetic resonance imaging data were collected. Analysis of the behavioral data revealed that uncertain (but correct) responses led to slowing on subsequent trials, a phenomenon that was positively correlated with increased accuracy. Critically, post-uncertainty slowing was negatively correlated with the VS activity elicited by uncertain responses. In agreement with previous reports, increases in MFC activation were observed for uncertain responses, although MFC activity was not correlated with post-uncertainty slowing. These results suggest that perceptual uncertainty can serve as a signal to adapt one's response strategy and that such behavioral changes are closely tied to the VS, a key node in the performance-monitoring network.

Striatal prediction errors support dynamic control of declarative memory decisions

Adaptive memory requires context-dependent control over how information is retrieved, evaluated and used to guide action, yet the signals that drive adjustments to memory decisions remain unknown. Here we show that prediction errors (PEs) coded by the striatum support control over memory decisions. Human participants completed a recognition memory test that incorporated biased feedback to influence participants' recognition criterion. Using model-based fMRI, we find that PEs-the deviation between the outcome and expected value of a memory decision-correlate with striatal activity and predict individuals' final criterion. Importantly, the striatal PEs are scaled relative to memory strength rather than the expected trial outcome. Follow-up experiments show that the learned recognition criterion transfers to free recall, and targeting biased feedback to experimentally manipulate the magnitude of PEs influences criterion consistent with PEs scaled relative to memory strength. This provides convergent evidence that declarative memory decisions can be regulated via striatally mediated reinforcement learning signals.

Reactivation of Reward-Related Patterns from Single Past Episodes Supports Memory-Based Decision Making

Rewarding experiences exert a strong influence on later decision making. While decades of neuroscience research have shown how reinforcement gradually shapes preferences, decisions are often influenced by single past experiences. Surprisingly, relatively little is known about the influence of single learning episodes. Although recent work has proposed a role for episodes in decision making, it is largely unknown whether and how episodic experiences contribute to value-based decision making and how the values of single episodes are represented in the brain. In multiple behavioral experiments and an fMRI experiment, we tested whether and how rewarding episodes could support later decision making. Participants experienced episodes of high reward or low reward in conjunction with incidental, trial-unique neutral pictures. In a surprise test phase, we found that participants could indeed remember the associated level of reward, as evidenced by accurate source memory for value and preferences to re-engage with rewarded objects. Further, in a separate experiment, we found that high-reward objects shown as primes before a gambling task increased financial risk taking. Neurally, re-exposure to objects in the test phase led to significant reactivation of reward-related patterns. Importantly, individual variability in the strength of reactivation predicted value memory performance. Our results provide a novel demonstration that affect-related neural patterns are reactivated during later experience. Reactivation of value information represents a mechanism by which memory can guide decision making.

Mesolimbic confidence signals guide perceptual learning in the absence of external feedback

It is well established that learning can occur without external feedback, yet normative reinforcement learning theories have difficulties explaining such instances of learning. Here, we propose that human observers are capable of generating their own feedback signals by monitoring internal decision variables. We investigated this hypothesis in a visual perceptual learning task using fMRI and confidence reports as a measure for this monitoring process. Employing a novel computational model in which learning is guided by confidence-based reinforcement signals, we found that mesolimbic brain areas encoded both anticipation and prediction error of confidence—in remarkable similarity to previous findings for external reward-based feedback. We demonstrate that the model accounts for choice and confidence reports and show that the mesolimbic confidence prediction error modulation derived through the model predicts individual learning success. These results provide a mechanistic neurobiological explanation for learning without external feedback by augmenting reinforcement models with confidence-based feedback.

DOI:http://dx.doi.org/10.7554/eLife.13388.001

Much of our behavior is shaped by feedback from the environment. We repeat behaviors that previously led to rewards and avoid those with negative outcomes. At the same time, we can learn in many situations without such feedback. Our ability to perceive sensory stimuli, for example, improves with training even in the absence of external feedback.

Guggenmos et al. hypothesized that this form of perceptual learning may be guided by self-generated feedback that is based on the confidence in our performance. The general idea is that the brain reinforces behaviors associated with states of high confidence, and weakens behaviors that lead to low confidence.

To test this idea, Guggenmos et al. used a technique called functional magnetic resonance imaging to record the brain activity of healthy volunteers as they performed a visual learning task. In this task, the participants had to judge the orientation of barely visible line gratings and then state how confident they were in their decisions.

Feedback signals derived from the participants’ confidence reports activated the same brain areas typically engaged for external feedback or reward. Moreover, just as these regions were previously found to signal the difference between actual and expected rewards, so did they signal the difference between actual confidence levels and those expected on the basis of previous confidence levels. This parallel suggests that confidence may take over the role of external feedback in cases where no such feedback is available. Finally, the extent to which an individual exhibited these signals predicted overall learning success.

Future studies could investigate whether these confidence signals are automatically generated, or whether they only emerge when participants are required to report their confidence levels. Another open question is whether such self-generated feedback applies in non-perceptual forms of learning, where learning without feedback has likewise been a long-standing puzzle.

DOI:http://dx.doi.org/10.7554/eLife.13388.002

An fMRI study investigating effects of conceptually related sentences on the perception of degraded speech

Prior research has shown that the perception of degraded speech is influenced by within sentence meaning and recruits one or more components of a frontal-temporal-parietal network. The goal of the current study is to examine whether the overall conceptual meaning of a sentence, made up of one set of words, influences the perception of a second acoustically degraded sentence, made up of a different set of words. Using functional magnetic resonance imaging (fMRI), we presented an acoustically clear sentence followed by an acoustically degraded sentence and manipulated the semantic relationship between them: Related in meaning (but consisting of different content words), Unrelated in meaning, or Same. Results showed that listeners' word recognition accuracy for the acoustically degraded sentences was significantly higher when the target sentence was preceded by a conceptually related compared to a conceptually unrelated sentence. Sensitivity to conceptual relationships was associated with enhanced activity in middle and inferior frontal, temporal, and parietal areas. In addition, the left middle frontal gyrus (LMFG), left inferior frontal gyrus (LIFG), and left middle temporal gyrus (LMTG) showed activity that correlated with individual performance on the Related condition. The superior temporal gyrus (STG) showed increased activation in the Same condition suggesting that it is sensitive to perceptual similarity rather than the integration of meaning between the sentence pairs. A fronto-temporo-parietal network appears to consolidate information sources across multiple levels of language (acoustic, lexical, syntactic, semantic) to build, and ultimately integrate conceptual information across sentences and facilitate the perception of a degraded speech signal. However, the nature of the sources of information that are available differentially recruit specific regions and modulate their activity within this network. Implications of these findings for the functional architecture of the network are considered.

Dopamine effects on evidence gathering and integration

BACKGROUND

Disturbances in evidence gathering and disconfirmatory evidence integration have been associated with the presence of or propensity for delusions. Previous evidence suggests that these 2 types of reasoning bias might be differentially affected by antipsychotic medication. We aimed to investigate the effects of a dopaminergic agonist (L-dopa) and a dopaminergic antagonist (haloperidol) on evidence gathering and disconfirmatory evidence integration after single-dose administration in healthy individuals.

METHODS

The study used a randomized, double-blind, placebo-controlled, 3-way crossover design. Participants were healthy individuals aged 18-40 years. We administered a new data-gathering task designed to increase sensitivity to change compared with traditional tasks. The Bias Against Disconfirmatory Evidence (BADE) task was used as a measure of disconfirmatory evidence integration.

RESULTS

We included 30 individuals in our study. In the data-gathering task, dopaminergic modulation had no significant effect on the amount of evidence gathered before reaching a decision. In contrast, the ability of participants to integrate disconfirmatory evidence showed a significant linear dopaminergic modulation pattern (highest with haloperidol, intermediate with placebo, lowest with L-dopa), with the difference between haloperidol and L-dopa marginally reaching significance.

LIMITATIONS

Although the doses used for haloperidol and L-dopa were similar to those used in previous studies, drug plasma level measurements would have added to the validity of findings.

CONCLUSION

Evidence gathering and disconfirmatory evidence integration might be differentially influenced by dopaminergic agents. Our findings are in support of a dual-disturbance account of delusions and provide a plausible neurobiological basis for the use of interventions targeted at improving reasoning biases as an adjunctive treatment in patients with psychotic disorders.

A task-independent neural representation of subjective certainty in visual perception

Am I really sure? This is a question not only scientists ask themselves but practically everybody every day. A recent study provides behavioral evidence supporting the view that one’s subjective confidence in a decision (i.e., feeling sure that a decision is correct) is represented in a task-independent format. Previous neuroimaging studies identified neural correlates of decision confidence but whether or not these are task-dependent remains unclear. Here, combining two perceptual decision tasks with functional magnetic resonance imaging (fMRI), we provide neural evidence for a task-independent representation of degrees of subjective certainty (i.e., a neural representation of subjective certainty that remains constant across two visual tasks). Importantly, due to the constant stimulus-intensity used this result is independent of task-difficulty and stimulus properties. Our data provide strong evidence for a generic mechanism underlying the computation of subjective perceptual certainty in vision.

Automatic integration of confidence in the brain valuation signal

A key process in decision-making is estimating the value of possible outcomes. Growing evidence suggests that different types of values are automatically encoded in the ventromedial prefrontal cortex (VMPFC). Here we extend this idea by suggesting that any overt judgment is accompanied by a second-order valuation (a confidence estimate), which is also automatically incorporated in VMPFC activity. In accordance with the predictions of our normative model of rating tasks, two behavioral experiments showed that confidence levels were quadratically related to first-order judgments (age, value or probability ratings). The analysis of three functional magnetic resonance imaging data sets using similar rating tasks confirmed that the quadratic extension of first-order ratings (our proxy for confidence) was encoded in VMPFC activity, even if no confidence judgment was required of the participants. Such an automatic aggregation of value and confidence in a same brain region might provide insight into many distortions of judgment and choice.

Goal- and retrieval-dependent activity in the striatum during memory recognition

The striatum has been associated with successful memory retrieval but the precise functional link still remains unclear. One hypothesis is that striatal activity reflects an active evaluation process of the retrieval outcome dependent on the current behavioral goals rather than being a consequence of memory reactivation. We have recently shown that the striatum also correlates with confidence in memory recognition, which could reflect high subjective value ascribed to high certainty decisions. To examine whether striatal activity during memory recognition reflects subjective value indeed, we conducted an fMRI study using a recognition memory paradigm in which the participants rated not only the recognition confidence but also indicated the pleasantness associated with the previous memory retrieval. The results demonstrated a high positive correlation between confidence and pleasantness both on the behavioral and brain activation level particularly in the striatum. As almost all of variance in the striatal confidence signal could be explained by experienced pleasantness, this part of the striatal memory recognition response probably corresponds to greater subjective value of high confidence responses. While perceived oldness was also strongly correlated with striatal activity, this activation pattern was clearly distinct from that associated with confidence and pleasantness and thus could not be explained by higher subjective value to detect "old" items. Together, these results show that at least two independent processes contribute to striatal activation in recognition memory: a more flexible evaluation response dependent on context and goals captured by memory confidence and a potentially retrieval-related response captured by perceived oldness.

Motivated Memories: Effects of Reward and Recollection in the Core Recollection Network and Beyond

fMRI was employed to assess whether the neural correlates of accurate source memory are modulated by the reward value of recollected information. Study items comprised pictures of objects, each paired with a depiction of 1 of 2 coins. The reward value of the coins ($2.00 vs. $0.02) was disclosed after study. At test, a source memory procedure was employed in which subjects discriminated between studied and unstudied objects and, for objects judged studied, indicated the identity of the coin paired with the object at study. Correct judgments earned a reward corresponding to the value of the coin, whereas incorrect judgments were penalized. No regions were identified where the magnitude of recollection effects was modulated by reward. Exclusive effects of source accuracy were evident in the hippocampus. Different striatal sub-regions demonstrated exclusive recollection effects, exclusive reward effects, and overlap between the 2 effects. The left angular gyrus and medial prefrontal cortex were additively responsive to source accuracy and the reward. The findings suggest that reward value and recollection success are conjointly but independently represented in at least 2 cortical regions and that striatal retrieval success effects cannot be accounted for in terms of a single construct, such as goal satisfaction.

Increased functional connectivity between dorsal posterior parietal and ventral occipitotemporal cortex during uncertain memory decisions

Retrieval of episodic memories is a multi-component act that relies on numerous operations ranging from processing the retrieval cue, evaluating retrieved information, and selecting the appropriate response given the demands of the task. Motivated by a rich functional neuroimaging literature, recent theorizing about various computations at retrieval has focused on the role of posterior parietal cortex (PPC). In a potentially promising line of research, recent neuroimaging findings suggest that different subregions of dorsal PPC respond distinctly to different aspects of retrieval decisions, suggesting that better understanding of their contributions might shed light on the component processes of retrieval. In an attempt to understand the basic operations performed by dorsal PPC, we used functional MRI and functional connectivity analyses to examine how activation in, and connectivity between, dorsal PPC and ventral temporal regions representing retrieval cues varies as a function of retrieval decision uncertainty. Specifically, participants made a five-point recognition confidence judgment for a series of old and new visually presented words. Consistent with prior studies, memory-related activity patterns dissociated across left dorsal PPC subregions, with activity in the lateral IPS tracking the degree to which participants perceived an item to be old, whereas activity in the SPL increased as a function of decision uncertainty. Importantly, whole-brain functional connectivity analyses further revealed that SPL activity was more strongly correlated with that in the visual word-form area during uncertain relative to certain decisions. These data suggest that the involvement of SPL during episodic retrieval reflects, at least in part, the processing of the retrieval cue, perhaps in service of attempts to increase the mnemonic evidence elicited by the cue.

Ventral striatum and the evaluation of memory retrieval strategies

Adaptive memory retrieval requires mechanisms of cognitive control that facilitate the recovery of goal-relevant information. Frontoparietal systems are known to support control of memory retrieval. However, the mechanisms by which the brain acquires, evaluates, and adapts retrieval strategies remain unknown. Here, we provide evidence that ventral striatal activation tracks the success of a retrieval strategy and correlates with subsequent reliance on that strategy. Human participants were scanned with fMRI while performing a lexical decision task. A rule was provided that indicated the likely semantic category of a target word given the category of a preceding prime. Reliance on the rule improved decision-making, as estimated within a drift diffusion framework. Ventral striatal activation tracked the benefit that relying on the rule had on decision-making. Moreover, activation in ventral striatum correlated with a participant's subsequent reliance on the rule. Taken together, these results support a role for ventral striatum in learning and evaluating declarative retrieval strategies.

Decision making as a window on cognition

A decision is a commitment to a proposition or plan of action based on information and values associated with the possible outcomes. The process operates in a flexible timeframe that is free from the immediacy of evidence acquisition and the real time demands of action itself. Thus, it involves deliberation, planning, and strategizing. This Perspective focuses on perceptual decision making in nonhuman primates and the discovery of neural mechanisms that support accuracy, speed, and confidence in a decision. We suggest that these mechanisms expose principles of cognitive function in general, and we speculate about the challenges and directions before the field.

Ventral fronto-temporal pathway supporting cognitive control of episodic memory retrieval

Achieving our goals often requires guiding access to relevant information from memory. Such goal-directed retrieval requires interactions between systems supporting cognitive control, including ventrolateral prefrontal cortex (VLPFC), and those supporting declarative memory, such as the medial temporal lobes (MTL). However, the pathways by which VLPFC interacts with MTL during retrieval are underspecified. Prior neuroanatomical evidence suggests that a polysynaptic ventral fronto-temporal pathway may support VLPFC-MTL interactions. To test this hypothesis, human participants were scanned using fMRI during performance of a source-monitoring task. The strength of source information was varied via repetition during encoding. Single encoding events should produce a weaker memory trace, thus recovering source information about these items should demand greater cognitive control. Results demonstrated that cortical targets along the ventral path--anterior VLPFC, temporal pole, anterior parahippocampus, and hippocampus--exhibited increases in univariate BOLD response correlated with increases in controlled retrieval demand, independent of factors related to response selection. Further, a functional connectivity analysis indicated that these regions functionally couple and are distinguishable from a dorsal pathway related to response selection demands. These data support a ventral retrieval pathway linking PFC and MTL.