Toward a better understanding on the role of prediction error on memory processes: From bench to clinic

Can neutral episodic memories become emotional? Evidence from facial expressions and subjective feelings

Maladaptive emotional memories are a transdiagnostic feature of mental health problems. Therefore, understanding whether and how emotional memories can change might help to prevent and treat mental disorders. We tested whether neutral memories of naturalistic events can retroactively acquire positive or negative affect, in a preregistered three-day Modification of Valence in Episodes (MOVIE) paradigm. On Day 1, participants (N = 41) encoded memories of neutral movie scenes, representing lifelike naturalistic experiences. On Day 2, they retrieved each episode before viewing a happy, sad, or neutral scene from the same movie (yielding a within-subjects design with a neutral-negative, neutral-positive, and neutral-neutral condition). On Day 3, participants again retrieved each memory from Day 1. We assessed the affective tone of episodes through facial expressions of positive and negative affect (using facial electromyography, fEMG) and through self-reported feelings. Positive updating of neutral episodes led to increased expressions of positive affect, whereas negative updating led to increased self-reported negative feelings. These results suggest that complex neutral episodic memories can retroactively acquire an affective tone, but the effects were modest and inconsistent across affect readouts. Future research should investigate alternative approaches to updating emotional memories that produce more profound changes in the valence of memories.

Reward prediction error in learning-related behaviors

Learning is a complex process, during which our opinions and decisions are easily changed due to unexpected information. But the neural mechanism underlying revision and correction during the learning process remains unclear. For decades, prediction error has been regarded as the core of changes to perception in learning, even driving the learning progress. In this article, we reviewed the concept of reward prediction error, and the encoding mechanism of dopaminergic neurons and the related neural circuities. We also discussed the relationship between reward prediction error and learning-related behaviors, including reversal learning. We then demonstrated the evidence of reward prediction error signals in several neurological diseases, including Parkinson's disease and addiction. These observations may help to better understand the regulatory mechanism of reward prediction error in learning-related behaviors.

Injury, illness, and emotion: A review of the motivational continuum from trauma through recovery from an ecological perspective

Image 1.

Sensory suppression and increased neuromodulation during actions disrupt memory encoding of unpredictable self-initiated stimuli

Actions modulate sensory processing by attenuating responses to self- compared to externally generated inputs, which is traditionally attributed to stimulus-specific motor predictions. Yet, suppression has been also found for stimuli merely coinciding with actions, pointing to unspecific processes that may be driven by neuromodulatory systems. Meanwhile, the differential processing for self-generated stimuli raises the possibility of producing effects also on memory for these stimuli; however, evidence remains mixed as to the direction of the effects. Here, we assessed the effects of actions on sensory processing and memory encoding of concomitant, but unpredictable sounds, using a combination of self-generation and memory recognition task concurrently with EEG and pupil recordings. At encoding, subjects performed button presses that half of the time generated a sound (motor-auditory; MA) and listened to passively presented sounds (auditory-only; A). At retrieval, two sounds were presented and participants had to respond which one was present before. We measured memory bias and memory performance by having sequences where either both or only one of the test sounds were presented at encoding, respectively. Results showed worse memory performance - but no differences in memory bias -, attenuated responses, and larger pupil diameter for MA compared to A sounds. Critically, the larger the sensory attenuation and pupil diameter, the worse the memory performance for MA sounds. Nevertheless, sensory attenuation did not correlate with pupil dilation. Collectively, our findings suggest that sensory attenuation and neuromodulatory processes coexist during actions, and both relate to disrupted memory for concurrent, albeit unpredictable sounds.

The evidence for and against reactivation-induced memory updating in humans and nonhuman animals

Systematic investigation of reactivation-induced memory updating began in the 1960s, and a wave of research in this area followed the seminal articulation of "reconsolidation" theory in the early 2000s. Myriad studies indicate that memory reactivation can cause previously consolidated memories to become labile and sensitive to weakening, strengthening, or other forms of modification. However, from its nascent period to the present, the field has been beset by inconsistencies in researchers' abilities to replicate seemingly established effects. Here we review these many studies, synthesizing the human and nonhuman animal literature, and suggest that these failures-to-replicate reflect a highly complex and delicately balanced memory modification system, the substrates of which must be finely tuned to enable adaptive memory updating while limiting maladaptive, inaccurate modifications. A systematic approach to the entire body of evidence, integrating positive and null findings, will yield a comprehensive understanding of the complex and dynamic nature of long-term memory storage and the potential for harnessing modification processes to treat mental disorders driven by pervasive maladaptive memories.

Long-term behavioural rewriting of maladaptive drinking memories via reconsolidation-update mechanisms

BACKGROUND

Alcohol use disorders can be conceptualised as a learned pattern of maladaptive alcohol-consumption behaviours. The memories encoding these behaviours centrally contribute to long-term excessive alcohol consumption and are therefore an important therapeutic target. The transient period of memory instability sparked during memory reconsolidation offers a therapeutic window to directly rewrite these memories using targeted behavioural interventions. However, clinically-relevant demonstrations of the efficacy of this approach are few. We examined key retrieval parameters for destabilising naturalistic drinking memories and the ability of subsequent counterconditioning to effect long-term reductions in drinking.

METHODS

Hazardous/harmful beer-drinking volunteers (N = 120) were factorially randomised to retrieve (RET) or not retrieve (No RET) alcohol reward memories with (PE) or without (No PE) alcohol reward prediction error. All participants subsequently underwent disgust-based counterconditioning of drinking cues. Acute responses to alcohol were assessed pre- and post-manipulation and drinking levels were assessed up to 9 months.

RESULTS

Greater long-term reductions in drinking were found when counterconditioning was conducted following retrieval (with and without PE), despite a lack of short-term group differences in motivational responding to acute alcohol. Large variability in acute levels of learning during counterconditioning was noted. 'Responsiveness' to counterconditioning predicted subsequent responses to acute alcohol in RET + PE only, consistent with reconsolidation-update mechanisms.

CONCLUSIONS

The longevity of behavioural interventions designed to reduce problematic drinking levels may be enhanced by leveraging reconsolidation-update mechanisms to rewrite maladaptive memory. However, inter-individual variability in levels of corrective learning is likely to determine the efficacy of reconsolidation-updating interventions and should be considered when designing and assessing interventions.

Role of prediction error and the cholinergic system on memory reconsolidation processes in mice

The ability to make predictions based on stored information is a general coding strategy. A prediction error (PE) is a mismatch between expected and current events. Our memories, like ourselves, are subject to change. Thus, an acquired memory can become active and update its content or strength by a labilization-reconsolidation process. Within the reconsolidation framework, PE drives the updating of consolidated memories. In the past our lab has made key progresses showing that a blockade in the central cholinergic system during reconsolidation can cause memory impairment, while reinforcement of cholinergic activity enhances it. In the present work we determined that PE is a necessary condition for memory to reconsolidate in an inhibitory avoidance task using both male and female mice. Depending on the intensity of the unconditioned stimulus (US) used during training, a negative (higher US intensity) or positive (lower US intensity/no US) PE on a retrieval session modified the behavioral response on a subsequent testing session. Furthermore, we demonstrated that the cholinergic system modulates memory reconsolidation only when PE is detected. In this scenario administration of oxotremorine, scopolamine or nicotine after memory reactivation either enhanced or impaired memory reconsolidation in a sex-specific manner.

Apparent reconsolidation interference without generalized amnesia

Memories remain dynamic after consolidation, and when reactivated, they can be rendered vulnerable to various pharmacological agents that disrupt the later expression of memory (i.e., amnesia). Such drug-induced post-reactivation amnesia has traditionally been studied in AAA experimental designs, where a memory is initially created for a stimulus A (be it a singular cue or a context) and later reactivated and tested through exposure to the exact same stimulus. Using a contextual fear conditioning procedure in rats and midazolam as amnestic agent, we recently demonstrated that drug-induced amnesia can also be obtained when memories are reactivated through exposure to a generalization stimulus (GS, context B) and later tested for that same generalization stimulus (ABB design). However, this amnestic intervention leaves fear expression intact when at test animals are instead presented with the original training stimulus (ABA design) or a novel generalization stimulus (ABC design). The underlying mechanisms of post-reactivation memory malleability and of MDZ-induced amnesia for a generalization context remain largely unknown. Here, we evaluated whether, like typical CS-mediated (or AAA) post-reactivation amnesia, GS-mediated (ABB) post-reactivation amnesia displays key features of a destabilization-based phenomenon. We first show that ABB post-reactivation amnesia is critically dependent on prediction error at the time of memory reactivation and provide evidence for its temporally graded nature. In line with the known role of GluN2B-NMDA receptor activation in memory destabilization, we further demonstrate that pre-reactivation administration of ifenprodil, a selective antagonist of GluN2B-NMDA receptors, prevents MDZ-induced ABB amnesia. In sum, our data reveal that ABB MDZ-induced post-reactivation amnesia exhibits the hallmark features of a destabilization-dependent phenomenon. Implication of our findings for a reconsolidation-based account of post-reactivation amnesia are discussed.

Generalization and recovery of post-retrieval amnesia

Selective amnesia for previously established memories can be induced by administering drugs that impair protein synthesis shortly after memory reactivation. Competing theoretical accounts attribute this selective post-retrieval amnesia to drug-induced engram degradation (reconsolidation blockade) or to incorporation of sensory features of the reactivation experience into the memory representation, hampering later retrieval in a drug-free state (memory integration). Here we present evidence that critically challenges both accounts. In contextual fear conditioning in rats, we find that amnesia induced by administration of midazolam (MDZ) after reexposure to the training context A generalizes readily to a similar context B. Amnesia is also observed when animals are exposed to the similar context B prior to MDZ administration and later tested for fear to context B but recovers when instead testing for fear to the original training context A or an equally similar but novel context C. Next to their theoretical implications for the nature of forgetting, our findings raise important questions about the viability of reconsolidation-based interventions for the treatment of emotional disorders. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

"Stopping for knowledge": The sense of beauty in the perception-action cycle

According to a millennial-old philosophical debate, aesthetic emotions have been connected to knowledge acquisition. Recent scientific evidence, collected across different disciplinary domains, confirms this link, but also reveals that motor inhibition plays a crucial role in the process. In this review, we discuss multidisciplinary results and propose an original account of aesthetic appreciation (the stopping for knowledge hypothesis) framed within the predictive coding theory. We discuss evidence showing that aesthetic emotions emerge in correspondence with an inhibition of motor behavior (i.e., minimizing action), promoting a simultaneous perceptual processing enhancement, at the level of sensory cortices (i.e., optimizing learning). Accordingly, we suggest that aesthetic appreciation may represent a hedonic feedback over learning progresses, motivating the individual to inhibit motor routines to seek further knowledge acquisition. Furthermore, the neuroimaging and neuropsychological studies we review reveal the presence of a strong association between aesthetic appreciation and the activation of the dopaminergic reward-related circuits. Finally, we propose a number of possible applications of the stopping for knowledge hypothesis in the clinical and education domains.

Generalising reconsolidation: Spatial context and prediction error

Activating a previously consolidated memory trace brings it back into a labile state where it must then undergo a re-stabilisation process known as reconsolidation. During this process memories are susceptible to interference and may be updated with new information. In the studies showing this effect in human episodic memory, the reconsolidation process has been triggered primarily using spatial context or prediction error manipulations to reactivate an established memory. However, these studies have produced conflicting results, showing both that spatial context is necessary and sufficient to trigger reconsolidation and that prediction error is necessary and sufficient to trigger the process. We examined this conflict in two experiments, one investigating the role of context cues and another investigating the role of prediction error. In Experiment 1, spatial context triggered a reconsolidation process and prediction error was irrelevant. In Experiment 2, prediction error triggered reconsolidation, and spatial context cues were irrelevant. These findings replicate prior research but add to the puzzle concerning the roles of these two means of triggering reconsolidation.

Should We Say Goodbye to Latent Constructs to Overcome Replication Crisis or Should We Take Into Account Epistemological Considerations?

This paper discusses theoretical and epistemological problems concerning validity of psychological science in the context of latent constructs. I consider the use of latent constructs as one reason for the replicability crisis. At the moment, there exist different constructs describing the same psychological phenomena side by side, and different psychological phenomena that are reflected by the same latent construct. Hagger called them déjà-variables, which lead to a decreasing validity of measurements and inhibit a deeper understanding of psychological phenomena. To overcome this problem, I suggest a shift of theoretical and epistemological perspective on latent constructs. One main point is the explicit consideration of latent constructs as mental representations, which change objects and are changed by objects via assimilative and accommodative processes. The explicit orientation toward assimilation and accommodation allows the control of normally automatized processes that influence our understanding of psychological phenomena and their corresponding latent constructs. I argue that assimilation and accommodation are part of our research practice anyway and cause the mentioned problems. For example, taking a measurement is an assimilative process, and thus a high measurement error should lead to an increase of accommodative processes. Taking into account these considerations, I suggest consequences for research practices, for individual researchers and for the philosophy of science.

Subanesthetic Dose Ketamine in Posttraumatic Stress Disorder: A Role for Reconsolidation During Trauma-Focused Psychotherapy?

Despite efforts to develop more effective therapies, PTSD remains a difficult disorder to treat. Insight into the dynamic nature of memory formation and its required molecular machinery can provide an opportunity to target pathological memories for emotionally arousing events. As memories become labile upon retrieval, novel information can update the strength and course of these consolidated memories. Targeting the process of reconsolidation may offer a relevant approach to attenuate fearful and traumatic memories. Specific molecular mechanisms that are required for reconsolidation of arousing information include an intact functioning of the glutamatergic signaling pathways and, more specifically, the integrity of NMDA receptors. Ketamine, a noncompetitive NMDA-receptor antagonist, is receiving increasing interest for a variety of psychiatric indications. This compound can also be an interesting candidate for targeting emotional memories. We explore whether single intravenous infusion of a subanesthetic dose of ketamine can be considered as a viable augmentation strategy for trauma-focused psychotherapy in patients with PTSD. As a consequence, a systematic approach is needed to assess the pharmacodynamic effects of ketamine in relation to both psychotherapy and its pharmacokinetics prior to its application in patient populations. By using a "question-based drug development plan," we can explore such aspects for novel drugs, and we formulated five additional topics that need to be addressed concerning the psychotherapeutic approach and phase orientation of pharmacological assisted psychotherapy.

Relevance of ERK1/2 Post-retrieval Participation on Memory Processes: Insights in Their Particular Role on Reconsolidation and Persistence of Memories

Back in 1968, Misanin and his group posited that reactivation of consolidated memories could support changes in that trace, similar to what might happen during the consolidation process. Not until 2000, when Nader et al. (2000) studied the behavioral effect of a protein synthesis inhibitor on retrieved memories, could this previous statement be taken under consideration once again; suggesting that consolidated memories can become labile after reactivation. The process of strengthening after memory labilization was named memory reconsolidation. In recent years, many studies pointed towards a critical participation of the extracellular signal-regulated kinase (ERK)/mitogen activated protein kinases (MAPKs) pathway in different memory processes (e.g., consolidation, extinction, reconsolidation, among others). In this review article, we will focus on how this system might be modulating the processes triggered after retrieval of well-consolidated memories in mice.

Temporal Flexibility of Systems Consolidation and the Synaptic Occupancy/Reset Theory (SORT): Cues About the Nature of the Engram

The ability to adapt to new situations involves behavioral changes expressed either from an innate repertoire, or by acquiring experience through memory consolidation mechanisms, by far a much richer and flexible source of adaptation. Memory formation consists of two interrelated processes that take place at different spatial and temporal scales, Synaptic Consolidation, local plastic changes in the recruited neurons, and Systems Consolidation, a process of gradual reorganization of the explicit/declarative memory trace between hippocampus and the neocortex. In this review, we summarize some converging experimental results from our lab that support a normal temporal framework of memory systems consolidation as measured both from the anatomical and the psychological points of view, and propose a hypothetical model that explains these findings while predicting other phenomena. Then, the same experimental design was repeated interposing additional tasks between the training and the remote test to verify for any interference: we found that (a) when the animals were subject to a succession of new learnings, systems consolidation was accelerated, with the disengagement of the hippocampus taking place before the natural time point of this functional switch, but (b) when a few reactivation sessions reexposed the animal to the training context without the shock, systems consolidation was delayed, with the hippocampus prolonging its involvement in retrieval. We hypothesize that new learning recruits from a fixed number of plastic synapses in the CA1 area to store the engram index, while reconsolidation lead to a different outcome, in which additional synapses are made available. The first situation implies the need of a reset mechanism in order to free synapses needed for further learning, and explains the acceleration observed under intense learning activity, while the delay might be explained by a different process, able to generate extra free synapses: depending on the cognitive demands, it deals either with a fixed or a variable pool of available synapses. The Synaptic Occupancy/Reset Theory (SORT) emerged as an explanation for the temporal flexibility of systems consolidation, to encompass the two different dynamics of explicit memories, as well as to bridge both synaptic and systems consolidation in one single mechanism.

Flexible updating of dynamic knowledge structures

Schemas are knowledge structures that allow us to make efficient judgments about the world without the cost of memorizing every detail of previous experiences. It has long been known that schemas can enhance long-term memory for related information. The usefulness of schemas, however, critically depends on their adaptability: how flexibly a schema can be updated according to changing environmental conditions. Prior consolidation of a schema supports new learning of schema-consistent information. Yet, the effect of consolidation on inconsistent information, and how schemas may be subsequently updated, are not well understood. It is difficult to track the dynamic updating of knowledge structures with traditional memory measures. Here, using a continuous-report paradigm, we were able to show that schematization increases incrementally with consolidation and that the strength with which schemas are initially established predicts schema-guided responding in a later test. Critically, schema updating in response to inconsistent information was more pronounced in a group which was given time to consolidate compared to a group that was not given time to consolidate. Importantly, the later group reverted back to the no longer relevant schema, indicating that systematic bias towards old information, rather than increased forgetting, underlies reduced memory for schema-inconsistent information.