Understanding Consolidation through the Architecture of Memories

Memory consolidation of sequence learning and dynamic adaptation during wakefulness

Motor learning involves acquiring new movement sequences and adapting motor commands to novel conditions. Labile motor memories, acquired through sequence learning and dynamic adaptation, undergo a consolidation process during wakefulness after initial training. This process stabilizes the new memories, leading to long-term memory formation. However, it remains unclear if the consolidation processes underlying sequence learning and dynamic adaptation are independent and if distinct neural regions underpin memory consolidation associated with sequence learning and dynamic adaptation. Here, we first demonstrated that the initially labile memories formed during sequence learning and dynamic adaptation were stabilized against interference through time-dependent consolidation processes occurring during wakefulness. Furthermore, we found that sequence learning memory was not disrupted when immediately followed by dynamic adaptation and vice versa, indicating distinct mechanisms for sequence learning and dynamic adaptation consolidation. Finally, by applying patterned transcranial magnetic stimulation to selectively disrupt the activity in the primary motor (M1) or sensory (S1) cortices immediately after sequence learning or dynamic adaptation, we found that sequence learning consolidation depended on M1 but not S1, while dynamic adaptation consolidation relied on S1 but not M1. For the first time in a single experimental framework, this study revealed distinct neural underpinnings for sequence learning and dynamic adaptation consolidation during wakefulness, with significant implications for motor skill enhancement and rehabilitation.

Memory decay and generalization following distinct motor learning mechanisms

Motor skill learning is considered to arise out of contributions from multiple learning mechanisms, including error-based learning (EBL), use-dependent learning (UDL), and reinforcement learning (RL). These learning mechanisms exhibit dissociable roles and engage different neural circuits during skill acquisition. However, it remains largely unknown how a newly formed motor memory acquired through each learning mechanism decays over time and whether distinct learning mechanisms produce different generalization patterns. Here, we used variants of reaching paradigms that dissociated these learning mechanisms to examine the time course of memory decay following each learning and the generalization patterns of each learning. We found that motor memories acquired through these learning mechanisms decayed as a function of time. Notably, 15 min, 6 h, and 24 h after acquisition, the memory of EBL decayed much greater than that of RL. The memory acquired through UDL faded away within a few minutes. Motor memories formed through EBL and RL for given movement directions generalized to untrained movement directions, with the generalization of EBL being greater than that of RL. In contrast, motor memory of UDL could not generalize to untrained movement directions. These results suggest that distinct learning mechanisms exhibit different patterns of memory decay and generalization.NEW & NOTEWORTHY Motor skill learning is likely to involve error-based learning, use-dependent plasticity, and operant reinforcement. Here, we showed that these dissociable learning mechanisms exhibited distinct patterns of memory decay and generalization. With a better understanding of the characteristics of these learning mechanisms, it becomes possible to regulate each learning process separately to improve neurological rehabilitation.

Wearable Real-Time Haptic Biofeedback Foot Progression Angle Gait Modification to Assess Short-Term Retention and Cognitive Demand

Foot progression angle gait (FPA) modification is an important part of rehabilitation for a variety of neuromuscular and musculoskeletal diseases. While wearable haptic biofeedback could enable FPA gait modification for more widespread use than traditional tethered, laboratory-based approaches, retention, and cognitive demand in FPA gait modification via wearable haptic biofeedback are currently unknown and may be important to real-life implementation. Thus, the purpose of this study was to assess the feasibility of wearable haptic biofeedback to assess short-term retention and cognitive demand during FPA gait modification. Ten healthy participants performed toe-in (target 10 degrees change in internal rotation) and toe-out (target 10 degrees change in external rotation) haptic gait training trials followed by short-term retention trials, and cognitive multitasking trials. Results showed that participants were able to initially respond to the wearable haptic feedback to modify their FPA to adopt the new toe-in (9.7 ± 0.8 degree change in internal rotation) and toe-out (8.9 ± 1.0 degree change in external rotation) gait patterns. Participants retained the modified gait pattern on average within 3.9 ± 3.6 deg of the final haptic gait training FPA values. Furthermore, cognitive multitasking did not influence short-term retention in that there were no differences in gait performance during retention trials with or without cognitive multitasking. These results demonstrate that wearable haptic biofeedback can be used to assess short-term retention and cognitive demand during FPA gait modification without the need for traditional, tethered systems.

Retrieval of a well-established skill is resistant to distraction: Evidence from an implicit probabilistic sequence learning task

The characteristics of acquiring new sequence information under dual-task situations have been extensively studied. A concurrent task has often been found to affect performance. In real life, however, we mostly perform a secondary task when the primary task is already well acquired. The effect of a secondary task on the ability to retrieve well-established sequence representations remains elusive. The present study investigates whether accessing well-acquired probabilistic sequence knowledge is affected by a concurrent task. Participants acquired non-adjacent regularities in an implicit probabilistic sequence learning task. After a 24-hour offline period, participants were tested on the same probabilistic sequence learning task under dual-task or single-task conditions. Here, we show that although the secondary task significantly prolonged the overall reaction times in the primary (sequence learning) task, access to the previously learned probabilistic representations remained intact. Our results highlight the importance of studying the dual-task effect not only in the learning phase but also during memory access to reveal the robustness of the acquired skill.

The Effects of Instruction Manipulation on Motor Performance Following Action Observation

The effects of action observation (AO) on motor performance can be modulated by instruction. The effects of two top-down aspects of the instruction on motor performance have not been fully resolved: those related to attention to the observed task and the incorporation of motor imagery (MI) during AO. In addition, the immediate vs. 24-h retention test effects of those instruction’s aspects are yet to be elucidated. Forty-eight healthy subjects were randomly instructed to: (1) observe reaching movement (RM) sequences toward five lighted units with the intention of reproducing the same sequence as fast and as accurate as possible (Intentional + Attentional group; AO+At); (2) observe the RMs sequence with the intention of reproducing the same sequence as fast and as accurate as possible and simultaneously to the observation to imagine performing the RMs (Intentional + attentional + MI group; AO+At+MI); and (3) observe the RMs sequence (Passive AO group). Subjects’ performance was tested before and immediately after the AO and retested after 24 h. During each of the pretest, posttest, and retest, the subject performed RMs toward the units that were activated in the same order as the observed sequence. Occasionally, the sequence order was changed by beginning the sequence with a different activated unit. The outcome measures were: averaged response time of the RMs during the sequences, difference between the response time of the unexpected and expected RMs and percent of failures to reach the target within 1 s. The averaged response time and the difference between the response time of the unexpected and expected RMs were improved in all groups at posttest compared to pretest, regardless of instruction. Averaged response time was improved in the retest compared to the posttest only in the Passive AO group. The percent of failures across groups was higher in pretest compared to retest. Our findings suggest that manipulating top-down aspects of instruction by adding attention and MI to AO in an RM sequence task does not improve subsequent performance more than passive observation. Off-line learning of the sequence in the retention test was improved in comparison to posttest following passive observation only.

Acute Exercise and Motor Memory Consolidation: The Role of Exercise Timing

High intensity aerobic exercise amplifies offline gains in procedural memory acquired during motor practice. This effect seems to be evident when exercise is placed immediately after acquisition, during the first stages of memory consolidation, but the importance of temporal proximity of the exercise bout used to stimulate improvements in procedural memory is unknown. The effects of three different temporal placements of high intensity exercise were investigated following visuomotor skill acquisition on the retention of motor memory in 48 young (24.0 ± 2.5 yrs), healthy male subjects randomly assigned to one of four groups either performing a high intensity (90% Maximal Power Output) exercise bout at 20 min (EX90), 1 h (EX90+1), 2 h (EX90+2) after acquisition or rested (CON). Retention tests were performed at 1 d (R1) and 7 d (R7). At R1 changes in performance scores after acquisition were greater for EX90 than CON (p < 0.001) and EX90+2 (p = 0.001). At R7 changes in performance scores for EX90, EX90+1, and EX90+2 were higher than CON (p < 0.001, p = 0.008, and p = 0.008, resp.). Changes for EX90 at R7 were greater than EX90+2 (p = 0.049). Exercise-induced improvements in procedural memory diminish as the temporal proximity of exercise from acquisition is increased. Timing of exercise following motor practice is important for motor memory consolidation.

Allowing time to consolidate knowledge gained through random practice facilitates later novel motor sequence acquisition

Two experiments were conducted to examine the efficacy of random (RP) and blocked practice (BP) for enhancing later motor learning. Each experiment involved practicing three unique seven key serial reaction time (SRT) tasks in either a blocked or random format followed by practice of a novel SRT task either 2-min (Experiment 1) or 24-h (Experiment 2) later. While the expected benefit of RP for retention was present in both experiments, in Experiment 1 there was no advantage from prior RP for new learning. Experiment 2 explored the possibility that increasing the interval, from 2-min to 24-h, between BP or RP and practice of the novel motor task might allow consolidation of sequence knowledge acquired during BP or RP which in turn might facilitate new learning. As a result of the additional time between training bouts RP facilitated the rate at which the novel motor task was acquired. Interestingly, when this additional time was provided, both BP and RP supported (a) a performance saving for the first trial with the novel task, and (b) an offline improvement in performance across a 24-h interval not present when only the novel motor task was practiced. The latter benefits for new learning may have resulted from exposure to prior physical practice per se. or practice variability. These data are discussed with respect to (a) future learning benefits from prior experience training with greater CI, and (b) the importance of memory consolidation for motor learning.

Novel Kinetic Strategies Adopted in Asymmetric Split-Belt Treadmill Walking

The hip and ankle strategies that affect learning of a novel gait have not been fully determined, and could be of importance in design of clinical gait interventions. The authors' purpose was to determine the effects of asymmetric split-belt treadmill walking on ankle and hip work during propulsion. Participants were randomized into either a gradual training group or a sudden training group and later returned for a retention test. The gradual training group performed significantly more work at the hip joint of the slow limb during acquisition, and decreased the hip joint work performed during retention. These findings reveal the hip joint on the slow limb during initial swing as a possible site of adaptation to a novel locomotor pattern.

Limits on movement integration in children: The concatenation of trained subsequences into composite sequences as a specific experience-triggered skill

Complex movement sequences may be easier to acquire in sub-segments. Nevertheless, the neuro-behavioral constraints on assembling short multi-element movement segments, acquired piecemeal and serially, into larger, composite units of action, are not clear. Here we examined the ability of children to combine movement subsequences into longer, composite, sequences. Eleven-year-olds were trained in the performance of two, 3-elements, finger-to-thumb opposition movement sequences and were tested, overnight, in the performance of composite, 6-elements, sequences. Two experiments were compared, differing only in whether or not a brief test for integration into a composite sequence was afforded immediately post-training. This composite sequence (Full) was a direct forward integration of the two subsequences, maintaining the order in which the two subsequences were trained. In both experiments, overnight performance of movement elements within the composite sequences was better than naive performance, but slower and less accurate compared to the performance of the identical movement elements in the context of the trained subsequences. Integration was as effective in the Full sequence as when the order between subsequences was switched (Reversed). However, the early test for subsequence integration was critical in inducing clear between-session ('offline') gains, as expressed in overnight performance, in both the Full and Reversed sequences. Without this brief experience in integration, no overnight gains were expressed in any of the 6-elements sequences. Moreover, the immediate post-training test resulted in a relative advantage of the Full and Reversed sequences over a 6-element sequence in which the order of the elements was mirror-reversed within each subsequence. Thus, training on subsequences may not spontaneously lead to an advantage in the performance of composite sequences, in children. However, an early brief experience with a composite sequence can suffice to trigger the establishment and consolidation of an integration routine. This routine is specific for the order of movement within the trained subsequences, but not for the order in which the subsequences were practiced.

Effects of robotically modulating kinematic variability on motor skill learning and motivation

It is unclear how the variability of kinematic errors experienced during motor training affects skill retention and motivation. We used force fields produced by a haptic robot to modulate the kinematic errors of 30 healthy adults during a period of practice in a virtual simulation of golf putting. On day 1, participants became relatively skilled at putting to a near and far target by first practicing without force fields. On day 2, they warmed up at the task without force fields, then practiced with force fields that either reduced or augmented their kinematic errors and were finally assessed without the force fields active. On day 3, they returned for a long-term assessment, again without force fields. A control group practiced without force fields. We quantified motor skill as the variability in impact velocity at which participants putted the ball. We quantified motivation using a self-reported, standardized scale. Only individuals who were initially less skilled benefited from training; for these people, practicing with reduced kinematic variability improved skill more than practicing in the control condition. This reduced kinematic variability also improved self-reports of competence and satisfaction. Practice with increased kinematic variability worsened these self-reports as well as enjoyment. These negative motivational effects persisted on day 3 in a way that was uncorrelated with actual skill. In summary, robotically reducing kinematic errors in a golf putting training session improved putting skill more for less skilled putters. Robotically increasing kinematic errors had no performance effect, but decreased motivation in a persistent way.

Aging increases the susceptibility to motor memory interference and reduces off-line gains in motor skill learning

Declines in the ability to learn motor skills in older adults are commonly attributed to deficits in the encoding of sensorimotor information during motor practice. We investigated whether aging also impairs motor memory consolidation by assessing the susceptibility to memory interference and off-line gains in motor skill learning after practice in children, young, and older adults. Subjects performed a ballistic task (A) followed by an accuracy-tracking task (B) designed to disrupt the consolidation of A. Retention tests of A were performed immediately and 24 hours after B. Older adults showed greater susceptibility to memory interference and no off-line gains in motor skill learning. Performing B produced memory interference and reduced off-line gains only in the older group. However, older adults also showed deficits in memory consolidation independent of the interfering effects of B. Age-related declines in motor skill learning are not produced exclusively by deficits in the encoding of sensorimotor information during practice. Aging also increases the susceptibility to memory interference and reduces off-line gains in motor skill learning after practice.

Gradual training reduces the challenge to lateral balance control during practice and subsequent performance of a novel locomotor task

Locomotor balance control mechanisms and impairments have been well described in the literature. In contrast, the role of evidence-based motor learning strategies in the recovery or restoration of locomotor balance control has received much less attention. Little is known about the efficacy of motor learning strategies to improve locomotor tasks and their unique requirements, such as lateral balance control. This study examined whether gradual versus sudden training influenced lateral balance control among unimpaired adults (n=16) during training and 24-h transfer performance of a novel locomotor task. This was accomplished by examining the variability of whole-body frontal plane kinematics throughout training and 24-h transfer performance of asymmetric split-belt treadmill walking. Compared to sudden training, gradual training significantly reduced the challenge to lateral balance control (exhibited by a reduction in frontal plane kinematic variability) during training and during subsequent transfer task performance. These results indicate that gradual training could play an important role in restoring locomotor balance control during physical rehabilitation.

One hertz repetitive transcranial magnetic stimulation over dorsal premotor cortex enhances offline motor memory consolidation for sequence-specific implicit learning

Consolidation of motor memories associated with skilled practice can occur both online, concurrent with practice, and offline, after practice has ended. The current study investigated the role of dorsal premotor cortex (PMd) in early offline motor memory consolidation of implicit sequence-specific learning. Thirty-three participants were assigned to one of three groups of repetitive transcranial magnetic stimulation (rTMS) over left PMd (5 Hz, 1 Hz or control) immediately following practice of a novel continuous tracking task. There was no additional practice following rTMS. This procedure was repeated for 4 days. The continuous tracking task contained a repeated sequence that could be learned implicitly and random sequences that could not. On a separate fifth day, a retention test was performed to assess implicit sequence-specific motor learning of the task. Tracking error was decreased for the group who received 1 Hz rTMS over the PMd during the early consolidation period immediately following practice compared with control or 5 Hz rTMS. Enhanced sequence-specific learning with 1 Hz rTMS following practice was due to greater offline consolidation, not differences in online learning between the groups within practice days. A follow-up experiment revealed that stimulation of PMd following practice did not differentially change motor cortical excitability, suggesting that changes in offline consolidation can be largely attributed to stimulation-induced changes in PMd. These findings support a differential role for the PMd in support of online and offline sequence-specific learning of a visuomotor task and offer converging evidence for competing memory systems.

About sleep's role in memory

Over more than a century of research has established the fact that sleep benefits the retention of memory. In this review we aim to comprehensively cover the field of "sleep and memory" research by providing a historical perspective on concepts and a discussion of more recent key findings. Whereas initial theories posed a passive role for sleep enhancing memories by protecting them from interfering stimuli, current theories highlight an active role for sleep in which memories undergo a process of system consolidation during sleep. Whereas older research concentrated on the role of rapid-eye-movement (REM) sleep, recent work has revealed the importance of slow-wave sleep (SWS) for memory consolidation and also enlightened some of the underlying electrophysiological, neurochemical, and genetic mechanisms, as well as developmental aspects in these processes. Specifically, newer findings characterize sleep as a brain state optimizing memory consolidation, in opposition to the waking brain being optimized for encoding of memories. Consolidation originates from reactivation of recently encoded neuronal memory representations, which occur during SWS and transform respective representations for integration into long-term memory. Ensuing REM sleep may stabilize transformed memories. While elaborated with respect to hippocampus-dependent memories, the concept of an active redistribution of memory representations from networks serving as temporary store into long-term stores might hold also for non-hippocampus-dependent memory, and even for nonneuronal, i.e., immunological memories, giving rise to the idea that the offline consolidation of memory during sleep represents a principle of long-term memory formation established in quite different physiological systems.

Visual long-term memory stores high-fidelity representations of observed actions

The ability to remember others' actions is fundamental to social cognition, but the precision of action memories remains unknown. To probe the fidelity of the action representations stored in visual long-term memory, we asked observers to view a large number of computer-animated actions. Afterward, observers were shown pairs of actions and indicated which of the two actions they had seen for each pair. On some trials, the previously viewed action was paired with an action from a different action category, and on other trials, it was paired with an action from the same category. Accuracy on both types of trials was remarkably high (81% and 82%, respectively). Further, results from a second experiment showed that the action representations maintained in visual long-term memory can be nearly as precise as the action representations maintained in visual working memory. Together, these findings provide evidence for a mechanism in visual long-term memory that maintains high-fidelity representations of observed actions.

Learning and memory

Learning and memory functions are crucial in the interaction of an individual with the environment and involve the interplay of large, distributed brain networks. Recent advances in technologies to explore neurobiological correlates of neuropsychological paradigms have increased our knowledge about human learning and memory. In this chapter we first review and define memory and learning processes from a neuropsychological perspective. Then we provide some illustrations of how noninvasive brain stimulation can play a major role in the investigation of memory functions, as it can be used to identify cause-effect relationships and chronometric properties of neural processes underlying cognitive steps. In clinical medicine, transcranial magnetic stimulation may be used as a diagnostic tool to understand memory and learning deficits in various patient populations. Furthermore, noninvasive brain stimulation is also being applied to enhance cognitive functions, offering exciting translational therapeutic opportunities in neurology and psychiatry.

Impact of nocturnal sleep deprivation on declarative memory retrieval in students at an orphanage: a psychoneuroradiological study

BACKGROUND AND METHODS

This study investigated the effects of sleep deprivation on total and partial (early and late) declarative memory and activation in the areas of the brain involved in these activities. The study included two experiments. Experiment 1 included 40 male residents of an orphanage aged 16-19 years, who were divided into four groups (n = 10 each) and subjected to total sleep deprivation, normal sleep, early-night sleep deprivation, or late-night sleep deprivation. Experiment 2 included eight students from the same institution who were divided into the same four groups (n = 2) as in experiment 1. Declarative memory was tested using lists of associated word pairs in both experiments, and activation of the relevant brain regions was measured before and after retrieval by single-photon emission computed tomography for subjects in experiment 2 only.

RESULTS

Students subjected to normal sleep had significantly higher scores for declarative memory retrieval than those subjected to total sleep deprivation (P = 0.002), early-night sleep deprivation (P = 0.005), or late-night sleep deprivation (P = 0.02). The left temporal lobe showed the highest rate of activity during memory retrieval after normal sleep, whereas the frontal, parietal, and right temporal lobes were more active after sleep deprivation.

CONCLUSION

Both slow wave sleep and rapid eye movement sleep play an active role in consolidation of declarative memory, which in turn allows memory traces to be actively reprocessed and strengthened during sleep, leading to improved performance in memory recall.

Offline improvement in learning to read a novel orthography depends on direct letter instruction

Improvement in performance after the end of the training session, termed "Offline improvement," has been shown in procedural learning tasks. We examined whether Offline improvement in learning a novel orthography depends on the type of reading instruction. Forty-eight adults received multisession training in reading nonsense words, written in an artificial script. Participants were trained in one of three conditions: alphabetical words preceded by direct letter instruction (Letter-Alph); alphabetical words with whole-word instruction (Word-Alph); and nonalphabetical (arbitrary) words with whole-word instruction (Word-Arb). Offline improvement was found only for the Letter-Alph group. Moreover, correlation with a standardized measure of word reading ability showed that good readers trained in the Letter-Alph group exhibit greater Offline improvement, whereas good readers trained in the Word-Arb group showed greater Within-session improvement during training. These results suggest that different consolidation processes and learning mechanisms were involved in each group. We argue that providing a short block of direct letter instruction prior to training resulted in increased involvement of procedural learning mechanisms during training.

Modulation of motor learning and memory formation by non-invasive cortical stimulation of the primary motor cortex

Transcranial magnetic (TMS) and direct current (tDCS) stimulation are non-invasive brain stimulation techniques that allow researchers to purposefully modulate cortical excitability in focal areas of the brain. Recent work has provided preclinical evidence indicating that TMS and tDCS can facilitate motor performance, motor memory formation, and motor skill learning in healthy subjects and possibly in patients with brain lesions. Although the optimal stimulation parameters to accomplish these goals remain to be determined, and controlled multicentre clinical studies are lacking, these findings suggest that cortical stimulation techniques could become in the future adjuvant strategies in the rehabilitation of motor deficits. The aim of this article is to critically review these findings and to discuss future directions regarding the possibility of combining these techniques with other interventions in neurorehabilitation.

Offline consolidation of procedural skill learning is enhanced by negative emotional content

It is now well established that both procedural skills and episodic memories consolidate across periods of offline retention, and most particularly across periods of sleep. Such consolidation has been demonstrated to be more marked for emotional than for neutral episodes, but the interaction between emotionality and the offline consolidation of procedural skills has yet to be investigated. Here, we address this issue by examining the impact of an emotional background context at encoding upon the subsequent consolidation of mirror tracing, a well-studied procedural skill. We also consider the importance of sleep for such consolidation by manipulating the retention interval (over a day, overnight, or over 24 h containing normal sleep). Our data show significantly greater offline improvements in the accuracy of mirror tracing when negative emotional content is present during the training phase when compared to when neutral or positive content is present. Furthermore, consolidation across a night of sleep is associated with faster and more accurate performance than consolidation across a day of wakefulness. These novel findings show that the emotional context in which a procedural skill is learned can impact upon subsequent offline consolidation.

Brain plasticity related to the consolidation of motor sequence learning and motor adaptation

This study aimed to investigate, through functional MRI (fMRI), the neuronal substrates associated with the consolidation process of two motor skills: motor sequence learning (MSL) and motor adaptation (MA). Four groups of young healthy individuals were assigned to either (i) a night/sleep condition, in which they were scanned while practicing a finger sequence learning task or an eight-target adaptation pointing task in the evening (test) and were scanned again 12 h later in the morning (retest) or (ii) a day/awake condition, in which they were scanned on the MSL or the MA tasks in the morning and were rescanned 12 h later in the evening. As expected and consistent with the behavioral results, the functional data revealed increased test-retest changes of activity in the striatum for the night/sleep group compared with the day/awake group in the MSL task. By contrast, the results of the MA task did not show any difference in test-retest activity between the night/sleep and day/awake groups. When the two MA task groups were combined, however, increased test-retest activity was found in lobule VI of the cerebellar cortex. Together, these findings highlight the presence of both functional and structural dissociations reflecting the off-line consolidation processes of MSL and MA. They suggest that MSL consolidation is sleep dependent and reflected by a differential increase of neural activity within the corticostriatal system, whereas MA consolidation necessitates either a period of daytime or sleep and is associated with increased neuronal activity within the corticocerebellar system.

Impaired off-line memory consolidation in depression

Sleep is critically involved in the consolidation of procedural memory. In major depression (MD) and during antidepressant pharmacotherapy, changes in sleep EEG are well documented. Here, we test if off-line motor memory consolidation is impaired in MD. 50 medicated patients with an acute episode of MD, 50 normal controls and 12 patients with a remitted episode of MD were assessed using a sequential finger tapping task before and after a night of sleep. Although depressed patients and control subjects did not differ in practice-dependent learning, healthy subjects showed markedly overnight improvements in tapping performance of 18% while patients failed to show any improvement. This pattern became even more striking when the subjects were divided by an age threshold of 30years: In the 30+yrs group the healthy subjects showed 16% overnight increase in motor performance, whereas the patients showed -10% overnight decrease. In contrast, patients and controls in the </=30yrs group showed virtually the same motor performance, as well as remitted patients and controls in the 30+yrs group. In addition, the younger controls showed stronger overnight improvements than the older controls. This pattern might be interpreted as a synergistic interaction between age and depression: Off-line motor memory consolidation is not affected in young patients, but severely impaired in older patients with an acute episode of MD. This impairment seems to recover after remission from depression.

Computational models of reinforcement learning: the role of dopamine as a reward signal

Reinforcement learning is ubiquitous. Unlike other forms of learning, it involves the processing of fast yet content-poor feedback information to correct assumptions about the nature of a task or of a set of stimuli. This feedback information is often delivered as generic rewards or punishments, and has little to do with the stimulus features to be learned. How can such low-content feedback lead to such an efficient learning paradigm? Through a review of existing neuro-computational models of reinforcement learning, we suggest that the efficiency of this type of learning resides in the dynamic and synergistic cooperation of brain systems that use different levels of computations. The implementation of reward signals at the synaptic, cellular, network and system levels give the organism the necessary robustness, adaptability and processing speed required for evolutionary and behavioral success.

Differential contribution of the supplementary motor area to stabilization of a procedural motor skill acquired through different practice schedules

Behavioral studies have suggested that the stabilization of motor memory varies depending on the practice schedule. The neural substrates underlying this schedule-dependent difference in memory stabilization are not known. Here, we evaluated the effects of 1-Hz repetitive transcranial magnetic stimulation (rTMS) applied to different cortical regions and sham after one session of training (Day 1) of sequential motor skills acquired through blocked (each sequence was completely trained before training the next)-practice schedules and random (random training of 3 sequences)-practice schedules. The recall of sequences learned on Day 1 by Day 2 was measured in different groups of healthy volunteers. The rTMS over the supplementary motor area (SMA) but not over control regions or over the primary motor cortex (M1) immediately after practice or over SMA 6 h later reduced recall relative to sham only in the blocked-practice group. In contrast, recall in the random-practice group was unaffected by rTMS. These results document a differential contribution of the SMA to the stabilization of motor memories acquired through different practice schedules. More generally, they indicate that the anatomical substrates underlying motor-memory stabilization (or their temporal operation) do differ depending on the practice schedule.

Neural substrates of practice structure that support future off-line learning

Off-line learning is facilitated when motor skills are acquired under a random practice schedule and retention suffers when a similar set of motor skills are practiced under a blocked schedule. The current study identified the neural correlates of a random training schedule while participants learned a set of four-element finger sequences using their nondominant hand during functional magnetic resonance imaging. A go/no go task was used to separately probe brain areas supporting sequence preparation and production. By the end of training, the random practice schedule, relative to the block schedule, recruited a broad premotor-parietal network as well as sensorimotor and subcortical regions during both preparation and production trials, despite equivalent motor performance. Longitudinal analysis demonstrated that preparation-related activity under a random schedule remained stable or increased over time. The blocked schedule showed the opposite pattern. Across individual subjects, successful skill retention was correlated with greater activity at the end of training in the ipsilateral left motor cortex, for both preparation and production. This is consistent with recent evidence that attributes off-line learning to training-related processing within primary motor cortex. These results reflect the importance of an overlooked aspect of motor skill learning. Specifically, how trials are organized during training-with a random schedule-provides an effective basis for the formation of enduring motor memories, through enhanced engagement of core regions involved in the active preparation and implementation of motor programs.

Excitatory repetitive transcranial magnetic stimulation to left dorsal premotor cortex enhances motor consolidation of new skills

BACKGROUND

Following practice of skilled movements, changes continue to take place in the brain that both strengthen and modify memory for motor learning. These changes represent motor memory consolidation a process whereby new memories are transformed from a fragile to a more permanent, robust and stable state. In the present study, the neural correlates of motor memory consolidation were probed using repetitive transcranial magnetic stimulation (rTMS) to the dorsal premotor cortex (PMd). Participants engaged in four days of continuous tracking practice that immediately followed either excitatory 5 HZ, inhibitory 1 HZ or control, sham rTMS. A delayed retention test assessed motor learning of repeated and random sequences of continuous movement; no rTMS was applied at retention.

RESULTS

We discovered that 5 HZ excitatory rTMS to PMd stimulated motor memory consolidation as evidenced by off-line learning, whereas only memory stabilization was noted following 1 Hz inhibitory or sham stimulation.

CONCLUSION

Our data support the hypothesis that PMd is important for continuous motor learning, specifically via off-line consolidation of learned motor behaviors.

Hormones that increase maternal responsiveness affect accumbal dopaminergic responses to pup- and food-stimuli in the female rat

The present study investigated hormonal mediation of maternal behavior and accumbal dopamine (DA) responses to pup-stimuli, as measured in microdialysis samples collected from the nucleus accumbens shell of female rats in non-homecage environment. In Experiment 1, samples were collected before and after continuous homecage pup experience from either intact postpartum or cycling females. In Experiment 2, samples were collected before and after responding maternally in homecage from ovariectomized females given either parturient-like hormone or sham treatments. After baseline sample collection in the dialysis chamber, pup and food stimuli were individually presented to females. Upon sampling completion, all animals were placed back into their homecage with donor pups for several days, and then the sample collection procedure was repeated. Prior to stimulus presentation, postpartum and hormone-treated females had decreased basal DA release compared to their controls. In response to pup stimuli, only postpartum and hormone-treated females had increased DA release compared to basal release (both sampling days). In response to food stimuli, all females had increased DA responses from basal; although there were group differences on the initial day of sampling. Findings suggest that hormones associated with inducing maternal behavior in the postpartum rat play a significant role in modifying accumbal dopaminergic responses on first exposure to pup stimuli in the rat. However, the postpartum experience provides further modifications to this brain region to promote DA responses to pup stimuli.

Does sleep promote motor learning? Implications for physical rehabilitation

Sleep following motor skill practice has repeatedly been demonstrated to enhance motor skill learning off-line (continued overnight improvements in motor skill that are not associated with additional physical practice) for young people who are healthy. Mounting evidence suggests that older people who are healthy fail to demonstrate sleep-dependent off-line motor learning. However, little is known regarding the influence of sleep on motor skill enhancement following damage to the brain. Emerging evidence suggests that individuals with brain damage, particularly following stroke, do benefit from sleep to promote off-line motor skill learning. Because rehabilitation following stroke requires learning new, and re-learning old, motor skills, awareness that individuals with stroke benefit from a period of sleep following motor skill practice to enhance skill learning could affect physical therapist practice. The objective of this article is to present the evidence demonstrating sleep-dependent off-line motor learning in young people who are healthy and the variables that may influence this beneficial sleep-dependent skill enhancement. In young people who are healthy, these variables include the stages of memory formation, the type of memory, the type of instruction provided (implicit versus explicit learning), and the task utilized. The neural mechanisms thought to be associated with sleep-dependent off-line motor learning also are considered. Research examining whether older adults who are healthy show the same benefits of sleep as do younger adults is discussed. The data suggest that older adults who are healthy do not benefit from sleep to promote off-line skill enhancement. A possible explanation for the apparent lack of sleep-dependent off-line motor learning by older adults who are healthy is presented. Last, emerging evidence showing that individuals with chronic stroke demonstrate sleep-dependent off-line motor skill learning and some of the possible mechanisms for this effect are considered.

From creation to consolidation: a novel framework for memory processing

Long after playing squash, your brain continues to process the events that occurred during the game, thereby improving your game, and more generally, enhancing adaptive behavior. Understanding these mysterious processes may require novel theories.

Sleep Enhances Off-line Spatial and Temporal Motor Learning After Stroke

Background. Individuals with chronic stroke demonstrate sleep-dependent off-line motor learning of a continuous tracking task. However, it remains unclear which aspects of learned movements are preferentially enhanced by sleep (ie, spatial accuracy and/or the time lag of tracking). Objective. The purpose of this study was to investigate whether spatial tracking accuracy, temporal tracking accuracy, or both are enhanced by sleep during off-line motor learning after stroke. Methods. Individuals with chronic stroke and control participants either practiced a continuous tracking task in the evening and underwent retention testing the following morning (sleep groups) or practiced the task in the morning and underwent retention testing in the evening (no-sleep groups). Results. Individuals with stroke who slept between practice and retention testing demonstrated off-line improvements in both spatial and temporal elements of tracking at retention. Participants with a stroke who stayed awake between practice and retention testing did not demonstrate off-line improvements in either spatial tracking accuracy or the time lag of tracking. Control participants did not demonstrate sleep- or time-dependent enhancement of either component of the movement task. Time of day of testing was not a factor in practice related changes in motor performance. Conclusion. This study provides the first evidence that sleep enhances motor learning through both improved spatial tracking accuracy and anticipation of upcoming movements, as demonstrated by a reduction in the time lag of tracking in individuals following stroke. We propose that the cerebellum and hippocampus are likely important neural correlates associated with sleep-dependent off-line motor skill learning.

Autobiographical memory retrieval and hippocampal activation as a function of repetition and the passage of time

Multiple trace theory (MTT) predicts that hippocampal memory traces expand and strengthen as a function of repeated memory retrievals. We tested this hypothesis utilizing fMRI, comparing the effect of memory retrieval versus the mere passage of time on hippocampal activation. While undergoing fMRI scanning, participants retrieved remote autobiographical memories that had been previously retrieved either one month earlier, two days earlier, or multiple times during the preceding month. Behavioral analyses revealed that the number and consistency of memory details retrieved increased with multiple retrievals but not with the passage of time. While all three retrieval conditions activated a similar set of brain regions normally associated with autobiographical memory retrieval including medial temporal lobe structures, hippocampal activation did not change as a function of either multiple retrievals or the passage of time. However, activation in other brain regions, including the precuneus, lateral prefrontal cortex, parietal cortex, lateral temporal lobe, and perirhinal cortex increased after multiple retrievals, but was not influenced by the passage of time. These results have important implications for existing theories of long-term memory consolidation.

Sleep does not benefit probabilistic motor sequence learning

It has become widely accepted that sleep-dependent consolidation occurs for motor sequence learning based on studies using finger-tapping tasks. Studies using another motor sequence learning task [the serial response time task (SRTT)] have portrayed a more nuanced picture of off-line consolidation, involving both sleep-dependent and daytime consolidation, as well as modifying influences of explicit awareness. The present study used a variant of the SRTT featuring probabilistic sequences to investigate off-line consolidation. Probabilistic sequences confer two advantages: first, spontaneous explicit awareness does not occur, and second, sequence learning measures are continuous, making it easier to separate general skill from sequence-specific learning. We found that sleep did not enhance general skill or sequence-specific learning. In contrast, daytime enhancement occurred for general skill but not for sequence-specific learning. Overall, these results suggest that motor learning does not always undergo consolidation with sleep.

Off-line processing: reciprocal interactions between declarative and procedural memories

The acquisition of declarative (i.e., facts) and procedural (i.e., skills) memories may be supported by independent systems. This same organization may exist, after memory acquisition, when memories are processed off-line during consolidation. Alternatively, memory consolidation may be supported by interactive systems. This latter interactive organization predicts interference between declarative and procedural memories. Here, we show that procedural consolidation, expressed as an off-line motor skill improvement, can be blocked by declarative learning over wake, but not over a night of sleep. The extent of the blockade on procedural consolidation was correlated to participants' declarative word recall. Similarly, in another experiment, the reciprocal relationship was found: declarative consolidation was blocked by procedural learning over wake, but not over a night of sleep. The decrease in declarative recall was correlated to participants' procedural learning. These results challenge the concept of fixed independent memory systems; instead, they suggest a dynamic relationship, modulated by when consolidation takes place, allowing at times for a reciprocal interaction between memory systems.

The debate over dopamine's role in reward: the case for incentive salience

INTRODUCTION

Debate continues over the precise causal contribution made by mesolimbic dopamine systems to reward. There are three competing explanatory categories: 'liking', learning, and 'wanting'. Does dopamine mostly mediate the hedonic impact of reward ('liking')? Does it instead mediate learned predictions of future reward, prediction error teaching signals and stamp in associative links (learning)? Or does dopamine motivate the pursuit of rewards by attributing incentive salience to reward-related stimuli ('wanting')? Each hypothesis is evaluated here, and it is suggested that the incentive salience or 'wanting' hypothesis of dopamine function may be consistent with more evidence than either learning or 'liking'. In brief, recent evidence indicates that dopamine is neither necessary nor sufficient to mediate changes in hedonic 'liking' for sensory pleasures. Other recent evidence indicates that dopamine is not needed for new learning, and not sufficient to directly mediate learning by causing teaching or prediction signals. By contrast, growing evidence indicates that dopamine does contribute causally to incentive salience. Dopamine appears necessary for normal 'wanting', and dopamine activation can be sufficient to enhance cue-triggered incentive salience. Drugs of abuse that promote dopamine signals short circuit and sensitize dynamic mesolimbic mechanisms that evolved to attribute incentive salience to rewards. Such drugs interact with incentive salience integrations of Pavlovian associative information with physiological state signals. That interaction sets the stage to cause compulsive 'wanting' in addiction, but also provides opportunities for experiments to disentangle 'wanting', 'liking', and learning hypotheses. Results from studies that exploited those opportunities are described here.

CONCLUSION

In short, dopamine's contribution appears to be chiefly to cause 'wanting' for hedonic rewards, more than 'liking' or learning for those rewards.