Consolidation of human skill linked to waking hippocampo-neocortical replay

Non-feature-specific elevated responses and feature-specific backward replay in human brain induced by visual sequence exposure

The ability of cortical circuits to adapt in response to experience is a fundamental property of the brain. After exposure to a moving dot sequence, flashing a dot as a cue at the starting point of the sequence can elicit successive elevated responses even in the absence of the sequence. These cue-triggered elevated responses have been shown to play a crucial role in predicting future events in dynamic environments. However, temporal sequences we are exposed to typically contain rich feature information. It remains unknown whether the elevated responses are feature-specific and, more crucially, how the brain organizes sequence information after exposure. To address these questions, participants were exposed to a predefined sequence of four motion directions for about 30 min, followed by the presentation of the start or end motion direction of the sequence as a cue. Surprisingly, we found that cue-triggered elevated responses were not specific to any motion direction. Interestingly, motion direction information was spontaneously reactivated, and the motion sequence was backward replayed in a time-compressed manner. These effects were observed even after brief exposure. Notably, no replay events were observed when the second or third motion direction of the sequence served as a cue. Further analyses revealed that activity in the medial temporal lobe (MTL) preceded the ripple power increase in visual cortex at the onset of replay, implying a coordinated relationship between the activities in the MTL and visual cortex. Together, these findings demonstrate that visual sequence exposure induces twofold brain plasticity that may simultaneously serve for different functional purposes. The non-feature-specific elevated responses may facilitate general processing of upcoming stimuli, whereas the feature-specific backward replay may underpin passive learning of visual sequences.

Human Sensorimotor Cortex Reactivates Recent Visuomotor Experience during Awake Rest

The re-emergence of task-related activation patterns during awake rest has been reported to play a role in memory consolidation and perceptual learning. This study aimed to test whether such reactivation occurs in the primary sensorimotor cortex following a visuomotor task. During functional magnetic resonance imaging (fMRI) scanning, 42 healthy participants (13 women and 29 men) learned visuomotor tracking, while a rotational perturbation was introduced between the cursor position and joystick angle. This visuomotor task block was interleaved with a control block, during which participants passively viewed a replay of their previously performed cursor movements. Half of the participants used their right hand, whereas the other half used their left hand to control the joystick. Resting-state scans were acquired before and after the visuomotor task sessions. A multivariate pattern classifier was trained to classify task and control blocks and was then tested on resting-state scans collected before and after the task session. Results revealed a significant increase in the number of volumes classified as "task" during post-task rest compared with pre-task rest, indicating re-emergence of task-related activity. Representational similarity analysis also showed a greater similarity to task-related patterns during the post-task rest period. Furthermore, this effect was specific to the left primary sensorimotor cortex contralateral to the hand used and significantly correlated with motor improvement following rest. Our findings reveal the reactivation of recent task-related experience in the primary sensorimotor cortex.

Effects of wakeful rest on memory consolidation: A systematic review and meta-analysis

Individuals spend roughly two-thirds of their day awake, with about half of that time in an offline state. This period may appear unproductive, potentially leading to perceived inefficiency. However, this period appears to be an essential component of our daily lives. Studies have increasingly found that quiet and wakeful rest after learning facilitates the consolidation of newly acquired memories, and enhances memory performance. Few studies quantitatively assessed the overall effect size of wakeful rest on memory consolidation, or examined the potential moderating factors. Therefore, we conducted this meta-analysis, compiled from 37 studies, including a total of 63 experiments that contributed 82 comparisons to this meta-analysis. We used a multilevel random-effects model to reveal a significant effect of wakeful rest on memory consolidation (Hedges's g = 0.448, 95% CI [0.339, 0.557], Z = 8.044, p < .001), and this effect persists even after 7 days (Hedges's g = 0.270, 95% CI [0.024, 0.516], Z = 2.153, p = .031). The effect of wakeful rest was influenced by age, with older adults deriving greater benefits compared with younger adults. Across different outcome measurements, the effect was better reflected by recall than by recognition. Additionally, the duration of wakeful rest, whether the eyes are open or closed, the luminance level, and the body posture do not seem to influence the wakeful rest effect. This meta-analysis offers a deep understanding of the effects of wakeful rest on memory consolidation and provides guidance for the experimental designs of future research in this area.

Level of M1 GABAB predicts micro offline consolidation of motor learning during wakefulness

The consolidation process stabilizes a new initially labile memory. This consolidation could operate on a shorter timescale during wakefulness after initial motor learning. Within micro-offline learning states, sequences of simple individual actions learned through interleaved practice are condensed into a unified skill through a time-dependent consolidation process occurring during wakeful periods. While emerging evidence links Glutamate and GABA modulations in the primary motor cortex (M1) to motor learning, its relationship with micro-offline consolidation processes in brief resting states during motor learning is unclear. To investigate this issue, we employed Transcranial magnetic stimulation (TMS) to evaluate whether interindividual variation of different neurotransmitters at rest influences motor learning consolidation in humans. Our results point to the role of GABAB in micro-offline motor consolidation processes during motor learning in M1. This finding could have an important impact on planning neuropharmacology or non-invasive brain stimulation approaches in clinical domains, such as post-stroke rehabilitation.

Ensemble reactivations during brief rest drive fast learning of sequences

During motor learning, breaks in practice are known to facilitate behavioural optimizations. Although this process has traditionally been studied over long breaks that last hours to days1-6, recent studies in humans have demonstrated that rapid performance gains during early motor sequence learning are most pronounced after very brief breaks lasting seconds to minutes7-10. However, the precise causal neural mechanisms that facilitate performance gains after brief breaks remain poorly understood. Here we recorded neural ensemble activity in the motor cortex of macaques while they performed a visuomotor sequence learning task interspersed with brief breaks. We found that task-related neural cofiring patterns were reactivated during brief breaks. The rate and content of reactivations predicted the magnitude and pattern of subsequent performance gains. Of note, we found that performance gains and reactivations were positively correlated with cortical ripples (80-120 Hz oscillations) but anti-correlated with β bursts (13-30 Hz oscillations), which ultimately dominated breaks after the fast learning phase plateaued. We then applied 20 Hz epidural alternating current stimulation (ACS) to motor cortex, which reduced reactivation rates in a phase-specific and dose-dependent manner. Notably, 20 Hz ACS also eliminated performance gains. Overall, our results indicate that the reactivations of task ensembles during brief breaks are causal drivers of subsequent performance gains. β bursts compete with this process, possibly to support stable performance.

Intact ultrafast memory consolidation in adults with autism and neurotypicals with autism traits

The processes of learning and memory consolidation are closely interlinked. Therefore, to uncover statistical learning in autism spectrum disorder (ASD), an in-depth examination of memory consolidation is essential. Studies of the last five years have revealed that learning can take place not only during practice but also during micro rest (<1 min) between practice blocks, termed micro offline gains. The concept of micro offline gains refers to performance improvements during short rest periods interspersed with practice, rather than during practice itself. This phenomenon is crucial for the acquisition and consolidation of motor skills and has been observed across various learning contexts. Numerous studies on learning in autism have identified intact learning but there has been no investigation into this fundamental aspect of memory consolidation in autistic individuals to date. We conducted two studies with two different samples: 1) neurotypical adults with distinct levels of autistic traits (N = 166) and 2) ASD-diagnosed adults (NASD = 22, NNTP = 20). Participants performed a well-established probabilistic learning task, allowing us to measure two learning processes separately in the same experimental design: statistical learning (i.e., learning probability-based regularities) and visuomotor performance (i.e., speed-up regardless of probabilities). Here we show considerable individual differences in offline (between blocks) changes during statistical learning and between-blocks improvement during visuomotor performance. However, cumulative evidence from individual studies suggests that the degree of autistic traits and ASD status are not associated with micro offline gains, indicating that, like statistical learning, rapid memory consolidation is intact.

M1 recruitment during interleaved practice is important for encoding, not just consolidation, of skill memory

The primary motor cortex (M1) is crucial for motor skill learning. We examined its role in interleaved practice, which enhances retention (vs. repetitive practice) through M1-dependent consolidation. We hypothesized that cathodal transcranial direct current stimulation (ctDCS) to M1 would disrupt retention. We found that ctDCS reduced retention due to weakened encoding during acquisition, not disrupted consolidation. These results highlight M1's broad role in encoding and retention of novel motor skills.

Motor sequence learning elicits mu peak-specific corticospinal plasticity

Motor cortical (M1) transcranial magnetic stimulation (TMS) interventions increase corticospinal output and improve motor learning when delivered during sensorimotor mu rhythm trough but not peak phases, suggesting that the mechanisms supporting motor learning may be most active during mu trough phases. Based on these findings, we predicted that motor sequence learning-related corticospinal plasticity would be most evident when measured during mu trough phases. Healthy adults were assigned to either a sequence or no-sequence group. Participants in the sequence group practiced the implicit serial reaction time task (SRTT), which contained an embedded, repeating 12-item sequence. Participants in the no-sequence group practiced a version of the SRTT that contained no sequence. We measured mu phase-independent and mu phase-dependent MEP amplitudes using EEG-informed single-pulse TMS before, immediately after, and 30 minutes after the SRTT in both groups. All participants performed a retention test one hour after SRTT acquisition. In both groups, mu phase-independent MEP amplitudes increased following SRTT acquisition, but the pattern of mu phase-dependent MEP amplitude changes after SRTT acquisition differed between groups. Relative to the no-sequence group, the sequence group showed greater peak-specific MEP amplitude increases 30 minutes after SRTT acquisition. Further, the magnitude of these peak-specific MEP amplitude increases was negatively associated with the magnitude of sequence-specific learning. Contrary to our original hypothesis, results revealed that motor sequence-specific learning elicits peak-specific corticospinal plasticity. Findings provide first direct evidence for the presence of a mu phase-dependent motor learning mechanism in the human brain.

New and Noteworthy

Recent work suggests that motor learning's neural mechanisms may be most active during specific sensorimotor mu rhythm phases. If so, motor sequence learning-induced corticospinal plasticity should be more evident during some mu phases than others. Our results show that motor sequence-specific learning elicits corticospinal plasticity that is most prominent during mu peak phases. Further, this peak-specific plasticity correlates with learning. Findings establish the presence of a mu phase-dependent motor learning mechanism in the human brain.

Context changes retrieval of prospective outcomes during decision deliberation

Foreseeing the future outcomes is the art of decision-making. Substantial evidence shows that, during choice deliberation, the brain can retrieve prospective decision outcomes. However, decisions are seldom made in a vacuum. Context carries information that can radically affect the outcomes of a choice. Nevertheless, most investigations of retrieval processes examined decisions in isolation, disregarding the context in which they occur. Here, we studied how context shapes prospective outcome retrieval during deliberation. We designed a decision-making task where participants were presented with object-context pairs and made decisions which led to a certain outcome. We show during deliberation, likely outcomes were retrieved in transient patterns of neural activity, as early as 3 s before participants decided. The strength of prospective outcome retrieval explains participants' behavioral efficiency, but only when context affects the decision outcome. Our results suggest context imparts strong constraints on retrieval processes and how neural representations are shaped during decision-making.

Cingulate and striatal hubs are linked to early skill learning

Early skill learning develops in the context of activity changes in distributed cortico-subcortical regions. Here, we investigated network hubs-centers of information integration and transmission-within the brain network supporting early skill learning. We recorded magnetoencephalographic (MEG) brain activity in healthy human subjects who learned a moderately difficult sequence skill with their non-dominant left hand. We then computed network hub strength by summing top 10% functional connectivity over 86 parcellated brain regions (AAL3 atlas) and five brain oscillatory frequency bands (alpha, low-, high-beta, low- and high-gamma). Virtually all skill gains developed during rest intervals of early learning (micro-offline gains). MEG hub strength in the alpha band (8-13Hz) in bilateral anterior cingulate (ACC) and caudate and in the low-beta band (13-16Hz) in bilateral caudate and right putamen correlated with micro-offline gains. These regions linked strongly with the hippocampus, parahippocampal cortex, and lingual and fusiform gyri. Thus, alpha and low-beta brain oscillatory activity in cingulate and striatal regions appear to contribute as hubs of information integration and transmission during early skill learning.

The Hippocampus Preorders Movements for Skilled Action Sequences

Plasticity in the subcortical motor basal ganglia-thalamo-cerebellar network plays a key role in the acquisition and control of long-term memory for new procedural skills, from the formation of population trajectories controlling trained motor skills in the striatum to the adaptation of sensorimotor maps in the cerebellum. However, recent findings demonstrate the involvement of a wider cortical and subcortical brain network in the consolidation and control of well-trained actions, including a brain region traditionally associated with declarative memory-the hippocampus. Here, we probe which role these subcortical areas play in skilled motor sequence control, from sequence feature selection during planning to their integration during sequence execution. An fMRI dataset (N = 24; 14 females) collected after participants learnt to produce four finger press sequences entirely from memory with high movement and timing accuracy over several days was examined for both changes in BOLD activity and their informational content in subcortical regions of interest. Although there was a widespread activity increase in effector-related striatal, thalamic, and cerebellar regions, in particular during sequence execution, the associated activity did not contain information on the motor sequence identity. In contrast, hippocampal activity increased during planning and predicted the order of the upcoming sequence of movements. Our findings suggest that the hippocampus preorders movements for skilled action sequences, thus contributing to the higher-order control of skilled movements that require flexible retrieval. These findings challenge the traditional taxonomy of episodic and procedural memory and carry implications for the rehabilitation of individuals with neurodegenerative disorders.

Similarity of brain activity patterns during learning and subsequent resting state predicts memory consolidation

Spontaneous reactivation of brain activity from learning to a subsequent off-line period has been implicated as a neural mechanism underlying memory consolidation. However, similarities in brain activity may also emerge as a result of individual, trait-like characteristics. Here, we introduced a novel approach for analyzing continuous electroencephalography (EEG) data to investigate learning-induced changes as well as trait-like characteristics in brain activity underlying memory consolidation. Thirty-one healthy young adults performed a learning task, and their performance was retested after a short (∼1 h) delay. Consolidation of two distinct types of information (serial-order and probability) embedded in the task were tested to reveal similarities in functional networks that uniquely predict the changes in the respective memory performance. EEG was recorded during learning and pre- and post-learning rest periods. To investigate brain activity associated with consolidation, we quantified similarities in EEG functional connectivity between learning and pre-learning rest (baseline similarity) and learning and post-learning rest (post-learning similarity). While comparable patterns of these two could indicate trait-like similarities, changes from baseline to post-learning similarity could indicate learning-induced changes, possibly spontaneous reactivation. Higher learning-induced changes in alpha frequency connectivity (8.5-9.5 Hz) were associated with better consolidation of serial-order information, particularly for long-range connections across central and parietal sites. The consolidation of probability information was associated with learning-induced changes in delta frequency connectivity (2.5-3 Hz) specifically for more local, short-range connections. Furthermore, there was a substantial overlap between the baseline and post-learning similarities and their associations with consolidation performance, suggesting robust (trait-like) differences in functional connectivity networks underlying memory processes.

Repetition dynamically and rapidly increases cortical, but not hippocampal, offline reactivation

No sooner is an experience over than its neural representation begins to be transformed through memory reactivation during offline periods. The lion's share of prior research has focused on understanding offline reactivation within the hippocampus. However, it is hypothesized that consolidation processes involve offline reactivation in cortical regions as well as coordinated reactivation in the hippocampus and cortex. Using fMRI, we presented novel and repeated paired associates to participants during encoding and measured offline memory reactivation for those events during an immediate post-encoding rest period. post-encoding reactivation frequency of repeated and once-presented events did not differ in the hippocampus. However, offline reactivation in widespread cortical regions and hippocampal-cortical coordinated reactivation were significantly enhanced for repeated events. These results provide evidence that repetition might facilitate the distribution of memory representations across cortical networks, a hallmark of systems-level consolidation. Interestingly, we found that offline reactivation frequency in both hippocampus and cortex explained variance in behavioral success on an immediate associative recognition test for the once-presented information, potentially indicating a role of offline reactivation in maintaining these novel, weaker, memories. Together, our findings highlight that endogenous offline reactivation can be robustly and significantly modulated by study repetition.

Sleep improves accuracy, but not speed, of generalized motor learning in young and older adults and in individuals with Parkinson's disease

An essential aspect of motor learning is generalizing procedural knowledge to facilitate skill acquisition across diverse conditions. Here, we examined the development of generalized motor learning during initial practice-dependent learning, and how distinct components of learning are consolidated over longer timescales during wakefulness or sleep. In the first experiment, a group of young healthy volunteers engaged in a novel motor sequence task over 36 h in a two-arm experimental design (either morning-evening-morning, or evening-morning-evening) aimed at controlling for circadian confounders. The findings unveiled an immediate, rapid generalization of sequential learning, accompanied by an additional long-timescale performance gain. Sleep modulated accuracy, but not speed, above and beyond equivalent wake intervals. To further elucidate the role of sleep across ages and under neurodegenerative disorders, a second experiment utilized the same task in a group of early-stage, drug-naïve individuals with Parkinson's disease and in healthy individuals of comparable age. Participants with Parkinson's disease exhibited comparable performance to their healthy age-matched group with the exception of reduced performance in recalling motor sequences, revealing a disease-related cognitive shortfall. In line with the results found in young subjects, both groups exhibited improved accuracy, but not speed, following a night of sleep. This result emphasizes the role of sleep in skill acquisition and provides a potential framework for deeper investigation of the intricate relationship between sleep, aging, Parkinson's disease, and motor learning.

The Hippocampus Represents Information about Movements in Their Temporal Position in a Learned Motor Sequence

Our repertoire of motor skills is filled with sequential movements that need to be performed in a specific order. Here, we used functional magnetic resonance imaging to investigate whether the human hippocampus, a region known to support temporal order in non-motor memory, represents information about the order of sequential motor actions in human participants (both sexes). We also examined such representations in other regions of the motor network (i.e., the premotor cortex, supplementary motor area, anterior superior parietal lobule, and striatum) already known for their critical role in motor sequence learning. Results showed that the hippocampus represents information about movements in their learned temporal position in the sequence, but not about movements or temporal positions in random movement patterns. Other regions of the motor network coded for movements in their learned temporal position, as well as movements and positions in random movement patterns. Importantly, movement coding contributed to sequence learning patterns in primary, supplementary, and premotor cortices but not in striatal and parietal regions. Our findings deepen our understanding of how striatal and cortical regions contribute to motor sequence learning and point to the capacity of the hippocampus to represent movements in their temporal context, an ability possibly explaining its contribution to motor learning.

Construction of ThermoMaze

Physiological changes during awake immobility-related brain states remain one of the great unexplored behavioral states. Controlling periods of awake immobility is challenging because restraining the animal is stressful and is accompanied by altered physiological states. Here, we describe the ThermoMaze, a behavioral paradigm that allows for the collection of large amounts of physiological data while the animal rests at distinct experimenter-determined locations. We found that the paradigm generated long periods of immobility and did not alter the brain temperature. We combined the ThermoMaze with electrophysiology recordings in the CA1 region of the hippocampus and found a location-specific distribution of sharp-wave ripple events. We describe the construction of the ThermoMaze with the intention that it helps enable large-scale data recordings on immobility-related brain states. Key features • Controlling periods of awake immobility in rodents. • Electronic-friendly analog of the Morris water maze.

Recognizing ideas generated in a creative task: the roles of the hippocampus and medial prefrontal cortex in facilitating self-generated learning

Creative idea generation plays an important role in promoting successful memory formation. Yet, its underlying neural correlates remain unclear. We investigated the self-generated learning of creative ideas motivated by the schema-linked interactions between medial prefrontal and medial temporal regions framework. This was achieved by having participants generate ideas in the alternative uses task, self-evaluating their ideas based on novelty and source (i.e. new or old), and then later being tested on the recognition performance of the generated ideas. At the behavioral level, our results indicated superior performances in discriminating novel ideas, highlighting the novelty effect on memory. At the neural level, the regions-of-interest analyses revealed that successful recognition of novel ideas was associated with greater activations in the hippocampus (HPC) and medial prefrontal cortex (mPFC) during ideation. However, only activation in the right HPC was positively related to the successful recognition of novel ideas. Importantly, the weaker the connection between the right HPC and left mPFC, the higher the recognition accuracy of novel ideas. Moreover, activations in the right HPC and left mPFC were both effective predictors of successful recognition of novel ideas. These findings uniquely highlight the role of novelty in promoting self-generated learning of creative ideas.

Rest to Promote Learning: A Brain Default Mode Network Perspective

The brain often switches freely between focused attention and divergent thinking, and the Default Mode Network (DMN) is activated during brain rest. Since its discovery, the DMN, together with its function and characteristics, indicates that learning does not stop when the brain "rests". Therefore, DMN plays an important role in learning. Neural activities such as beta wave rhythm regulation, "subconscious" divergence thinking mode initiation, hippocampal function, and neural replay occur during default mode, all of which explains that "rest" promotes learning. This paper summarized the function and neural mechanism of DMN in learning and proposed that the DMN plays an essential role in learning, which is that it enables rest to promote learning.

Children exhibit a developmental advantage in the offline processing of a learned motor sequence

Changes in specific behaviors across the lifespan are frequently reported as an inverted-U trajectory. That is, young adults exhibit optimal performance, children are conceptualized as developing systems progressing towards this ideal state, and older adulthood is characterized by performance decrements. However, not all behaviors follow this trajectory, as there are instances in which children outperform young adults. Here, we acquired data from 7-35 and >55 year-old participants and assessed potential developmental advantages in motor sequence learning and memory consolidation. Results revealed no credible evidence for differences in initial learning dynamics among age groups, but 7- to 12-year-old children exhibited smaller sequence-specific learning relative to adolescents, young adults and older adults. Interestingly, children demonstrated the greatest performance gains across the 5 h and 24 h offline periods, reflecting enhanced motor memory consolidation. These results suggest that children exhibit an advantage in the offline processing of recently learned motor sequences.

Maintenance of Procedural Motor Memory across Brief Rest Periods Requires the Hippocampus

Research on the role of the hippocampus in memory acquisition has generally focused on active learning. But to understand memory, it is at least as important to understand processes that happen offline, during both wake and sleep. In a study of patients with amnesia, we previously demonstrated that although a functional hippocampus is not necessary for the acquisition of procedural motor memory during training session, it is required for its offline consolidation during sleep. Here, we investigated whether an intact hippocampus is also required for the offline consolidation of procedural motor memory while awake. Patients with amnesia due to hippocampal damage (n = 4, all male) and demographically matched controls (n = 10, 8 males) trained on the finger tapping motor sequence task. Learning was measured as gains in typing speed and was divided into online (during task execution) and offline (during interleaved 30 s breaks) components. Amnesic patients and controls showed comparable total learning, but differed in the pattern of performance improvement. Unlike younger adults, who gain speed across breaks, both groups gained speed only while typing. Only controls retained these gains over the breaks; amnesic patients slowed down and compensated for these losses during subsequent typing. In summary, unlike their peers, whose motor performance remained stable across brief breaks in typing, amnesic patients showed evidence of impaired access to motor procedural memory. We conclude that in addition to being necessary for the offline consolidation of motor memories during sleep, the hippocampus maintains access to motor memory across brief offline periods during wake.

Micro-consolidation occurs when learning an implicit motor sequence, but is not influenced by HIIT exercise

We investigated if micro-consolidation, a phenomenon recently discovered during the brief rest periods between practice when learning an explicit motor sequence, generalises to learning an implicit motor sequence task. We demonstrate micro-consolidation occurs in the absence of explicit sequence awareness. We also investigated the effect of a preceding bout of high-intensity exercise, as exercise is known to augment the consolidation of new motor skills. Micro-consolidation was not modified by exercise.

Comparison of online, offline, and hybrid hypotheses of motor sequence learning using a quantitative model that incorporate reactive inhibition

Two hypotheses have been advanced for when motor sequence learning occurs: offline between bouts of practice or online concurrently with practice. A third possibility is that learning occurs both online and offline. A complication for differentiating between those hypotheses is a process known as reactive inhibition, whereby performance worsens over consecutively executed sequences, but dissipates during breaks. We advance a new quantitative modeling framework that incorporates reactive inhibition and in which the three learning accounts can be implemented. Our results show that reactive inhibition plays a far larger role in performance than is appreciated in the literature. Across four groups of participants in which break times and correct sequences per trial were varied, the best overall fits were provided by a hybrid model. The version of the offline model that does not account for reactive inhibition, which is widely assumed in the literature, had the worst fits. We discuss implications for extant hypotheses and directions for future research.

Functional connectivity via the dorsolateral prefrontal cortex in the late phase of rest periods predicts offline learning

The relationship between offline learning gains and functional connectivity (FC) has been investigated in several studies. They have focused on average motor task performance and resting-state FC across subjects. Generally, individual differences are seen in both offline learning gain and neurophysiological profiles in resting-state FC. However, few studies have focused on the relationship between individual differences in offline learning gain and temporal characteristics of resting-state FC. The present study aimed to clarify this relationship between the two profiles. Thirty-four healthy right-handed participants performed a force-controlled motor task. Electroencephalography was performed during the 15-minute wakeful rest period between tasks. The results revealed a significant correlation between offline learning gain and FC between the contralateral dorsolateral prefrontal cortex (DLPFC) and contralateral primary motor cortex (M1), and ipsilateral primary somatosensory cortex (S1) during late phase of the rest interval. These results are consistent with the findings of previous studies showing the FC between M1, which is necessary for awake offline learning, and DLPFC, which is related to motor control. Additionally, sensory feedback related to force control may be caused by the interaction between contralateral DLPFC and ipsilateral S1. Our study shed light on the temporal profiles of resting-state FC associated with individual differences in offline learning.

Effect of cognitive load on time spent offline during wakefulness

Humans continuously alternate between online attention to the current environment and offline attention to internally generated thought and imagery. This may be a fundamental feature of the waking brain, but remains poorly understood. Here, we took a data-driven approach to defining online and offline states of wakefulness, using machine learning methods applied to measures of sensory responsiveness, subjective report, electroencephalogram (EEG), and pupil diameter. We tested the effect of cognitive load on the structure and prevalence of online and offline states, hypothesizing that time spent offline would increase as cognitive load of an ongoing task decreased. We also expected that alternation between online and offline states would persist even in the absence of a cognitive task. As in prior studies, we arrived at a three-state model comprised of one online state and two offline states. As predicted, when cognitive load was high, more time was spent online. Also as predicted, the same three states were present even when participants were not performing a task. These observations confirm our method is successful at isolating seconds-long periods of offline time. Varying cognitive load may be a useful way to manipulate time spent in at least one of these offline states in future experimental studies.

Early excitatory-inhibitory cortical modifications following skill learning are associated with motor memory consolidation and plasticity overnight

Consolidation of motor memories is vital to offline enhancement of new motor skills and involves short and longer-term offline processes following learning. While emerging evidence link glutamate and GABA dynamics in the primary motor cortex (M1) to online motor skill practice, its relationship with offline consolidation processes in humans is unclear. Using two-day repeated measures of behavioral and multimodal neuroimaging data before and following motor sequence learning, we show that short-term glutamatergic and GABAergic responses in M1 within minutes after learning were associated with longer-term learning-induced functional, structural, and behavioral modifications overnight. Furthermore, Glutamatergic and GABAergic modifications were differentially associated with different facets of motor memory consolidation. Our results point to unique and distinct roles of Glutamate and GABA in motor memory consolidation processes in the human brain across timescales and mechanistic levels, tying short-term changes on the neurochemical level to overnight changes in macroscale structure, function, and behavior.

Efficient, continual, and generalized learning in the brain - neural mechanism of Mental Schema 2.0

There has been tremendous progress in artificial neural networks (ANNs) over the past decade; however, the gap between ANNs and the biological brain as a learning device remains large. With the goal of closing this gap, this paper reviews learning mechanisms in the brain by focusing on three important issues in ANN research: efficiency, continuity, and generalization. We first discuss the method by which the brain utilizes a variety of self-organizing mechanisms to maximize learning efficiency, with a focus on the role of spontaneous activity of the brain in shaping synaptic connections to facilitate spatiotemporal learning and numerical processing. Then, we examined the neuronal mechanisms that enable lifelong continual learning, with a focus on memory replay during sleep and its implementation in brain-inspired ANNs. Finally, we explored the method by which the brain generalizes learned knowledge in new situations, particularly from the mathematical generalization perspective of topology. Besides a systematic comparison in learning mechanisms between the brain and ANNs, we propose "Mental Schema 2.0," a new computational property underlying the brain's unique learning ability that can be implemented in ANNs.

Theta EEG neurofeedback promotes early consolidation of real life-like episodic memory

Theta oscillations are believed to coordinate neuronal activity related to human cognition, especially for memory functions. Theta power during learning and retrieval has been found to correlate with memory performance success. Additionally, up-regulating theta oscillations during a post-encoding epoch crucial for memory consolidation was previously shown to benefit long-term memory for acquired motor sequences, pictures, and object-location associations. However, it remains to be determined whether such effects would be found for more ecological aspects of long-term episodic memory. Therefore, the current study assessed neurofeedback-based theta upregulation effects on movie memory. After viewing a 15-minute silent, narrative movie, participants engaged in neurofeedback-based theta/beta up-regulation, neurofeedback beta/theta up-regulation as an active control condition, or an unrelated passive control task. Memory was tested three times: once immediately after watching the movie (as baseline); 24 hours thereafter; and once again 1 week later. Memory performance 1 week after encoding was significantly enhanced in the theta/beta up-regulation group compared with the other groups. Additionally, changes in neurofeedback theta/beta ratio from baseline EEG recordings correlated with long-term memory gains in retrieving the movie's content. These findings highlight the relationship between post-learning theta oscillations and the consolidation of episodic memory for a naturalistic event.

Brain plasticity underlying sleep-dependent motor consolidation after motor imagery

Motor imagery can, similarly to physical practice, improve motor performance through experience-based plasticity. Using magnetoencephalography, we investigated changes in brain activity associated with offline consolidation of motor sequence learning through physical practice or motor imagery. After an initial training session with either physical practice or motor imagery, participants underwent overnight consolidation. As control condition, participants underwent wake-related consolidation after training with motor imagery. Behavioral analyses revealed that overnight consolidation of motor learning through motor imagery outperformed wake-related consolidation (95% CI [0.02, 0.07], P < 0.001, RP2 = 0.05). As regions of interest, we selected the generators of event-related synchronization/desynchronization of alpha (8-12 Hz) and beta (15-30 Hz) oscillations, which predicted the level of performance on the motor sequence. This yielded a primary sensorimotor-premotor network for alpha oscillations and a cortico-cerebellar network for beta oscillations. The alpha network exhibited increased neural desynchronization after overnight consolidation compared to wake-related consolidation. By contrast, the beta network exhibited an increase in neural synchronization after wake-related consolidation compared to overnight consolidation. We provide the first evidence of parallel brain plasticity underlying behavioral changes associated with sleep-dependent consolidation of motor skill learning through motor imagery and physical practice.

Generalization of procedural motor sequence learning after a single practice trial

When humans begin learning new motor skills, they typically display early rapid performance improvements. It is not well understood how knowledge acquired during this early skill learning period generalizes to new, related skills. Here, we addressed this question by investigating factors influencing generalization of early learning from a skill A to a different, but related skill B. Early skill generalization was tested over four experiments (N = 2095). Subjects successively learned two related motor sequence skills (skills A and B) over different practice schedules. Skill A and B sequences shared ordinal (i.e., matching keypress locations), transitional (i.e., ordered keypress pairs), parsing rule (i.e., distinct sequence events like repeated keypresses that can be used as a breakpoint for segmenting the sequence into smaller units) structures, or possessed no structure similarities. Results showed generalization for shared parsing rule structure between skills A and B after only a single 10-second practice trial of skill A. Manipulating the initial practice exposure to skill A (1 to 12 trials) and inter-practice rest interval (0-30 s) between skills A and B had no impact on parsing rule structure generalization. Furthermore, this generalization was not explained by stronger sensorimotor mapping between individual keypress actions and their symbolic representations. In contrast, learning from skill A did not generalize to skill B during early learning when the sequences shared only ordinal or transitional structure features. These results document sequence structure that can be very rapidly generalized during initial learning to facilitate generalization of skill.

Prefrontal stimulation as a tool to disrupt hippocampal and striatal reactivations underlying fast motor memory consolidation

BACKGROUND

Recent evidence suggests that hippocampal replay in humans support rapid motor memory consolidation during epochs of wakefulness interleaved with task practice.

OBJECTIVES/HYPOTHESES

The goal of this study was to test whether such reactivation patterns can be modulated with experimental interventions and in turn influence fast consolidation. We hypothesized that non-invasive brain stimulation targeting hippocampal and striatal networks via the prefrontal cortex would influence brain reactivation and the rapid form of motor memory consolidation.

METHODS

Theta-burst stimulation was applied to a prefrontal cluster functionally connected to both the hippocampus and striatum of young healthy participants before they learned a motor sequence task in a functional magnetic resonance imaging (fMRI) scanner. Neuroimaging data acquired during task practice and the interleaved rest epochs were analyzed to comprehensively characterize the effect of stimulation on the neural processes supporting fast motor memory consolidation.

RESULTS

Our results collectively show that active, as compared to control, theta-burst stimulation of the prefrontal cortex hindered fast motor memory consolidation. Converging evidence from both univariate and multivariate analyses of fMRI data indicate that active stimulation disrupted hippocampal and caudate responses during inter-practice rest, presumably altering the reactivation of learning-related patterns during the micro-offline consolidation episodes. Last, stimulation altered the link between the brain and the behavioral markers of the fast consolidation process.

CONCLUSION

These results suggest that stimulation targeting deep brain regions via the prefrontal cortex can be used to modulate hippocampal and striatal reactivations in the human brain and influence motor memory consolidation.

Engram neurons: Encoding, consolidation, retrieval, and forgetting of memory

Tremendous strides have been made in our understanding of the neurobiological substrates of memory - the so-called memory "engram". Here, we integrate recent progress in the engram field to illustrate how engram neurons transform across the "lifespan" of a memory - from initial memory encoding, to consolidation and retrieval, and ultimately to forgetting. To do so, we first describe how cell-intrinsic properties shape the initial emergence of the engram at memory encoding. Second, we highlight how these encoding neurons preferentially participate in synaptic- and systems-level consolidation of memory. Third, we describe how these changes during encoding and consolidation guide neural reactivation during retrieval, and facilitate memory recall. Fourth, we describe neurobiological mechanisms of forgetting, and how these mechanisms can counteract engram properties established during memory encoding, consolidation, and retrieval. Motivated by recent experimental results across these four sections, we conclude by proposing some conceptual extensions to the traditional view of the engram, including broadening the view of cell-type participation within engrams and across memory stages. In collection, our review synthesizes general principles of the engram across memory stages, and describes future avenues to further understand the dynamic engram.

Distinct frequencies balance segregation with interaction between different memory types within a prefrontal circuit

Once formed, the fate of memory is uncertain. Subsequent offline interactions between even different memory types (actions versus words) modify retention.^1,2,3,4,5,6 These interactions may occur due to different oscillations functionally linking together different memory types within a circuit.^{7,8,9,10,11,12,13} With memory processing driving the circuit, it may become less susceptible to external influences.¹⁴ We tested this prediction by perturbing the human brain with single pulses of transcranial magnetic stimulation (TMS) and simultaneously measuring the brain activity changes with electroencephalography (EEG^15,16,17). Stimulation was applied over brain areas that contribute to memory processing (dorsolateral prefrontal cortex, DLPFC; primary motor cortex, M1) at baseline and offline, after memory formation, when memory interactions are known to occur.^1,4,6,10,18 The EEG response decreased offline (compared with baseline) within the alpha/beta frequency bands when stimulation was applied to the DLPFC, but not to M1. This decrease exclusively followed memory tasks that interact, revealing that it was due specifically to the interaction, not task performance. It remained even when the order of the memory tasks was changed and so was present, regardless of how the memory interaction was produced. Finally, the decrease within alpha power (but not beta) was correlated with impairment in motor memory, whereas the decrease in beta power (but not alpha) was correlated with impairment in word-list memory. Thus, different memory types are linked to different frequency bands within a DLPFC circuit, and the power of these bands shapes the balance between interaction and segregation between these memories.

Human motor sequence learning drives transient changes in network topology and hippocampal connectivity early during memory consolidation

In the last decade, the exclusive role of the hippocampus in human declarative learning has been challenged. Recently, we have shown that gains in performance observed in motor sequence learning (MSL) during the quiet rest periods interleaved with practice are associated with increased hippocampal activity, suggesting a role of this structure in motor memory reactivation. Yet, skill also develops offline as memory stabilizes after training and overnight. To examine whether the hippocampus contributes to motor sequence memory consolidation, here we used a network neuroscience strategy to track its functional connectivity offline 30 min and 24 h post learning using resting-state functional magnetic resonance imaging. Using a graph-analytical approach we found that MSL transiently increased network modularity, reflected in an increment in local information processing at 30 min that returned to baseline at 24 h. Within the same time window, MSL decreased the connectivity of a hippocampal-sensorimotor network, and increased the connectivity of a striatal-premotor network in an antagonistic manner. Finally, a supervised classification identified a low-dimensional pattern of hippocampal connectivity that discriminated between control and MSL data with high accuracy. The fact that changes in hippocampal connectivity were detected shortly after training supports a relevant role of the hippocampus in early stages of motor memory consolidation.

Breaking the barriers to designing online experiments: A novel open-source platform for supporting procedural skill learning experiments

BACKGROUND

Motor learning experiments are typically performed in laboratory environments, which can be time-consuming and require dedicated equipment/personnel, thus limiting the ability to gather data from large samples. To address this problem, some researchers have transitioned to unsupervised online experiments, showing advantages in participant recruitment without losing validity. However, most online platforms require coding experience or time-consuming setups to create and run experiments, limiting their usage across the field.

METHOD

To tackle this issue, an open-source web-based platform was developed (https://experiments.neurro-lab.engin.umich.edu/) to create, run, and manage procedural skill learning experiments without coding or setup requirements. The feasibility of the platform and the comparability of the results between supervised (n = 17) and unsupervised (n = 24) were tested in 41 naive right-handed participants using an established sequential finger tapping task. The study also tested if a previously reported rapid form of offline consolidation (i.e., microscale learning) in procedural skill learning could be replicated with the developed platform and evaluated the extent of interlimb transfer associated with the finger tapping task.

RESULTS

The results indicated that the performance metrics were comparable between the supervised and unsupervised groups (all p's > 0.05). The learning curves, mean tapping speeds, and micro-scale learning were similar to previous studies. Training led to significant improvements in mean tapping speed (2.22 ± 1.48 keypresses/s, p < 0.001) and a significant interlimb transfer of learning (1.22 ± 1.43 keypresses/s, p < 0.05).

CONCLUSIONS

The results show that the presented platform may serve as a valuable tool for conducting online procedural skill-learning experiments.

How our understanding of memory replay evolves

Memory reactivations and replay, widely reported in the hippocampus and cortex across species, have been implicated in memory consolidation, planning, and spatial and skill learning. Technological advances in electrophysiology, calcium imaging, and human neuroimaging techniques have enabled neuroscientists to measure large-scale neural activity with increasing spatiotemporal resolution and have provided opportunities for developing robust analytic methods to identify memory replay. In this article, we first review a large body of historically important and representative memory replay studies from the animal and human literature. We then discuss our current understanding of memory replay functions in learning, planning, and memory consolidation and further discuss the progress in computational modeling that has contributed to these improvements. Next, we review past and present analytic methods for replay analyses and discuss their limitations and challenges. Finally, looking ahead, we discuss some promising analytic methods for detecting nonstereotypical, behaviorally nondecodable structures from large-scale neural recordings. We argue that seamless integration of multisite recordings, real-time replay decoding, and closed-loop manipulation experiments will be essential for delineating the role of memory replay in a wide range of cognitive and motor functions.

Reactivation-induced motor skill modulation does not operate at a rapid micro-timescale level

Abundant evidence shows that consolidated memories are susceptible to modifications following their reactivation. Processes of memory consolidation and reactivation-induced skill modulation have been commonly documented after hours or days. Motivated by studies showing rapid consolidation in early stages of motor skill acquisition, here we asked whether motor skill memories are susceptible to modifications following brief reactivations, even at initial stages of learning. In a set of experiments, we collected crowdsourced online motor sequence data to test whether post-encoding interference and performance enhancement occur following brief reactivations in early stages of learning. Results indicate that memories forming during early learning are not susceptible to interference nor to enhancement within a rapid reactivation-induced time window, relative to control conditions. This set of evidence suggests that reactivation-induced motor skill memory modulation might be dependent on consolidation at the macro-timescale level, requiring hours or days to occur.

Manipulating the Rapid Consolidation Periods in a Learning Task Affects General Skills More than Statistical Learning and Changes the Dynamics of Learning

Memory consolidation processes have traditionally been investigated from the perspective of hours or days. However, recent developments in memory research have shown that memory consolidation processes could occur even within seconds, possibly because of the neural replay of just practiced memory traces during short breaks. Here, we investigate this rapid form of consolidation during statistical learning. We aim to answer (1) whether this rapid consolidation occurs in implicit statistical learning and general skill learning, and (2) whether the duration of rest periods affects these two learning types differently. Human participants performed a widely used statistical learning task-the alternating serial reaction time (ASRT) task-that enables us to measure implicit statistical and general skill learning separately. The ASRT task consisted of 25 learning blocks with a rest period between the blocks. In a between-subjects design, the length of the rest periods was fixed at 15 or 30 s, or the participants could control the length themselves. We found that the duration of rest periods does not affect the amount of statistical knowledge acquired but does change the dynamics of learning. Shorter rest periods led to better learning during the learning blocks, whereas longer rest periods promoted learning also in the between-block rest periods, possibly because of the higher amount of replay. Moreover, we found weaker general skill learning in the self-paced group than in the fixed rest period groups. These results suggest that distinct learning processes are differently affected by the duration of short rest periods.

Cortical-hippocampal coupling during manifold exploration in motor cortex

Systems consolidation-a process for long-term memory stabilization-has been hypothesized to occur in two stages1-4. Whereas new memories require the hippocampus5-9, they become integrated into cortical networks over time10-12, making them independent of the hippocampus. How hippocampal-cortical dialogue precisely evolves during this and how cortical representations change in concert is unknown. Here, we use a skill learning task13,14 to monitor the dynamics of cross-area coupling during non-rapid eye movement sleep along with changes in primary motor cortex (M1) representational stability. Our results indicate that precise cross-area coupling between hippocampus, prefrontal cortex and M1 can demarcate two distinct stages of processing. We specifically find that each animal demonstrates a sharp increase in prefrontal cortex and M1 sleep slow oscillation coupling with stabilization of performance. This sharp increase then predicts a drop in hippocampal sharp-wave ripple (SWR)-M1 slow oscillation coupling-suggesting feedback to inform hippocampal disengagement and transition to a second stage. Notably, the first stage shows significant increases in hippocampal SWR-M1 slow oscillation coupling in the post-training sleep and is closely associated with rapid learning and variability of the M1 low-dimensional manifold. Strikingly, even after consolidation, inducing new manifold exploration by changing task parameters re-engages hippocampal-M1 coupling. We thus find evidence for dynamic hippocampal-cortical dialogue associated with manifold exploration during learning and adaptation.

Applied strategies of neuroplasticity

Various levels of somatotopic organization are present throughout the human nervous system. However, this organization can change when needed based on environmental demands, a phenomenon known as neuroplasticity. Neuroplasticity can occur when learning a new motor skill, adjusting to life after blindness, or following a stroke. Following an injury, these neuroplastic changes can be adaptive or maladaptive, and often occur regardless of whether rehabilitation occurs or not. But not all movements produce neuroplasticity, nor do all rehabilitation interventions. Here, we focus on research regarding how to maximize adaptive neuroplasticity while also minimizing maladaptive plasticity, known as applied neuroplasticity. Emphasis is placed on research exploring how best to apply neuroplastic principles to training environments and rehabilitation protocols. By studying and applying these principles in research and clinical practice, it is hoped that learning of skills and regaining of function and independence can be optimized.

Robust enhancement of motor sequence learning with 4 mA transcranial electric stimulation

BACKGROUND AND OBJECTIVES

Motor learning experiments with transcranial direct current stimulation (tDCS) at 2 mA have produced mixed results. We hypothesize that tDCS boosts motor learning provided sufficiently high field intensity on the motor cortex.

METHODS

In a single-blinded design, 108 healthy participants received either anodal (N = 36) or cathodal (N = 36) tDCS at 4 mA total, or no stimulation (N = 36) while they practiced a 12-min sequence learning task. Anodal stimulation was delivered across four electrode pairs (1 mA each), with anodes above the right parietal lobe and cathodes above the right frontal lobe. Cathodal stimulation, with reversed polarities, served as an active control for sensation, while the no-stimulation condition established baseline performance. fMRI-localized targets on the primary motor cortex in 10 subjects were used in current flow models to optimize electrode placement for maximal field intensity. A single electrode montage was then selected for all participants.

RESULTS

We found a significant difference in performance with anodal vs. cathodal stimulation (Cohen's d = 0.71) and vs. no stimulation (d = 0.56). This effect persisted for at least 1 h, and subsequent learning for a new sequence and the opposite hand also improved. Sensation ratings were comparable in the active groups and did not exceed moderate levels. Current flow models suggest the new electrode montage can achieve stronger motor cortex polarization than alternative montages.

CONCLUSION

The present paradigm shows a medium to large effect size and is well-tolerated. It may serve as a go-to experiment for future studies on motor learning and tDCS.

Dissipation of reactive inhibition is sufficient to explain post-rest improvements in motor sequence learning

The prevailing hypothesis for observed post-rest motor reaction time improvements is offline consolidation. In the present study, we present evidence for an alternate account involving the accrual and dissipation of reactive inhibition. Four groups of participants (N = 159) performed a finger-tapping task involving either massed (30 s per trial) or spaced (10 s per trial) training, and with one of two break intervals between each trial: 10 s or 30 s. After 360 s of training in each group, there was a 300 s rest period followed by a final test on the same task. The results show that the smaller the ratio of break time to on-task trial time during training, the larger the improvement in reaction time after the rest period. Those results are fully consistent with a model that assumes no facilitating offline consolidation, but rather learning that is concurrent with performance and reactive inhibition that builds during performance and dissipates during breaks.

Sustained upregulation of widespread hippocampal-neocortical coupling following memory encoding

Systems consolidation of new experiences into lasting episodic memories involves hippocampal-neocortical interactions. Evidence of this process is already observed during early post-encoding rest periods, both as increased hippocampal coupling with task-relevant perceptual regions and reactivation of stimulus-specific patterns following intensive encoding tasks. We investigate the spatial and temporal characteristics of these hippocampally anchored post-encoding neocortical modulations. Eighty-nine adults participated in an experiment consisting of interleaved memory task- and resting-state periods. We observed increased post-encoding functional connectivity between hippocampus and individually localized neocortical regions responsive to stimuli encountered during memory encoding. Post-encoding modulations were manifested as a nearly system-wide upregulation in hippocampal coupling with all major functional networks. The configuration of these extensive modulations resembled hippocampal-neocortical interaction patterns estimated from active encoding operations, suggesting hippocampal post-encoding involvement exceeds perceptual aspects. Reinstatement of encoding patterns was not observed in resting-state scans collected 12 h later, nor when using other candidate seed regions. The similarity in hippocampal functional coupling between online memory encoding and offline post-encoding rest suggests reactivation in humans involves a spectrum of cognitive processes engaged during the experience of an event. There were no age effects, suggesting that upregulation of hippocampal-neocortical connectivity represents a general phenomenon seen across the adult lifespan.

Effects of virtual body-representation on motor skill learning

Motor learning is often hindered or facilitated by visual information from one's body and its movement. However, it is unclear whether visual representation of the body itself facilitates motor learning. Thus, we tested the effects of virtual body-representation on motor learning through a virtual reality rotary pursuit task. In the task, visual feedback on participants' movements was identical, but virtual body-representation differed by dividing the experimental conditions into three conditions: non-avatar, non-hand avatar, and hand-shaped avatar. We measured the differences in the rate of motor learning, body-ownership, and sense of agency in the three conditions. Although there were no differences in body-ownership and sense of agency between the conditions, the hand-shaped avatar condition was significantly superior to the other conditions in the rate of learning. These findings suggest that visually recognizing one's body shape facilitates motor learning.

Wakeful resting and listening to music contrast their effects on verbal long-term memory in dependence on word concreteness

Wakeful resting and listening to music are powerful means to modulate memory. How these activities affect memory when directly compared has not been tested so far. In two experiments, participants encoded and immediately recalled two word lists followed by either 6 min wakefully resting or 6 min listening to music. The results of Experiment 1 show that both post-encoding conditions have a similar effect on memory after 1 day. In Experiment 2, we explored the possibility that less concrete words, i.e. lower in imageability than in Experiment 1, are differently affected by the two post-encoding conditions. The results of Experiment 2 show that, when words are less concrete, more words are retained after 1 day when encoding is followed by wakeful resting rather than listening to music. These findings indicate that the effects of wakeful resting and listening to music on memory consolidation are moderated by the concreteness of the encoded material.

Somatosensory targeted memory reactivation enhances motor performance via hippocampal-mediated plasticity

Increasing evidence suggests that reactivation of newly acquired memory traces during postlearning wakefulness plays an important role in memory consolidation. Here, we sought to boost the reactivation of a motor memory trace during postlearning wakefulness (quiet rest) immediately following learning using somatosensory targeted memory reactivation (TMR). Using functional magnetic resonance imaging, we examined the neural correlates of the reactivation process as well as the effect of the TMR intervention on brain responses elicited by task practice on 24 healthy young adults. Behavioral data of the post-TMR retest session showed a faster learning rate for the motor sequence that was reactivated as compared to the not-reactivated sequence. Brain imaging data revealed that motor, parietal, frontal, and cerebellar brain regions, which were recruited during initial motor learning, were specifically reactivated during the TMR episode and that hippocampo-frontal connectivity was modulated by the reactivation process. Importantly, the TMR-induced behavioral advantage was paralleled by dynamical changes in hippocampal activity and hippocampo-motor connectivity during task practice. Altogether, the present results suggest that somatosensory TMR during postlearning quiet rest can enhance motor performance via the modulation of hippocampo-cortical responses.

Modulation of neural co-firing to enhance network transmission and improve motor function after stroke

Stroke is a leading cause of disability. While neurotechnology has shown promise for improving upper limb recovery after stroke, efficacy in clinical trials has been variable. Our central thesis is that to improve clinical translation, we need to develop a common neurophysiological framework for understanding how neurotechnology alters network activity. Our perspective discusses principles for how motor networks, both healthy and those recovering from stroke, subserve reach-to-grasp movements. We focus on neural processing at the resolution of single movements, the timescale at which neurotechnologies are applied, and discuss how this activity might drive long-term plasticity. We propose that future studies should focus on cross-area communication and bridging our understanding of timescales ranging from single trials within a session to across multiple sessions. We hope that this perspective establishes a combined path forward for preclinical and clinical research with the goal of more robust clinical translation of neurotechnology.

Time Is of the Essence: Neural Codes, Synchronies, Oscillations, Architectures

Time is of the essence in how neural codes, synchronies, and oscillations might function in encoding, representation, transmission, integration, storage, and retrieval of information in brains. This Hypothesis and Theory article examines observed and possible relations between codes, synchronies, oscillations, and types of neural networks they require. Toward reverse-engineering informational functions in brains, prospective, alternative neural architectures incorporating principles from radio modulation and demodulation, active reverberant circuits, distributed content-addressable memory, signal-signal time-domain correlation and convolution operations, spike-correlation-based holography, and self-organizing, autoencoding anticipatory systems are outlined. Synchronies and oscillations are thought to subserve many possible functions: sensation, perception, action, cognition, motivation, affect, memory, attention, anticipation, and imagination. These include direct involvement in coding attributes of events and objects through phase-locking as well as characteristic patterns of spike latency and oscillatory response. They are thought to be involved in segmentation and binding, working memory, attention, gating and routing of signals, temporal reset mechanisms, inter-regional coordination, time discretization, time-warping transformations, and support for temporal wave-interference based operations. A high level, partial taxonomy of neural codes consists of channel, temporal pattern, and spike latency codes. The functional roles of synchronies and oscillations in candidate neural codes, including oscillatory phase-offset codes, are outlined. Various forms of multiplexing neural signals are considered: time-division, frequency-division, code-division, oscillatory-phase, synchronized channels, oscillatory hierarchies, polychronous ensembles. An expandable, annotative neural spike train framework for encoding low- and high-level attributes of events and objects is proposed. Coding schemes require appropriate neural architectures for their interpretation. Time-delay, oscillatory, wave-interference, synfire chain, polychronous, and neural timing networks are discussed. Some novel concepts for formulating an alternative, more time-centric theory of brain function are discussed. As in radio communication systems, brains can be regarded as networks of dynamic, adaptive transceivers that broadcast and selectively receive multiplexed temporally-patterned pulse signals. These signals enable complex signal interactions that select, reinforce, and bind common subpatterns and create emergent lower dimensional signals that propagate through spreading activation interference networks. If memory traces share the same kind of temporal pattern forms as do active neuronal representations, then distributed, holograph-like content-addressable memories are made possible via temporal pattern resonances.

Reward timing matters in motor learning

Reward timing, that is, the delay after which reward is delivered following an action is known to strongly influence reinforcement learning. Here, we asked if reward timing could also modulate how people learn and consolidate new motor skills. In 60 healthy participants, we found that delaying reward delivery by a few seconds influenced motor learning. Indeed, training with a short reward delay (1 s) induced continuous improvements in performance, whereas a long reward delay (6 s) led to initially high learning rates that were followed by an early plateau in the learning curve and a lower performance at the end of training. Participants who learned the skill with a long reward delay also exhibited reduced overnight memory consolidation. Overall, our data show that reward timing affects the dynamics and consolidation of motor learning, a finding that could be exploited in future rehabilitation programs.