1
|
Mista CA, Arguissain FG, Ranieri A, Nielsen JF, Andersen H, Biurrun Manresa JA, Andersen OK. Spatio-temporal modulation of cortical activity during motor deadaptation depends on the feedback of task-related error. Behav Brain Res 2024; 468:115024. [PMID: 38705283 DOI: 10.1016/j.bbr.2024.115024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2024] [Revised: 04/26/2024] [Accepted: 04/27/2024] [Indexed: 05/07/2024]
Abstract
Motor adaptations are responsible for recalibrating actions and facilitating the achievement of goals in a constantly changing environment. Once consolidated, the decay of motor adaptation is a process affected by available sensory information during deadaptation. However, the cortical response to task error feedback during the deadaptation phase has received little attention. Here, we explored changes in brain cortical responses due to feedback of task-related error during deadaptation. Twelve healthy volunteers were recruited for the study. Right hand movement and EEG were recorded during repetitive trials of a hand reaching movement. A visuomotor rotation of 30° was introduced to induce motor adaptation. Volunteers participated in two experimental sessions organized in baseline, adaptation, and deadaptation blocks. In the deadaptation block, the visuomotor rotation was removed, and visual feedback was only provided in one session. Performance was quantified using angle end-point error, averaged speed, and movement onset time. A non-parametric spatiotemporal cluster-level permutation test was used to analyze the EEG recordings. During deadaptation, participants experienced a greater error reduction when feedback of the cursor was provided. The EEG responses showed larger activity in the left centro-frontal parietal areas during the deadaptation block when participants received feedback, as opposed to when they did not receive feedback. Centrally distributed clusters were found for the adaptation and deadaptation blocks in the absence of visual feedback. The results suggest that visual feedback of the task-related error activates cortical areas related to performance monitoring, depending on the accessible sensory information.
Collapse
Affiliation(s)
- C A Mista
- Institute for Research and Development on Bioengineering and Bioinformatics (IBB), CONICET-UNER, Oro Verde, Argentina; Center for Rehabilitation Engineering and Neuromuscular and Sensory Research (CIRINS), National University of Entre Ríos, Oro Verde, Argentina
| | - F G Arguissain
- Center for Neuroplasticity and Pain (CNAP), Department of Health Science and Technology, Aalborg University, Aalborg, Denmark
| | - A Ranieri
- Center for Neuroplasticity and Pain (CNAP), Department of Health Science and Technology, Aalborg University, Aalborg, Denmark
| | - J F Nielsen
- Hammel Neurorehabilitation and Research Centre, Aarhus University Hospital, Denmark
| | - H Andersen
- Hammel Neurorehabilitation and Research Centre, Aarhus University Hospital, Denmark; Department of Neurology, Aarhus University Hospital, Aarhus, Denmark
| | - J A Biurrun Manresa
- Institute for Research and Development on Bioengineering and Bioinformatics (IBB), CONICET-UNER, Oro Verde, Argentina; Center for Rehabilitation Engineering and Neuromuscular and Sensory Research (CIRINS), National University of Entre Ríos, Oro Verde, Argentina; Center for Neuroplasticity and Pain (CNAP), Department of Health Science and Technology, Aalborg University, Aalborg, Denmark
| | - O K Andersen
- Center for Neuroplasticity and Pain (CNAP), Department of Health Science and Technology, Aalborg University, Aalborg, Denmark.
| |
Collapse
|
2
|
Wood JM, Thompson E, Wright H, Festa L, Morton SM, Reisman DS, Kim HE. Explicit and implicit locomotor learning in individuals with chronic hemiparetic stroke. bioRxiv 2024:2024.02.04.578807. [PMID: 38370851 PMCID: PMC10871205 DOI: 10.1101/2024.02.04.578807] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/20/2024]
Abstract
Motor learning involves both explicit and implicit processes that are fundamental for acquiring and adapting complex motor skills. However, stroke may damage the neural substrates underlying explicit and/or implicit learning, leading to deficits in overall motor performance. While both learning processes are typically used in concert in daily life and rehabilitation, no gait studies have determined how these processes function together after stroke when tested during a task that elicits dissociable contributions from both. Here, we compared explicit and implicit locomotor learning in individuals with chronic stroke to age- and sex-matched neurologically intact controls. We assessed implicit learning using split-belt adaptation (where two treadmill belts move at different speeds). We assessed explicit learning (i.e., strategy-use) using visual feedback during split-belt walking to help individuals explicitly correct for step length errors created by the split-belts. The removal of visual feedback after the first 40 strides of split-belt walking, combined with task instructions, minimized contributions from explicit learning for the remainder of the task. We utilized computational modeling to determine the individual contributions of explicit and implicit processes to overall behavioral change. The computational and behavioral analyses revealed that, compared to controls, individuals with chronic stroke demonstrated deficits in both explicit and implicit contributions to locomotor learning, a result that runs counter to prior work testing each process individually during gait. Since post-stroke locomotor rehabilitation involves interventions that rely on both explicit and implicit motor learning, future work should determine how locomotor rehabilitation interventions can be structured to optimize overall motor learning.
Collapse
Affiliation(s)
- Jonathan M. Wood
- Department of Physical Therapy, University of Delaware, Newark, DE 19713, United States
- Biomechanics and Movement Sciences Program, University of Delaware, Newark, DE 19713, United States
| | - Elizabeth Thompson
- Department of Physical Therapy, University of Delaware, Newark, DE 19713, United States
| | - Henry Wright
- Department of Physical Therapy, University of Delaware, Newark, DE 19713, United States
| | - Liam Festa
- Department of Physical Therapy, University of Delaware, Newark, DE 19713, United States
| | - Susanne M. Morton
- Department of Physical Therapy, University of Delaware, Newark, DE 19713, United States
- Biomechanics and Movement Sciences Program, University of Delaware, Newark, DE 19713, United States
| | - Darcy S. Reisman
- Department of Physical Therapy, University of Delaware, Newark, DE 19713, United States
- Biomechanics and Movement Sciences Program, University of Delaware, Newark, DE 19713, United States
| | - Hyosub E. Kim
- Department of Physical Therapy, University of Delaware, Newark, DE 19713, United States
- Biomechanics and Movement Sciences Program, University of Delaware, Newark, DE 19713, United States
- School of Kinesiology, University of British Columbia, Vancouver, BC, Canada
- Graduate Program in Neuroscience, University of British Columbia, Vancouver, BC, Canada
| |
Collapse
|
3
|
Hadjiosif AM, Abraham G, Ranjan T, Smith MA. Subtle Visual Latency Can Profoundly Impair Implicit Sensorimotor Learning. bioRxiv 2024:2024.03.14.585093. [PMID: 38558971 PMCID: PMC10980026 DOI: 10.1101/2024.03.14.585093] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/04/2024]
Abstract
Short sub-100ms visual feedback latencies are common in many types of human-computer interactions yet are known to markedly reduce performance in a wide variety of motor tasks from simple pointing to operating surgical robotics. These latencies are also present in the computer-based experiments used to study the sensorimotor learning that underlies the acquisition of motor performance. Inspired by neurophysiological findings showing that cerebellar LTD and cortical LTP would both be disrupted by sub-100ms latencies, we hypothesized that implicit sensorimotor learning may be particularly sensitive to these short latencies. Remarkably, we find that improving latency by just 60ms, from 85 to 25ms in latency-optimized experiments, increases implicit learning by 50% and proportionally decreases explicit learning, resulting in a dramatic reorganization of sensorimotor memory. We go on to show that implicit sensorimotor learning is considerably more sensitive to latencies in the sub-100ms range than at higher latencies, in line with the latency-specific neural plasticity that has been observed. This suggests a clear benefit for latency reduction in computer-based training that involves implicit sensorimotor learning and that across-study differences in implicit motor learning might often be explained by disparities in feedback latency.
Collapse
|
4
|
Churchland MM, Shenoy KV. Preparatory activity and the expansive null-space. Nat Rev Neurosci 2024; 25:213-236. [PMID: 38443626 DOI: 10.1038/s41583-024-00796-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/26/2024] [Indexed: 03/07/2024]
Abstract
The study of the cortical control of movement experienced a conceptual shift over recent decades, as the basic currency of understanding shifted from single-neuron tuning towards population-level factors and their dynamics. This transition was informed by a maturing understanding of recurrent networks, where mechanism is often characterized in terms of population-level factors. By estimating factors from data, experimenters could test network-inspired hypotheses. Central to such hypotheses are 'output-null' factors that do not directly drive motor outputs yet are essential to the overall computation. In this Review, we highlight how the hypothesis of output-null factors was motivated by the venerable observation that motor-cortex neurons are active during movement preparation, well before movement begins. We discuss how output-null factors then became similarly central to understanding neural activity during movement. We discuss how this conceptual framework provided key analysis tools, making it possible for experimenters to address long-standing questions regarding motor control. We highlight an intriguing trend: as experimental and theoretical discoveries accumulate, the range of computational roles hypothesized to be subserved by output-null factors continues to expand.
Collapse
Affiliation(s)
- Mark M Churchland
- Department of Neuroscience, Columbia University, New York, NY, USA.
- Grossman Center for the Statistics of Mind, Columbia University, New York, NY, USA.
- Kavli Institute for Brain Science, Columbia University, New York, NY, USA.
| | - Krishna V Shenoy
- Department of Electrical Engineering, Stanford University, Stanford, CA, USA
- Department of Bioengineering, Stanford University, Stanford, CA, USA
- Department of Neurobiology, Stanford University, Stanford, CA, USA
- Department of Neurosurgery, Stanford University, Stanford, CA, USA
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA
- Bio-X Institute, Stanford University, Stanford, CA, USA
- Howard Hughes Medical Institute at Stanford University, Stanford, CA, USA
| |
Collapse
|
5
|
Wood JM, Kim HE, Morton SM. Reinforcement Learning during Locomotion. eNeuro 2024; 11:ENEURO.0383-23.2024. [PMID: 38438263 PMCID: PMC10946027 DOI: 10.1523/eneuro.0383-23.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2023] [Revised: 02/20/2024] [Accepted: 02/23/2024] [Indexed: 03/06/2024] Open
Abstract
When learning a new motor skill, people often must use trial and error to discover which movement is best. In the reinforcement learning framework, this concept is known as exploration and has been linked to increased movement variability in motor tasks. For locomotor tasks, however, increased variability decreases upright stability. As such, exploration during gait may jeopardize balance and safety, making reinforcement learning less effective. Therefore, we set out to determine if humans could acquire and retain a novel locomotor pattern using reinforcement learning alone. Young healthy male and female participants walked on a treadmill and were provided with binary reward feedback (indicated by a green checkmark on the screen) that was tied to a fixed monetary bonus, to learn a novel stepping pattern. We also recruited a comparison group who walked with the same novel stepping pattern but did so by correcting for target error, induced by providing real-time veridical visual feedback of steps and a target. In two experiments, we compared learning, motor variability, and two forms of motor memories between the groups. We found that individuals in the binary reward group did, in fact, acquire the new walking pattern by exploring (increasing motor variability). Additionally, while reinforcement learning did not increase implicit motor memories, it resulted in more accurate explicit motor memories compared with the target error group. Overall, these results demonstrate that humans can acquire new walking patterns with reinforcement learning and retain much of the learning over 24 h.
Collapse
Affiliation(s)
- Jonathan M Wood
- Department of Physical Therapy, University of Delaware, Newark, Delaware 19713
- Interdisciplinary Graduate Program in Biomechanics & Movement Science, University of Delaware, Newark, Delaware 19713
| | - Hyosub E Kim
- Department of Physical Therapy, University of Delaware, Newark, Delaware 19713
- Interdisciplinary Graduate Program in Biomechanics & Movement Science, University of Delaware, Newark, Delaware 19713
- Department of Psychological and Brain Sciences, University of Delaware, Newark, Delaware 19716
- School of Kinesiology, University of British Columbia, Vancouver, British Columbia V6T 1Z1, Canada
| | - Susanne M Morton
- Department of Physical Therapy, University of Delaware, Newark, Delaware 19713
- Interdisciplinary Graduate Program in Biomechanics & Movement Science, University of Delaware, Newark, Delaware 19713
| |
Collapse
|
6
|
Tsay JS, Asmerian H, Germine LT, Wilmer J, Ivry RB, Nakayama K. Large-scale citizen science reveals predictors of sensorimotor adaptation. Nat Hum Behav 2024; 8:510-525. [PMID: 38291127 DOI: 10.1038/s41562-023-01798-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2023] [Accepted: 12/04/2023] [Indexed: 02/01/2024]
Abstract
Sensorimotor adaptation is essential for keeping our movements well calibrated in response to changes in the body and environment. For over a century, researchers have studied sensorimotor adaptation in laboratory settings that typically involve small sample sizes. While this approach has proved useful for characterizing different learning processes, laboratory studies are not well suited for exploring the myriad of factors that may modulate human performance. Here, using a citizen science website, we collected over 2,000 sessions of data on a visuomotor rotation task. This unique dataset has allowed us to replicate, reconcile and challenge classic findings in the learning and memory literature, as well as discover unappreciated demographic constraints associated with implicit and explicit processes that support sensorimotor adaptation. More generally, this study exemplifies how a large-scale exploratory approach can complement traditional hypothesis-driven laboratory research in advancing sensorimotor neuroscience.
Collapse
Affiliation(s)
- Jonathan S Tsay
- Department of Psychology, Carnegie Mellon University, Pittsburgh, PA, USA.
| | - Hrach Asmerian
- Department of Psychology, University of California, Berkeley, Berkeley, CA, USA.
| | - Laura T Germine
- Department of Psychiatry, Harvard Medical School, Boston, MA, USA
- Institute for Technology in Psychiatry, McLean Hospital, Belmont, MA, USA
| | - Jeremy Wilmer
- Department of Psychology, Wellesley College, Wellesley, MA, USA
| | - Richard B Ivry
- Department of Psychology, University of California, Berkeley, Berkeley, CA, USA
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA, USA
| | - Ken Nakayama
- Department of Psychology, University of California, Berkeley, Berkeley, CA, USA
| |
Collapse
|
7
|
Zhou W, Monsen E, Fernandez KD, Haly K, Kruse EA, Joiner WM. Motion state-dependent motor learning based on explicit visual feedback has limited spatiotemporal properties compared with adaptation to physical perturbations. J Neurophysiol 2024; 131:278-293. [PMID: 38166455 DOI: 10.1152/jn.00198.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2023] [Revised: 12/26/2023] [Accepted: 01/01/2024] [Indexed: 01/04/2024] Open
Abstract
We recently showed that subjects can learn motion state-dependent changes to motor output (temporal force patterns) based on explicit visual feedback of the equivalent force field (i.e., without the physical perturbation). Here, we examined the spatiotemporal properties of this learning compared with learning based on physical perturbations. There were two human subject groups and two experimental paradigms. One group (n = 40) experienced physical perturbations (i.e., a velocity-dependent force field, vFF), whereas the second (n = 40) was given explicit visual feedback (EVF) of the force-velocity relationship. In the latter, subjects moved in force channels and we provided visual feedback of the lateral force exerted during the movement, as well as the required force pattern based on movement velocity. In the first paradigm (spatial generalization), following vFF or EVF training, generalization of learning was tested by requiring subjects to move to 14 untrained target locations (0° to ±135° around the trained location). In the second paradigm (temporal stability), following training, we examined the decay of learning over eight delay periods (0 to 90 s). Results showed that learning based on EVF did not generalize to untrained directions, whereas the generalization for the vFF was significant for targets ≤ 45° away. In addition, the decay of learning for the EVF group was significantly faster than the FF group (a time constant of 2.72 ± 1.74 s vs. 12.53 ± 11.83 s). Collectively, our results suggest that recalibrating motor output based on explicit motion state information, in contrast to physical disturbances, uses learning mechanisms with limited spatiotemporal properties.NEW & NOTEWORTHY Adjustment of motor output based on limb motion state information can be achieved based on explicit information or from physical perturbations. Here, we investigated the spatiotemporal characteristics of short-term motor learning to determine the properties of the respective learning mechanisms. Our results suggest that adjustments based on physical perturbations are more temporally stable and applied over a greater spatial range than the learning based on explicit visual feedback, suggesting largely separate learning mechanisms.
Collapse
Affiliation(s)
- Weiwei Zhou
- Department of Neurobiology, Physiology and Behavior, University of California, Davis, California, United States
| | - Emma Monsen
- Department of Neurobiology, Physiology and Behavior, University of California, Davis, California, United States
| | - Kareelynn Donjuan Fernandez
- Department of Neurobiology, Physiology and Behavior, University of California, Davis, California, United States
| | - Katelyn Haly
- Department of Neurobiology, Physiology and Behavior, University of California, Davis, California, United States
| | | | - Wilsaan M Joiner
- Department of Neurobiology, Physiology and Behavior, University of California, Davis, California, United States
- Department of Neurology, University of California, Davis, California, United States
| |
Collapse
|
8
|
Jang J, Shadmehr R, Albert ST. A software tool for at-home measurement of sensorimotor adaptation. bioRxiv 2023:2023.12.12.571359. [PMID: 38168264 PMCID: PMC10760058 DOI: 10.1101/2023.12.12.571359] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/05/2024]
Abstract
Sensorimotor adaptation is traditionally studied in well-controlled laboratory settings with specialized equipment. However, recent public health concerns such as the COVID-19 pandemic, as well as a desire to recruit a more diverse study population, have led the motor control community to consider at-home study designs. At-home motor control experiments are still rare because of the requirement to write software that can be easily used by anyone on any platform. To this end, we developed software that runs locally on a personal computer. The software provides audiovisual instructions and measures the ability of the subject to control the cursor in the context of visuomotor perturbations. We tested the software on a group of at-home participants and asked whether the adaptation principles inferred from in-lab measurements were reproducible in the at-home setting. For example, we manipulated the perturbations to test whether there were changes in adaptation rates (savings and interference), whether adaptation was associated with multiple timescales of memory (spontaneous recovery), and whether we could selectively suppress subconscious learning (delayed feedback, perturbation variability) or explicit strategies (limited reaction time). We found remarkable similarity between in-lab and at-home behaviors across these experimental conditions. Thus, we developed a software tool that can be used by research teams with little or no programming experience to study mechanisms of adaptation in an at-home setting.
Collapse
Affiliation(s)
- Jihoon Jang
- Laboratory for Computational Motor Control, Department of Biomedical Engineering Johns Hopkins School of Medicine, Baltimore MD
| | - Reza Shadmehr
- Laboratory for Computational Motor Control, Department of Biomedical Engineering Johns Hopkins School of Medicine, Baltimore MD
| | - Scott T Albert
- Laboratory for Computational Motor Control, Department of Biomedical Engineering Johns Hopkins School of Medicine, Baltimore MD
| |
Collapse
|
9
|
De La Fontaine E, Hamel R, Lepage JF, Bernier PM. The influence of learning history on anterograde interference. Neurobiol Learn Mem 2023; 206:107866. [PMID: 37995802 DOI: 10.1016/j.nlm.2023.107866] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2023] [Revised: 10/04/2023] [Accepted: 11/20/2023] [Indexed: 11/25/2023]
Abstract
Classically interpreted as a competition between opposite memories (A vs B), anterograde interference (AI) also emerges in the absence of competing memories (A vs A), suggesting that mechanisms other than those involved in memory competition contribute to AI. To investigate this, we tested the hypothesis that extending motor practice would enhance a first memory, but come at the cost of reduced learning capabilities when subsequently exposed to a second learning session of the same task. Based on converging biological evidence, AI was expected to depend upon the degree of extended practice of the initial exposure. During a first Session, four conditions were carried out where participants (n = 24) adapted to a gradually introduced -20° visual deviation while the extent of the initial exposure was manipulated by varying the duration or type of the performance asymptote. Specifically, the performance asymptote at -20° was either Short (40 trials), Moderate (160 trials), Long (320 trials), or absent due to continuously changing perturbations around the mean of -20° (Jagged; 160 trials). After a 2-min interval, participants re-adapted to the same (-20°) visual deviation, which was meant to probe the effect of extended practice in the first Session on the learning capabilities of a second identical memory (A vs A). The results first confirmed that the duration of exposure in the first Session enhanced immediate aftereffects in the Moderate, Long, and Jagged conditions as compared to the Short condition, suggesting that extended practice enhanced retention of the first memory. When comparing the second Session to the first one, results revealed a different pattern of re-adaptation depending on the duration of initial exposure: in the Short condition, there was evidence for facilitated re-adaptation and similar aftereffects. However, in the Moderate, Long and Jagged conditions, re-adaptation was similar and aftereffects were impaired, suggestive of AI. This suggests that extended practice initially enhances memory formation, but comes at the cost of reduced subsequent learning capabilities. One possibility is that AI occurs because extended practice induces the emergence of network-specific homeostatic constraints, which limit subsequent neuroplastic and learning capabilities in the same neural network.
Collapse
Affiliation(s)
- E De La Fontaine
- Département de kinanthropologie, Faculté des sciences de l'activité physique, Université de Sherbrooke
| | - R Hamel
- Département de kinanthropologie, Faculté des sciences de l'activité physique, Université de Sherbrooke; Département de pédiatrie, Faculté de médecine et des sciences de la santé, Université de Sherbrooke, Centre de Recherche du Centre Hospitalier Universitaire de Sherbrooke
| | - J F Lepage
- Département de pédiatrie, Faculté de médecine et des sciences de la santé, Université de Sherbrooke, Centre de Recherche du Centre Hospitalier Universitaire de Sherbrooke
| | - P M Bernier
- Département de kinanthropologie, Faculté des sciences de l'activité physique, Université de Sherbrooke.
| |
Collapse
|
10
|
Yin C, Li B, Gao T. Differential effects of reward and punishment on reinforcement-based motor learning and generalization. J Neurophysiol 2023; 130:1150-1161. [PMID: 37791387 DOI: 10.1152/jn.00242.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2023] [Revised: 09/13/2023] [Accepted: 09/28/2023] [Indexed: 10/05/2023] Open
Abstract
Reward and punishment have long been recognized as potent modulators of human behavior. Although reinforcement learning is a significant motor learning process, the exact mechanisms underlying how the brain learns movements through reward and punishment are not yet fully understood. Beyond the memory of specific examples, investigating the ability to generalize to new situations offers a better understanding of motor learning. This study hypothesizes that reward and punishment engage qualitatively different motivational systems with different neurochemical and neuroanatomical substrates, which would have differential effects on reinforcement-based motor learning and generalization. To test this hypothesis, two groups of participants learn a motor task in one direction and then relearn the same task in a new direction, receiving only performance-based reward or punishment score feedback. Our findings support our hypothesis, showing that reward led to slower learning but promoted generalization. On the other hand, punishment led to faster learning but impaired generalization. These behavioral differences may be due to different tendencies of movement variability in each group. The punishment group tended to explore more actively than the reward group during the initial learning phase, possibly due to loss aversion. In contrast, the reward group tended to explore more actively than the initial learning phase during the generalization test phase, seemingly recalling the strategy that led to the reward. These results suggest that reward and punishment may engage different neural mechanisms during reinforcement-based motor learning and generalization, with important implications for practical applications such as sports training and motor rehabilitation.NEW & NOTEWORTHY Although reinforcement learning is a significant motor learning process, the mechanisms underlying how the brain learns movements through reward and punishment are not fully understood. We modified a well-established motor adaptation task and used savings (faster relearning) to measure generalization. We found reward led to slower learning but promoted generalization, whereas punishment led to faster learning but impaired generalization, suggesting that reward and punishment may engage different neural mechanisms during reinforcement-based motor learning and generalization.
Collapse
Affiliation(s)
- Cong Yin
- School of Kinesiology and Health, Capital University of Physical Education and Sports, Beijing, People's Republic of China
| | - Biao Li
- School of Kinesiology and Health, Capital University of Physical Education and Sports, Beijing, People's Republic of China
| | - Tian Gao
- School of Kinesiology and Health, Capital University of Physical Education and Sports, Beijing, People's Republic of China
| |
Collapse
|
11
|
James R, Wang J. The effects of a single bout of moderate-intensity aerobic exercise on visuomotor adaptation and its savings. Neurobiol Learn Mem 2023; 204:107801. [PMID: 37541612 DOI: 10.1016/j.nlm.2023.107801] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2023] [Revised: 06/02/2023] [Accepted: 07/28/2023] [Indexed: 08/06/2023]
Abstract
Performing exercise before or after motor skill learning is thought to have a positive impact on acquisition and retention of motor memories stored in our nervous system. It has been shown that performing 25 min of moderate-intensity aerobic exercise prior to visuomotor adaptation can enhance both visuomotor adaptation and its retention compared to 25 min of rest before the adaptation. To determine whether a single bout of aerobic exercise could actually facilitate the formation of a neural representation associated with a novel visuomotor condition, we examined aftereffects and savings associated with a visuomotor adaptation task following either an exercise or a rest condition. Sixteen healthy young individuals (18-35 years) first experienced 25 min of moderate-intensity cycling or rest, and then adapted to a 30-degree visuomotor rotation condition. Immediately following that, participants experienced a washout session, which was followed by a readaptation session. Results indicated that all subjects adapted to the visuomotor rotation completely, although no difference was found between the cycling and rest conditions. Aftereffects and savings were also observed in both conditions, but with no difference between the conditions. These findings suggest that compared to a short rest session, a single bout of moderate-intensity cycling may not have a greater impact for enhancing visuomotor adaptation and its retention. Further research is needed, in which the effects of certain factors such as exercise intensity, duration and timing are more systematically investigated.
Collapse
Affiliation(s)
- Reshma James
- Department of Kinesiology, University of Wisconsin - Milwaukee, Milwaukee, WI 53201, United States
| | - Jinsung Wang
- Department of Kinesiology, University of Wisconsin - Milwaukee, Milwaukee, WI 53201, United States.
| |
Collapse
|
12
|
Mangin EN, Chen J, Lin J, Li N. Behavioral measurements of motor readiness in mice. Curr Biol 2023; 33:3610-3624.e4. [PMID: 37582373 PMCID: PMC10529875 DOI: 10.1016/j.cub.2023.07.029] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2023] [Revised: 05/09/2023] [Accepted: 07/18/2023] [Indexed: 08/17/2023]
Abstract
Motor planning facilitates rapid and precise execution of volitional movements. Although motor planning has been classically studied in humans and monkeys, the mouse has become an increasingly popular model system to study neural mechanisms of motor planning. It remains yet untested whether mice and primates share common behavioral features of motor planning. We combined videography and a delayed response task paradigm in an autonomous behavioral system to measure motor planning in non-body-restrained mice. Motor planning resulted in both reaction time (RT) savings and increased movement accuracy, replicating classic effects in primates. We found that motor planning was reflected in task-relevant body features. Both the specific actions prepared and the degree of motor readiness could be read out online during motor planning. The online readout further revealed behavioral evidence of simultaneous preparation for multiple actions under uncertain conditions. These results validate the mouse as a model to study motor planning, demonstrate body feature movements as a powerful real-time readout of motor readiness, and offer behavioral evidence that motor planning can be a parallel process that permits rapid selection of multiple prepared actions.
Collapse
Affiliation(s)
- Elise N Mangin
- Department of Neuroscience, Baylor College of Medicine, Houston, TX 77030, USA
| | - Jian Chen
- Department of Neuroscience, Baylor College of Medicine, Houston, TX 77030, USA
| | - Jing Lin
- Department of Neuroscience, Baylor College of Medicine, Houston, TX 77030, USA
| | - Nuo Li
- Department of Neuroscience, Baylor College of Medicine, Houston, TX 77030, USA.
| |
Collapse
|
13
|
Bernier PM, Puygrenier A, Danion FR. Concurrent Implicit Adaptation to Multiple Opposite Perturbations. eNeuro 2023; 10:ENEURO.0066-23.2023. [PMID: 37468329 PMCID: PMC10408782 DOI: 10.1523/eneuro.0066-23.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2023] [Revised: 06/19/2023] [Accepted: 07/17/2023] [Indexed: 07/21/2023] Open
Abstract
Simultaneous adaptation to opposite visuomotor perturbations is known to be difficult. It has been shown to be possible only in situations where the two tasks are associated with different contexts, being either a different colored background, a different area of workspace, or a different follow-through movement. However, many of these elements evoke explicit mechanisms that could contribute to storing separate (modular) memories. It remains to be shown whether simultaneous adaptation to multiple perturbations is possible when they are introduced in a fully implicit manner. Here, we sought to test this possibility using a visuomotor perturbation small enough to eliminate explicit awareness. Participants (N = 25) performed center-out reaching movements with a joystick to five targets located 72° apart. Depending on the target, visual feedback of cursor position was either veridical (one target) or could be rotated by +5 or -5° (two targets each). After 300 trials of adaptation (60 to each target), results revealed that participants were able to fully compensate for each of the imposed rotations. Moreover, when veridical visual feedback was restored, participants exhibited after-effects that were consistent with the rotations applied at each target. Questionnaires collected immediately after the experiment confirmed that none of the participants were aware of the perturbations. These results speak for the existence of implicit processes that can smoothly handle small and opposite visual perturbations when these are associated with distinct target locations.
Collapse
Affiliation(s)
- Pierre-Michel Bernier
- Département de Kinanthropologie, Université de Sherbrooke, Sherbrooke, Québec, J1K 2R1, Canada
| | - Alice Puygrenier
- Centre National de la Recherche Scientifique, Université de Poitiers, Université de Tours, Centre de Recherches sur la Cognition et l'Apprentissage, Unité Mixte de Recherche 7295, 86073 Poitiers Cedex 9, France
| | - Frederic R Danion
- Centre National de la Recherche Scientifique, Université de Poitiers, Université de Tours, Centre de Recherches sur la Cognition et l'Apprentissage, Unité Mixte de Recherche 7295, 86073 Poitiers Cedex 9, France
| |
Collapse
|
14
|
Albert ST, Blaum EC, Blustein DH. Sensory prediction error drives subconscious motor learning outside of the laboratory. J Neurophysiol 2023; 130:427-435. [PMID: 37435648 DOI: 10.1152/jn.00110.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2023] [Revised: 06/13/2023] [Accepted: 07/03/2023] [Indexed: 07/13/2023] Open
Abstract
Sensorimotor adaptation is supported by at least two parallel learning systems: an intentionally controlled explicit strategy and an involuntary implicit learning system. Past work focused on constrained reaches or finger movements in laboratory environments has shown subconscious learning systems to be driven in part by sensory prediction error (SPE), i.e., the mismatch between the realized and expected outcome of an action. We designed a ball rolling task to explore whether SPEs can drive implicit motor adaptation during complex whole body movements that impart physical motion on external objects. After applying a visual shift, participants rapidly adapted their rolling angles to reduce the error between the ball and the target. We removed all visual feedback and told participants to aim their throw directly toward the primary target, revealing an unintentional 5.06° implicit adjustment to reach angles that decayed over time. To determine whether this implicit adaptation was driven by SPE, we gave participants a second aiming target that would "solve" the visual shift, as in the study by Mazzoni and Krakauer (Mazzoni P, Krakauer JW. J Neurosci 26: 3642-3645, 2006). Remarkably, after rapidly reducing ball-rolling error to zero (due to enhancements in strategic aiming), the additional aiming target caused rolling angles to deviate beyond the primary target by 3.15°. This involuntary overcompensation, which worsened task performance, is a hallmark of SPE-driven implicit learning. These results show that SPE-driven implicit processes, previously observed within simplified finger or planar reaching movements, actively contribute to motor adaptation in more complex naturalistic skill-based tasks.NEW & NOTEWORTHY Implicit and explicit learning systems have been detected using simple, constrained movements inside the laboratory. How these systems impact movements during complex whole body, skill-based tasks has not been established. Here, we demonstrate that sensory prediction errors significantly impact how a person updates their movements, replicating findings from the laboratory in an unconstrained ball-rolling task. This real-world validation is an important step toward explaining how subconscious learning helps humans execute common motor skills in dynamic environments.
Collapse
Affiliation(s)
- Scott T Albert
- Neuroscience Center, UNC Chapel Hill, Chapel Hill, North Carolina, United States
| | - Emily C Blaum
- Neuroscience Program, Rhodes College, Memphis, Tennessee, United States
| | - Daniel H Blustein
- Department of Psychology, Acadia University, Wolfville, Nova Scotia, Canada
| |
Collapse
|
15
|
Suglia V, Brunetti A, Pasquini G, Caputo M, Marvulli TM, Sibilano E, Della Bella S, Carrozza P, Beni C, Naso D, Monaco V, Cristella G, Bevilacqua V, Buongiorno D. A Serious Game for the Assessment of Visuomotor Adaptation Capabilities during Locomotion Tasks Employing an Embodied Avatar in Virtual Reality. Sensors (Basel) 2023; 23:s23115017. [PMID: 37299744 DOI: 10.3390/s23115017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/06/2023] [Revised: 05/17/2023] [Accepted: 05/22/2023] [Indexed: 06/12/2023]
Abstract
The study of visuomotor adaptation (VMA) capabilities has been encompassed in various experimental protocols aimed at investigating human motor control strategies and/or cognitive functions. VMA-oriented frameworks can have clinical applications, primarily in the investigation and assessment of neuromotor impairments caused by conditions such as Parkinson's disease or post-stroke, which affect the lives of tens of thousands of people worldwide. Therefore, they can enhance the understanding of the specific mechanisms of such neuromotor disorders, thus being a potential biomarker for recovery, with the aim of being integrated with conventional rehabilitative programs. Virtual Reality (VR) can be entailed in a framework targeting VMA since it allows the development of visual perturbations in a more customizable and realistic way. Moreover, as has been demonstrated in previous works, a serious game (SG) can further increase engagement thanks to the use of full-body embodied avatars. Most studies implementing VMA frameworks have focused on upper limb tasks and have utilized a cursor as visual feedback for the user. Hence, there is a paucity in the literature about VMA-oriented frameworks targeting locomotion tasks. In this article, the authors present the design, development, and testing of an SG-based framework that addresses VMA in a locomotion activity by controlling a full-body moving avatar in a custom VR environment. This workflow includes a set of metrics to quantitatively assess the participants' performance. Thirteen healthy children were recruited to evaluate the framework. Several quantitative comparisons and analyses were run to validate the different types of introduced visuomotor perturbations and to evaluate the ability of the proposed metrics to describe the difficulty caused by such perturbations. During the experimental sessions, it emerged that the system is safe, easy to use, and practical in a clinical setting. Despite the limited sample size, which represents the main limitation of the study and can be compensated for with future recruitment, the authors claim the potential of this framework as a useful instrument for quantitatively assessing either motor or cognitive impairments. The proposed feature-based approach gives several objective parameters as additional biomarkers that can integrate the conventional clinical scores. Future studies might investigate the relation between the proposed biomarkers and the clinical scores for specific disorders such as Parkinson's disease and cerebral palsy.
Collapse
Affiliation(s)
- Vladimiro Suglia
- Department of Electrical and Information Engineering (DEI), Polytechnic University of Bari, 70126 Bari, Italy
| | - Antonio Brunetti
- Department of Electrical and Information Engineering (DEI), Polytechnic University of Bari, 70126 Bari, Italy
- Apulian Bioengineering s.r.l., 70026 Modugno, Italy
| | - Guido Pasquini
- IRCCS Fondazione Don Carlo Gnocchi ONLUS, 50143 Florence, Italy
| | - Mariapia Caputo
- Department of Electrical and Information Engineering (DEI), Polytechnic University of Bari, 70126 Bari, Italy
| | - Tommaso Maria Marvulli
- Department of Electrical and Information Engineering (DEI), Polytechnic University of Bari, 70126 Bari, Italy
| | - Elena Sibilano
- Department of Electrical and Information Engineering (DEI), Polytechnic University of Bari, 70126 Bari, Italy
| | | | - Paola Carrozza
- IRCCS Fondazione Don Carlo Gnocchi ONLUS, 50143 Florence, Italy
| | - Chiara Beni
- IRCCS Fondazione Don Carlo Gnocchi ONLUS, 50143 Florence, Italy
| | - David Naso
- Department of Electrical and Information Engineering (DEI), Polytechnic University of Bari, 70126 Bari, Italy
| | - Vito Monaco
- The Biorobotics Institute, Department of Excellence in Robotics and AI, Scuola Superiore Sant'Anna, 56127 Pisa, Italy
| | | | - Vitoantonio Bevilacqua
- Department of Electrical and Information Engineering (DEI), Polytechnic University of Bari, 70126 Bari, Italy
- Apulian Bioengineering s.r.l., 70026 Modugno, Italy
| | - Domenico Buongiorno
- Department of Electrical and Information Engineering (DEI), Polytechnic University of Bari, 70126 Bari, Italy
- Apulian Bioengineering s.r.l., 70026 Modugno, Italy
| |
Collapse
|
16
|
Standage DI, Areshenkoff CN, Gale DJ, Nashed JY, Flanagan JR, Gallivan JP. Whole-brain dynamics of human sensorimotor adaptation. Cereb Cortex 2023; 33:4761-4778. [PMID: 36245212 PMCID: PMC10110437 DOI: 10.1093/cercor/bhac378] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2022] [Revised: 08/26/2022] [Accepted: 08/27/2022] [Indexed: 11/13/2022] Open
Abstract
Humans vary greatly in their motor learning abilities, yet little is known about the neural processes that underlie this variability. We identified distinct profiles of human sensorimotor adaptation that emerged across 2 days of learning, linking these profiles to the dynamics of whole-brain functional networks early on the first day when cognitive strategies toward sensorimotor adaptation are believed to be most prominent. During early learning, greater recruitment of a network of higher-order brain regions, involving prefrontal and anterior temporal cortex, was associated with faster learning. At the same time, greater integration of this "cognitive network" with a sensorimotor network was associated with slower learning, consistent with the notion that cognitive strategies toward adaptation operate in parallel with implicit learning processes of the sensorimotor system. On the second day, greater recruitment of a network that included the hippocampus was associated with faster learning, consistent with the notion that declarative memory systems are involved with fast relearning of sensorimotor mappings. Together, these findings provide novel evidence for the role of higher-order brain systems in driving variability in adaptation.
Collapse
Affiliation(s)
- Dominic I Standage
- Centre for Neuroscience Studies, Queen’s University, Botterell Hall, 18 Stuart Street, Kingston, Ontario K7L 3N6, Canada
- Department of Biomedical and Molecular Sciences, Queen’s University, Kingston, Ontario, Canada
| | - Corson N Areshenkoff
- Centre for Neuroscience Studies, Queen’s University, Botterell Hall, 18 Stuart Street, Kingston, Ontario K7L 3N6, Canada
| | - Daniel J Gale
- Centre for Neuroscience Studies, Queen’s University, Botterell Hall, 18 Stuart Street, Kingston, Ontario K7L 3N6, Canada
| | - Joseph Y Nashed
- Centre for Neuroscience Studies, Queen’s University, Botterell Hall, 18 Stuart Street, Kingston, Ontario K7L 3N6, Canada
- Department of Biomedical and Molecular Sciences, Queen’s University, Kingston, Ontario, Canada
| | - J Randall Flanagan
- Centre for Neuroscience Studies, Queen’s University, Botterell Hall, 18 Stuart Street, Kingston, Ontario K7L 3N6, Canada
- Department of Psychology, Queen’s University, Humphrey Hall, 62 Arch Street, Kingston, Ontario K7L 3N6, Canada
| | - Jason P Gallivan
- Centre for Neuroscience Studies, Queen’s University, Botterell Hall, 18 Stuart Street, Kingston, Ontario K7L 3N6, Canada
- Department of Biomedical and Molecular Sciences, Queen’s University, Kingston, Ontario, Canada
- Department of Psychology, Queen’s University, Humphrey Hall, 62 Arch Street, Kingston, Ontario K7L 3N6, Canada
| |
Collapse
|
17
|
Tsay JS, Tan S, Chu MA, Ivry RB, Cooper EA. Low Vision Impairs Implicit Sensorimotor Adaptation in Response to Small Errors, But Not Large Errors. J Cogn Neurosci 2023; 35:736-748. [PMID: 36724396 PMCID: PMC10512469 DOI: 10.1162/jocn_a_01969] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/03/2023]
Abstract
Successful goal-directed actions require constant fine-tuning of the motor system. This fine-tuning is thought to rely on an implicit adaptation process that is driven by sensory prediction errors (e.g., where you see your hand after reaching vs. where you expected it to be). Individuals with low vision experience challenges with visuomotor control, but whether low vision disrupts motor adaptation is unknown. To explore this question, we assessed individuals with low vision and matched controls with normal vision on a visuomotor task designed to isolate implicit adaptation. We found that low vision was associated with attenuated implicit adaptation only for small visual errors, but not for large visual errors. This result highlights important constraints underlying how low-fidelity visual information is processed by the sensorimotor system to enable successful implicit adaptation.
Collapse
|
18
|
Teunissen L, Selen LPJ, Medendorp WP. Abrupt, but not gradual, motor adaptation biases saccadic target selection. J Neurophysiol 2023; 129:733-748. [PMID: 36812151 DOI: 10.1152/jn.00223.2022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/24/2023] Open
Abstract
Motor costs influence movement selection. These costs could change when movements are adapted in response to errors. When the motor system attributes the encountered errors to an external cause, appropriate movement selection requires an update of the movement goal, which prompts the selection of a different control policy. However, when errors are attributed to an internal cause, the initially selected control policy could remain unchanged, but the internal forward model of the body needs to be updated, resulting in an online correction of the movement. We hypothesized that external attribution of errors leads to the selection of a different control policy, and thus to a change in the expected cost of movements. This should also affect subsequent motor decisions. Conversely, internal attribution of errors may (initially) only evoke online corrections, and thus is expected to leave the motor decision process unchanged. We tested this hypothesis using a saccadic adaptation paradigm, designed to change the relative motor cost of two targets. Motor decisions were measured using a target selection task between the two saccadic targets before and after adaptation. Adaptation was induced by either abrupt or gradual perturbation schedules, which are thought to induce more external or internal attribution of errors, respectively. By taking individual variability into account, our results show that saccadic decisions shift toward the least costly target after adaptation, but only when the perturbation is abruptly, and not gradually, introduced. We suggest that credit assignment of errors not only influences motor adaptation but also subsequent motor decisions.NEW & NOTEWORTHY Decisions between potential motor actions are influenced by their costs, but costs change when movements are adapted. Using a saccadic target selection task, we show that target preference shifts after abrupt, but not after gradual adaptation. We suggest that this difference emerges because abrupt adaptation results in target remapping, and thus directly influences cost calculations, whereas gradual adaptation is mainly driven by corrections to a forward model that is not involved in cost calculations.
Collapse
Affiliation(s)
- Lonneke Teunissen
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
| | - Luc P J Selen
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
| | - W Pieter Medendorp
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
| |
Collapse
|
19
|
Abstract
Contextual interference refers to the phenomenon whereby a blocked practice schedule results in faster acquisition but poorer retention of new motor skills compared to a random practice schedule. While contextual interference has been observed under a broad range of tasks, it remains unclear if this effect generalizes to the implicit and automatic recalibration of an overlearned motor skill. To address this question, we compared blocked and random practice schedules in a visuomotor rotation task that isolates implicit adaptation. In experiment 1, we found robust signatures of contextual interference in implicit adaptation: compared to participants tested under a blocked training schedule, participants tested under a random training schedule exhibited a reduced rate of learning during the training phase but better retention during a subsequent no-feedback assessment phase. In experiment 2, we again observed an advantage in retention following random practice and showed that this result was not due to a change in context between the training and assessment phases (e.g. a blocked training schedule followed by a random assessment schedule). Taken together, these results indicate that contextual interference is not limited to the acquisition of new motor skills but also applies to the implicit adaptation of established motor skills.
Collapse
Affiliation(s)
- Jonathan S. Tsay
- Department of Psychology, University of California, Berkeley, CA, USA
- Helen Wills Neuroscience Institute, University of California, Berkeley, CA, USA
| | - Carolyn Irving
- Department of Psychology, University of California, Berkeley, CA, USA
| | - Richard B. Ivry
- Department of Psychology, University of California, Berkeley, CA, USA
- Helen Wills Neuroscience Institute, University of California, Berkeley, CA, USA
| |
Collapse
|
20
|
Mangin EN, Chen J, Lin J, Li N. Behavioral measurements of motor readiness in mice. bioRxiv 2023:2023.02.03.527054. [PMID: 36778494 PMCID: PMC9915731 DOI: 10.1101/2023.02.03.527054] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
Motor planning facilitates rapid and precise execution of volitional movements. Although motor planning has been classically studied in humans and monkeys, the mouse has become an increasingly popular model system to study neural mechanisms of motor planning. It remains yet untested whether mice and primates share common behavioral features of motor planning. We combined videography and a delayed response task paradigm in an autonomous behavioral system to measure motor planning in non-body- restrained mice. Motor planning resulted in both reaction time savings and increased movement accuracy, replicating classic effects in primates. We found that motor planning was reflected in task-relevant body features. Both the specific actions prepared and the degree of motor readiness could be read out online during motor planning. The online readout further revealed behavioral evidence of simultaneous preparation for multiple actions under uncertain conditions. These results validate the mouse as a model to study motor planning, demonstrate body feature movements as a powerful real-time readout of motor readiness, and offer behavioral evidence that motor planning can be a parallel process that permits rapid selection of multiple prepared actions.
Collapse
Affiliation(s)
| | - Jian Chen
- Department of Neuroscience, Baylor College of Medicine
| | - Jing Lin
- Department of Neuroscience, Baylor College of Medicine
| | - Nuo Li
- Department of Neuroscience, Baylor College of Medicine
| |
Collapse
|
21
|
Zadeh AK, Videnovic A, MacKinnon CD, Alibiglou L. Startle-induced rapid release of a gait initiation sequence in Parkinson's disease with freezing of gait. Clin Neurophysiol 2023; 146:97-108. [PMID: 36608531 DOI: 10.1016/j.clinph.2022.12.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2022] [Revised: 11/29/2022] [Accepted: 12/11/2022] [Indexed: 12/24/2022]
Abstract
OBJECTIVE Freezing of gait (FOG) in Parkinson's disease (PD) is characterized by the inability to initiate stepping, despite the intention to do so. This study used a startling acoustic stimulus paradigm to examine if the capacity to select, prepare and initiate gait under simple and choice reaction time conditions are impaired in people with PD and FOG. METHODS Thirty individuals (10 PD with FOG, 10 PD without FOG, and 10 controls) performed an instructed-delay gait initiation task under simple and choice reaction time conditions. In a subset of trials, a startle stimulus (124 dB) was presented 500 ms before the time of the imperative go-cue. Anticipatory postural adjustments preceding and accompanying gait initiation were quantified. RESULTS The presentation of a startling acoustic stimulus resulted in the rapid initiation of an anticipatory postural adjustment sequence during both the simple and choice reaction time tasks in all groups. CONCLUSIONS The neural capacity to prepare the spatial and temporal components of gait initiation remains intact in PD individuals with and without FOG. SIGNIFICANCE The retained capacity to prepare anticipatory postural adjustments in advance may explain why external sensory cues are effective in the facilitation of gait initiation in people with PD with FOG.
Collapse
Affiliation(s)
- Ali K Zadeh
- Department of Clinical Neurosciences, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada
| | - Aleksandar Videnovic
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Colum D MacKinnon
- Department of Neurology, University of Minnesota, Minneapolis, MN, USA; Department of Physical Therapy and Human Movement Sciences, Northwestern University, Chicago, IL, USA
| | - Laila Alibiglou
- Department of Neuroscience, School of Advanced Technologies in Medicine, Iran University of Medical Sciences, Tehran, Iran; Department of Physical Therapy and Human Movement Sciences, Northwestern University, Chicago, IL, USA.
| |
Collapse
|
22
|
Codol O, Kashefi M, Forgaard CJ, Galea JM, Pruszynski JA, Gribble PL. Sensorimotor feedback loops are selectively sensitive to reward. eLife 2023; 12:81325. [PMID: 36637162 PMCID: PMC9910828 DOI: 10.7554/elife.81325] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2022] [Accepted: 12/29/2022] [Indexed: 01/14/2023] Open
Abstract
Although it is well established that motivational factors such as earning more money for performing well improve motor performance, how the motor system implements this improvement remains unclear. For instance, feedback-based control, which uses sensory feedback from the body to correct for errors in movement, improves with greater reward. But feedback control encompasses many feedback loops with diverse characteristics such as the brain regions involved and their response time. Which specific loops drive these performance improvements with reward is unknown, even though their diversity makes it unlikely that they are contributing uniformly. We systematically tested the effect of reward on the latency (how long for a corrective response to arise?) and gain (how large is the corrective response?) of seven distinct sensorimotor feedback loops in humans. Only the fastest feedback loops were insensitive to reward, and the earliest reward-driven changes were consistently an increase in feedback gains, not a reduction in latency. Rather, a reduction of response latencies only tended to occur in slower feedback loops. These observations were similar across sensory modalities (vision and proprioception). Our results may have implications regarding feedback control performance in athletic coaching. For instance, coaching methodologies that rely on reinforcement or 'reward shaping' may need to specifically target aspects of movement that rely on reward-sensitive feedback responses.
Collapse
Affiliation(s)
- Olivier Codol
- Brain and Mind Institute, University of Western OntarioLondonCanada
- Department of Psychology, University of Western OntarioLondonCanada
- School of Psychology, University of BirminghamBirminghamUnited Kingdom
| | - Mehrdad Kashefi
- Brain and Mind Institute, University of Western OntarioLondonCanada
- Department of Psychology, University of Western OntarioLondonCanada
- Department of Physiology & Pharmacology, Schulich School of Medicine & Dentistry, University of Western OntarioOntarioCanada
- Robarts Research Institute, University of Western OntarioLondonCanada
| | - Christopher J Forgaard
- Brain and Mind Institute, University of Western OntarioLondonCanada
- Department of Psychology, University of Western OntarioLondonCanada
| | - Joseph M Galea
- School of Psychology, University of BirminghamBirminghamUnited Kingdom
| | - J Andrew Pruszynski
- Brain and Mind Institute, University of Western OntarioLondonCanada
- Department of Psychology, University of Western OntarioLondonCanada
- Department of Physiology & Pharmacology, Schulich School of Medicine & Dentistry, University of Western OntarioOntarioCanada
- Robarts Research Institute, University of Western OntarioLondonCanada
| | - Paul L Gribble
- Brain and Mind Institute, University of Western OntarioLondonCanada
- Department of Psychology, University of Western OntarioLondonCanada
- Department of Physiology & Pharmacology, Schulich School of Medicine & Dentistry, University of Western OntarioOntarioCanada
- Haskins LaboratoriesNew HavenUnited States
| |
Collapse
|
23
|
Abstract
We examined age-related changes in intermanual transfer and retention of implicit visuomotor adaptation. We further asked if providing augmented somatosensory feedback regarding movement endpoint would enhance visuomotor adaptation. Twenty young adults and twenty older adults were recruited and randomly divided into an Augmented Feedback group and a Control group. All participants reached to five visual targets with visual feedback rotated 30° counter-clockwise relative to their actual hand motion. Augmented somatosensory feedback was provided at the end of the reach via the robotic handle that participants held. Implicit adaptation was assessed in the absence of visual feedback in the right trained hand and in the left untrained hand following rotated training trials to establish implicit adaptation and intermanual transfer of adaptation respectively. Participants then returned 24 hours later to assess retention in the trained and untrained hands. Results revealed that older adults demonstrated a comparable magnitude of implicit adaptation, transfer and retention of visuomotor adaptation as observed in younger adults, regardless of the presence of augmented somatosensory feedback. To conclude, when visuomotor adaptation is driven implicitly, intermanual transfer and retention do not differ significantly between young and older adults, even when the availability of augmented somatosensory feedback is manipulated.
Collapse
Affiliation(s)
- Sajida Khanafer
- School of Human Kinetics, University of Ottawa, Ottawa, Canada
| | - Heidi Sveistrup
- School of Rehabilitation Sciences, University of Ottawa, Ottawa, Canada
| | - Erin K Cressman
- School of Human Kinetics, University of Ottawa, Ottawa, Canada
| |
Collapse
|
24
|
Tsay JS, Najafi T, Schuck L, Wang T, Ivry RB. Implicit sensorimotor adaptation is preserved in Parkinson's disease. Brain Commun 2022; 4:fcac303. [PMID: 36531745 PMCID: PMC9750131 DOI: 10.1093/braincomms/fcac303] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2022] [Revised: 07/06/2022] [Accepted: 11/18/2022] [Indexed: 11/22/2022] Open
Abstract
Our ability to enact successful goal-directed actions involves multiple learning processes. Among these processes, implicit motor adaptation ensures that the sensorimotor system remains finely tuned in response to changes in the body and environment. Whether Parkinson's disease impacts implicit motor adaptation remains a contentious area of research: whereas multiple reports show impaired performance in this population, many others show intact performance. While there is a range of methodological differences across studies, one critical issue is that performance in many of the studies may reflect a combination of implicit adaptation and strategic re-aiming. Here, we revisited this controversy using a visuomotor task designed to isolate implicit adaptation. In two experiments, we found that adaptation in response to a wide range of visual perturbations was similar in Parkinson's disease and matched control participants. Moreover, in a meta-analysis of previously published and unpublished work, we found that the mean effect size contrasting Parkinson's disease and controls across 16 experiments involving over 200 participants was not significant. Together, these analyses indicate that implicit adaptation is preserved in Parkinson's disease, offering a fresh perspective on the role of the basal ganglia in sensorimotor learning.
Collapse
Affiliation(s)
- Jonathan S Tsay
- Correspondence to: Jonathan S. Tsay 2121 Berkeley Way West Berkeley, CA 94704, USA E-mail:
| | | | - Lauren Schuck
- Department of Psychology, University of California Berkeley, Berkeley, CA 94704, USA
| | - Tianhe Wang
- Department of Psychology, University of California Berkeley, Berkeley, CA 94704, USA
| | - Richard B Ivry
- Department of Psychology, University of California Berkeley, Berkeley, CA 94704, USA,Helen Wills Neuroscience Institute, University of California Berkeley, Berkeley, CA 94704, USA
| |
Collapse
|
25
|
Avraham G, Taylor JA, Breska A, Ivry RB, McDougle SD. Contextual effects in sensorimotor adaptation adhere to associative learning rules. eLife 2022; 11:e75801. [PMID: 36197002 PMCID: PMC9635873 DOI: 10.7554/elife.75801] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2021] [Accepted: 10/04/2022] [Indexed: 11/20/2022] Open
Abstract
Traditional associative learning tasks focus on the formation of associations between salient events and arbitrary stimuli that predict those events. This is exemplified in cerebellar-dependent delay eyeblink conditioning, where arbitrary cues such as a tone or light act as conditioned stimuli (CSs) that predict aversive sensations at the cornea (unconditioned stimulus [US]). Here, we ask if a similar framework could be applied to another type of cerebellar-dependent sensorimotor learning - sensorimotor adaptation. Models of sensorimotor adaptation posit that the introduction of an environmental perturbation results in an error signal that is used to update an internal model of a sensorimotor map for motor planning. Here, we take a step toward an integrative account of these two forms of cerebellar-dependent learning, examining the relevance of core concepts from associative learning for sensorimotor adaptation. Using a visuomotor adaptation reaching task, we paired movement-related feedback (US) with neutral auditory or visual contextual cues that served as CSs. Trial-by-trial changes in feedforward movement kinematics exhibited three key signatures of associative learning: differential conditioning, sensitivity to the CS-US interval, and compound conditioning. Moreover, after compound conditioning, a robust negative correlation was observed between responses to the two elemental CSs of the compound (i.e. overshadowing), consistent with the additivity principle posited by theories of associative learning. The existence of associative learning effects in sensorimotor adaptation provides a proof-of-concept for linking cerebellar-dependent learning paradigms within a common theoretical framework.
Collapse
Affiliation(s)
- Guy Avraham
- Department of Psychology, University of California, BerkeleyBerkeleyUnited States
- Helen Wills Neuroscience Institute, University of California, BerkeleyBerkeleyUnited States
| | - Jordan A Taylor
- Department of Psychology, Princeton UniversityPrincetonUnited States
| | - Assaf Breska
- Department of Psychology, University of California, BerkeleyBerkeleyUnited States
- Helen Wills Neuroscience Institute, University of California, BerkeleyBerkeleyUnited States
- Max Planck Institute for Biological CyberneticsTübingenGermany
| | - Richard B Ivry
- Department of Psychology, University of California, BerkeleyBerkeleyUnited States
- Helen Wills Neuroscience Institute, University of California, BerkeleyBerkeleyUnited States
| | | |
Collapse
|
26
|
Hardwick RM, Forrence AD, Costello MG, Zackowski K, Haith AM. Age-related increases in reaction time result from slower preparation, not delayed initiation. J Neurophysiol 2022; 128:582-592. [PMID: 35829640 PMCID: PMC9423772 DOI: 10.1152/jn.00072.2022] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2022] [Revised: 06/28/2022] [Accepted: 07/11/2022] [Indexed: 11/22/2022] Open
Abstract
Recent work indicates that healthy younger adults can prepare accurate responses faster than their voluntary reaction times would suggest, leaving a seemingly unnecessary delay of 80-100 ms before responding. Here, we examined how the preparation of movements, initiation of movements, and the delay between them are affected by aging. Participants made planar reaching movements in two conditions. The "free reaction time" condition assessed the voluntary reaction times with which participants responded to the appearance of a stimulus. The "forced reaction time" condition assessed the minimum time actually needed to prepare accurate movements by controlling the time allowed for movement preparation. The time taken to both initiate movements in the free reaction time and to prepare movements in the forced response condition increased with age. Notably, the time required to prepare accurate movements was significantly shorter than participants' self-selected initiation times; however, the delay between movement preparation and initiation remained consistent across the lifespan (∼90 ms). These results indicate that the slower reaction times of healthy older adults are not due to an increased hesitancy to respond, but can instead be attributed to changes in their ability to process stimuli and prepare movements accordingly, consistent with age-related changes in brain structure and function.NEW & NOTEWORTHY Previous research argues that older adults have slower response times because they hesitate to react, favoring accuracy over speed. The present results challenge this proposal. We found the delay between the minimum time required to prepare movements and the self-selected time at which they initiated remained consistent at ∼90 ms from ages 21 to 80. We therefore suggest older adults' slower response times can be attributed to changes in their ability to process stimuli and prepare movements.
Collapse
Affiliation(s)
- Robert M Hardwick
- Department of Neurology, Johns Hopkins University, Baltimore, Maryland
- Department of Kinesiology, KU Leuven, Leuven, Belgium
- Institute of Neurosciences, UC Louvain, Leuven, Belgium
| | | | - M Gabriela Costello
- Laboratory of Sensorimotor Research, National Eye Institute, Bethesda, Maryland
- Center for Movement Studies, Kennedy Krieger Institute, Baltimore, Maryland
- Department of Physical Medicine and Rehabilitation, Johns Hopkins School of Medicine, Baltimore, Maryland
| | - Kathy Zackowski
- Department of Neurology, Johns Hopkins University, Baltimore, Maryland
- Center for Movement Studies, Kennedy Krieger Institute, Baltimore, Maryland
- Department of Physical Medicine and Rehabilitation, Johns Hopkins School of Medicine, Baltimore, Maryland
| | - Adrian M Haith
- Department of Neurology, Johns Hopkins University, Baltimore, Maryland
| |
Collapse
|
27
|
Zhou W, Kruse EA, Brower R, North R, Joiner WM. Motion state-dependent motor learning based on explicit visual feedback is quickly recalled, but is less stable than adaptation to physical perturbations. J Neurophysiol 2022; 128:854-871. [PMID: 36043804 PMCID: PMC9529258 DOI: 10.1152/jn.00520.2021] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Recent studies have shown that adaptation to visual feedback perturbations during arm reaching movements involves implicit and explicit learning components. Evidence also suggests that explicit, intentional learning mechanisms are largely responsible for savings—a faster recalibration compared with initial training. However, the extent explicit learning mechanisms facilitate learning and early savings (i.e., the rapid recall of previous performance) for motion state-dependent learning is generally unknown. To address this question, we compared the early savings/recall achieved by two groups of human subjects. One experienced physical perturbations (a velocity-dependent force-field, vFF) to promote adaptation that is thought to be a largely implicit process. The second was only given visual feedback of the required force-velocity relationship; subjects moved in force channels and we provided visual feedback of the lateral force exerted during the movement, as well as the required force pattern based on the movement velocity. Thus, subjects were shown explicit information on the extent the applied temporal pattern of force matched the required velocity-dependent force profile if the force-field perturbation had been applied. After training, both groups experienced a decay and washout period, which was followed by a reexposure block to assess early savings/recall. Although decay was faster for the explicit visual feedback group, the single-trial recall was similar to the physical perturbation group. Thus, compared with visual feedback perturbations, conscious modification of motor output based on motion state-dependent feedback demonstrates rapid recall, but this adjustment is less stable than adaptation based on experiencing the multisensory errors that accompany physical perturbations. NEW & NOTEWORTHY The extent explicit feedback facilitates motion state-dependent changes to motor output is largely unknown. Here, we examined motor adaptation for subjects that experienced physical perturbations and another that made adjustments based on explicit visual feedback information of the required force-velocity relationship. Our results suggest that adjustment of motor output can be based on explicit motion state-dependent information and demonstrates rapid recall, but this learning is less stable than adaptation based on physical perturbations to movement.
Collapse
Affiliation(s)
- Weiwei Zhou
- Department of Neurobiology, Physiology and Behavior, University of California, Davis, Davis, CA, United States
| | - Elizabeth A Kruse
- Department of Neurobiology, Physiology and Behavior, University of California, Davis, Davis, CA, United States
| | - Rylee Brower
- Department of Neurobiology, Physiology and Behavior, University of California, Davis, Davis, CA, United States
| | - Ryan North
- Department of Neurobiology, Physiology and Behavior, University of California, Davis, Davis, CA, United States
| | - Wilsaan M Joiner
- Department of Neurobiology, Physiology and Behavior, University of California, Davis, Davis, CA, United States.,NDepartment of Neurology, University of California, Davis, Davis, CA, United States
| |
Collapse
|
28
|
Abekawa N, Ito S, Gomi H. Gaze-specific motor memories for hand-reaching. Curr Biol 2022; 32:2747-2753.e6. [DOI: 10.1016/j.cub.2022.04.065] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2021] [Revised: 03/23/2022] [Accepted: 04/22/2022] [Indexed: 10/18/2022]
|
29
|
Areshenkoff C, Gale DJ, Standage D, Nashed JY, Flanagan JR, Gallivan JP. Neural excursions from manifold structure explain patterns of learning during human sensorimotor adaptation. eLife 2022; 11:e74591. [PMID: 35438633 PMCID: PMC9018069 DOI: 10.7554/elife.74591] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2021] [Accepted: 03/04/2022] [Indexed: 11/24/2022] Open
Abstract
Humans vary greatly in their motor learning abilities, yet little is known about the neural mechanisms that underlie this variability. Recent neuroimaging and electrophysiological studies demonstrate that large-scale neural dynamics inhabit a low-dimensional subspace or manifold, and that learning is constrained by this intrinsic manifold architecture. Here, we asked, using functional MRI, whether subject-level differences in neural excursion from manifold structure can explain differences in learning across participants. We had subjects perform a sensorimotor adaptation task in the MRI scanner on 2 consecutive days, allowing us to assess their learning performance across days, as well as continuously measure brain activity. We find that the overall neural excursion from manifold activity in both cognitive and sensorimotor brain networks is associated with differences in subjects' patterns of learning and relearning across days. These findings suggest that off-manifold activity provides an index of the relative engagement of different neural systems during learning, and that subject differences in patterns of learning and relearning are related to reconfiguration processes occurring in cognitive and sensorimotor networks.
Collapse
Affiliation(s)
- Corson Areshenkoff
- Centre for Neuroscience Studies, Queen's UniversityKingstonCanada
- Department of Psychology, Queen's UniversityKingstonCanada
| | - Daniel J Gale
- Centre for Neuroscience Studies, Queen's UniversityKingstonCanada
| | - Dominic Standage
- School of Psychology, Centre for Computational Neuroscience and Cognitive Robotics, University of BirminghamBirminghamUnited Kingdom
| | - Joseph Y Nashed
- Centre for Neuroscience Studies, Queen's UniversityKingstonCanada
| | - J Randall Flanagan
- Centre for Neuroscience Studies, Queen's UniversityKingstonCanada
- Department of Psychology, Queen's UniversityKingstonCanada
| | - Jason P Gallivan
- Centre for Neuroscience Studies, Queen's UniversityKingstonCanada
- Department of Psychology, Queen's UniversityKingstonCanada
- Department of Biomedical and Molecular Sciences, Queen's UniversityKingstonCanada
| |
Collapse
|
30
|
Tsay JS, Haith AM, Ivry RB, Kim HE. Interactions between sensory prediction error and task error during implicit motor learning. PLoS Comput Biol 2022; 18:e1010005. [PMID: 35320276 PMCID: PMC8979451 DOI: 10.1371/journal.pcbi.1010005] [Citation(s) in RCA: 31] [Impact Index Per Article: 15.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2021] [Revised: 04/04/2022] [Accepted: 03/09/2022] [Indexed: 01/11/2023] Open
Abstract
Implicit motor recalibration allows us to flexibly move in novel and changing environments. Conventionally, implicit recalibration is thought to be driven by errors in predicting the sensory outcome of movement (i.e., sensory prediction errors). However, recent studies have shown that implicit recalibration is also influenced by errors in achieving the movement goal (i.e., task errors). Exactly how sensory prediction errors and task errors interact to drive implicit recalibration and, in particular, whether task errors alone might be sufficient to drive implicit recalibration remain unknown. To test this, we induced task errors in the absence of sensory prediction errors by displacing the target mid-movement. We found that task errors alone failed to induce implicit recalibration. In additional experiments, we simultaneously varied the size of sensory prediction errors and task errors. We found that implicit recalibration driven by sensory prediction errors could be continuously modulated by task errors, revealing an unappreciated dependency between these two sources of error. Moreover, implicit recalibration was attenuated when the target was simply flickered in its original location, even though this manipulation did not affect task error - an effect likely attributed to attention being directed away from the feedback cursor. Taken as a whole, the results were accounted for by a computational model in which sensory prediction errors and task errors, modulated by attention, interact to determine the extent of implicit recalibration.
Collapse
Affiliation(s)
- Jonathan S. Tsay
- Department of Psychology, University of California, Berkeley, California, United States of America
- Helen Wills Neuroscience Institute, University of California, Berkeley, California, United States of America
- * E-mail: (JST); (HEK)
| | - Adrian M. Haith
- Department of Neurology, Johns Hopkins University, Baltimore, Maryland, United States of America
| | - Richard B. Ivry
- Department of Psychology, University of California, Berkeley, California, United States of America
- Helen Wills Neuroscience Institute, University of California, Berkeley, California, United States of America
| | - Hyosub E. Kim
- Department of Physical Therapy, University of Delaware, Newark, Delaware, United States of America
- Department of Psychological and Brain Sciences, University of Delaware, Newark, Delaware, United States of America
- * E-mail: (JST); (HEK)
| |
Collapse
|
31
|
Vandevoorde K, Vollenkemper L, Schwan C, Kohlhase M, Schenck W. Using Artificial Intelligence for Assistance Systems to Bring Motor Learning Principles into Real World Motor Tasks. Sensors (Basel) 2022; 22:s22072481. [PMID: 35408094 PMCID: PMC9002555 DOI: 10.3390/s22072481] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/18/2022] [Revised: 03/18/2022] [Accepted: 03/20/2022] [Indexed: 11/03/2022]
Abstract
Humans learn movements naturally, but it takes a lot of time and training to achieve expert performance in motor skills. In this review, we show how modern technologies can support people in learning new motor skills. First, we introduce important concepts in motor control, motor learning and motor skill learning. We also give an overview about the rapid expansion of machine learning algorithms and sensor technologies for human motion analysis. The integration between motor learning principles, machine learning algorithms and recent sensor technologies has the potential to develop AI-guided assistance systems for motor skill training. We give our perspective on this integration of different fields to transition from motor learning research in laboratory settings to real world environments and real world motor tasks and propose a stepwise approach to facilitate this transition.
Collapse
|
32
|
Sadaphal DP, Kumar A, Mutha PK. Sensorimotor Learning in Response to Errors in Task Performance. eNeuro 2022; 9:ENEURO. [PMID: 35110383 DOI: 10.1523/ENEURO.0371-21.2022] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2021] [Revised: 01/18/2022] [Accepted: 01/23/2022] [Indexed: 01/09/2023] Open
Abstract
The human sensorimotor system is sensitive to both limb-related prediction errors and task-related performance errors. Prediction error signals are believed to drive implicit refinements to motor plans. However, an understanding of the mechanisms that performance errors stimulate has remained unclear largely because their effects have not been probed in isolation from prediction errors. Diverging from past work, we induced performance errors independent of prediction errors by shifting the location of a reach target but keeping the intended and actual kinematic consequences of the motion matched. Our first two experiments revealed that rather than implicit learning, motor adjustments in response to performance errors reflect the use of deliberative, volitional strategies. Our third experiment revealed a potential dissociation of performance-error-driven strategies based on error size. Specifically, behavioral changes following large errors were consistent with goal-directed or model-based control, known to be supported by connections between prefrontal cortex and associative striatum. In contrast, motor changes following smaller performance errors carried signatures of model-free stimulus-response learning, of the kind underpinned by pathways between motor cortical areas and sensorimotor striatum. Across all experiments, we also found remarkably faster re-learning, advocating that such “savings” is associated with retrieval of previously learned strategic error compensation and may not require a history of exposure to limb-related errors.
Collapse
|
33
|
Albert ST, Jang J, Modchalingam S, 't Hart BM, Henriques D, Lerner G, Della-Maggiore V, Haith AM, Krakauer JW, Shadmehr R. Competition between parallel sensorimotor learning systems. eLife 2022; 11:e65361. [PMID: 35225229 PMCID: PMC9068222 DOI: 10.7554/elife.65361] [Citation(s) in RCA: 19] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2020] [Accepted: 02/11/2022] [Indexed: 11/13/2022] Open
Abstract
Sensorimotor learning is supported by at least two parallel systems: a strategic process that benefits from explicit knowledge and an implicit process that adapts subconsciously. How do these systems interact? Does one system's contributions suppress the other, or do they operate independently? Here, we illustrate that during reaching, implicit and explicit systems both learn from visual target errors. This shared error leads to competition such that an increase in the explicit system's response siphons away resources that are needed for implicit adaptation, thus reducing its learning. As a result, steady-state implicit learning can vary across experimental conditions, due to changes in strategy. Furthermore, strategies can mask changes in implicit learning properties, such as its error sensitivity. These ideas, however, become more complex in conditions where subjects adapt using multiple visual landmarks, a situation which introduces learning from sensory prediction errors in addition to target errors. These two types of implicit errors can oppose each other, leading to another type of competition. Thus, during sensorimotor adaptation, implicit and explicit learning systems compete for a common resource: error.
Collapse
Affiliation(s)
- Scott T Albert
- Department of Biomedical Engineering, Johns Hopkins School of MedicineBaltimoreUnited States
- Neuroscience Center, University of North CarolinaChapel HillUnited States
| | - Jihoon Jang
- Department of Biomedical Engineering, Johns Hopkins School of MedicineBaltimoreUnited States
- Vanderbilt University School of MedicineNashvilleUnited States
| | | | | | - Denise Henriques
- Department of Kinesiology and Health Science, York UniversityTorontoCanada
| | - Gonzalo Lerner
- IFIBIO Houssay, Deparamento de Fisiología y Biofísia, Facultad de Medicina, Universidad de Buenos AiresBuenos AiresArgentina
| | - Valeria Della-Maggiore
- IFIBIO Houssay, Deparamento de Fisiología y Biofísia, Facultad de Medicina, Universidad de Buenos AiresBuenos AiresArgentina
| | - Adrian M Haith
- Department of Neurology, Johns Hopkins School of MedicineBaltimoreUnited States
| | - John W Krakauer
- Department of Neurology, Johns Hopkins School of MedicineBaltimoreUnited States
- Department of Neuroscience, Johns Hopkins School of MedicineBaltimoreUnited States
- The Santa Fe InstituteSanta FeUnited States
| | - Reza Shadmehr
- Department of Biomedical Engineering, Johns Hopkins School of MedicineBaltimoreUnited States
| |
Collapse
|
34
|
Weightman M, Brittain JS, Miall RC, Jenkinson N. Residual errors in visuomotor adaptation persist despite extended motor preparation periods. J Neurophysiol 2022; 127:519-528. [PMID: 35044854 PMCID: PMC8836731 DOI: 10.1152/jn.00301.2021] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/04/2022] Open
Abstract
A consistent finding in sensorimotor adaptation is a persistent undershoot of full compensation, such that performance asymptotes with residual errors greater than seen at baseline. This behavior has been attributed to limiting factors within the implicit adaptation system, which reaches a suboptimal equilibrium between trial-by-trial learning and forgetting. However, recent research has suggested that allowing longer motor planning periods prior to movement eliminates these residual errors. The additional planning time allows required cognitive processes to be completed before movement onset, thus increasing accuracy. Here, we looked to extend these findings by investigating the relationship between increased motor preparation time and the size of imposed visuomotor rotation (30°, 45°, or 60°), with regard to the final asymptotic level of adaptation. We found that restricting preparation time to 0.35 s impaired adaptation for moderate and larger rotations, resulting in larger residual errors compared to groups with additional preparation time. However, we found that even extended preparation time failed to eliminate persistent errors, regardless of magnitude of cursor rotation. Thus, the asymptote of adaptation was significantly less than the degree of imposed rotation, for all experimental groups. In addition, there was a positive relationship between asymptotic error and implicit retention. These data suggest that a prolonged motor preparation period is insufficient to reliably achieve complete adaptation, and therefore, our results suggest that factors beyond that of planning time contribute to asymptotic adaptation levels.NEW & NOTEWORTHY Residual errors in sensorimotor adaptation are commonly attributed to an equilibrium between trial-by-trial learning and forgetting. Recent research suggested that allowing sufficient time for mental rotation eliminates these errors. In a number of experimental conditions, we show that although restricted motor preparation time does limit adaptation-consistent with mental rotation-extending preparation time fails to eliminate the residual errors in motor adaptation.
Collapse
Affiliation(s)
- Matthew Weightman
- 1School of Sport, Exercise and Rehabilitation Sciences, University of Birmingham, Birmingham, United Kingdom,3MRC-Versus Arthritis Centre for Musculoskeletal Ageing Research, University of Birmingham, Birmingham, United Kingdom,4Centre for Human Brain Health, University of Birmingham, Birmingham, United Kingdom
| | - John-Stuart Brittain
- 2School of Psychology, University of Birmingham, Birmingham, United Kingdom,4Centre for Human Brain Health, University of Birmingham, Birmingham, United Kingdom
| | - R. Chris Miall
- 2School of Psychology, University of Birmingham, Birmingham, United Kingdom,3MRC-Versus Arthritis Centre for Musculoskeletal Ageing Research, University of Birmingham, Birmingham, United Kingdom,4Centre for Human Brain Health, University of Birmingham, Birmingham, United Kingdom
| | - Ned Jenkinson
- 1School of Sport, Exercise and Rehabilitation Sciences, University of Birmingham, Birmingham, United Kingdom,3MRC-Versus Arthritis Centre for Musculoskeletal Ageing Research, University of Birmingham, Birmingham, United Kingdom,4Centre for Human Brain Health, University of Birmingham, Birmingham, United Kingdom
| |
Collapse
|
35
|
Abstract
Human motor learning is governed by a suite of interacting mechanisms each one of which modifies behavior in distinct ways and rely on different neural circuits. In recent years, much attention has been given to one type of motor learning, called motor adaptation. Here, the field has generally focused on the interactions of three mechanisms: sensory prediction error SPE-driven, explicit (strategy-based), and reinforcement learning. Studies of these mechanisms have largely treated them as modular, aiming to model how the outputs of each are combined in the production of overt behavior. However, when examined closely the results of some studies also suggest the existence of additional interactions between the sub-components of each learning mechanism. In this perspective, we propose that these sub-component interactions represent a critical means through which different motor learning mechanisms are combined to produce movement; understanding such interactions is critical to advancing our knowledge of how humans learn new behaviors. We review current literature studying interactions between SPE-driven, explicit, and reinforcement mechanisms of motor learning. We then present evidence of sub-component interactions between SPE-driven and reinforcement learning as well as between SPE-driven and explicit learning from studies of people with cerebellar degeneration. Finally, we discuss the implications of interactions between learning mechanism sub-components for future research in human motor learning.
Collapse
|
36
|
De Havas J, Haggard P, Gomi H, Bestmann S, Ikegaya Y, Hagura N. Evidence that endpoint feedback facilitates intermanual transfer of visuomotor force learning by a cognitive strategy. J Neurophysiol 2022; 127:16-26. [PMID: 34879215 PMCID: PMC8794053 DOI: 10.1152/jn.00008.2021] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Humans continuously adapt their movement to a novel environment by recalibrating their sensorimotor system. Recent evidence, however, shows that explicit planning to compensate for external changes, i.e., a cognitive strategy, can also aid performance. If such a strategy is planned in external space, it should improve performance in an effector-independent manner. We tested this hypothesis by examining whether promoting a cognitive strategy during a visual-force adaptation task performed in one hand can facilitate learning for the opposite hand. Participants rapidly adjusted the height of visual bar on screen to a target level by isometrically exerting force on a handle using their right hand. Visuomotor gain increased during the task and participants learned the increased gain. Visual feedback was continuously provided for one group, whereas for another group only the endpoint of the force trajectory was presented. The latter has been reported to promote cognitive strategy use. We found that endpoint feedback produced stronger intermanual transfer of learning and slower response times than continuous feedback. In a separate experiment, we found evidence that aftereffects are reduced when only endpoint feedback is provided, a finding that has been consistently observed when cognitive strategies are used. The results suggest that intermanual transfer can be facilitated by a cognitive strategy. This indicates that the behavioral observation of intermanual transfer can be achieved either by forming an effector-independent motor representation or by sharing an effector-independent cognitive strategy between the hands. NEW & NOTEWORTHY The causes and consequences of cognitive strategy use are poorly understood. We tested whether a visuomotor task learned in a manner that may promote cognitive strategy use causes greater generalization across effectors. Visual feedback was manipulated to promote cognitive strategy use. Learning consistent with cognitive strategy use for one hand transferred to the unlearned hand. Our result suggests that intermanual transfer can result from a common cognitive strategy used to control both hands.
Collapse
Affiliation(s)
- Jack De Havas
- NTT Communication Science Laboratories, Atsugi, Japan.,Institute of Cognitive Neuroscience, University College London, London, United Kingdom.,Center for Information and Neural Networks, National Institute for Information and Communications Technology, Osaka, Japan
| | - Patrick Haggard
- Institute of Cognitive Neuroscience, University College London, London, United Kingdom
| | - Hiroaki Gomi
- NTT Communication Science Laboratories, Atsugi, Japan
| | - Sven Bestmann
- UCL Queen Square Institute of Neurology, Department of Clinical and Movement Neurosciences, University College London, London, United Kingdom.,Wellcome Centre for Human Neuroimaging, University College London, London, United Kingdom
| | - Yuji Ikegaya
- Center for Information and Neural Networks, National Institute for Information and Communications Technology, Osaka, Japan.,Faculty of Pharmaceutical Sciences, Graduate School of Pharmaceutical Sciences, The University of Tokyo, Tokyo, Japan
| | - Nobuhiro Hagura
- Center for Information and Neural Networks, National Institute for Information and Communications Technology, Osaka, Japan.,Graduate School of Frontier Biosciences, Osaka University, Osaka, Japan
| |
Collapse
|
37
|
de Brouwer AJ, Areshenkoff CN, Rashid MR, Flanagan JR, Poppenk J, Gallivan JP. Human Variation in Error-Based and Reinforcement Motor Learning Is Associated With Entorhinal Volume. Cereb Cortex 2021; 32:3423-3440. [PMID: 34963128 PMCID: PMC9376876 DOI: 10.1093/cercor/bhab424] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2021] [Revised: 11/01/2021] [Accepted: 11/03/2021] [Indexed: 12/31/2022] Open
Abstract
Error-based and reward-based processes are critical for motor learning and are thought to be mediated via distinct neural pathways. However, recent behavioral work in humans suggests that both learning processes can be bolstered by the use of cognitive strategies, which may mediate individual differences in motor learning ability. It has been speculated that medial temporal lobe regions, which have been shown to support motor sequence learning, also support the use of cognitive strategies in error-based and reinforcement motor learning. However, direct evidence in support of this idea remains sparse. Here we first show that better overall learning during error-based visuomotor adaptation is associated with better overall learning during the reward-based shaping of reaching movements. Given the cognitive contribution to learning in both of these tasks, these results support the notion that strategic processes, associated with better performance, drive intersubject variation in both error-based and reinforcement motor learning. Furthermore, we show that entorhinal cortex volume is larger in better learning individuals-characterized across both motor learning tasks-compared with their poorer learning counterparts. These results suggest that individual differences in learning performance during error and reinforcement learning are related to neuroanatomical differences in entorhinal cortex.
Collapse
Affiliation(s)
- Anouk J de Brouwer
- Centre for Neuroscience Studies, Queen’s University, Kingston, ON K7L 3N6, Canada
| | - Corson N Areshenkoff
- Centre for Neuroscience Studies, Queen’s University, Kingston, ON K7L 3N6, Canada,Department of Psychology, Queen’s University, Kingston, ON K7L 3N6, Canada
| | - Mohammad R Rashid
- School of Computing, Queen’s University, Kingston, ON K7L 3N6, Canada
| | - J Randall Flanagan
- Centre for Neuroscience Studies, Queen’s University, Kingston, ON K7L 3N6, Canada,Department of Psychology, Queen’s University, Kingston, ON K7L 3N6, Canada
| | - Jordan Poppenk
- Centre for Neuroscience Studies, Queen’s University, Kingston, ON K7L 3N6, Canada,Department of Psychology, Queen’s University, Kingston, ON K7L 3N6, Canada,School of Computing, Queen’s University, Kingston, ON K7L 3N6, Canada
| | - Jason P Gallivan
- Address correspondence to Jason P. Gallivan, Queen’s University, Kingston, Ontario K7L 3N6, Canada.
| |
Collapse
|
38
|
Abstract
Classic taxonomies of memory distinguish explicit and implicit memory systems, placing motor skills squarely in the latter branch. This assertion is in part a consequence of foundational discoveries showing significant motor learning in amnesics. Those findings suggest that declarative memory processes in the medial temporal lobe (MTL) do not contribute to motor learning. Here, we revisit this issue, testing an individual (L. S. J.) with severe MTL damage on four motor learning tasks and comparing her performance to age-matched controls. Consistent with previous findings in amnesics, we observed that L. S. J. could improve motor performance despite having significantly impaired declarative memory. However, she tended to perform poorly relative to age-matched controls, with deficits apparently related to flexible action selection. Further supporting an action selection deficit, L. S. J. fully failed to learn a task that required the acquisition of arbitrary action-outcome associations. We thus propose a modest revision to the classic taxonomic model: Although MTL-dependent memory processes are not necessary for some motor learning to occur, they play a significant role in the acquisition, implementation, and retrieval of action selection strategies. These findings have implications for our understanding of the neural correlates of motor learning, the psychological mechanisms of skill, and the theory of multiple memory systems.
Collapse
|
39
|
James R, Bao S, D'Amato A, Wang J. The nature of savings associated with a visuomotor adaptation task that involves one arm or both arms. Hum Mov Sci 2021; 81:102896. [PMID: 34823221 DOI: 10.1016/j.humov.2021.102896] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2021] [Revised: 09/27/2021] [Accepted: 11/08/2021] [Indexed: 01/11/2023]
Abstract
The nature of savings in visuomotor adaptation is typically studied using a paradigm in which one arm experiences multiple conditions such as adaptation, washout and readaptation. It has seldom been studied, however, using a paradigm that involves both arms. Here, we examined the effect of (1) using different arms and (2) the availability of visual feedback during a washout session following visuomotor adaptation on savings. We first had healthy young adults adapt to a visuomotor rotation condition during reaching movements with the left arm. Following that, they experienced a washout session with either the left or right arm, with or without visual feedback, and then the readaptation session with the left arm again. We hypothesized that if savings occurred due to the explicit recall of cognitive strategies, the pattern of savings would be similar regardless of which arm was used during the washout session. Results showed that in terms of the percentage of savings, there was a significant difference between the conditions in which the left or right arm was used during the washout, but not between the conditions in which visual feedback was provided or absent. In terms of the rate of relearning, a significant difference was observed between the conditions in which the left or right arm was used during the washout, and also between the conditions in which visual feedback was provided or absent. These findings suggest that the explicit recall of strategies is not the only source for savings and further suggest that effector-specific, use-dependent learning can also contribute to savings.
Collapse
Affiliation(s)
- Reshma James
- Department of Kinesiology, University of Wisconsin-Milwaukee, Milwaukee, WI 53201, USA
| | - Shancheng Bao
- Department of Kinesiology, University of Wisconsin-Milwaukee, Milwaukee, WI 53201, USA
| | - Arthur D'Amato
- Department of Kinesiology, University of Wisconsin-Milwaukee, Milwaukee, WI 53201, USA
| | - Jinsung Wang
- Department of Kinesiology, University of Wisconsin-Milwaukee, Milwaukee, WI 53201, USA.
| |
Collapse
|
40
|
Abstract
Adapting hand movements to changes in our body or the environment is essential for skilled motor behavior, as is the ability to flexibly combine experience gathered in separate contexts. However, it has been shown that when adapting hand movements to two different visuomotor perturbations in succession, interference effects can occur. Here, we investigate whether these interference effects compromise our ability to adapt to the superposition of the two perturbations. Participants tracked with a joystick, a visual target that followed a smooth but an unpredictable trajectory. Four separate groups of participants (total n = 83) completed one block of 50 trials under each of three mappings: one in which the cursor was rotated by 90° (ROTATION), one in which the cursor mimicked the behavior of a mass-spring system (SPRING), and one in which the SPRING and ROTATION mappings were superimposed (SPROT). The order of the blocks differed across groups. Although interference effects were found when switching between SPRING and ROTATION, participants who performed these blocks first performed better in SPROT than participants who had no prior experience with SPRING and ROTATION (i.e., composition). Moreover, participants who started with SPROT exhibited better performance under SPRING and ROTATION than participants who had no prior experience with each of these mappings (i.e., decomposition). Additional analyses confirmed that these effects resulted from components of learning that were specific to the rotational and spring perturbations. These results show that interference effects do not preclude the ability to compose/decompose various forms of visuomotor adaptation.NEW & NOTEWORTHY The ability to compose/decompose task representations is critical for both cognitive and behavioral flexibility. Here, we show that this ability extends to two forms of visuomotor adaptation in which humans have to perform visually guided hand movements. Despite the presence of interference effects when switching between visuomotor maps, we show that participants are able to flexibly compose or decompose knowledge acquired in previous sessions. These results further demonstrate the flexibility of sensorimotor adaptation in humans.
Collapse
Affiliation(s)
- Pierre-Michel Bernier
- Département de Kinanthropologie, Université de Sherbrooke, Sherbrooke, Quebec, Canada
| | - James Mathew
- Institut Neurosci Timone, Aix Marseille Univ, CNRS, INT, Marseille, France.,Institute of Neuroscience, Institute of Communication & Information Technologies, Electronics & Applied Mathematics, Université Catholique de Louvain, Louvain-la-neuve, Belgium
| | - Frederic R Danion
- Institut Neurosci Timone, Aix Marseille Univ, CNRS, INT, Marseille, France.,Center for Research on Cognition and Learning (CERCA) UMR 7295, University of Poitiers, CNRS, Poitiers, France
| |
Collapse
|
41
|
Struber L, Baumont M, Barraud PA, Nougier V, Cignetti F. Brain oscillatory correlates of visuomotor adaptive learning. Neuroimage 2021; 245:118645. [PMID: 34687861 DOI: 10.1016/j.neuroimage.2021.118645] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2021] [Revised: 10/06/2021] [Accepted: 10/10/2021] [Indexed: 11/24/2022] Open
Abstract
Sensorimotor adaptation involves the recalibration of the mapping between motor command and sensory feedback in response to movement errors. Although adaptation operates within individual movements on a trial-to-trial basis, it can also undergo learning when adaptive responses improve over the course of many trials. Brain oscillatory activities related to these "adaptation" and "learning" processes remain unclear. The main reason for this is that previous studies principally focused on the beta band, which confined the outcome message to trial-to-trial adaptation. To provide a wider understanding of adaptive learning, we decoded visuomotor tasks with constant, random or no perturbation from EEG recordings in different bandwidths and brain regions using a multiple kernel learning approach. These different experimental tasks were intended to separate trial-to-trial adaptation from the formation of the new visuomotor mapping across trials. We found changes in EEG power in the post-movement period during the course of the visuomotor-constant rotation task, in particular an increased (i) theta power in prefrontal region, (ii) beta power in supplementary motor area, and (iii) gamma power in motor regions. Classifying the visuomotor task with constant rotation versus those with random or no rotation, we were able to relate power changes in beta band mainly to trial-to-trial adaptation to error while changes in theta band would relate rather to the learning of the new mapping. Altogether, this suggested that there is a tight relationship between modulation of the synchronization of low (theta) and higher (essentially beta) frequency oscillations in prefrontal and sensorimotor regions, respectively, and adaptive learning.
Collapse
Affiliation(s)
- Lucas Struber
- Univ. Grenoble Alpes, CNRS, UMR 5525, VetAgro Sup, Grenoble INP, TIMC, 38000 Grenoble, France.
| | - Marie Baumont
- Univ. Grenoble Alpes, CNRS, UMR 5525, VetAgro Sup, Grenoble INP, TIMC, 38000 Grenoble, France
| | - Pierre-Alain Barraud
- Univ. Grenoble Alpes, CNRS, UMR 5525, VetAgro Sup, Grenoble INP, TIMC, 38000 Grenoble, France
| | - Vincent Nougier
- Univ. Grenoble Alpes, CNRS, UMR 5525, VetAgro Sup, Grenoble INP, TIMC, 38000 Grenoble, France
| | - Fabien Cignetti
- Univ. Grenoble Alpes, CNRS, UMR 5525, VetAgro Sup, Grenoble INP, TIMC, 38000 Grenoble, France
| |
Collapse
|
42
|
Bindra G, Brower R, North R, Zhou W, Joiner WM. Normal Aging Affects the Short-Term Temporal Stability of Implicit, But Not Explicit, Motor Learning following Visuomotor Adaptation. eNeuro 2021; 8:ENEURO. [PMID: 34580156 DOI: 10.1523/ENEURO.0527-20.2021] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2020] [Revised: 09/10/2021] [Accepted: 09/16/2021] [Indexed: 11/21/2022] Open
Abstract
Normal aging is associated with a decline in memory and motor learning ability. However, the exact form of these impairments (e.g., the short-term temporal stability and affected learning mechanisms) is largely unknown. Here, we used a sensorimotor adaptation task to examine changes in the temporal stability of two forms of learning (explicit and implicit) because of normal aging. Healthy young subjects (age range, 19–28 years; 20 individuals) and older human subjects (age range, 63–85 years; 19 individuals) made reaching movements in response to altered visual feedback. On each trial, subjects turned a rotation dial to select an explicit aiming direction. Once selected, the display was removed and subjects moved the cursor from the start position to the target. After initial training with the rotational feedback perturbation, subjects completed a series of probe trials at different delay periods to systematically assess the short-term retention of learning. For both groups, the explicit aiming showed no significant decrease over 1.5 min. However, this was not the case for implicit learning; the decay pattern was markedly different between groups. Older subjects showed a linear decrease of the implicit component of adaptation over time, while young subjects showed an exponential decay over the same period (time constant, 25.61 s). Although older subjects adapted at a similar rate, these results suggest natural aging selectively impacts the short-term (seconds to minutes) temporal stability of implicit motor learning mechanisms. This understanding may provide a means to dissociate natural aging memory impairments from deficits caused by brain disorders that progress with aging.
Collapse
|
43
|
Abstract
Actions often require the selection of a specific goal amongst a range of possibilities, like when a softball player must precisely position her glove to field a fast-approaching ground ball. Previous studies have suggested that during goal uncertainty the brain prepares for all potential goals in parallel and averages the corresponding motor plans to command an intermediate movement that is progressively refined as additional information becomes available. Although intermediate movements are widely observed, they could instead reflect a neural decision about the single best action choice given the uncertainty present. Here we systematically dissociate these possibilities using novel experimental manipulations and find that when confronted with uncertainty, humans generate a motor plan that optimizes task performance rather than averaging potential motor plans. In addition to accurate predictions of population-averaged changes in motor output, a novel computational model based on this performance-optimization theory accounted for a majority of the variance in individual differences between participants. Our findings resolve a long-standing question about how the brain selects an action to execute during goal uncertainty, providing fundamental insight into motor planning in the nervous system.
Collapse
Affiliation(s)
- Laith Alhussein
- John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, United States
| | - Maurice A Smith
- John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, United States.,Center for Brain Science, Harvard University, Cambridge, United States
| |
Collapse
|
44
|
Hooyman A, Gordon J, Winstein C. Unique behavioral strategies in visuomotor learning: Hope for the non-learner. Hum Mov Sci 2021; 79:102858. [PMID: 34392189 DOI: 10.1016/j.humov.2021.102858] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2021] [Revised: 05/06/2021] [Accepted: 08/02/2021] [Indexed: 10/20/2022]
Abstract
The existence of individual differences in motor learning capability is well known but the behaviors or strategies that contribute to this variability have been vastly understudied. What performance characteristics distinguish an expert level performer from individuals who experience little to no success, those labeled non-learners? We designed a rule-based visuomotor task which requires identification (discovery) and then exploitation of specific explicit and implicit task components that requires a specific movement pattern, the task rule, for goal achievement. When participants first attempt the task, they are informed about the goal, but are naïve to the task rule. Therefore, the purpose of this experiment is to determine how acquisition of both implicit and explicit task components, the inherent elements of the task rule, reveals differing strategies associated with performance and task success. We test the hypothesis that an examination of performance will reveal sub-groups with varying levels of success. Further, for each subgroup, we expect to find a unique relationship between visual Time-in-Target feedback (a measure of success) and subsequent updating of each task component. Out of 32 non-disabled adults, we identified three distinct sub-groups: (Low Performer/Non-Learner (LP, N = 9), Moderate Performer (MP, N = 12) and High Performer (HP, N = 11)). A quantitative analysis of behavioral patterns reveals three findings: First, the LP sub-group demonstrated significantly lower task success which was associated with difficulty identifying the explicit component of the task. Second, the HP sub-group acquired the two task components in parallel over practice. Third, when both explicit and implicit component performance is plotted across sub-groups, a task component continuum emerges that seamlessly progresses from low to moderate to high performer groups. An exploratory analysis reveals that self-reported level of prior lifetime accumulation of video game and physical activity experience is a significant predictor of individual task performance (R2 = 0.50). In summary, what appears to be a key distinction between varying levels of human rule-based motor learning is the process by which feedback is used to update performance of inherent elements of the task rule. Evidence of a performance continuum and limited prior experience suggests that Low Performer/Non-Learners are generally inexperienced with these kinds of tasks, although the role of genetics and other innate learning capabilities in visuomotor learning is still largely unknown. These findings provoke new research directions toward probing the differential performance strategies associated with expertise and the development of interventions aimed to convert non-learners into learners.
Collapse
Affiliation(s)
- Andrew Hooyman
- School of Biological and Health Systems Engineering, Arizona State University, United States of America.
| | - James Gordon
- Division of Biokinesiology and Physical Therapy, Herman Ostrow School of Dentistry, and Department of Neurology, Keck School of Medicine, University of Southern California, United States of America
| | - Carolee Winstein
- Division of Biokinesiology and Physical Therapy, Herman Ostrow School of Dentistry, and Department of Neurology, Keck School of Medicine, University of Southern California, United States of America
| |
Collapse
|
45
|
Wilterson SA, Taylor JA. Implicit Visuomotor Adaptation Remains Limited after Several Days of Training. eNeuro 2021; 8:ENEURO. [PMID: 34301722 DOI: 10.1523/ENEURO.0312-20.2021] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2020] [Revised: 07/09/2021] [Accepted: 07/13/2021] [Indexed: 12/31/2022] Open
Abstract
Learning in sensorimotor adaptation tasks has been viewed as an implicit learning phenomenon. The implicit process affords recalibration of existing motor skills so that the system can adjust to changes in the body or environment without relearning from scratch. However, recent findings suggest that the implicit process is heavily constrained, calling into question its utility in motor learning and the theoretical framework of sensorimotor adaptation paradigms. These inferences have been based mainly on results from single bouts of training, where explicit compensation strategies, such as explicitly re-aiming the intended movement direction, contribute a significant proportion of adaptive learning. It is possible, however, that the implicit process supersedes explicit compensation strategies over repeated practice sessions. We tested this by dissociating the contributions of explicit re-aiming strategies and the implicit process in human participants over five consecutive days of training. Despite a substantially longer duration of training, the implicit process still plateaued at a value far short of complete learning and, as has been observed in previous studies, was inappropriate for a mirror-reversal task. Notably, we find significant between subject differences that call into question traditional interpretation of these group-level results.
Collapse
|
46
|
Xing X, Saunders JA. Different generalization of fast and slow visuomotor adaptation across locomotion and pointing tasks. Exp Brain Res 2021; 239:2859-2871. [PMID: 34292343 DOI: 10.1007/s00221-021-06112-w] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2020] [Accepted: 04/09/2021] [Indexed: 11/25/2022]
Abstract
Sensorimotor adaptation can involve multiple learning processes with different time courses, and these processes may have different patterns of transfer. In this study, we tested how slow learning and fast learning transfer across tasks, and the specificity of transfer. We tested two natural goal-directed tasks: pointing and walking toward a visible target. We also tested a novel "hand locomotion" task in which subjects used pointing movements to cause simulated self-motion in virtual reality. The hand locomotion task used the same physical movement as pointing, but performed the same function as stepping. During an experimental block, subjects performed alternating training trials with perturbed visual feedback and test trials with no feedback. The test trials were either the same task to measure adaptation, or a different task to measure transfer. Perturbations on adaptation trials varied over time as a sum of sinusoids with different frequencies. Fast learning would be expected to produce equal responses to fast and slow perturbations, while slower learning would dampen responses to higher frequency perturbations. Subjects were generally not aware of the smoothly varying perturbations, but showed detectable adaptation for all three tasks. Only pointing produced significantly different responses to high- and low-frequency perturbations, consistent with slow learning. Adaptation of pointing produced more transfer to the hand locomotion task, which shared the same effector and motor actions, than to the stepping task. The other tasks showed fast learning but little or no slow learning, and equal transfer to tasks with different effector or function. Our results suggest that the slower components of sensorimotor adaptation are more movement specific, while faster learning is more generalizable.
Collapse
Affiliation(s)
- Xing Xing
- Department of Psychology, The University of Hong Kong, Pokfulam, Hong Kong SAR
| | - Jeffrey A Saunders
- Department of Psychology, The University of Hong Kong, Pokfulam, Hong Kong SAR.
| |
Collapse
|
47
|
Abstract
Exposure to task-irrelevant feedback leads to perceptual learning, but its effect on motor learning has been understudied. Here, we asked human participants to reach a visual target with a hand-controlled cursor while observing another cursor moving independently in a different direction. Although the task-irrelevant feedback did not change the main task's performance, it elicited robust savings in subsequent adaptation to classical visuomotor rotation perturbation. We demonstrated that the saving effect resulted from a faster formation of strategic learning through a series of experiments, not from gains in the implicit learning process. Furthermore, the saving effect was robust against drastic changes in stimulus features (i.e., rotation size or direction) or task types (i.e., for motor adaptation and skill learning). However, the effect was absent when the task-irrelevant feedback did not carry the visuomotor relationship embedded in visuomotor rotation. Thus, though previous research on perceptual learning has related task-irrelevant feedback to changes in early sensory processes, our findings support its role in acquiring abstract sensorimotor knowledge during motor learning. Motor learning studies have traditionally focused on task-relevant feedback, but our study extends the scope of feedback processes and sheds new light on the dichotomy of explicit and implicit learning in motor adaptation and motor structure learning.NEW & NOTEWORTHY When the motor system faces perturbations, such as fatigue or new environmental changes, it adapts to these changes by voluntarily selecting new action plans or implicitly fine-tuning the control. We show that the action selection part can be enhanced without practice or explicit instruction. We further demonstrate that this enhancement is probably linked to the acquisition of abstract knowledge about the to-be-adapted novel visual feedback. Our findings draw an interesting parallel between motor and perceptual learning by showing that top-down information affects both types of procedural learning.
Collapse
Affiliation(s)
- Yajie Liu
- School of Psychological and Cognitive Sciences, Peking University, Beijing, China
| | - Wanying Jiang
- School of Psychological and Cognitive Sciences, Peking University, Beijing, China.,Peking-Tsinghua Center for Life Sciences, Beijing, China
| | - Yuqing Bi
- School of Psychological and Cognitive Sciences, Peking University, Beijing, China
| | - Kunlin Wei
- School of Psychological and Cognitive Sciences, Peking University, Beijing, China.,Beijing Key Laboratory of Behavior and Mental Health, Beijing, China.,Peking-Tsinghua Center for Life Sciences, Beijing, China
| |
Collapse
|
48
|
Orozco SP, Albert ST, Shadmehr R. Adaptive control of movement deceleration during saccades. PLoS Comput Biol 2021; 17:e1009176. [PMID: 34228710 PMCID: PMC8284628 DOI: 10.1371/journal.pcbi.1009176] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2020] [Revised: 07/16/2021] [Accepted: 06/13/2021] [Indexed: 11/19/2022] Open
Abstract
As you read this text, your eyes make saccades that guide your fovea from one word to the next. Accuracy of these movements require the brain to monitor and learn from visual errors. A current model suggests that learning is supported by two different adaptive processes, one fast (high error sensitivity, low retention), and the other slow (low error sensitivity, high retention). Here, we searched for signatures of these hypothesized processes and found that following experience of a visual error, there was an adaptive change in the motor commands of the subsequent saccade. Surprisingly, this adaptation was not uniformly expressed throughout the movement. Rather, after experience of a single error, the adaptive response in the subsequent trial was limited to the deceleration period. After repeated exposure to the same error, the acceleration period commands also adapted, and exhibited resistance to forgetting during set-breaks. In contrast, the deceleration period commands adapted more rapidly, but suffered from poor retention during these same breaks. State-space models suggested that acceleration and deceleration periods were supported by a shared adaptive state which re-aimed the saccade, as well as two separate processes which resembled a two-state model: one that learned slowly and contributed primarily via acceleration period commands, and another that learned rapidly but contributed primarily via deceleration period commands.
Collapse
Affiliation(s)
- Simon P. Orozco
- Laboratory for Computational Motor Control, Dept. of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, Maryland, United States of America
| | - Scott T. Albert
- Laboratory for Computational Motor Control, Dept. of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, Maryland, United States of America
| | - Reza Shadmehr
- Laboratory for Computational Motor Control, Dept. of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, Maryland, United States of America
| |
Collapse
|
49
|
Albert ST, Jang J, Sheahan HR, Teunissen L, Vandevoorde K, Herzfeld DJ, Shadmehr R. An implicit memory of errors limits human sensorimotor adaptation. Nat Hum Behav 2021; 5:920-934. [PMID: 33542527 DOI: 10.1038/s41562-020-01036-x] [Citation(s) in RCA: 34] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2019] [Accepted: 11/24/2020] [Indexed: 01/30/2023]
Abstract
During extended motor adaptation, learning appears to saturate despite persistence of residual errors. This adaptation limit is not fixed but varies with perturbation variance; when variance is high, residual errors become larger. These changes in total adaptation could relate to either implicit or explicit learning systems. Here, we found that when adaptation relied solely on the explicit system, residual errors disappeared and learning was unaltered by perturbation variability. In contrast, when learning depended entirely, or in part, on implicit learning, residual errors reappeared. Total implicit adaptation decreased in the high-variance environment due to changes in error sensitivity, not in forgetting. These observations suggest a model in which the implicit system becomes more sensitive to errors when they occur in a consistent direction. Thus, residual errors in motor adaptation are at least in part caused by an implicit learning system that modulates its error sensitivity in response to the consistency of past errors.
Collapse
Affiliation(s)
- Scott T Albert
- Department of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, MD, USA.
| | - Jihoon Jang
- Department of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, MD, USA
| | - Hannah R Sheahan
- Department of Experimental Psychology, University of Oxford, Oxford, UK
| | - Lonneke Teunissen
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, the Netherlands
| | - Koenraad Vandevoorde
- Leuven Brain Institute, KU Leuven, Leuven, Belgium
- Movement Control and Neuroplasticity Research Group, Department of Movement Sciences, KU Leuven, Leuven, Belgium
| | - David J Herzfeld
- Department of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, MD, USA
- Department of Neurobiology, Duke University School of Medicine, Durham, NC, USA
| | - Reza Shadmehr
- Department of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, MD, USA
| |
Collapse
|
50
|
Maresch J, Mudrik L, Donchin O. Measures of explicit and implicit in motor learning: what we know and what we don't. Neurosci Biobehav Rev 2021; 128:558-568. [PMID: 34214514 DOI: 10.1016/j.neubiorev.2021.06.037] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2021] [Revised: 06/21/2021] [Accepted: 06/25/2021] [Indexed: 11/19/2022]
Abstract
Adaptation tasks are a key tool in characterizing the contribution of explicit and implicit processes to sensorimotor learning. However, different assumptions and ideas underlie methods used to measure these processes, leading to inconsistencies between studies. For instance, it is still unclear explicit and implicit combine additively. Cognitive studies of explicit and implicit processes show how non-additivity and bias in measurement can distort results. We argue that to understand explicit and implicit processes in visuomotor adaptation, we need a stronger characterization of the phenomenology and a richer set of models to test it on.
Collapse
Affiliation(s)
- Jana Maresch
- Department of Brain and Cognitive Sciences, Ben Gurion University of the Negev, Be'er Sheva, Israel.
| | - Liad Mudrik
- Sagol School of Neuroscience and School of Psychological Sciences, Tel Aviv University, PO Box 39040, Tel Aviv, 69978, Israel.
| | - Opher Donchin
- Department of Biomedical Engineering and Zlotowski Center for Neuroscience, Ben-Gurion University of the Negev, P.O.B. 653, Be'er Sheva, 8410501, Israel.
| |
Collapse
|