The role of feedback in the production of skilled finger sequences

Actions involving fine control of the hand, for example, grasping an object, rely heavily on sensory information from the fingertips. Although the integration of feedback during the execution of individual movements is well understood, less is known about the use of sensory feedback in the control of skilled movement sequences. To address this gap, we trained participants to produce sequences of finger movements on a keyboard-like device over a 4-day training period. Participants received haptic, visual, and auditory feedback indicating the occurrence of each finger press. We then either transiently delayed or advanced the feedback for a single press by a small amount of time (30 or 60 ms). We observed that participants rapidly adjusted their ongoing finger press by either accelerating or prolonging the ongoing press, in accordance with the direction of the perturbation. Furthermore, we could show that this rapid behavioral modulation was driven by haptic feedback. Although these feedback-driven adjustments reduced in size with practice, they were still clearly present at the end of training. In contrast to the directionally specific effect we observed on the perturbed press, a feedback perturbation resulted in a delayed onset of the subsequent presses irrespective of perturbation direction or feedback modality. This observation is consistent with a hierarchical organization of even very skilled and fast movement sequences, with different levels reacting distinctly to sensory perturbations.NEW & NOTEWORTHY Sensory feedback is important during the execution of a movement. However, little is known about how sensory feedback is used during the production of movement sequences. Here, we show two distinct feedback processes in the execution of fast finger movement sequences. By transiently delaying or advancing the feedback of a single press within a sequence, we observed a directionally specific effect on the perturbed press and a directionally non-specific effect on the subsequent presses.

The Dopamine System and Automatization of Movement Sequences: A Review With Relevance for Speech and Stuttering

The last decades of research have gradually elucidated the complex functions of the dopamine system in the vertebrate brain. The multiple roles of dopamine in motor function, learning, attention, motivation, and the emotions have been difficult to reconcile. A broad and detailed understanding of the physiology of cerebral dopamine is of importance in understanding a range of human disorders. One of the core functions of dopamine involves the basal ganglia and the learning and execution of automatized sequences of movements. Speech is one of the most complex and highly automatized sequential motor behaviors, though the exact roles that the basal ganglia and dopamine play in speech have been difficult to determine. Stuttering is a speech disorder that has been hypothesized to be related to the functions of the basal ganglia and dopamine. The aim of this review was to provide an overview of the current understanding of the cerebral dopamine system, in particular the mechanisms related to motor learning and the execution of movement sequences. The primary aim was not to review research on speech and stuttering, but to provide a platform of neurophysiological mechanisms, which may be utilized for further research and theoretical development on speech, speech disorders, and other behavioral disorders. Stuttering and speech are discussed here only briefly. The review indicates that a primary mechanism for the automatization of movement sequences is the merging of isolated movements into chunks that can be executed as units. In turn, chunks can be utilized hierarchically, as building blocks of longer chunks. It is likely that these mechanisms apply also to speech, so that frequent syllables and words are produced as motor chunks. It is further indicated that the main learning principle for sequence learning is reinforcement learning, with the phasic release of dopamine as the primary teaching signal indicating successful sequences. It is proposed that the dynamics of the dopamine system constitute the main neural basis underlying the situational variability of stuttering.

Effects of Physical and Observational Practice on Intermanual Transfer

Some studies have shown that different coordinate systems in the coding of movement sequences develop during observational and physical practice. According to Newell's (Newell, 1986) constraintsled approach, such contradictions could possibly depend on task characteristics. Accordingly, in the present study, two experiments were designed using a five-segment sequence timing task, in which the instructions on how to perform the sequence were different. The task in the first experiment comprised an alternating shift of fast and slow segments, whereas the second experiment involved an incremental procedure from slow to fast. In these experiments, the intermanual transfer of absolute and relative timing through observational and physical practice was examined. Transfer conditions were such that they required the same motor commands (mirror transfer) or the same visual-spatial coordinates (non-mirror transfer) as those in the practice conditions. The first experiment showed that the transfer to the non-mirror condition for relative timing in the physical group was better than that to the mirror condition, while the transfer was similar for both conditions in the observational group, indicating a different pattern of transfer for relative timing. The relative timing transfer pattern in the second experiment was the same for both experimental groups, such that the physical and observational practice resulted in a similar transfer to both mirror and non-mirror conditions. In both experiments, observational and physical practice participants exhibited similar intramanual transfer of absolute timing under both transfer conditions. Thus, the task itself as a constraint was revealed to be an effective factor influencing the behavioral results derived from physical and observational practice.

A Dynamical Systems Perspective on Flexible Motor Timing

A hallmark of higher brain function is the ability to rapidly and flexibly adjust behavioral responses based on internal and external cues. Here, we examine the computational principles that allow decisions and actions to unfold flexibly in time. We adopt a dynamical systems perspective and outline how temporal flexibility in such a system can be achieved through manipulations of inputs and initial conditions. We then review evidence from experiments in nonhuman primates that support this interpretation. Finally, we explore the broader utility and limitations of the dynamical systems perspective as a general framework for addressing open questions related to the temporal control of movements, as well as in the domains of learning and sequence generation.

The coding and inter-manual transfer of movement sequences

The manuscript reviews recent experiments that use inter-manual transfer and inter-manual practice paradigms to determine the coordinate system (visual-spatial or motor) used in the coding of movement sequences during physical and observational practice. The results indicated that multi-element movement sequences are more effectively coded in visual-spatial coordinates even following extended practice, while very early in practice movement sequences with only a few movement elements and relatively short durations are coded in motor coordinates. Likewise, inter-manual practice of relatively simple movement sequences show benefits of right and left limb practice that involves the same motor coordinates while the opposite is true for more complex sequences. The results suggest that the coordinate system used to code the sequence information is linked to both the task characteristics and the control processes used to produce the sequence. These findings have the potential to greatly enhance our understanding of why in some conditions participants following practice with one limb or observation of one limb practice can effectively perform the task with the contralateral limb while in other (often similar) conditions cannot.

Coarticulation in fluent fingerspelling

In speech, the phenomenon of coarticulation (differentiation of phoneme production depending on the preceding or following phonemes) suggests an organization of movement sequences that is not strictly serial. In the skeletal motor system, however, evidence for comparable fluency has been lacking. Thus the present study was designed to quantify coarticulation in the hand movement sequences of sign language interpreters engaged in fingerspelling. Records of 17 measured joint angles were subjected to discriminant and correlation analyses to determine to what extent and in what manner the hand shape for a particular letter was influenced by the hand shapes for the preceding or the following letters. Substantial evidence of coarticulation was found, revealing both forward and reverse influences across letters. These influences could be further categorized as assimilation (tending to reduce the differences between sequential hand shapes) or dissimilation (tending to emphasize the differences between sequential hand shapes). The proximal interphalangeal (PIP) joints of the index and middle fingers tended to show dissimilation, whereas at the same time (i.e., during the spelling of the same letters) the joints of the wrist and thumb tended to show assimilation. The index and middle finger PIP joints have been shown previously to be among the most important joints for computer recognition of the 26 letter shapes, and therefore the dissimilation may have served to enhance visual discrimination. The simultaneous occurrence of dissimilation in some joints and assimilation in others demonstrates an unprecedented level of parallel control of individual joint rotations in an essentially serial task.

Coding of serial order by neostriatal neurons: a "natural action" approach to movement sequence

The neostriatum controls behavioral sequencing, or action syntax, as well as simpler aspects of movement. Yet the precise nature of the neostriatums role in sequencing remains unclear. Here we used a "natural action" approach that combined electrophysiological and neuroethological techniques. We identified neostriatal neurons that code the serial order of natural movement sequences of rats. During grooming behavior, rats emit complex but highly predictable species-specific sequences of movements, termed "syntactic chains." Neuronal activity of 41% of cells in the dorsolateral and ventromedial neostriatum coded the sequential pattern of syntactic chains. Only 14% coded simple motor properties of grooming movements. Neurons fired preferentially during syntactic chains compared with similar grooming movements made in different sequential order or to behavioral resting. Sequential coding differed between the dorsolateral and ventromedial neostriatum. Neurons in the dorsolateral site increased firing by 116% during syntactic chains, compared with only a 30% increase by neurons in the ventromedial site, and dorsolateral neurons showed strongest coding of grooming syntax by several additional criteria. These data demonstrate that neostriatal neurons code abstract properties of serial order for natural movement and support the hypothesis that the dorsolateral neostriatum plays a special role in implementing action syntax.