Interaction in planning movement direction for articulatory gestures and manual actions

Front Is High and Back Is Low: Sound-Space Iconicity in Finnish

Previous investigations have shown various interactions between spatial concepts and speech sounds. For instance, the front-high vowel [i] is associated with the concept of forward, and the back-high vowel [o] is associated with the concept of backward. Three experiments investigated whether the concepts of forward/front and backward/back are associated with high- and low-pitched vocalizations, respectively, in Finnish. In Experiments 1 and 2, the participants associated the high-pitched vocalization with the forward-directed movement and the low-pitched vocalizations with the backward-directed movement. In Experiment 3, the same effect was observed in relation to the concepts of front of and back of. We propose that these observations present a novel sound-space symbolism phenomenon in which spatial concepts of forward/front and backward/back are iconically associated with high- and low-pitched speech sounds. This observation is discussed in relation to the grounding of semantic knowledge of these spatial concepts in the movements of articulators such as relative front/back-directed movements of the tongue.

Synergistic effects of combined motor and language interventions on stroke rehabilitation: a holistic approach

Background

Stroke patients typically suffer from a range of symptoms, such as motor and language impairments, due to shared neural networks. The recovery process after stroke is intricate and requires a comprehensive approach. While previous studies have investigated the motor and language interventions independently, this study aimed to explore the relationship between these domains and compared the effectiveness of individual interventions versus their combined use.

Methods

We divided 45 stroke patients into three groups: Speech and Language Therapy (SLT) group; Arm Ability Training (AAT) group; and consecutive combination of SLT and AAT group. Participants attended 40-min sessions three days a week for three weeks. Standardized assessments, including picture naming test, syntactic comprehension test, and Test d'Evaluation des Membres Supérieurs de Personnes Âgées (TEMPA) test, were conducted pre-and post-treatment and during the first and second weeks of the intervention.

Results

Within-group comparisons demonstrated a significant enhancement in test scores for all groups post-intervention compared to pre-intervention (p < 0.05). Between-group comparisons revealed significant differences (p < 0.05) in performance on the picture naming test during the first week, the syntactic comprehension test in the second week, the functional rating subscale of Tempa test changes pre-and post-treatment and the first week, and the length of the time subscale of Tempa test improvements from pre-intervention to the first week.

Conclusion

Findings underscored the mutual and synergistic benefits of integrating motor and language in stroke rehabilitation. While SLT and AAT were effective when applied independently, their combined application yielded superior outcomes, emphasizing the holistic advantages of integrating these interventions, as supported by existing literature on dual-task rehabilitation strategies.

Clinical trial registration

https://irct.behdasht.gov.ir/search/result?query=IRCT20200114046134N1, IRCT20200114046134N1.

The initiation of a hand grip is delayed by silently reading an incompatible syllable

The movements of phonation structures (e.g., tongue) have been shown to facilitate compatible hand movements. For example, reaction time (RT) of precision and power hand grips (made with tips of thumb and finger vs. whole hand) are shortened with the production of syllables that share similar action features (e.g., employing the proximal vs. dorsal portion of the tongue, respectively). This effect is coined the articulation-grip correspondence (AGC) effect. However, it is not known if the AGC effect is due to action facilitation vs. interference, and if such facilitation/ interference is due to covertly or overtly reading the syllable. To answer the associated empirical questions, the present experiment involved participants initiating a precision or power grip without the covert/ overt reading of a syllable, or while covertly or overtly reading the syllable /ti/ or /ka/. In both the covert and overt reading conditions, there were longer RTs for precision grips with the syllable /ka/ than /ti/, and there were longer RTs for power grips with the syllable /ti/. In contrast, the syllable /ti/ or /ka/ did not alter precision or power grip RTs, respectively. These findings support the notion of articulation-grip interference but not facilitation and that such interference can be observed with covert (silent) reading.

Interaction between grasping and articulation: How vowel and consonant pronunciation influences precision and power grip responses

Grasping and mouth movements have been proposed to be integrated anatomically, functionally and evolutionarily. In line with this, we have shown that there is a systematic interaction between particular speech units and grip performance. For example, when the task requires pronouncing a speech unit simultaneously with grasp response, the speech units [i] and [t] are associated with relatively rapid and accurate precision grip responses, while [ɑ] and [k] are associated with power grip responses. This study is aimed at complementing the picture about which vowels and consonants are associated with these grasp types. The study validated our view that the high-front vowels and the alveolar consonants are associated with precision grip responses, while low and high-back vowels as well as velar consonants or those whose articulation involves the lowering of the tongue body are associated with power grip responses. This paper also proposes that one reason why small/large concepts are associated with specific speech sounds in the sound-magnitude symbolism is because articulation of these sounds is programmed within the overlapping mechanisms of precision or power grasping.

Sound-Action Symbolism

Recent evidence has shown linkages between actions and segmental elements of speech. For instance, close-front vowels are sound symbolically associated with the precision grip, and front vowels are associated with forward-directed limb movements. The current review article presents a variety of such sound-action effects and proposes that they compose a category of sound symbolism that is based on grounding a conceptual knowledge of a referent in articulatory and manual action representations. In addition, the article proposes that even some widely known sound symbolism phenomena such as the sound-magnitude symbolism can be partially based on similar sensorimotor grounding. It is also discussed that meaning of suprasegmental speech elements in many instances is similarly grounded in body actions. Sound symbolism, prosody, and body gestures might originate from the same embodied mechanisms that enable a vivid and iconic expression of a meaning of a referent to the recipient.

Dual-task performance of speech and motor skill: verb generation facilitates grasping behaviour

Pronouncing nouns or verbs while grasping distinctly alters movement. Changes in hand speed and final position occur according to the meaning of the words spoken. These results are typically found when executing a single movement paired with a single word. For example, pronouncing the word 'fast' increased the speed of the hand when reaching to grasp. Our objective was to compare how verb and noun fluency tasks interact with grasping behaviour in a grasp-to-construct task. Because previous imaging research shows that verb and noun production activates distinct neural areas, we reasoned that grasping outcomes would differ according to the category of word produced by participants. Specifically, we hypothesized that verb pronunciation would distinctly affect grasping behaviour compared to producing nouns. We recruited 38 young adults who performed a grasp-to-construct task and two different verbal fluency tasks. Participants completed each task (grasp, verb fluency, and noun fluency) separately as control conditions, and the grasping and each speaking task simultaneously for dual-task conditions. We found that during the dual-task condition, when generating nouns and grasping, participants made significantly more grasping errors (inaccurate grasps) compared to the control and verb dual-task conditions. Moreover, our results revealed a relationship between the number of verbs generated and grasping performance. Participants who generated more verbs were faster and more accurate during the motor component of the dual-task condition. This relationship was not observed when nouns were produced, indicating a unique relationship between verb production and functional grasping. The result is a facilitation effect, diminishing the negative outcome on motor control associated with increased cognitive load (as observed during noun pronunciation).

Connecting directional limb movements to vowel fronting and backing

It has been shown recently that when participants are required to pronounce a vowel at the same time with the hand movement, the vocal and manual responses are facilitated when a front vowel is produced with forward-directed hand movements and a back vowel is produced with backward-directed hand movements. This finding suggests a coupling between spatial programing of articulatory tongue movements and hand movements. The present study revealed that the same effect can be also observed in relation to directional leg movements. The study suggests that the effect operates within the common directional processes of movement planning including at least tongue, hand and leg movements, and these processes might contribute sound-to-meaning mappings to the semantic concepts of 'forward' and 'backward'.

Connection between movements of mouth and hand: Perspectives on development and evolution of speech

Mounting evidence shows interaction between manipulative hand movements and movements of tongue, lips and mouth in a vocal and non-vocal context. The current article reviews this evidence and discusses its contribution to perspectives of development and evolution of speech. In particular, the article aims to present novel insight on how processes controlling the two primary grasp components of manipulative hand movements, the precision and power grip, might be systematically connected to motor processes involved in producing certain articulatory gestures. This view assumes that due to these motor overlaps between grasping and articulation, development of these grip types in infancy can facilitate development of specific articulatory gestures. In addition, the hand-mouth connections might have even boosted the evolution of some articulatory gestures. This account also proposes that some semantic sound-symbolic pairings between a speech sound and a referent concept might be partially based on these hand-mouth interactions.

Hear speech, change your reach: changes in the left-hand grasp-to-eat action during speech processing

Research has shown that the kinematic characteristics of right-hand movements change when executed during both speech production and processing. Despite the variety of prehension and manual actions used to examine this relationship, the literature has yet to examine potential movement effects using an action with a distinct kinematic signature: the hand-to-mouth (grasp-to-eat) action. In this study, participants performed grasp-to-eat and grasp-to-place actions in (a) a quiet environment and (b) while processing speech. Results during the quiet condition replicated the previous findings; consistently smaller grasp-to-eat (compared to grasp-to-place), maximum grip apertures appeared only when using the right hand. Interestingly, in the listen condition, smaller maximum grip apertures in the grasp-to-eat movement appeared in both the right and left hands, despite the fact that participants were right-handed. This paper addresses these results in relation with similar behaviour observed in children, and discusses implications for functional lateralization and neural organization.

Reaching and grasping with the tongue: Shared motor planning between hand actions and articulatory gestures

Research has shown connections between articulatory mouth actions and manual actions. This study investigates whether forward-backward hand movements could be associated with vowel production processes that programme tongue fronting/backing, lip rounding/spreading (Experiment 1), and/or consonant production processes that programme tongue tip and tongue dorsum actions (Experiment 2). The participants had to perform either forward or backward hand movement and simultaneously pronounce different vowels or consonants. The results revealed a response benefit, measured in vocal and manual reaction times, when the responses consisted of front vowels and forward hand movements. Conversely, back vowels were associated with backward hand movements. Articulation of rounded versus unrounded vowels or coronal versus dorsal consonants did not produce the effect. In contrast, when the manual responses of forward-backward hand movements were replaced by precision and power grip responses, the coronal consonants [t] and [r] were associated with the precision grip, whereas the dorsal consonant [k] was associated with the power grip. We propose that the movements of the tongue body, operating mainly for vowel production, share the directional action planning processes with the hand movements. Conversely, the tongue articulators related to tongue tip and dorsum movements, operating mainly for consonant production, share the action planning processes with the precision and power grip, respectively.

Inter-limb coupling of proximal and distal hand actions

Past studies have revealed connections in directional programming between hands. The present study investigated whether there could also be interaction in programming proximal and distal components of a prehensile hand action. In Experiment 1, the participants performed simultaneously either a push or pull response with the left hand and the grip closure or opening with the right hand. In Experiment 2, the push and pull responses of the left hand were performed together with the precision or power grip responses of the right hand. The participants showed preference, measured in reaction times, to couple the push response with the grip opening and the precision grip, whereas the pull response was associated with the grip closure and the power grip. The study shows for the first time a systematic interaction in proximal and distal prehensile components between two hands. We propose that these effects reflect inter- and intra-limb connections between the representations that prepare the arm extension for the outward reaching, the finger extension for the grip opening, and the motor processes that prepare the precision grip. Conversely, there appear to be connections between the representations that prepare the arm flexion for the inward directed hand movements, the flexion of the thumb and the fingers for the grip closure, and flexion of four fingers for the power grip.

Connections of Grasping and Horizontal Hand Movements with Articulation in Czech Speakers

We have recently shown in Finnish speakers that articulation of certain vowels and consonants has a systematic influence on simultaneous grasp actions as well as on forward and backward hand movements. Here we studied whether these effects generalize to another language, namely Czech. We reasoned that if the results generalized to another language environment, it would suggest that the effects arise through other processes than language-dependent semantic associations. Rather, the effects would be likely to arise through language-independent interactions between processes that plan articulatory gestures and hand movements. Participants were presented with visual stimuli specifying articulations to be uttered (e.g., A or I), and they were required to produce a manual response concurrently with the articulation. In Experiment 1 they responded with a precision or a power grip, whereas in Experiment 2 they responded with a forward or a backward hand movement. The grip congruency effect was fully replicated: the consonant [k] and the vowel [α] were associated with power grip responses, while the consonant [t] and the vowel [i] were associated with precision grip responses. The forward/backward congruency effect was replicated with vowels [α], [o], which were associated with backward movement and with [i], which was associated with forward movement, but not with consonants [k] and [t]. These findings suggest that the congruency effects mostly reflect interaction between processes that plan articulatory gestures and hand movements with an exception that the forward/backward congruency effect might only work with vowel articulation.