1
|
Repetto C, Mathias B, Weichselbaum O, Macedonia M. Visual recognition of words learned with gestures induces motor resonance in the forearm muscles. Sci Rep 2021; 11:17278. [PMID: 34446772 PMCID: PMC8390650 DOI: 10.1038/s41598-021-96792-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2020] [Accepted: 08/03/2021] [Indexed: 02/07/2023] Open
Abstract
According to theories of Embodied Cognition, memory for words is related to sensorimotor experiences collected during learning. At a neural level, words encoded with self-performed gestures are represented in distributed sensorimotor networks that resonate during word recognition. Here, we ask whether muscles involved in gesture execution also resonate during word recognition. Native German speakers encoded words by reading them (baseline condition) or by reading them in tandem with picture observation, gesture observation, or gesture observation and execution. Surface electromyogram (EMG) activity from both arms was recorded during the word recognition task and responses were detected using eye-tracking. The recognition of words encoded with self-performed gestures coincided with an increase in arm muscle EMG activity compared to the recognition of words learned under other conditions. This finding suggests that sensorimotor networks resonate into the periphery and provides new evidence for a strongly embodied view of recognition memory.
Collapse
Affiliation(s)
- Claudia Repetto
- Department of Psychology, Università Cattolica del Sacro Cuore, Milan, Italy.
| | - Brian Mathias
- Chair of Cognitive and Clinical Neuroscience, Faculty of Psychology, Technical University Dresden, Dresden, Germany
- Research Group Neural Mechanisms of Human Communication, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Otto Weichselbaum
- Department of Information Engineering, Johannes Kepler University, Linz, Austria
| | - Manuela Macedonia
- Department of Information Engineering, Johannes Kepler University, Linz, Austria
- Research Group Ilse Meitner Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
- Linz Center of Mechatronics, Johannes Kepler University, Linz, Austria
| |
Collapse
|
2
|
Wang L, Li Q, Wu Q, Takahashi S, Wu J. The categorical relational process mechanism in enactment learning: effects of divided attention and categorical cues. JOURNAL OF COGNITIVE PSYCHOLOGY 2021. [DOI: 10.1080/20445911.2021.1883032] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
Affiliation(s)
- Lijuan Wang
- School of Psychology, Northeast Normal University, Changchun, People’s Republic of China
| | - Qingqing Li
- Cognitive Neuroscience Laboratory, Graduate School of Natural Science and Technology, Okayama University, Okayama, Japan
| | - Qiong Wu
- Department of Psychology, Suzhou University of Science and Technology, Suzhou, People’s Republic of China
| | - Satoshi Takahashi
- Cognitive Neuroscience Laboratory, Graduate School of Interdisciplinary Science and Engineering in Health Systems, Okayama University, Okayama, Japan
| | - Jinglong Wu
- Cognitive Neuroscience Laboratory, Graduate School of Interdisciplinary Science and Engineering in Health Systems, Okayama University, Okayama, Japan
| |
Collapse
|
3
|
Yang J, Wang L. Could actions improve retrieval performance in 4-to 6-year-old children? EUROPEAN JOURNAL OF DEVELOPMENTAL PSYCHOLOGY 2020. [DOI: 10.1080/17405629.2020.1794808] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
Affiliation(s)
- Jing Yang
- Psychology Department, School of Philosophy and Society, Jilin University, Changchun, China
- Psychology Department, School of Educational Science, Xingyi Normal University for Nationalities, Xingyi, China
| | - Lijuan Wang
- Psychology Department, School of Philosophy and Society, Jilin University, Changchun, China
- Psychology Department, School of Educational Science, Xingyi Normal University for Nationalities, Xingyi, China
| |
Collapse
|
4
|
Too late to be grounded? Motor resonance for action words acquired after middle childhood. Brain Cogn 2019; 138:105509. [PMID: 31855702 DOI: 10.1016/j.bandc.2019.105509] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2019] [Revised: 11/23/2019] [Accepted: 12/04/2019] [Indexed: 11/22/2022]
Abstract
Though well established for languages acquired in infancy, the role of embodied mechanisms remains poorly understood for languages learned in middle childhood and adulthood. To bridge this gap, we examined 34 experiments that assessed sensorimotor resonance during processing of action-related words in real and artificial languages acquired since age 7 and into adulthood. Evidence from late bilinguals indicates that foreign-language action words modulate neural activity in motor circuits and predictably facilitate or delay physical movements (even in an effector-specific fashion), with outcomes that prove partly sensitive to language proficiency. Also, data from newly learned vocabularies suggest that embodied effects emerge after brief periods of adult language exposure, remain stable through time, and hinge on the performance of bodily movements (and, seemingly, on action observation, too). In sum, our work shows that infant language exposure is not indispensable for the recruitment of embodied mechanisms during language processing, a finding that carries non-trivial theoretical, pedagogical, and clinical implications for neurolinguistics, in general, and bilingualism research, in particular.
Collapse
|
5
|
Yu Z, Wang L. Do Physical Properties Affect Enactment Effect? The Regulatory Function of Item Familiarity. AMERICAN JOURNAL OF PSYCHOLOGY 2017. [DOI: 10.5406/amerjpsyc.130.3.0315] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Abstract
Our aim was to examine the regulatory function that item familiarity has for the impact of physical properties on the enactment effect. We also evaluated the relation between motor and imagery encoding. In 2 experiments controlling for the familiarity of nouns in action phrases, free recall data showed that the presence of physical properties improved memory performance under verbal task-encoding conditions, regardless of item familiarity. In the subject-performed task-encoding condition, physical properties played a positive role in memorizing familiar items but not in unfamiliar items. These findings revealed the correlation between motor encoding and imagery encoding. The regulatory function of item familiarity was demonstrated, because the presence of physical properties had no impact on the enactment effect of familiar items but determined whether the enactment effect of unfamiliar items was significant. These findings provide empirical support for both the multimodal theory and the motor encoding theory of subject-performed tasks. We summarized the “item character view” to analyze the divergent conclusions about the enactment effect from the perspective of research methods and to promote the standardized development of action memory.
Collapse
|
6
|
Macedonia M, Mueller K. Exploring the Neural Representation of Novel Words Learned through Enactment in a Word Recognition Task. Front Psychol 2016; 7:953. [PMID: 27445918 PMCID: PMC4923151 DOI: 10.3389/fpsyg.2016.00953] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2015] [Accepted: 06/09/2016] [Indexed: 01/03/2023] Open
Abstract
Vocabulary learning in a second language is enhanced if learners enrich the learning experience with self-performed iconic gestures. This learning strategy is called enactment. Here we explore how enacted words are functionally represented in the brain and which brain regions contribute to enhance retention. After an enactment training lasting 4 days, participants performed a word recognition task in the functional Magnetic Resonance Imaging (fMRI) scanner. Data analysis suggests the participation of different and partially intertwined networks that are engaged in higher cognitive processes, i.e., enhanced attention and word recognition. Also, an experience-related network seems to map word representation. Besides core language regions, this latter network includes sensory and motor cortices, the basal ganglia, and the cerebellum. On the basis of its complexity and the involvement of the motor system, this sensorimotor network might explain superior retention for enactment.
Collapse
Affiliation(s)
- Manuela Macedonia
- Information Engineering, Johannes Kepler University LinzLinz, Austria; Neural Mechanisms of Human Communication, Max Planck Institute for Human Cognitive and Brain SciencesLeipzig, Germany
| | - Karsten Mueller
- Nuclear Magnetic Resonance Unit, Max Planck Institute for Human Cognitive and Brain Sciences Leipzig, Germany
| |
Collapse
|
7
|
|
8
|
Brodeur MB, Pelletier M, Lepage M. Memory for everyday actions in schizophrenia. Schizophr Res 2009; 114:71-8. [PMID: 19643579 DOI: 10.1016/j.schres.2009.06.023] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/25/2009] [Revised: 06/23/2009] [Accepted: 06/24/2009] [Indexed: 11/29/2022]
Abstract
In healthy people, enacting actions by manipulating objects improves memory compared to verbal encoding of the description of the same actions. We used this paradigm to test memory for actions in 40 stable schizophrenia participants and 24 healthy volunteers. Three encoding conditions were used and consisted of action sentences that were: 1) self-performed by the participants, 2) performed by an experimenter (observed), or 3) encoded verbally. Memory for those actions was tested in two formats. First a cued-recall task with the object as a retrieval cue was administered. Secondly source recognition was examined by asking the participants to decide in which of the three conditions each action was encoded. On cued-recall, schizophrenia participants largely benefited from self-enacting actions, reaching performance levels comparable to that of the healthy volunteers. On the source recognition test however, they showed a substantial impairment. The present study thus indicates that people with schizophrenia can benefit from the enactment effect. However, the fact that their performance was reduced considerably during source recognition relative to healthy volunteers suggests that the beneficial effect provided by enactment was mostly implicit.
Collapse
Affiliation(s)
- Mathieu B Brodeur
- Douglas Mental Health University Institute, Department of Psychiatry, McGill University, Montreal, Canada
| | | | | |
Collapse
|
9
|
Tsukiura T, Mochizuki-Kawai H, Fujii T. The effect of encoding strategies on medial temporal lobe activations during the recognition of words: an event-related fMRI study. Neuroimage 2005; 25:452-61. [PMID: 15784424 DOI: 10.1016/j.neuroimage.2005.01.003] [Citation(s) in RCA: 18] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2004] [Revised: 12/28/2004] [Accepted: 01/07/2005] [Indexed: 11/17/2022] Open
Abstract
It is known that manipulation of the encoding strategy affects behavioral and activation data during later retrieval. In the present fMRI study, we examined brain activity during the recognition of words encoded using three different strategies formed by the combination of two factors of relational and self-performed processes. The first encoding strategy involved subjects learning words using both relational and self-performed processes (R+S+). In the second, subjects learned words using only a relational process (R+S-). In the third, subjects learned words without using either process (R-S-). During fMRI after encoding, subjects were randomly presented with words encoded previously and with new words (New) and were required to judge whether or not the word presented had been previously encoded. The fMRI experiment was performed with the event-related design. Compared to New, activation of the left medial temporal lobe (MTL) occurred during the recognition of words encoded using R+S+ and R+S-, whereas right MTL activations only occurred with the R+S+ strategy. ROI analysis for the bilateral hippocampus and parahippocampal gyrus showed a linear increase in left MTL activity (hippocampus and parahippocampal gyrus) during the recognition of words encoded with the R-S-, R+S-, to R+S+, whereas right MTL activity (parahippocampal gyrus) was only increased with the R+S+ strategy. The findings suggest that the left and right MTL structures may contribute differentially to the processes involved in the recognition of stimuli and that these differential activities may depend on the encoding strategies formed by the two factors of relational and self-performed processes.
Collapse
Affiliation(s)
- Takashi Tsukiura
- Cognitive and Behavioral Sciences Group, Neuroscience Research Institute, National Institute of Advanced Industrial Science and Technology (AIST), Tsukuba CENTRAL 2, 1-1-1 Umezono, Tsukuba 305-8568, Japan.
| | | | | |
Collapse
|
10
|
von Essen JD, Nilsson LG. Memory effects of motor activation in subject-performed tasks and sign language. Psychon Bull Rev 2003; 10:445-9. [PMID: 12921422 DOI: 10.3758/bf03196504] [Citation(s) in RCA: 17] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Research on memory has consistently shown that when a subject-performed task (SPT) is compared with a traditional verbal task (VT), enactment at the encoding of verbal materials (i.e., SPT) yields better memory performance than does nonenactment (i.e. VT). There is some controversy regarding the extent to which motor activation per se might be causing this effect, and whether or not SPTs may be influenced by memory strategies. The purpose of this study was to contribute toward a solution of these questions. The effect of SPT encoding was compared with the effect of encoding by means of a sign language task (SLT). The SLT condition is claimed to be a verbal/linguistic task with a major relevant motor component. The motor activation in SLT is in the present study seen to be the main difference between the SLT and the VT, and the main similarity between the SLT and the SPT. Control conditions were tested in order to evaluate possible effects of translation and imagery in the SLT condition. Subjects in the SLT condition performed similarly to subjects in the SPT condition in free recall. Subjects in both these conditions outperformed subjects in the control conditions. The SPT and SLT superiority is suggested to be caused mainly by relevant motor activation.
Collapse
Affiliation(s)
- Jan D von Essen
- Department of Psychology, Stockholm University, Stockholm, Sweden.
| | | |
Collapse
|
11
|
Mulligan NW, Hornstein SL. Memory for actions: self-performed tasks and the reenactment effect. Mem Cognit 2003; 31:412-21. [PMID: 12795483 DOI: 10.3758/bf03194399] [Citation(s) in RCA: 56] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Encoding action phrases by enactment (self-performed tasks, or SPTs) leads to better memory than does observing actions (experimenter-performed tasks, or EPTs) or hearing action phrases (Engelkamp, 1998). In addition, recognition memory for SPTs is enhanced when test items are reenacted. Experiment 1 demonstrated a reenactment effect for EPTs, as well as for SPTs, indicating that the effect can be based on visual, as well as motoric, feedback. However, the reenactment effect in SPTs was found even when the participants were blindfolded at test (Experiment 2), indicating that the basis for the reenactment effect differs across SPTs and EPTs. Experiments 3 and 4 provided additional evidence that visual feedback is not critical for reenactment recognition in the case of SPTs. In addition, these experiments failed to show a hand congruency effect (enhanced recognition when the same hand enacts at study and at test), indicating that this effect is not as generalizable as the reenactment effect. These results have important implications for the motor-encoding hypothesis of the enactment effect.
Collapse
Affiliation(s)
- Neil W Mulligan
- Department of Psychology, University of North Carolina, Chapel Hill, North Carolina 27599-3270, USA.
| | | |
Collapse
|
12
|
Patel H, Blades M, Andrade J. Children’s incidental learning of the colors of objects and clothing. COGNITIVE DEVELOPMENT 2001. [DOI: 10.1016/s0885-2014(02)00072-2] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
13
|
Kormi-Nouri R, Nilsson LG. The role of integration in recognition failure and action memory. Mem Cognit 1998; 26:681-91. [PMID: 9701961 DOI: 10.3758/bf03211389] [Citation(s) in RCA: 33] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
In three experiments, we studied memory for action events with respect to exceptions from the Tulving-Wiseman function demonstrated in experiments on recognition failure of recallable words. In Experiment 1, we examined exceptions of poor integration in a regular recognition failure condition (i.e., recognition of targets without contextual cues, followed by recall of targets in the presence of contextual cues). In Experiment 2, we examined exceptions of cue overlap in which subjects also had access to the information of contextual cues at recognition test. In Experiment 3, we attempted to equate the levels of recognition across the action and verbal encoding. In addition, the cue overlap and no-cue overlap conditions were studied in a within-subjects design. Results from the three experiments indicated that encoding enactment (episodic integration) and conceptual integration (semantic integration) are related to each other. As a consequence of this relationship, there is a larger independence between recognition and recall of well-integrated items with encoding enactment. On the other hand, for the poorly integrated items without encoding enactment, there is a larger dependence between recognition and recall. Even in the cue overlap condition, where there is a case of large dependence between recognition and recall, the same pattern of data was observed. The results are discussed in terms of an episodic integration view of encoding enactment.
Collapse
Affiliation(s)
- R Kormi-Nouri
- Department of Psychology, Stockholm University, Sweden.
| | | |
Collapse
|
14
|
Kormi-nouri R. The nature of memory for action events: An episodic integration view. ACTA ACUST UNITED AC 1995. [DOI: 10.1080/09541449508403103] [Citation(s) in RCA: 64] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
|
15
|
The dual-conception view reexamined: attentional demands and the encoding of verbal and physical information in action events. PSYCHOLOGICAL RESEARCH 1994. [DOI: 10.1007/bf00452994] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|