The Semantics of Natural Objects and Tools in the Brain: A Combined Behavioral and MEG Study

Graspability in disguise: The cognitive and neural differences in processing words representing small and big objects

Size is a fundamental visual-spatial characteristic of the physical world. Previous studies have revealed distinct brain responses to small and big objects represented by pictures, implying that object size is a key dimension in organizing concrete concepts. However, it remains unknown whether the brain responses reflecting size-based categorization extend to symbolic input like words. Furthermore, several behavioral studies have indicated faster lexical decisions for words representing big objects (big words) than those representing small objects (small words). However, how this behavioral finding relates to potential neural differences in processing small and big words, as well as the underlying cognitive processes, remains unclear. Therefore, the present study investigates the cognitive and neural differences in processing small and big words. We compared the behavioral and neural responses (EEG) to small and big words using a lexical decision task (LDT) and a semantic decision task (SDT). Our results showed that in the LDT, reaction times to big words were significantly shorter than those to small words in the by-participant but not by-item analysis, suggesting a potential rather than robust processing advantage for big words. By contrast, no behavioral differences were observed in the SDT. Our EEG decoding results revealed distinct brain responses to small and big words at 190-250 msec in both tasks, with additional distinct neural responses at 390-520 msec only in the SDT. Importantly, the regression representational similarity analysis (RSA) suggested that these distinct brain responses could be explained by object graspability represented by small and big words, rather than object size. These findings illustrate the cognitive and neural differences in processing small and big words, identify graspability as the key influencing dimension, and demonstrate flexible, two-stage processing of semantic concepts. Moreover, we propose a novel hypothesis to explain the potential processing advantage for big words over small words.

Activity in Occipito-Temporal Cortex Is Involved in Tool-Use Planning and Contributes to Tool-Related Semantic Neural Representations

Tool use and language are highly refined human abilities which may show neural commonalities due to their potential reciprocal interaction during evolution. Recent work provided evidence for shared neural resources between tool use and syntax. However, whether activity within the tool-use network also contributes to semantic neural representations of tool nouns remains untested. To this aim, we identified the tool-use planning network with functional magnetic resonance imaging while participants used pliers. The very same participants underwent a semantic priming task including two categories, tool nouns and animal nouns, to highlight the respective underlying networks. With multivariate analyses of the activation neural patterns, we tested whether activity in tool-use brain clusters takes part in the neural representation of tool nouns as compared with animal nouns. The results revealed that word semantic categories were decoded within the left occipito-temporal cortex activated by preparing to use a tool, with similar patterns of brain activity for words within the same category. In addition, in the same area, neural activations for tool nouns were found to be higher than those for animal nouns. These findings suggest that activity in tool-use related brain areas encodes semantic information separately for tool nouns and animal nouns, thus supporting the embodiment of tool-noun processing in the tool-use sensorimotor network.

Syntax matters in shaping sensorimotor activation driven by nouns

Existing evidence has shown that adjectives modulate the grasp-compatibility effect elicited by object nouns. The aim of the present study was to investigate the role of syntax on the sensorimotor activation elicited by nouns in a grasp-compatibility task. We assessed two languages with different syntactic rules, Italian in Experiment 1 and English in Experiment 2. In both experiments, an adjective-noun pair was shown on the screen. The adjective was always in a pre-nominal position and denoted either a disadvantageous quality of the object graspability (e.g., sharp) or the object colour (e.g., reddish). Participants had to categorize the object nouns as natural or artifact, performing a precision or a power reach-to-grasp movement. On different trials, the grasp response was compatible or incompatible with the grip typically used to manipulate the object indicated by the noun. In Experiment 1 (Italian language) the adjective-noun order violated the syntactic order and no difference emerged between reaction times on compatible and incompatible trials (no grasp compatibility effect). In Experiment 2 (English language), the adjective-noun order followed the syntactic rule. Results showed a grasp-compatibility effect when a colour adjective was presented before a natural object noun. When a disadvantageous adjective preceded an artifact or a natural object noun, an inverted grasp-compatibility effect emerged with slower responses on compatible than incompatible trials. Taken together, these findings suggest that adjectives can shape the sensorimotor activation elicited by nouns of graspable objects only when the syntax is correct. Results are discussed with respect to embodied cognition theories.

Grasping the semantic of actions: a combined behavioral and MEG study

There is experimental evidence that the brain systems involved in action execution also play a role in action observation and understanding. Recently, it has been suggested that the sensorimotor system is also involved in language processing. Supporting results are slower response times and weaker motor-related MEG Beta band power suppression in semantic decision tasks on single action verbs labels when the stimulus and the motor response involve the same effector. Attenuated power suppression indicates decreased cortical excitability and consequent decreased readiness to act. The embodied approach forwards that the simultaneous involvement of the sensorimotor system in the processing of the linguistic content and in the planning of the response determines this language-motor interference effect. Here, in a combined behavioral and MEG study we investigated to what extent the processing of actions visually presented (i.e., pictures of actions) and verbally described (i.e., verbs in written words) share common neural mechanisms. The findings demonstrated that, whether an action is experienced visually or verbally, its processing engages the sensorimotor system in a comparable way. These results provide further support to the embodied view of semantic processing, suggesting that this process is independent from the modality of presentation of the stimulus, including language.

Hand constraint reduces brain activity and affects the speed of verbal responses on semantic tasks

According to the theory of embodied cognition, semantic processing is closely coupled with body movements. For example, constraining hand movements inhibits memory for objects that can be manipulated with the hands. However, it has not been confirmed whether body constraint reduces brain activity related to semantics. We measured the effect of hand constraint on semantic processing in the parietal lobe using functional near-infrared spectroscopy. A pair of words representing the names of hand-manipulable (e.g., cup or pencil) or nonmanipulable (e.g., windmill or fountain) objects were presented, and participants were asked to identify which object was larger. The reaction time (RT) in the judgment task and the activation of the left intraparietal sulcus (LIPS) and left inferior parietal lobule (LIPL), including the supramarginal gyrus and angular gyrus, were analyzed. We found that constraint of hand movement suppressed brain activity in the LIPS toward hand-manipulable objects and affected RT in the size judgment task. These results indicate that body constraint reduces the activity of brain regions involved in semantics. Hand constraint might inhibit motor simulation, which, in turn, would inhibit body-related semantic processing.