Neural activation for conceptual identification of correct versus incorrect tool–object pairs

Shaping the physical world to our ends through the left PF technical-cognition area

Our propensity to materiality, which consists in using, making, creating, and passing on technologies, has enabled us to shape the physical world according to our ends. To explain this proclivity, scientists have calibrated their lens to either low-level skills such as motor cognition or high-level skills such as language or social cognition. Yet, little has been said about the intermediate-level cognitive processes that are directly involved in mastering this materiality, that is, technical cognition. We aim to focus on this intermediate level for providing new insights into the neurocognitive bases of human materiality. Here, we show that a technical-reasoning process might be specifically at work in physical problem-solving situations. We found via two distinct neuroimaging studies that the area PF (parietal F) within the left parietal lobe is central for this reasoning process in both tool-use and non-tool-use physical problem-solving and can work along with social-cognitive skills to resolve day-to-day interactions that combine social and physical constraints. Our results demonstrate the existence of a specific cognitive module in the human brain dedicated to materiality, which might be the supporting pillar allowing the accumulation of technical knowledge over generations. Intensifying research on technical cognition could nurture a comprehensive framework that has been missing in fields interested in how early and modern humans have been interacting with the physical world through technology, and how this interaction has shaped our history and culture.

The Role of Attention and Saccades on Parietofrontal Encoding of Contextual and Grasp-specific Affordances of Tools: An ERP Study

The ability to recognize a tool's affordances (how a spoon should be appropriately grasped and used), is vital for daily life. Prior research has identified parietofrontal circuits, including mirror neurons, to be critical in understanding affordances. However, parietofrontal action-encoding regions receive extensive visual input and are adjacent to parietofrontal attention control networks. It is unclear how eye movements and attention modulate parietofrontal encoding of affordances. To address this issue, scenes depicting tools in different use-contexts and grasp-postures were presented to healthy subjects across two experiments, with stimuli durations of 100 ms or 500 ms. The 100-ms experiment automatically restricted saccades and required covert attention, while the 500-ms experiment allowed overt attention. The two experiments elicited similar behavioral decisions on tool-use correctness and isolated the influence of attention on parietofrontal activity. Parietofrontal ERPs (P600) distinguishing tool-use contexts (e.g., spoon-yogurt vs. spoon-ball) were similar in both experiments. Conversely, parietofrontal ERPs distinguishing tool-grasps were characterized by posterior to frontal N130-N200 ERPs in the 100-ms experiment and by saccade-perturbed N130-N200 ERPs, frontal N400 and parietal P500 in the 500-ms experiment. Particularly, only overt gaze toward the hand-tool interaction engaged mirror neurons (frontal N400) when discerning grasps that manipulate but not functionally use a tool - (grasp bowl rather than stem of spoon). Results here detail the first human electrophysiological evidence on how attention selectively modulates multiple parietofrontal grasp-perception circuits, especially the mirror neuron system, while unaffecting parietofrontal encoding of tool-use contexts. These results are pertinent to neurophysiological models of affordances that typically neglect the role of attention in action perception.

Tool selection and the ventral-dorsal organization of tool-related knowledge

Tool selection is a cognitive process necessary for tool use, and may rely on distinct knowledge under different conditions. This fMRI experiment was designed to identify neural substrates mediating tool selection under different conditions. Participants performed a picture‐matching task that presented a recipient object and an action‐goal, and required the selection of the best tool object from among four candidates. Some trials allowed selection of the prototypical tool, whereas others forced selection of either a functionally substitutable or impossible tool. Statistical contrasts revealed significantly different activation between Proto and Sub conditions in frontal, parietal, and temporal lobes. The middle temporal gyrus (MTG) bilaterally, and the right posterior cingulate were more strongly activated by prototypical tool selection, and left inferior parietal lobule (IPL), intraparietal sulcus (IPS), middle frontal gyrus, and precuneus were more strongly activated when selecting substitutable objects. These findings are concordant with previous neuroimaging studies of tool use knowledge in demonstrating that activation of the MTG represents functional knowledge for conventional tool usage, and activation of the IPL/IPS supports action (i.e., praxic) knowledge representations. These results contribute to the literature that dissociates the roles of ventral and dorsal streams in tool‐related knowledge and behavior, and emphasize the role of the left hemisphere for processing goal‐directed object interactions.

Automatic Recruitment of the Motor System by Undetected Graspable Objects: A Motor-evoked Potential Study

Previous behavioral and neuroimaging studies have suggested that the motor properties associated with graspable objects may be automatically accessed when people passively view these objects. We directly tested this by measuring the excitability of the motor pathway when participants viewed pictures of graspable objects that were presented during the attentional blink (AB), when items frequently go undetected. Participants had to identify two briefly presented objects separated by either a short or long SOA. Motor-evoked potentials were measured from the right hand in response to a single TMS pulse delivered over the left primary motor cortex 250 msec after the onset of the second target. Behavioral results showed poorer identification of objects at short SOA compared with long SOA, consistent with an AB, which did not differ between graspable and nongraspable objects. However, motor-evoked potentials measured during the AB were significantly higher for graspable objects than for nongraspable objects, irrespective of whether the object was successfully identified or undetected. This provides direct evidence that the motor system is automatically activated during visual processing of objects that afford a motor action.

Chained Activation of the Motor System during Language Understanding

Two experiments were carried out to investigate whether and how one important characteristic of the motor system, that is its goal-directed organization in motor chains, is reflected in language processing. This possibility stems from the embodied theory of language, according to which the linguistic system re-uses the structures of the motor system. The participants were presented with nouns of common tools preceded by a pair of verbs expressing grasping or observational motor chains (i.e., grasp-to-move, grasp-to-use, look-at-to-grasp, and look-at-to-stare). They decided whether the tool mentioned in the sentence was the same as that displayed in a picture presented shortly after. A primacy of the grasp-to-use motor chain over the other motor chains in priming the participants' performance was observed in both the experiments. More interestingly, we found that the motor information evoked by the noun was modulated by the specific motor-chain expressed by the preceding verbs. Specifically, with the grasping chain aimed at using the tool, the functional motor information prevailed over the volumetric information, and vice versa with the grasping chain aimed at moving the tool (Experiment 2). Instead, the functional and volumetric information were balanced for those motor chains that comprise at least an observational act (Experiment 1). Overall our results are in keeping with the embodied theory of language and suggest that understanding sentences expressing an action directed toward a tool drives a chained activation of the motor system.

The involvement of the dorsal stream in processing implied actions between paired objects: A TMS study

Perceiving and selecting the action possibilities (affordances) provided by objects is an important challenge to human vision, and is not limited to single-object scenarios. Xu et al. (2015) identified two effects of implied actions between paired objects on response selection: an inhibitory effect on responses aligned with the passive object in the pair (e.g. a bowl) and an advantage associated with responses aligned with the active objects (e.g. a spoon). The present study investigated the neurocognitive mechanisms behind these effects by examining the involvement of the ventral (vision for perception) and the dorsal (vision for action) visual streams, as defined in Goodale and Milner's (1992) two visual stream theory. Online repetitive transcranial magnetic stimulation (rTMS) applied to the left anterior intraparietal sulcus (aIPS) reduced both the inhibitory effect of implied actions on responses aligned with the passive objects and the advantage of those aligned with the active objects, but only when the active objects were contralateral to the stimulation. rTMS to the left lateral occipital areas (LO) did not significantly alter the influence of implied actions. The results reveal that the dorsal visual stream is crucial not only in single-object affordance processing, but also in responding to implied actions between objects.

Diet-Induced Weight Loss Alters Functional Brain Responses during an Episodic Memory Task

OBJECTIVE

It has been suggested that overweight is negatively associated with cognitive functions. The aim of this study was to investigate whether a reduction in body weight by dietary interventions could improve episodic memory performance and alter associated functional brain responses in overweight and obese women.

METHODS

20 overweight postmenopausal women were randomized to either a modified paleolithic diet or a standard diet adhering to the Nordic Nutrition Recommendations for 6 months. We used functional magnetic resonance imaging to examine brain function during an episodic memory task as well as anthropometric and biochemical data before and after the interventions.

RESULTS

Episodic memory performance improved significantly (p = 0.010) after the dietary interventions. Concomitantly, brain activity increased in the anterior part of the right hippocampus during memory encoding, without differences between diets. This was associated with decreased levels of plasma free fatty acids (FFA). Brain activity increased in pre-frontal cortex and superior/middle temporal gyri. The magnitude of increase correlated with waist circumference reduction. During episodic retrieval, brain activity decreased in inferior and middle frontal gyri, and increased in middle/superior temporal gyri.

CONCLUSIONS

Diet-induced weight loss, associated with decreased levels of plasma FFA, improves episodic memory linked to increased hippocampal activity.

I give you a cup, I get a cup: a kinematic study on social intention

While affordances have been intensively studied, the mechanisms according to how their activation is modulated by context are poorly understood. We investigated how the Agent׳s reach-to-grasp movement towards a target-object (e.g. a can) is influenced by the other׳s interaction with a second object (manipulative/functional) and by his/her eye-gaze communication. To manipulate physical context we showed participants two objects that could be linked by a spatial relation (e.g. can-knife, typically found in the same context), or by different functional relations. The functional relations could imply an action to perform with another person (functional-cooperative: e.g. can-glass), or on our own (functional-individual: e.g. can-straw). When objects were not related (e.g. can-toothbrush) participants had to refrain from responding. In order to respond, in the giving condition participants had to move the target object towards the other person, in the getting condition towards their own body. When participants (Agents) performed a reach-to-grasp movement to give the target object, in presence of eye-gaze communication they reached the wrist׳s acceleration peak faster if the Other previously interacted with the second object in accordance with its conventional use. Consistently participants reached faster the MFA when the objects were related by a functional-individual than a functional-cooperative relation. The Agent׳s getting response strongly affected the grasping component of the movement: in case of eye-gaze sharing, MFA was greater when the other previously performed a manipulative than a functional grip. Results reveal that humans have developed a sophisticated capability in detecting information from hand posture and eye-gaze, which are informative as to the Agent׳s intention.

Differential mechanisms of action understanding in left and right handed subjects: the role of perspective and handedness

The ability to comprehend outcomes of skilled action is important for understanding the world around us. Prior studies have evaluated the perspective an action is performed in, but few have evaluated how handedness of the actor and the observer interact with action perspective. Understanding handedness affords the opportunity to identify the role of mirroring and matched limb action encoding, which may display unique strategies of action understanding. Right and left-handed subjects were presented with images of tools from egocentric or allocentric perspectives performing movements by either a left or right hand. Subjects had to judge the outcome of the task, and accuracy and latency were evaluated. Our hypothesis was that both left and right-handed subjects would predict action best from an egocentric perspective. In allocentric perspectives, identification of action outcomes would occur best in the mirror-matched dominant limb for all subjects. Results showed there was a significant effect on accuracy and latency with respect to perspective for both right and left-handed subjects. The highest accuracies and fastest latencies were found in the egocentric perspective. Handedness of subject also showed an effect on accuracy, where right-handed subjects were significantly more accurate in the task than left-handed subjects. An interaction effect revealed that left-handed subjects were less accurate at judging images from an allocentric viewpoint compared to all other conditions. These findings suggest that action outcomes are best facilitated in an internal perspective, regardless of the hand being used. The decreased accuracy for left-handed subjects on allocentric images could be due to asymmetrical lateralization of encoding action and motoric dominance, which may interfere with translating allocentric limb action outcomes. Further neurophysiological studies will help us understand the specific processes of how left and right-handed subjects may encode actions.

Decoding abstract and concrete concept representations based on single-trial fMRI data

Previously, multi-voxel pattern analysis has been used to decode words referring to concrete object categories. In this study we investigated if single-trial-based brain activity was sufficient to distinguish abstract (e.g., mercy) versus concrete (e.g., barn) concept representations. Multiple neuroimaging studies have identified differences in the processing of abstract versus concrete concepts based on the averaged activity across time by using univariate methods. In this study we used multi-voxel pattern analysis to decode functional magnetic resonance imaging (fMRI) data when participants perform a semantic similarity judgment task on triplets of either abstract or concrete words with similar meanings. Classifiers were trained to identify individual trials as concrete or abstract. Cross-validated accuracies for classifying trials as abstract or concrete were significantly above chance (P < 0.05) for all participants. Discriminating information was distributed in multiple brain regions. Moreover, accuracy of identifying single trial data for any one participant as abstract or concrete was also reliably above chance (P < 0.05) when the classifier was trained solely on data from other participants. These results suggest abstract and concrete concepts differ in representations in terms of neural activity patterns during a short period of time across the whole brain.