1
|
Shaikh UJ, Binkofski F, Pellicano A. Location Coding of Tool-Object Pairs Based on Perceptual Grouping: Evidence from Object-Based Correspondence Effect. J Cogn 2025; 8:24. [PMID: 40027257 PMCID: PMC11869823 DOI: 10.5334/joc.435] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2024] [Accepted: 02/14/2025] [Indexed: 03/05/2025] Open
Abstract
Motor interactions with single, as well as pairs of objects can be automatically affected by visual asymmetries provided by protruding parts, whether the handle or not. Faster and more accurate performance is typically produced when task-defined responses correspond to the location of such protruding parts, relative to when they do not correspond (i.e., object-based spatial correspondence effects). In two experiments we investigated the mechanisms that underlie the spatial coding of tool-object pairs when semantic and action alignment relationships were orthogonally combined. Centrally presented pictures of "active" tools (depicted as potentially performing their proper action) were paired, on one side, to a "passive" object (target of the tool action). We observed S-R correspondence effects that depended on the location of the protruding side of tool-object pairs, and not on the non-protruding side of the tool handle. Thus, results further supported the location coding account of the effect, against the affordance activation one. The effect was only produced when tool-object pairs belonged to the same semantic category or were correctly aligned for action, but with no further interplay. This was not consistent with the idea that action links were coded between tool-object pairs, and that the resulting action direction interacted with response spatial codes. Alternatively, we claimed that semantic relation and action alignment acted, independent from each other, as perceptual grouping criteria; allowing for the basic spatial coding of visual asymmetries to take place. This brought to speculation, at neurocognitive level, about independent processing along the ventral and ventro-dorsal streams.
Collapse
Affiliation(s)
- Usman Jawed Shaikh
- Division for Clinical Cognitive Sciences, Department of Neurology, Faculty of Medicine, RWTH Aachen University, Aachen, Germany
| | - Ferdinand Binkofski
- Division for Clinical Cognitive Sciences, Department of Neurology, Faculty of Medicine, RWTH Aachen University, Aachen, Germany
- Juelich Aachen Research Alliance (JARA)—BRAIN, Juelich, Germany
- Research Centre Juelich, Institute of Neuroscience and Medicine (INM-4), Juelich, Germany
| | | |
Collapse
|
2
|
Pezet E, Boussard L, Morgado N, Heurley LP. The spatial coding of responses can depend on the spatial features of action goals. PSYCHOLOGICAL RESEARCH 2025; 89:54. [PMID: 39960527 DOI: 10.1007/s00426-025-02081-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2024] [Accepted: 01/26/2025] [Indexed: 04/30/2025]
Abstract
In this work, we aimed to explore whether the spatial coding of responses is influenced by the spatial features of the action goal and whether this coding extends beyond the spatial features of the response keys to include the spatial features of the tools used. Therefore, we employed a size-based Simon effect in which participants were presented with either a large or small object, appearing in blue or orange, during each trial. Depending on the color, participants had to press a switch using a stick with either a large or small component. This component was located at either the end of the stick (Experiment 1) or in the middle (Experiment 2). In Experiment 3, the size difference between the stick components was larger than in Experiment 1. Importantly, the size of both possible keys was strictly similar. Our findings revealed a consistent pattern across all three experiments. Participants exhibited shorter response times when the size of the stimulus matched the size of the stick component compared to when it did not. These findings suggest that participants code their responses based on the spatial features of the action goal (i.e., size) and that this coding extends beyond the response keys to include features of the tools used. These results contribute to our understanding of action representation and provide insights into the neurocognitive processes associated with tool use.
Collapse
Affiliation(s)
- Elsa Pezet
- Laboratoire sur les Interactions Cognition, Action, Émotion (LICAE), Université Paris Nanterre, 200 avenue de La République, Nanterre Cedex, 92001, France.
| | - Lucas Boussard
- Laboratoire sur les Interactions Cognition, Action, Émotion (LICAE), Université Paris Nanterre, 200 avenue de La République, Nanterre Cedex, 92001, France
| | - Nicolas Morgado
- Laboratoire sur les Interactions Cognition, Action, Émotion (LICAE), Université Paris Nanterre, 200 avenue de La République, Nanterre Cedex, 92001, France
| | - Loïc P Heurley
- Laboratoire sur les Interactions Cognition, Action, Émotion (LICAE), Université Paris Nanterre, 200 avenue de La République, Nanterre Cedex, 92001, France.
| |
Collapse
|
3
|
Ruan J, Yuan Y, Qiao Y, Qiu M, Dong X, Cui Y, Wang J, Liu N. Connectional differences between humans and macaques in the MT+ complex. iScience 2025; 28:111617. [PMID: 39834863 PMCID: PMC11743884 DOI: 10.1016/j.isci.2024.111617] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2024] [Revised: 10/16/2024] [Accepted: 12/13/2024] [Indexed: 01/22/2025] Open
Abstract
MT+ is pivotal in the dorsal visual stream, encoding tool-use characteristics such as motion speed and direction. Despite its conservation between humans and monkeys, differences in MT+ spatial location and organization may lead to divergent, yet unexplored, connectivity patterns and functional characteristics. Using diffusion tensor imaging, we examined the structural connectivity of MT+ subregions in macaques and humans. We also employed graph-theoretical analyses on the constructed homologous tool-use network to assess their functional roles. Our results revealed location-dependent connectivity in macaques, with MST, MT, and FST predominantly connected to dorsal, middle, and ventral surfaces, respectively. Humans showed similar connectivity across all subregions. Differences in connectivity between MST and FST are more pronounced in macaques. In humans, the entire MT+ region, especially MST, exhibited stronger information transmission capabilities. Our findings suggest that the differences in tool use between humans and macaques may originate earlier than previously thought, particularly within the MT+ region.
Collapse
Affiliation(s)
- Jianxiong Ruan
- School of Life Sciences, Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei, Anhui 230026, China
- State Key Laboratory of Brain and Cognitive Science, Institute of Biophysics, Chinese Academy of Sciences, Beijing 100101, China
| | - Ye Yuan
- State Key Laboratory of Brain and Cognitive Science, Institute of Biophysics, Chinese Academy of Sciences, Beijing 100101, China
- Wolfson Brain Imaging Centre, University of Cambridge, Cambridge, UK
| | - Yicheng Qiao
- State Key Laboratory of Brain and Cognitive Science, Institute of Biophysics, Chinese Academy of Sciences, Beijing 100101, China
- College of Life Sciences, University of Chinese Academy of Sciences, Beijing 101408, China
| | - Minghao Qiu
- National Resource Center for Non-Human Primates and National Research Facility for Phenotypic & Genetic Analysis of Model Animals (Primate Facility), Kunming Institute of Zoology, Chinese Academy of Sciences, Kunming, Yunnan 650223, China
| | - Xueda Dong
- State Key Laboratory of Brain and Cognitive Science, Institute of Biophysics, Chinese Academy of Sciences, Beijing 100101, China
- Sino-Danish College, University of Chinese Academy of Sciences, Beijing 101408, China
- Sino-Danish Centre for Education and Research, University of Chinese Academy of Sciences, Beijing 101408, China
| | - Yue Cui
- Laboratory of Brain Atlas and Brain-inspired Intelligence, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 101408, China
| | - Jianhong Wang
- National Resource Center for Non-Human Primates and National Research Facility for Phenotypic & Genetic Analysis of Model Animals (Primate Facility), Kunming Institute of Zoology, Chinese Academy of Sciences, Kunming, Yunnan 650223, China
| | - Ning Liu
- State Key Laboratory of Brain and Cognitive Science, Institute of Biophysics, Chinese Academy of Sciences, Beijing 100101, China
- College of Life Sciences, University of Chinese Academy of Sciences, Beijing 101408, China
| |
Collapse
|
4
|
van Liempd IH, Oudgenoeg‐Paz O, Leseman PPM. Object exploration is facilitated by the physical and social environment in center-based child care. Child Dev 2025; 96:161-175. [PMID: 39189928 PMCID: PMC11693833 DOI: 10.1111/cdev.14161] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/28/2024]
Abstract
Object exploration is considered a driver of motor, cognitive, and social development. However, little is known about how early childhood education and care settings facilitate object exploration. This study examined if children's exploration of objects during free play was facilitated by the use of particular spatial components (floor, tables, and activity centers) and types of play (solitary, social, and parallel). Participants were 61 children (aged 11 to 48 months and 50.8% boys, socioeconomic levels representative of the Dutch population). Intraindividual variability in children's object exploration was predicted by the use of particular spatial components and the social setting, with small-to-medium effect sizes. Solitary and parallel play were positively associated with complex object exploration, especially when sitting or standing at child-height tables. During social play, object exploration was mostly absent.
Collapse
Affiliation(s)
- Ine H. van Liempd
- Department of Development & Education of Youth in Diverse SocietiesUtrecht UniversityUtrechtThe Netherlands
| | - Ora Oudgenoeg‐Paz
- Department of Development & Education of Youth in Diverse SocietiesUtrecht UniversityUtrechtThe Netherlands
| | - Paul P. M. Leseman
- Department of Development & Education of Youth in Diverse SocietiesUtrecht UniversityUtrechtThe Netherlands
| |
Collapse
|
5
|
Fragaszy DM, Kelty-Stephen DG, Mangalam M. How bipedalism shapes humans' actions with hand tools. Philos Trans R Soc Lond B Biol Sci 2024; 379:20230152. [PMID: 39155723 PMCID: PMC11391300 DOI: 10.1098/rstb.2023.0152] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2023] [Revised: 03/28/2024] [Accepted: 05/09/2024] [Indexed: 08/20/2024] Open
Abstract
The task for an embodied cognitive understanding of humans' actions with tools is to elucidate how the human body, as a whole, supports the perception of affordances and dexterous action with objects in relation to other objects. Here, we focus on the relationship between humans' actions with handheld tools and bipedal posture. Posture plays a pivotal role in shaping animals' perception and action dynamics. While humans stand and locomote bipedally, other primates predominantly employ quadrupedal postures and locomotion, relying on both hands and feet to support the body. Drawing upon evidence from evolutionary biology, developmental psychology and performance studies, we elucidate the influence of bipedalism on our actions with objects and on our proficiency in using tools. We use the metaphor of cascades to capture the dynamic, nonlinear transformations in morphology and behaviour associated with posture and the use of tools across evolutionary and developmental timescales. Recent work illustrates the promise of multifractal cascade analysis to reveal nonlinear, cross-scale interactions across the entire body in real-time, supporting the perception of affordances for actions with tools. Cascade analysis enriches our comprehension of real-time performance and facilitates exploration of the relationships among whole-body coordination, individual development, and evolutionary processes.This article is part of the theme issue 'Minds in movement: embodied cognition in the age of artificial intelligence'.
Collapse
Affiliation(s)
| | - Damian G Kelty-Stephen
- Department of Psychology, State University of New York at New Paltz, New Paltz, NY 12561, USA
| | - Madhur Mangalam
- Division of Biomechanics and Research Development, Department of Biomechanics, Center for Research in Human Movement Variability, University of Nebraska, Omaha, NE 68182, USA
| |
Collapse
|
6
|
Coco M, Di Pasquale F, Pellicano A. Knowledge over Time of Action Codes for Perceived Objects: An Exploratory Study on Developmental Children. Brain Sci 2024; 14:854. [PMID: 39335350 PMCID: PMC11429757 DOI: 10.3390/brainsci14090854] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2024] [Revised: 08/16/2024] [Accepted: 08/21/2024] [Indexed: 09/30/2024] Open
Abstract
Over the past 20 years, there has been a growing interest in the processing of tool objects, and in the spatial S-R correspondence effects obtained with pictures of manipulable objects. Beyond the original affordance activation account, a location coding account has been proposed for such behavioral effects, which states that the location of the visually salient portion of an object speeds up spatially aligned motor responses and slows down misaligned ones. Furthermore, an additional action coding account has been proposed, according to which it is the direction of the action of the perceived object (e.g., "pouring tea leftward" when the spout of a teapot is leftward-oriented) that biases motor performance. We investigated this action coding account of S-R correspondence effects by comparing the reaction time (RT) performance of two groups: younger (6 to 9 years old) and older (10 to 13 years old) children. We assumed that knowledge of tool objects and the activation of action codes from object perception is proportional to age. Therefore, a larger correspondence effect was hypothesized for the older relative to the younger children's group. Consistently, a 34 ms correspondence effect was observed in the older children relative to the younger ones (18 ms). The results support the view that action direction is a constitutive feature of tool objects, which is subject to experience, and thus, to increasing knowledge over time.
Collapse
Affiliation(s)
- Marinella Coco
- Department of Educational Sciences, University of Catania, 95100 Catania, Italy
- B.R.I.T. (Bio-Nanotech Research and Innovation Tower) Service Center, University of Catania, 95100 Catania, Italy
| | | | - Antonello Pellicano
- Department of Educational Sciences, University of Catania, 95100 Catania, Italy
| |
Collapse
|
7
|
Malo R, Prié Y. Reaching conceptual stability by re-articulating empirical and theoretical work on affordances. Front Psychol 2024; 15:1283168. [PMID: 38947904 PMCID: PMC11212831 DOI: 10.3389/fpsyg.2024.1283168] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2023] [Accepted: 04/12/2024] [Indexed: 07/02/2024] Open
Abstract
Theoretical developments on affordances have proliferated, resulting in a lack of conceptual stability and a potential compromise in scientific validity. However, affordances should not be discarded, given their centrality in post-cognitive theories and their widespread reuse across various research domains. Empirical research on affordances remains sparse, out of sync with theoretical advancements, and thus unable to contribute effectively to scientific progress due to its disarticulation with theoretical work. That is why re-articulating theoretical and empirical investigations on affordances is needed to pave a more fruitful path for the concept's advancement. To accomplish this objective, emphasis must be placed on empirical research, leveraging recent theoretical propositions and devising corresponding empirical methodologies. The proposed requirements and framework represent a step in this endeavor.
Collapse
Affiliation(s)
- Roman Malo
- Nantes Université, Laboratoire de psychologie des Pays de la Loire, LPPL, UR 4638, Nantes, France
| | - Yannick Prié
- Nantes Université, École Centrale Nantes, CNRS, LS2N, UMR 6004, Nantes, France
| |
Collapse
|
8
|
Funayama M, Hojo T, Nakagawa Y, Kurose S, Koreki A. Investigating the Link Between Subjective Depth Perception Deficits and Objective Stereoscopic Vision Deficits in Individuals With Acquired Brain Injury. Cogn Behav Neurol 2024; 37:82-95. [PMID: 38682873 DOI: 10.1097/wnn.0000000000000369] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2023] [Accepted: 01/03/2024] [Indexed: 05/01/2024]
Abstract
Individuals with acquired brain injury have reported subjective complaints of depth perception deficits, but few have undergone objective assessments to confirm these deficits. As a result, the literature currently lacks reports detailing the correlation between subjective depth perception deficits and objective stereoscopic vision deficits in individuals with acquired brain injury, particularly those cases that are characterized by a clearly defined lesion. To investigate this relationship, we recruited three individuals with acquired brain injury who experienced depth perception deficits and related difficulties in their daily lives. We had them take neurologic, ophthalmological, and neuropsychological examinations. We also had them take two types of stereoscopic vision tests: a Howard-Dolman-type stereoscopic vision test and the Topcon New Objective Stereo Test. Then, we compared the results with those of two control groups: a group with damage to the right hemisphere of the brain and a group of healthy controls. Performance on the two stereoscopic vision tests was severely impaired in the three patients. One of the patients also presented with cerebral diplopia. We identified the potential neural basis of these deficits in the cuneus and the posterior section of the superior parietal lobule, which play a role in vergence fusion and are located in the caudal region of the dorso-dorsal visual pathway, which is known to be crucial not only for visual spatial perception, but also for reaching, grasping, and making hand postures in the further course of that pathway.
Collapse
Affiliation(s)
- Michitaka Funayama
- Department of Neuropsychiatry, Ashikaga Red Cross Hospital, Ashikaga, Japan
- Department of Rehabilitation, Edogawa Hospital, Tokyo, Japan
- Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
| | - Tomohito Hojo
- Department of Rehabilitation, Edogawa Hospital, Tokyo, Japan
- Department of Rehabilitation, National Rehabilitation Center for Persons with Disabilities, Tokorozawa, Japan
| | | | - Shin Kurose
- Department of Neuropsychiatry, Ashikaga Red Cross Hospital, Ashikaga, Japan
- Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
- Department of Psychiatry, National Hospital Organization Shimofusa Psychiatric Medical Center, Chiba, Japan
| | - Akihiro Koreki
- Department of Neuropsychiatry, Ashikaga Red Cross Hospital, Ashikaga, Japan
- Department of Psychiatry, National Hospital Organization Shimofusa Psychiatric Medical Center, Chiba, Japan
| |
Collapse
|
9
|
Ianì F, Limata T, Ras IN, Bucciarelli M. Forward effects from action observation: the role of attentional focus. PSYCHOLOGICAL RESEARCH 2024; 88:773-785. [PMID: 37884629 DOI: 10.1007/s00426-023-01888-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2023] [Accepted: 10/02/2023] [Indexed: 10/28/2023]
Abstract
After viewing an image representing an action on an object, we recognize the forward states of the seen action faster than the backward states. The present study exploits a variant of a new experimental paradigm to investigate cognitive mechanisms underlying this effect. Participants viewed a series of still photos of unfolding actions on objects, each followed by a photo depicting either one of three (instead of two of the original paradigm) different and temporally distant moments after the image or one moment before the image, along with photos of different actions. Experiment 1 revealed the classical forward effects in this new context: when the task was to judge whether the action in the second photo was the same as in the first photo, evaluations were faster for all forward photos than for backward photos. In Experiment 2, we examined the role of participants' attention to the object alongside the role of attention to action kinematics in triggering these "forward effects" by manipulating participants' attentional focus. As the results showed, evaluations were faster for all forward photos when the focus was on the action kinematics, but when the focus was on the object, evaluations were faster only for the last forward photo showing the final action state. These results seem to suggest that focusing on the object triggers a representation of the action goal and thus modulates the mental simulation underlying action anticipation.
Collapse
Affiliation(s)
- Francesco Ianì
- Dipartimento di Psicologia, Università di Torino, Via Verdi, 10, 10124, Turin, Italy
- Centro di Logica, Linguaggio, e Cognizione, Università di Torino, Turin, Italy
| | - Teresa Limata
- Dipartimento di Psicologia, Università di Torino, Via Verdi, 10, 10124, Turin, Italy.
| | - Ivan Nabil Ras
- Dipartimento di Psicologia, Università di Torino, Via Verdi, 10, 10124, Turin, Italy
| | - Monica Bucciarelli
- Dipartimento di Psicologia, Università di Torino, Via Verdi, 10, 10124, Turin, Italy
- Centro di Logica, Linguaggio, e Cognizione, Università di Torino, Turin, Italy
| |
Collapse
|
10
|
Felippin MR, Azevedo IL, Saunier G, Keniston L, Nogueira-Campos AA. Grasping affordance judgments depend on the object emotional value. Front Hum Neurosci 2024; 18:1331253. [PMID: 38566999 PMCID: PMC10986176 DOI: 10.3389/fnhum.2024.1331253] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2023] [Accepted: 02/28/2024] [Indexed: 04/04/2024] Open
Abstract
Introduction The concept of affordance refers to the opportunities for action provided by the environment, often conveyed through visual information. It has been applied to explain visuomotor processing and movement planning. As emotion modulates both visual perception and the motor system, it is reasonable to ask whether emotion can influence affordance judgments. If present, this relationship can have important ontological implications for affordances. Thus, we investigated whether the emotional value of manipulable objects affected the judgment of the appropriate grasping that could be used to interact with them (i.e., their affordance). Methods Volunteers were instructed to use a numerical scale to report their judgment on how an observed object should be grasped. We compared these judgments across emotional categories of objects (pleasant, unpleasant and neutral), while also considering the expected effect of object size. Results We found that unpleasant objects were rated as more appropriately graspable by a precision grip than pleasant and neutral objects. Simultaneously, smaller object size also favored this judgment. This effect was seen in all emotional categories examined in equal magnitude. Discussion Our findings suggest that the emotional value of objects modulates affordance judgments in a way that favors careful manipulation and minimal physical contact with aversive stimuli. Finally, we discuss how this affective aspect of our experience of objects overlaps with what affordances are conceptualized to be, calling for further reexamination of the relationship between affordances and emotions.
Collapse
Affiliation(s)
- Matheus Ribeiro Felippin
- Laboratory of Cognitive Neurophysiology, Institute of Biological Sciences, Department of Biophysics and Physiology, Federal University of Juiz de Fora (UFJF), Juiz de Fora, Minas Gerais, Brazil
- Post-Graduation Program in Biological Sciences, Carlos Chagas Filho Institute of Biophysics, Federal University of Rio de Janeiro (UFRJ), Rio de Janeiro, Brazil
| | - Ivo Lopes Azevedo
- Laboratory of Cognitive Neurophysiology, Institute of Biological Sciences, Department of Biophysics and Physiology, Federal University of Juiz de Fora (UFJF), Juiz de Fora, Minas Gerais, Brazil
- Post-Graduation Program in Biological Sciences, Carlos Chagas Filho Institute of Biophysics, Federal University of Rio de Janeiro (UFRJ), Rio de Janeiro, Brazil
| | - Ghislain Saunier
- Laboratory of Motor Cognition, Department of Anatomy, Federal University of Pará (UFPA), Belém, Brazil
- Post-Graduation Program in Human Movement Sciences, Federal University of Pará (UFPA), Belém, Brazil
| | - Les Keniston
- Department of Biomedical Sciences, Kentucky College of Osteopathic Medicine, University of Pikeville, Pikeville, KY, United States
| | - Anaelli Aparecida Nogueira-Campos
- Laboratory of Cognitive Neurophysiology, Institute of Biological Sciences, Department of Biophysics and Physiology, Federal University of Juiz de Fora (UFJF), Juiz de Fora, Minas Gerais, Brazil
- Post-Graduation Program in Rehabilitation Sciences and Physical-Functional Performance, Federal University of Juiz de Fora (UFJF), Juiz de Fora, Minas Gerais, Brazil
| |
Collapse
|
11
|
Stöckl C, Yang Y, Maass W. Local prediction-learning in high-dimensional spaces enables neural networks to plan. Nat Commun 2024; 15:2344. [PMID: 38490999 PMCID: PMC10943103 DOI: 10.1038/s41467-024-46586-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2023] [Accepted: 03/01/2024] [Indexed: 03/18/2024] Open
Abstract
Planning and problem solving are cornerstones of higher brain function. But we do not know how the brain does that. We show that learning of a suitable cognitive map of the problem space suffices. Furthermore, this can be reduced to learning to predict the next observation through local synaptic plasticity. Importantly, the resulting cognitive map encodes relations between actions and observations, and its emergent high-dimensional geometry provides a sense of direction for reaching distant goals. This quasi-Euclidean sense of direction provides a simple heuristic for online planning that works almost as well as the best offline planning algorithms from AI. If the problem space is a physical space, this method automatically extracts structural regularities from the sequence of observations that it receives so that it can generalize to unseen parts. This speeds up learning of navigation in 2D mazes and the locomotion with complex actuator systems, such as legged bodies. The cognitive map learner that we propose does not require a teacher, similar to self-attention networks (Transformers). But in contrast to Transformers, it does not require backpropagation of errors or very large datasets for learning. Hence it provides a blue-print for future energy-efficient neuromorphic hardware that acquires advanced cognitive capabilities through autonomous on-chip learning.
Collapse
Affiliation(s)
- Christoph Stöckl
- Institute of Theoretical Computer Science, Graz University of Technology, 8010, Graz, Austria
| | - Yukun Yang
- Institute of Theoretical Computer Science, Graz University of Technology, 8010, Graz, Austria
| | - Wolfgang Maass
- Institute of Theoretical Computer Science, Graz University of Technology, 8010, Graz, Austria.
| |
Collapse
|
12
|
Bosco A, Sanz Diez P, Filippini M, De Vitis M, Fattori P. A focus on the multiple interfaces between action and perception and their neural correlates. Neuropsychologia 2023; 191:108722. [PMID: 37931747 DOI: 10.1016/j.neuropsychologia.2023.108722] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2023] [Revised: 10/13/2023] [Accepted: 10/31/2023] [Indexed: 11/08/2023]
Abstract
Successful behaviour relies on the appropriate interplay between action and perception. The well-established dorsal and ventral stream theories depicted two distinct functional pathways for the processes of action and perception, respectively. In physiological conditions, the two pathways closely cooperate in order to produce successful adaptive behaviour. As the coupling between perception and action exists, this requires an interface that is responsible for a common reading of the two functions. Several studies have proposed different types of perception and action interfaces, suggesting their role in the creation of the shared interaction channel. In the present review, we describe three possible perception and action interfaces: i) the motor code, including common coding approaches, ii) attention, and iii) object affordance; we highlight their potential neural correlates. From this overview, a recurrent neural substrate that underlies all these interface functions appears to be crucial: the parieto-frontal circuit. This network is involved in the mirror mechanism which underlies the perception and action interfaces identified as common coding and motor code theories. The same network is also involved in the spotlight of attention and in the encoding of potential action towards objects; these are manifested in the perception and action interfaces for common attention and object affordance, respectively. Within this framework, most studies were dedicated to the description of the role of the inferior parietal lobule; growing evidence, however, suggests that the superior parietal lobule also plays a crucial role in the interplay between action and perception. The present review proposes a novel model that is inclusive of the superior parietal regions and their relative contribution to the different action and perception interfaces.
Collapse
Affiliation(s)
- A Bosco
- Department of Biomedical and Neuromotor Sciences, University of Bologna, Piazza di Porta San Donato 2, 40126, Bologna, Italy; Alma Mater Research Institute For Human-Centered Artificial Intelligence (Alma Human AI), University of Bologna, Via Galliera 3 Bologna, 40121, Bologna, Italy.
| | - P Sanz Diez
- Carl Zeiss Vision International GmbH, Turnstrasse 27, 73430, Aalen, Germany; Institute for Ophthalmic Research, Eberhard Karls University Tuebingen, Elfriede-Aulhorn-Straße 7, 72076, Tuebingen, Germany
| | - M Filippini
- Department of Biomedical and Neuromotor Sciences, University of Bologna, Piazza di Porta San Donato 2, 40126, Bologna, Italy; Alma Mater Research Institute For Human-Centered Artificial Intelligence (Alma Human AI), University of Bologna, Via Galliera 3 Bologna, 40121, Bologna, Italy
| | - M De Vitis
- Department of Biomedical and Neuromotor Sciences, University of Bologna, Piazza di Porta San Donato 2, 40126, Bologna, Italy
| | - P Fattori
- Department of Biomedical and Neuromotor Sciences, University of Bologna, Piazza di Porta San Donato 2, 40126, Bologna, Italy; Alma Mater Research Institute For Human-Centered Artificial Intelligence (Alma Human AI), University of Bologna, Via Galliera 3 Bologna, 40121, Bologna, Italy
| |
Collapse
|
13
|
Yu W, Ni L, Zhang Z, Zheng W, Liu Y. No need to integrate action information during coarse semantic processing of man-made tools. Psychon Bull Rev 2023; 30:2230-2239. [PMID: 37221279 DOI: 10.3758/s13423-023-02301-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/26/2023] [Indexed: 05/25/2023]
Abstract
Action representation of man-made tools consists of two subtypes: structural action representation concerning how to grasp an object, and functional action representation concerning the skilled use of an object. Compared to structural action representation, functional action representation plays the dominant role in fine-grained (i.e., basic level) object recognition. However, it remains unclear whether the two types of action representation are involved differently in the coarse semantic processing in which the object is recognized at a superordinate level (i.e., living/non-living). Here we conducted three experiments using the priming paradigm, in which video clips displaying structural and functional action hand gestures were used as prime stimuli and grayscale photos of man-made tools were used as target stimuli. Participants recognized the target objects at the basic level in Experiment 1 (i.e., naming task) and at the superordinate level in Experiments 2 and 3 (i.e., categorization task). We observed a significant priming effect for functional action prime-target pairs only in the naming task. In contrast, no priming effect was found in either the naming or the categorization task for the structural action prime-target pairs (Experiment 2), even when the categorization task was preceded by a preliminary action imitation of the prime gestures (Experiment 3). Our results suggest that only functional action information is retrieved during fine-grained object processing. In contrast, coarse semantic processing does not require the integration of either structural or functional action information.
Collapse
Affiliation(s)
- Wenyuan Yu
- State Key Laboratory of Brain and Cognitive Science, Institute of Psychology, Chinese Academy of Sciences, 16 Lincui Road, Chaoyang District, Beijing, 100101, People's Republic of China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, 101408, People's Republic of China
- Research Center for Applied Mathematics and Machine Intelligence, Research Institute of Basic Theories, Zhejiang Lab, Hangzhou, 311121, People's Republic of China
| | - Long Ni
- State Key Laboratory of Brain and Cognitive Science, Institute of Psychology, Chinese Academy of Sciences, 16 Lincui Road, Chaoyang District, Beijing, 100101, People's Republic of China
- Department of Psychology, University of Pennsylvania, Philadelphia, PA, 19106, USA
| | - Zijian Zhang
- State Key Laboratory of Brain and Cognitive Science, Institute of Psychology, Chinese Academy of Sciences, 16 Lincui Road, Chaoyang District, Beijing, 100101, People's Republic of China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, 101408, People's Republic of China
| | - Weiqi Zheng
- School of Psychology, Beijing Sport University, Beijing, 100084, People's Republic of China
| | - Ye Liu
- State Key Laboratory of Brain and Cognitive Science, Institute of Psychology, Chinese Academy of Sciences, 16 Lincui Road, Chaoyang District, Beijing, 100101, People's Republic of China.
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, 101408, People's Republic of China.
| |
Collapse
|
14
|
Federico G, Osiurak F, Ciccarelli G, Ilardi CR, Cavaliere C, Tramontano L, Alfano V, Migliaccio M, Di Cecca A, Salvatore M, Brandimonte MA. On the functional brain networks involved in tool-related action understanding. Commun Biol 2023; 6:1163. [PMID: 37964121 PMCID: PMC10645930 DOI: 10.1038/s42003-023-05518-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2023] [Accepted: 10/27/2023] [Indexed: 11/16/2023] Open
Abstract
Tool-use skills represent a significant cognitive leap in human evolution, playing a crucial role in the emergence of complex technologies. Yet, the neural mechanisms underlying such capabilities are still debated. Here we explore with fMRI the functional brain networks involved in tool-related action understanding. Participants viewed images depicting action-consistent (e.g., nail-hammer) and action-inconsistent (e.g., scarf-hammer) object-tool pairs, under three conditions: semantic (recognizing the tools previously seen in the pairs), mechanical (assessing the usability of the pairs), and control (looking at the pairs without explicit tasks). During the observation of the pairs, task-based left-brain functional connectivity differed within conditions. Compared to the control, both the semantic and mechanical conditions exhibited co-activations in dorsal (precuneus) and ventro-dorsal (inferior frontal gyrus) regions. However, the semantic condition recruited medial and posterior temporal areas, whereas the mechanical condition engaged inferior parietal and posterior temporal regions. Also, when distinguishing action-consistent from action-inconsistent pairs, an extensive frontotemporal neural circuit was activated. These findings support recent accounts that view tool-related action understanding as the combined product of semantic and mechanical knowledge. Furthermore, they emphasize how the left inferior parietal and anterior temporal lobes might be considered as hubs for the cross-modal integration of physical and conceptual knowledge, respectively.
Collapse
Affiliation(s)
| | - François Osiurak
- Laboratoire d'Etude des Mécanismes Cognitifs (EA 3082), Université de Lyon, Bron, France
- Institut Universitaire de France, Paris, France
| | | | | | | | | | | | | | | | | | | |
Collapse
|
15
|
Zavagno D. Illusion as a Cognitive Clash Rooted in Perception. J Intell 2023; 11:215. [PMID: 37998714 PMCID: PMC10672324 DOI: 10.3390/jintelligence11110215] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2023] [Revised: 10/21/2023] [Accepted: 11/07/2023] [Indexed: 11/25/2023] Open
Abstract
Illusions are important 'tools' in the study of perceptual processes. Their conception is typically linked to the notion of veridicality in a dual-world framework, in which we either see the macro physical world as it is (ecological approaches) or we derive a faithful representation (cognitive approaches) of it. Within such theoretical views, illusions are errors caused by inadequate sensory information (because of poor quality, insufficient quantity, contradictory, etc.). From a phenomenological stance, however, experiencing an illusion does not relate to the physical quality of the distal or proximal stimulus; rather, it depends on a comparison between the actual perception and what one believes should be perceived given the knowledge s/he has gained about the physical stimulus. Within such a framework, illusions are still considered of extreme importance in the study of the processes underpinning perception, but they are not conceived as errors. They represent instead a cognitive clash between actual perception and hypothesized perception based on some sort of comparison, thus also showing their potential as a tool for studying the underpinnings of cognitive processes.
Collapse
Affiliation(s)
- Daniele Zavagno
- Department of Psychology, University of Milano-Bicocca, P.zza dell'Ateneo Nuovo 1, 20126 Milano, Italy
| |
Collapse
|
16
|
Pilacinski A, Pinto A, Oliveira S, Araújo E, Carvalho C, Silva PA, Matias R, Menezes P, Sousa S. The robot eyes don't have it. The presence of eyes on collaborative robots yields marginally higher user trust but lower performance. Heliyon 2023; 9:e18164. [PMID: 37520993 PMCID: PMC10382291 DOI: 10.1016/j.heliyon.2023.e18164] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2023] [Revised: 06/21/2023] [Accepted: 07/10/2023] [Indexed: 08/01/2023] Open
Abstract
Eye gaze is a prominent feature of human social lives, but little is known on whether fitting eyes on machines makes humans trust them more. In this study we compared subjective and objective markers of human trust when collaborating with eyed and non-eyed robots of the same type. We used virtual reality scenes in which we manipulated distance and the presence of eyes on a robot's display during simple collaboration scenes. We found that while collaboration with eyed cobots resulted in slightly higher subjective trust ratings, the objective markers such as pupil size and task completion time indicated it was in fact less comfortable to collaborate with eyed robots. These findings are in line with recent suggestions that anthropomorphism may be actually a detrimental feature of collaborative robots. These findings also show the complex relationship between human objective and subjective markers of trust when collaborating with artificial agents.
Collapse
Affiliation(s)
- Artur Pilacinski
- Medical Faculty, Ruhr University Bochum, Bochum, Germany
- CINEICC - Center for Research in Neuropsychology and Cognitive Behavioral Intervention, University of Coimbra, Coimbra, Portugal
- Faculty of Psychology and Educational Sciences, University of Coimbra, Coimbra, Portugal
| | - Ana Pinto
- Faculty of Psychology and Educational Sciences, University of Coimbra, Coimbra, Portugal
- Faculty of Sciences and Technology, University of Coimbra, Coimbra, Portugal
- CeBER – Centre for Business and Economics Research, University of Coimbra, Coimbra, Portugal
| | - Soraia Oliveira
- Faculty of Psychology and Educational Sciences, University of Coimbra, Coimbra, Portugal
| | - Eduardo Araújo
- Faculty of Sciences and Technology, University of Coimbra, Coimbra, Portugal
- Department of Informatics Engineering, University of Coimbra, Coimbra, Portugal
| | - Carla Carvalho
- CINEICC - Center for Research in Neuropsychology and Cognitive Behavioral Intervention, University of Coimbra, Coimbra, Portugal
- Faculty of Psychology and Educational Sciences, University of Coimbra, Coimbra, Portugal
| | - Paula Alexandra Silva
- Faculty of Sciences and Technology, University of Coimbra, Coimbra, Portugal
- Department of Informatics Engineering, University of Coimbra, Coimbra, Portugal
- CISUC - Centre for Informatics and Systems of the University of Coimbra, Coimbra, Portugal
| | - Ricardo Matias
- Faculty of Sciences and Technology, University of Coimbra, Coimbra, Portugal
- Electrical and Computer Engineering Department, University of Coimbra, Coimbra, Portugal
| | - Paulo Menezes
- Faculty of Sciences and Technology, University of Coimbra, Coimbra, Portugal
- Electrical and Computer Engineering Department, University of Coimbra, Coimbra, Portugal
| | - Sonia Sousa
- University of Trás-os-Montes e Alto Douro, Vila Real, Portugal
- School of Digital Technologies, Tallinn University, Tallinn, Estonia
| |
Collapse
|
17
|
Omori T, Funayama M, Anamizu S, Ishikawa M, Niida R, Tabuchi H. A Selective Hand Posture Apraxia in an Individual With Posterior Cortical Atrophy and Probable Corticobasal Syndrome. Cogn Behav Neurol 2023; 36:118-127. [PMID: 36961317 DOI: 10.1097/wnn.0000000000000339] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2022] [Accepted: 11/09/2022] [Indexed: 03/25/2023]
Abstract
A selective impairment for making hand postures that are required to use specific tools has rarely been reported in individuals with acquired brain injury, and such an impairment has not been documented at all in individuals with degenerative disorders. We describe an individual with posterior cortical atrophy and probable corticobasal syndrome who was unable to use tools because of an inability to make the proper hand posture required for each tool. This individual was, however, able to use the tools properly once her hand postures were corrected, and her ability to manipulate the tools (ie, timing, arm posture, and amplitude) was intact. Also, she had no difficulty with a test of her manipulation knowledge. Areas of hypoperfusion observed by single-photon emission computerized tomography included the anterior intraparietal sulcus in the left parietal lobe, which is an area that has been proposed to control hand postures. This selective impairment might be explained by the reasoning-based hypothesis for apraxia, which attributes hand posture errors in the absence of manipulation errors to dysfunction in one of the three independent pathways that subserve tool use, rather than the manipulation-based hypothesis for apraxia, which attributes hand posture errors to impaired manipulation knowledge. This is the first case with a degenerative disorder that revealed a selective impairment for making hand postures for tool use, which might be explained mainly by apraxia of hand postures along with visuospatial dysfunction (simultanagnosia) and/or sensory disturbance.
Collapse
Affiliation(s)
- Tomohiro Omori
- Department of Rehabilitation, International University of Health and Welfare, Narita Hospital, Narita-City, Japan
| | - Michitaka Funayama
- Department of Neuropsychiatry, Ashikaga Red Cross Hospital, Ashikaga-City, Japan
| | - Sachiko Anamizu
- Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
| | - Mei Ishikawa
- Department of Rehabilitation, Kawagoe Rehabilitation Hospital, Kawagoe-City, Japan
| | - Richi Niida
- Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
| | - Hajime Tabuchi
- Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
| |
Collapse
|
18
|
Guerra-Armas J, Flores-Cortes M, Pineda-Galan C, Luque-Suarez A, La Touche R. Role of Immersive Virtual Reality in Motor Behaviour Decision-Making in Chronic Pain Patients. Brain Sci 2023; 13:617. [PMID: 37190582 PMCID: PMC10136729 DOI: 10.3390/brainsci13040617] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2023] [Revised: 03/31/2023] [Accepted: 04/03/2023] [Indexed: 05/17/2023] Open
Abstract
Primary chronic pain is a major contributor to disability worldwide, with an estimated prevalence of 20-33% of the world's population. The high socio-economic impact of musculoskeletal pain justifies seeking an appropriate therapeutic strategy. Immersive virtual reality (VR) has been proposed as a first-line intervention for chronic musculoskeletal pain. However, the growing literature has not been accompanied by substantial progress in understanding how VR exerts its impact on the pain experience and what neurophysiological mechanisms might be involved in the clinical effectiveness of virtual reality interventions in chronic pain patients. The aim of this review is: (i) to establish the state of the art on the effects of VR on patients with chronic pain; (ii) to identify neuroplastic changes associated with chronic pain that may be targeted by VR intervention; and (iii) to propose a hypothesis on how immersive virtual reality could modify motor behavioral decision-making through an interactive experience in patients with chronic pain.
Collapse
Affiliation(s)
- Javier Guerra-Armas
- Faculty of Health Sciences, Universidad Las Palmas de Gran Canaria (ULPGC), 35016 Las Palmas, Spain
| | - Mar Flores-Cortes
- Faculty of Health Sciences, Universidad de Malaga, 29071 Malaga, Spain
| | | | - Alejandro Luque-Suarez
- Faculty of Health Sciences, Universidad de Malaga, 29071 Malaga, Spain
- Instituto de la Investigacion Biomedica de Malaga (IBIMA), 29071 Malaga, Spain
| | - Roy La Touche
- Departamento de Fisioterapia, Centro Superior de Estudios Universitarios La Salle, Universidad Autónoma de Madrid, 28023 Madrid, Spain
- Motion in Brains Research Group, Institute of Neuroscience and Sciences of the Movement (INCIMOV), Centro Superior de Estudios Universitarios La Salle, Universidad Autónoma de Madrid, 28023 Madrid, Spain
- Instituto de Dolor Craneofacial y Neuromusculoesquelético (INDCRAN), 28008 Madrid, Spain
| |
Collapse
|
19
|
The visual encoding of graspable unfamiliar objects. PSYCHOLOGICAL RESEARCH 2023; 87:452-461. [PMID: 35322276 DOI: 10.1007/s00426-022-01673-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2021] [Accepted: 03/08/2022] [Indexed: 10/18/2022]
Abstract
We explored by eye-tracking the visual encoding modalities of participants (N = 20) involved in a free-observation task in which three repetitions of ten unfamiliar graspable objects were administered. Then, we analysed the temporal allocation (t = 1500 ms) of visual-spatial attention to objects' manipulation (i.e., the part aimed at grasping the object) and functional (i.e., the part aimed at recognizing the function and identity of the object) areas. Within the first 750 ms, participants tended to shift their gaze on the functional areas while decreasing their attention on the manipulation areas. Then, participants reversed this trend, decreasing their visual-spatial attention to the functional areas while fixing the manipulation areas relatively more. Crucially, the global amount of visual-spatial attention for objects' functional areas significantly decreased as an effect of stimuli repetition while remaining stable for the manipulation areas, thus indicating stimulus familiarity effects. These findings support the action reappraisal theoretical approach, which considers object/tool processing as abilities emerging from semantic, technical/mechanical, and sensorimotor knowledge integration.
Collapse
|
20
|
Henlein A, Gopinath A, Krishnaswamy N, Mehler A, Pustejovsky J. Grounding human-object interaction to affordance behavior in multimodal datasets. Front Artif Intell 2023; 6:1084740. [PMID: 36793938 PMCID: PMC9923013 DOI: 10.3389/frai.2023.1084740] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2022] [Accepted: 01/03/2023] [Indexed: 01/31/2023] Open
Abstract
While affordance detection and Human-Object interaction (HOI) detection tasks are related, the theoretical foundation of affordances makes it clear that the two are distinct. In particular, researchers in affordances make distinctions between J. J. Gibson's traditional definition of an affordance, "the action possibilities" of the object within the environment, and the definition of a telic affordance, or one defined by conventionalized purpose or use. We augment the HICO-DET dataset with annotations for Gibsonian and telic affordances and a subset of the dataset with annotations for the orientation of the humans and objects involved. We then train an adapted Human-Object Interaction (HOI) model and evaluate a pre-trained viewpoint estimation system on this augmented dataset. Our model, AffordanceUPT, is based on a two-stage adaptation of the Unary-Pairwise Transformer (UPT), which we modularize to make affordance detection independent of object detection. Our approach exhibits generalization to new objects and actions, can effectively make the Gibsonian/telic distinction, and shows that this distinction is correlated with features in the data that are not captured by the HOI annotations of the HICO-DET dataset.
Collapse
Affiliation(s)
- Alexander Henlein
- Text Technology Lab, Faculty of Computer Science and Mathematics, Institute of Computer Science, Goethe University Frankfurt, Frankfurt, Germany,*Correspondence: Alexander Henlein ✉
| | - Anju Gopinath
- Situated Grounding and Natural Language Lab, Department of Computer Science, Colorado State University, Fort Collins, CO, United States
| | - Nikhil Krishnaswamy
- Situated Grounding and Natural Language Lab, Department of Computer Science, Colorado State University, Fort Collins, CO, United States
| | - Alexander Mehler
- Text Technology Lab, Faculty of Computer Science and Mathematics, Institute of Computer Science, Goethe University Frankfurt, Frankfurt, Germany
| | - James Pustejovsky
- Lab for Linguistics and Computation, Department of Computer Science, Brandeis University, Waltham, MA, United States
| |
Collapse
|
21
|
Modularity in Nervous Systems—a Key to Efficient Adaptivity for Deep Reinforcement Learning. Cognit Comput 2023. [DOI: 10.1007/s12559-022-10080-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/21/2023]
Abstract
AbstractModularity as observed in biological systems has proven valuable for guiding classical motor theories towards good answers about action selection and execution. New challenges arise when we turn to learning: Trying to scale current computational models, such as deep reinforcement learning (DRL), to action spaces, input dimensions, and time horizons seen in biological systems still faces severe obstacles unless vast amounts of training data are available. This leads to the question: does biological modularity also hold an important key for better answers to obtain efficient adaptivity for deep reinforcement learning? We review biological experimental work on modularity in biological motor control and link this with current examples of (deep) RL approaches. Analyzing outcomes of simulation studies, we show that these approaches benefit from forms of modularization as found in biological systems. We identify three different strands of modularity exhibited in biological control systems. Two of them—modularity in state (i) and in action (ii) spaces—appear as a consequence of local interconnectivity (as in reflexes) and are often modulated by higher levels in a control hierarchy. A third strand arises from chunking of action elements along a (iii) temporal dimension. Usually interacting in an overarching spatio-temporal hierarchy of the overall system, the three strands offer major “factors” decomposing the entire modularity structure. We conclude that modularity with its above strands can provide an effective prior for DRL approaches to speed up learning considerably and making learned controllers more robust and adaptive.
Collapse
|
22
|
Krishnaswamy N, Pustejovsky J. Affordance embeddings for situated language understanding. Front Artif Intell 2022; 5:774752. [PMID: 36213167 PMCID: PMC9538673 DOI: 10.3389/frai.2022.774752] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2021] [Accepted: 06/27/2022] [Indexed: 11/13/2022] Open
Abstract
Much progress in AI over the last decade has been driven by advances in natural language processing technology, in turn facilitated by large datasets and increased computation power used to train large neural language models. These systems demonstrate apparently sophisticated linguistic understanding or generation capabilities, but often fail to transfer their skills to situations they have not encountered before. We argue that computational situated grounding of linguistic information to real or simulated scenarios provide a solution to some of these learning challenges by creating situational representations that both serve as a formal model of the salient phenomena, and contain rich amounts of exploitable, task-appropriate data for training new, flexible computational models. We approach this problem from a neurosymbolic perspective, using multimodal contextual modeling of interactive situations, events, and object properties, particularly afforded behaviors, and habitats, the situations that condition them. These properties are tightly coupled to processes of situated grounding, and herein we discuss we combine neural and symbolic methods with multimodal simulations to create a platform, VoxWorld, for modeling communication in context, and we demonstrate how neural embedding vectors of symbolically-encoded object affordances facilitate transferring knowledge of objects and situations to novel entities, and learning how to recognize and generate linguistic and gestural denotations.
Collapse
Affiliation(s)
- Nikhil Krishnaswamy
- Situated Grounding and Natural Language Lab, Department of Computer Science, Colorado State University, Fort Collins, CO, United States
| | - James Pustejovsky
- Lab for Linguistics and Computation, Department of Computer Science, Brandeis University, Waltham, MA, United States
| |
Collapse
|
23
|
Giocondo F, Borghi AM, Baldassarre G, Caligiore D. Emotions Modulate Affordances-Related Motor Responses: A Priming Experiment. Front Psychol 2022; 13:701714. [PMID: 35756268 PMCID: PMC9215344 DOI: 10.3389/fpsyg.2022.701714] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2021] [Accepted: 05/17/2022] [Indexed: 11/25/2022] Open
Abstract
Traditionally, research on affordances and emotions follows two separate routes. For the first time, this article explicitly links the two phenomena by investigating whether, in a discrimination task (artifact vs. natural object), the motivational states induced by emotional images can modulate affordances-related motor response elicited by dangerous and neutral graspable objects. The results show faster RTs: (i) for both neutral and dangerous objects with neutral images; (ii) for dangerous objects with pleasant images; (iii) for neutral objects with unpleasant images. Overall, these data support a significant effect of emotions on affordances. The article also proposes a brain neural network underlying emotions and affordance interplay.
Collapse
Affiliation(s)
- Flora Giocondo
- Laboratory of Embodied Natural and Artificial Intelligence, Institute of Cognitive Sciences and Technologies, National Research Council, Rome, Italy
| | - Anna M Borghi
- Department of Dynamic and Clinical Psychology, Sapienza University of Rome, Rome, Italy.,Institute of Cognitive Sciences and Technologies, National Research Council, Rome, Italy
| | - Gianluca Baldassarre
- Laboratory of Embodied Natural and Artificial Intelligence, Institute of Cognitive Sciences and Technologies, National Research Council, Rome, Italy.,AI2Life s.r.l., Innovative Start-up, ISTC-CNR Spin-off, Rome, Italy
| | - Daniele Caligiore
- AI2Life s.r.l., Innovative Start-up, ISTC-CNR Spin-off, Rome, Italy.,Computational and Translational Neuroscience Laboratory, Institute of Cognitive Sciences and Technologies, National Research Council, Rome, Italy
| |
Collapse
|
24
|
Michalowski B, Buchwald M, Klichowski M, Ras M, Kroliczak G. Action goals and the praxis network: an fMRI study. Brain Struct Funct 2022; 227:2261-2284. [PMID: 35731447 PMCID: PMC9418102 DOI: 10.1007/s00429-022-02520-y] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2021] [Accepted: 05/30/2022] [Indexed: 01/09/2023]
Abstract
The praxis representation network (PRN) of the left cerebral hemisphere is typically linked to the control of functional interactions with familiar tools. Surprisingly, little is known about the PRN engagement in planning and execution of tool-directed actions motivated by non-functional but purposeful action goals. Here we used functional neuroimaging to perform both univariate and multi-voxel pattern analyses (MVPA) in 20 right-handed participants who planned and later executed, with their dominant and non-dominant hands, disparate grasps of tools for different goals, including: (1) planning simple vs. demanding functional grasps of conveniently vs. inconveniently oriented tools with an intention to immediately use them, (2) planning simple—but non-functional—grasps of inconveniently oriented tools with a goal to pass them to a different person, (3) planning reaching movements directed at such tools with an intention to move/push them with the back of the hand, and (4) pantomimed execution of the earlier planned tasks. While PRN contributed to the studied interactions with tools, the engagement of its critical nodes, and/or complementary right hemisphere processing, was differently modulated by task type. E.g., planning non-functional/structural grasp-to-pass movements of inconveniently oriented tools, regardless of the hand, invoked the left parietal and prefrontal nodes significantly more than simple, non-demanding functional grasps. MVPA corroborated decoding capabilities of critical PRN areas and some of their right hemisphere counterparts. Our findings shed new lights on how performance of disparate action goals influences the extraction of object affordances, and how or to what extent it modulates the neural activity within the parieto-frontal brain networks.
Collapse
Affiliation(s)
- Bartosz Michalowski
- Action and Cognition Laboratory, Faculty of Psychology and Cognitive Science, Adam Mickiewicz University, Wydział Psychologii i Kognitywistyki UAM, ul. Szamarzewskiego 89, 60-568, Poznan, Poland
| | - Mikolaj Buchwald
- Action and Cognition Laboratory, Faculty of Psychology and Cognitive Science, Adam Mickiewicz University, Wydział Psychologii i Kognitywistyki UAM, ul. Szamarzewskiego 89, 60-568, Poznan, Poland
| | - Michal Klichowski
- Action and Cognition Laboratory, Faculty of Psychology and Cognitive Science, Adam Mickiewicz University, Wydział Psychologii i Kognitywistyki UAM, ul. Szamarzewskiego 89, 60-568, Poznan, Poland.,Learning Laboratory, Faculty of Educational Studies, Adam Mickiewicz University, Poznan, Poland
| | - Maciej Ras
- Action and Cognition Laboratory, Faculty of Psychology and Cognitive Science, Adam Mickiewicz University, Wydział Psychologii i Kognitywistyki UAM, ul. Szamarzewskiego 89, 60-568, Poznan, Poland
| | - Gregory Kroliczak
- Action and Cognition Laboratory, Faculty of Psychology and Cognitive Science, Adam Mickiewicz University, Wydział Psychologii i Kognitywistyki UAM, ul. Szamarzewskiego 89, 60-568, Poznan, Poland.
| |
Collapse
|
25
|
Virtual Reality for Safe Testing and Development in Collaborative Robotics: Challenges and Perspectives. ELECTRONICS 2022. [DOI: 10.3390/electronics11111726] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Collaborative robots (cobots) could help humans in tasks that are mundane, dangerous or where direct human contact carries risk. Yet, the collaboration between humans and robots is severely limited by the aspects of the safety and comfort of human operators. In this paper, we outline the use of extended reality (XR) as a way to test and develop collaboration with robots. We focus on virtual reality (VR) in simulating collaboration scenarios and the use of cobot digital twins. This is specifically useful in situations that are difficult or even impossible to safely test in real life, such as dangerous scenarios. We describe using XR simulations as a means to evaluate collaboration with robots without putting humans at harm. We show how an XR setting enables combining human behavioral data, subjective self-reports, and biosignals signifying human comfort, stress and cognitive load during collaboration. Several works demonstrate XR can be used to train human operators and provide them with augmented reality (AR) interfaces to enhance their performance with robots. We also provide a first attempt at what could become the basis for a human–robot collaboration testing framework, specifically for designing and testing factors affecting human–robot collaboration. The use of XR has the potential to change the way we design and test cobots, and train cobot operators, in a range of applications: from industry, through healthcare, to space operations.
Collapse
|
26
|
Mangalam M, Fragaszy DM, Wagman JB, Day BM, Kelty-Stephen DG, Bongers RM, Stout DW, Osiurak F. On the psychological origins of tool use. Neurosci Biobehav Rev 2022; 134:104521. [PMID: 34998834 DOI: 10.1016/j.neubiorev.2022.104521] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2021] [Revised: 12/01/2021] [Accepted: 01/01/2022] [Indexed: 01/13/2023]
Abstract
The ubiquity of tool use in human life has generated multiple lines of scientific and philosophical investigation to understand the development and expression of humans' engagement with tools and its relation to other dimensions of human experience. However, existing literature on tool use faces several epistemological challenges in which the same set of questions generate many different answers. At least four critical questions can be identified, which are intimately intertwined-(1) What constitutes tool use? (2) What psychological processes underlie tool use in humans and nonhuman animals? (3) Which of these psychological processes are exclusive to tool use? (4) Which psychological processes involved in tool use are exclusive to Homo sapiens? To help advance a multidisciplinary scientific understanding of tool use, six author groups representing different academic disciplines (e.g., anthropology, psychology, neuroscience) and different theoretical perspectives respond to each of these questions, and then point to the direction of future work on tool use. We find that while there are marked differences among the responses of the respective author groups to each question, there is a surprising degree of agreement about many essential concepts and questions. We believe that this interdisciplinary and intertheoretical discussion will foster a more comprehensive understanding of tool use than any one of these perspectives (or any one of these author groups) would (or could) on their own.
Collapse
Affiliation(s)
- Madhur Mangalam
- Department of Physical Therapy, Movement and Rehabilitation Science, Northeastern University, Boston, Massachusetts 02115, USA.
| | | | - Jeffrey B Wagman
- Department of Psychology, Illinois State University, Normal, IL 61761, USA
| | - Brian M Day
- Department of Psychology, Butler University, Indianapolis, IN 46208, USA
| | | | - Raoul M Bongers
- Department of Human Movement Sciences, University Medical Center Groningen, University of Groningen, 9713 GZ Groningen, Netherlands
| | - Dietrich W Stout
- Department of Anthropology, Emory University, Atlanta, GA 30322, USA
| | - François Osiurak
- Laboratoire d'Etude des Mécanismes Cognitifs, Université de Lyon, Lyon 69361, France; Institut Universitaire de France, Paris 75231, France
| |
Collapse
|
27
|
Silva-Gago M, Ioannidou F, Fedato A, Hodgson T, Bruner E. Visual Attention and Cognitive Archaeology: An Eye-Tracking Study of Palaeolithic Stone Tools. Perception 2021; 51:3-24. [PMID: 34967251 DOI: 10.1177/03010066211069504] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
The study of lithic technology can provide information on human cultural evolution. This article aims to analyse visual behaviour associated with the exploration of ancient stone artefacts and how this relates to perceptual mechanisms in humans. In Experiment 1, we used eye tracking to record patterns of eye fixations while participants viewed images of stone tools, including examples of worked pebbles and handaxes. The results showed that the focus of gaze was directed more towards the upper regions of worked pebbles and on the basal areas for handaxes. Knapped surfaces also attracted more fixation than natural cortex for both tool types. Fixation distribution was different to that predicted by models that calculate visual salience. Experiment 2 was an online study using a mouse-click attention tracking technique and included images of unworked pebbles and 'mixed' images combining the handaxe's outline with the pebble's unworked texture. The pattern of clicks corresponded to that revealed using eye tracking and there were differences between tools and other images. Overall, the findings suggest that visual exploration is directed towards functional aspects of tools. Studies of visual attention and exploration can supply useful information to inform understanding of human cognitive evolution and tool use.
Collapse
Affiliation(s)
- María Silva-Gago
- Centro Nacional de Investigación sobre la Evolución Humana, Burgos, Spain
| | | | - Annapaola Fedato
- Centro Nacional de Investigación sobre la Evolución Humana, Burgos, Spain
| | - Timothy Hodgson
- College of Social Science, 4547University of Lincoln, Lincoln, UK
| | - Emiliano Bruner
- Centro Nacional de Investigación sobre la Evolución Humana, Burgos, Spain
| |
Collapse
|
28
|
Ortenzi V, Cosgun A, Pardi T, Chan WP, Croft E, Kulic D. Object Handovers: A Review for Robotics. IEEE T ROBOT 2021. [DOI: 10.1109/tro.2021.3075365] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
29
|
Osiurak F, Reynaud E, Baumard J, Rossetti Y, Bartolo A, Lesourd M. Pantomime of tool use: looking beyond apraxia. Brain Commun 2021; 3:fcab263. [PMID: 35350708 PMCID: PMC8936430 DOI: 10.1093/braincomms/fcab263] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2021] [Revised: 09/10/2021] [Accepted: 09/17/2021] [Indexed: 11/22/2022] Open
Abstract
Pantomime has a long tradition in clinical neuropsychology of apraxia. It has been much more used by researchers and clinicians to assess tool-use disorders than real tool use. Nevertheless, it remains incompletely understood and has given rise to controversies, such as the involvement of the left inferior parietal lobe or the nature of the underlying cognitive processes. The present article offers a comprehensive framework, with the aim of specifying the neural and cognitive bases of pantomime. To do so, we conducted a series of meta-analyses of brain-lesion, neuroimaging and behavioural studies about pantomime and other related tasks (i.e. real tool use, imitation of meaningless postures and semantic knowledge). The first key finding is that the area PF (Area PF complex) within the left inferior parietal lobe is crucially involved in both pantomime and real tool use as well as in the kinematics component of pantomime. The second key finding is the absence of a well-defined neural substrate for the posture component of pantomime (both grip errors and body-part-as-tool responses). The third key finding is the role played by the intraparietal sulcus in both pantomime and imitation of meaningless postures. The fourth key finding is that the left angular gyrus seems to be critical in the production of motor actions directed towards the body. The fifth key finding is that performance on pantomime is strongly correlated with the severity of semantic deficits. Taken together, these findings invite us to offer a neurocognitive model of pantomime, which provides an integrated alternative to the two hypotheses that dominate the field: The gesture-engram hypothesis and the communicative hypothesis. More specifically, this model assumes that technical reasoning (notably the left area PF), the motor-control system (notably the intraparietal sulcus), body structural description (notably the left angular gyrus), semantic knowledge (notably the polar temporal lobes) and potentially theory of mind (notably the middle prefrontal cortex) work in concert to produce pantomime. The original features of this model open new avenues for understanding the neurocognitive bases of pantomime, emphasizing that pantomime is a communicative task that nevertheless originates in specific tool-use (not motor-related) cognitive processes. .
Collapse
Affiliation(s)
- François Osiurak
- Laboratoire d’Etude des Mécanismes Cognitifs (EA3082), Université Lyon 2, 69676 Bron, France
- Institut Universitaire de France, 75231 Paris, France
| | - Emanuelle Reynaud
- Laboratoire d’Etude des Mécanismes Cognitifs (EA3082), Université Lyon 2, 69676 Bron, France
| | - Josselin Baumard
- Normandie University, UNIROUEN, CRFDP (EA7475), 76821 Mont Saint Aignan, France
| | - Yves Rossetti
- Centre de Recherche en Neurosciences de Lyon, Trajectoires Team, CNRS U5292, Inserm U1028, Université de Lyon, 69676 Bron, France
- Mouvement, Handicap, et Neuro-Immersion, Hospices Civils de Lyon et Centre de Recherche en Neurosciences de Lyon, Hôpital Henry Gabrielle, 69230 Saint-Genis-Laval, France
| | - Angela Bartolo
- Institut Universitaire de France, 75231 Paris, France
- Univ. Lille, CNRS, UMR9193, SCALab—Sciences Cognitives et Sciences Affectives, 59653 Villeneuve d'Ascq, France
| | - Mathieu Lesourd
- Laboratoire de Recherches Intégratives en Neurosciences et Psychologie Cognitive (UR481), Université de Bourgogne Franche-Comté, 25030 Besançon, France
- MSHE Ledoux, CNRS, Université de Bourgogne Franche-Comté, 25000 Besançon, France
| |
Collapse
|
30
|
Kumar S, Bach P, Kourtis D. Editorial: Behavioral and Neural Bases of Object Affordance Processing and Its Clinical Implications. Front Hum Neurosci 2021; 15:759377. [PMID: 34658823 PMCID: PMC8513713 DOI: 10.3389/fnhum.2021.759377] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2021] [Accepted: 08/31/2021] [Indexed: 11/13/2022] Open
Affiliation(s)
- Sanjay Kumar
- Psychology, Oxford Brookes University, Oxford, United Kingdom
| | - Patric Bach
- School of Psychology, University of Aberdeen, Aberdeen, United Kingdom
| | | |
Collapse
|
31
|
Korisky U, Mudrik L. Dimensions of Perception: 3D Real-Life Objects Are More Readily Detected Than Their 2D Images. Psychol Sci 2021; 32:1636-1648. [PMID: 34555305 DOI: 10.1177/09567976211010718] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
Most of our interactions with our environment involve manipulating real 3D objects. Accordingly, 3D objects seem to enjoy preferential processing compared with 2D images, for example, in capturing attention or being better remembered. But are they also more readily perceived? Thus far, the possibility of preferred detection for real 3D objects could not be empirically tested because suppression from awareness has been applied only to on-screen stimuli. Here, using a variant of continuous flash suppression (CFS) with augmented-reality goggles ("real-life" CFS), we managed to suppress both real 3D objects and their 2D representations. In 20 healthy young adults, real objects broke suppression faster than their photographs. Using 3D printing, we also showed in 50 healthy young adults that this finding held only for meaningful objects, whereas no difference was found for meaningless, novel ones (a similar trend was observed in another experiment with 20 subjects, yet it did not reach significance). This suggests that the effect might be mediated by affordances facilitating detection of 3D objects under interocular suppression.
Collapse
Affiliation(s)
- Uri Korisky
- School of Psychological Sciences, Tel Aviv University
| | - Liad Mudrik
- School of Psychological Sciences, Tel Aviv University.,Sagol School of Neuroscience, Tel Aviv University
| |
Collapse
|
32
|
Irie K, Zhao S, Okamoto K, Liang N. Examining the Effect of Adverbs and Onomatopoeia on Physical Movement. Front Psychol 2021; 12:723602. [PMID: 34630234 PMCID: PMC8492989 DOI: 10.3389/fpsyg.2021.723602] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2021] [Accepted: 09/02/2021] [Indexed: 11/13/2022] Open
Abstract
Introduction: The effect of promoting a physical reaction by the described action is called the action-sentence compatibility effect (ACE). It has been verified that physical motion changes depending on the time phase and grammatical expression. However, it is unclear how adverbs and onomatopoeia change motion simulations and subsequent movements. Methods: The subjects were 35 healthy adults (11 females; mean age 21.3). We prepared 20 sentences each, expressing actions related to hands and feet. These were converted into 80 sentences (stimulus set A), with the words "Slow" or "Quick" added to the words related to the speed of movement, and 80 sentences (stimulus set B) with the words "Fast" and onomatopoeia "Satto" added. Additionally, 20 unnatural sentences were prepared for each stimulus set as pseudo sentences. Choice reaction time was adopted; subjects pressed the button with their right hand only when the presented text was correctly understood (Go no-go task). The reaction time (RTs) and the number of errors (NoE) were recorded and compared. Results: As a result of a two-way repeated ANOVA, an interaction effect (body parts × words) was observed in RTs and NoE in set A. "Hand and Fast" had significantly faster RTs than "Hand and Slow" and "Foot and Fast." Furthermore, "Hand and Fast" had a significantly higher NoE than others. In set B, the main effects were observed in both RTs and NoE. "Hand" and "Satto" had significantly faster RTs than "Foot" and "Quick," respectively. Additionally, an interaction effect was observed in NoE, wherein "Foot and Satto" was significantly higher than "Hand and Satto" and "Foot and Quick." Conclusion: In this study, the word "Fast" promoted hand response, reaffirming ACE. The onomatopoeia "Satto" was a word that conveys the speed of movement, but it was suggested that the degree of understanding may be influenced by the body part and the attributes of the subject.
Collapse
Affiliation(s)
- Keisuke Irie
- Cognitive Motor Neuroscience, Department of Human Health Sciences, Graduate School of Medicine, Kyoto University, Kyoto, Japan
| | - Shuo Zhao
- School of Psychology, Shenzhen University, Shenzhen, China
| | - Kazuhiro Okamoto
- Department of Rehabilitation, Faculty of Health Science, Fukui Health Science University, Fukui, Japan
| | - Nan Liang
- Cognitive Motor Neuroscience, Department of Human Health Sciences, Graduate School of Medicine, Kyoto University, Kyoto, Japan
| |
Collapse
|
33
|
Danel S, Rebout N, von Bayern AMP, Osiurak F. Complex nests but no use of tools: An investigation of problem solving in weaverbirds (Ploceidae). Behav Processes 2021; 192:104493. [PMID: 34487830 DOI: 10.1016/j.beproc.2021.104493] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2021] [Revised: 08/30/2021] [Accepted: 08/31/2021] [Indexed: 11/17/2022]
Abstract
Few avian species use tools in the wild. Yet, several birds build nests of great complexity and many aspects of tool use may also apply to nest building. It has long been hypothesised that tool use may select for specialised cognitive adaptations or even general cognitive skills. This might similarly pertain to species that build complex nests. In this study, we investigated the problem-solving capacity of a complex nest builder, a weaverbird species, in a foraging context that either required or did not require the use of tools. First, we tested the capacity of yellow-crowned bishops (Euplectes afer ssp. afer) to use a tool for retrieving an out-of-reach reward during three problem-solving tasks offering different nest/non-nest materials (Experiment 1). Next, subjects were confronted with two problem-solving tasks that required no tools (Experiment 2). No subject was able to use a tool in Experiment 1. However, 11 out of 12 subjects succeeded in using their beak in the first problem-solving task, and 9 in the second problem-solving task of Experiment 2. These results suggest that weaverbirds showed flexible problem-solving if the use of tools was not required.
Collapse
Affiliation(s)
- Samara Danel
- Department of Zoology, University of Oxford, Oxford, OX1 3PS, UK; Laboratory for the Study of Cognitive Mechanisms, University of Lyon, Bron Rhône-Alpes, 69500, France.
| | - Nancy Rebout
- FaunaStats, 16 Avenue de l'Europe, Immeuble, SXB1, 67300, Schiltigheim, France
| | | | - François Osiurak
- Laboratory for the Study of Cognitive Mechanisms, University of Lyon, Bron Rhône-Alpes, 69500, France; University Institute of France, Paris Ile-de-France, 75005, France
| |
Collapse
|
34
|
Mizuguchi N, Tsuchimoto S, Fujii H, Kato K, Nagami T, Kanosue K. Recognition capability of one's own skilled movement is dissociated from acquisition of motor skill memory. Sci Rep 2021; 11:16710. [PMID: 34408254 PMCID: PMC8373862 DOI: 10.1038/s41598-021-96381-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2021] [Accepted: 08/03/2021] [Indexed: 11/09/2022] Open
Abstract
When we have rehearsed a movement using an object, we can reproduce the movement without holding the object. However, the reproduced movement sometimes differs from the movement holding a real object, likely because movement recognition is inaccurate. In the present study, we tested whether the recognition capability was dissociated from the acquisition of motor skill memory. Twelve novices were asked to rotate two balls with their right hand as quickly as possible; they practiced the task for 29 days. To evaluate recognition capability, we calculated the difference in coordination pattern of all five digits between the ball-rotation movement and the reproduced movement without holding balls. The recognition capability did not change within the first day, but improved after one week of practice. On the other hand, performance of the ball rotation significantly improved within the first day. Since improvement of performance is likely associated with acquisition of motor skill memory, we suggest that recognition capability, which reflects the capability to cognitively access motor skill memory, was dissociated from the acquisition of motor skill memory. Therefore, recognition of one’s own skilled movement would rely on a hierarchical structure of acquisition of motor skill memory and cognitive access to that memory.
Collapse
Affiliation(s)
- Nobuaki Mizuguchi
- Research Organization of Science and Technology, Ritsumeikan University, 1-1-1 Noji-Higashi, Kusatsu, Shiga, 525-8577, Japan. .,Faculty of Sport Sciences, Waseda University, 2-579-15 Mikajima, Tokorozawa, Saitama, 359-1192, Japan.
| | - Shohei Tsuchimoto
- Division of System Neuroscience, National Institute for Physiological Sciences, Aichi, 444-8585, Japan
| | - Hirofumi Fujii
- Faculty of Sport Sciences, Waseda University, 2-579-15 Mikajima, Tokorozawa, Saitama, 359-1192, Japan
| | - Kouki Kato
- Faculty of Sport Sciences, Waseda University, 2-579-15 Mikajima, Tokorozawa, Saitama, 359-1192, Japan.,Physical Education Center, Nanzan University, 18 Yamazato, Aichi, 466-8673, Japan
| | - Tomoyuki Nagami
- Faculty of Sport Sciences, Waseda University, 2-579-15 Mikajima, Tokorozawa, Saitama, 359-1192, Japan.,College of Liberal Arts and Sciences, Kitasato University, 1-15-1 Kitazato, Minami-ku, Sagamihara, Kanagawa, 252-0373, Japan
| | - Kazuyuki Kanosue
- Faculty of Sport Sciences, Waseda University, 2-579-15 Mikajima, Tokorozawa, Saitama, 359-1192, Japan
| |
Collapse
|
35
|
Foerster FR, Goslin J. Tool use and function knowledge shape visual object processing. Biol Psychol 2021; 164:108143. [PMID: 34229004 DOI: 10.1016/j.biopsycho.2021.108143] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2020] [Revised: 05/24/2021] [Accepted: 07/01/2021] [Indexed: 10/20/2022]
Abstract
Perceiving the environment automatically informs how we can interact with it through affordance mechanisms. However, it remains unknown how our knowledge about the environment shapes how it is perceived. In this training study, we evaluated whether motor and function knowledge about novel objects affects visual object processing. Forty-three participants associated a usage or function to a novel object in interactive virtual reality while their EEG was recorded. Both usage and function influenced the mu-band (8-12 Hz) rhythms, suggesting that motor and function object information influence motor processing during object recognition. Learning the usage also prevented the reduction of the theta-band (4-8 Hz) rhythms recorded over the posterior cortical areas, suggesting a predominant top-down influence of tool use information on visuo-motor pathways. The modulation being specifically induced by learning an object usage, the results support further the embodied cognition approach rather than the reasoning-based approach of object processing.
Collapse
Affiliation(s)
- Francois R Foerster
- Université de Strasbourg, INSERM U1114, 1 place de l'hôpital, 67100, Strasbourg, France.
| | - Jeremy Goslin
- University of Plymouth, School of Psychology, Drake Circus, Plymouth, Devon, PL4 8AA, United Kingdom.
| |
Collapse
|
36
|
Pilacinski A, De Haan S, Donato R, Almeida J. Tool heads prime saccades. Sci Rep 2021; 11:11954. [PMID: 34099787 PMCID: PMC8184872 DOI: 10.1038/s41598-021-91254-8] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2021] [Accepted: 05/21/2021] [Indexed: 11/09/2022] Open
Abstract
Tools are wielded by their handles, but a lot of information about their function comes from their heads (the action-ends). Here we investigated whether eye saccadic movements are primed by tool handles, or whether they are primed by tool heads. We measured human saccadic reaction times while subjects were performing an attentional task. We found that saccades were executed quicker when performed to the side congruent with the tool head, even though "toolness" was irrelevant for the task. Our results show that heads are automatically processed by the visual system to orient eye movements, indicating that eyes are attracted by functional parts of manipulable objects and by the characteristic information these parts convey.
Collapse
Affiliation(s)
- Artur Pilacinski
- Proaction Laboratory, Faculty of Psychology and Educational Sciences, University of Coimbra, 3000-115, Coimbra, Portugal. .,CINEICC, Faculty of Psychology and Educational Sciences, University of Coimbra, Coimbra, Portugal.
| | - Stella De Haan
- Proaction Laboratory, Faculty of Psychology and Educational Sciences, University of Coimbra, 3000-115, Coimbra, Portugal.,CINEICC, Faculty of Psychology and Educational Sciences, University of Coimbra, Coimbra, Portugal.,GIGA-CRC In Vivo Imaging, University of Liège, Liège, Belgium
| | - Rita Donato
- Proaction Laboratory, Faculty of Psychology and Educational Sciences, University of Coimbra, 3000-115, Coimbra, Portugal.,CINEICC, Faculty of Psychology and Educational Sciences, University of Coimbra, Coimbra, Portugal.,Department of General Psychology, University of Padova, Padova, Italy.,Human Inspired Technology Research Centre, University of Padova, Padova, Italy
| | - Jorge Almeida
- Proaction Laboratory, Faculty of Psychology and Educational Sciences, University of Coimbra, 3000-115, Coimbra, Portugal.,CINEICC, Faculty of Psychology and Educational Sciences, University of Coimbra, Coimbra, Portugal
| |
Collapse
|
37
|
Federico G, Osiurak F, Reynaud E, Brandimonte MA. Semantic congruency effects of prime words on tool visual exploration. Brain Cogn 2021; 152:105758. [PMID: 34102405 DOI: 10.1016/j.bandc.2021.105758] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2021] [Revised: 05/19/2021] [Accepted: 05/23/2021] [Indexed: 10/21/2022]
Abstract
Most recent research on human tool use highlighted how people might integrate multiple sources of information through different neurocognitive systems to exploit the environment for action. This mechanism of integration is known as "action reappraisal". In the present eye-tracking study, we further tested the action reappraisal idea by devising a word-priming paradigm to investigate how semantically congruent (e.g., "nail") vs. semantically incongruent words (e.g., "jacket") that preceded the vision of tools (e.g., a hammer) may affect participants' visual exploration of them. We found an implicit modulation of participants' temporal allocation of visuospatial attention as a function of the object-word consistency. Indeed, participants tended to increase over time their fixations on tools' manipulation areas under semantically congruent conditions. Conversely, participants tended to concentrate their visual-spatial attention on tools' functional areas when inconsistent object-word pairs were presented. These results support and extend the information-integrated perspective of the action reappraisal approach. Also, these findings provide further evidence about how higher-level semantic information may influence tools' visual exploration.
Collapse
Affiliation(s)
| | - François Osiurak
- Laboratoire d'Etude des Mécanismes Cognitifs, Université de Lyon, Lyon, France; Institut Universitaire de France, Paris, France
| | - Emanuelle Reynaud
- Laboratoire d'Etude des Mécanismes Cognitifs, Université de Lyon, Lyon, France
| | - Maria A Brandimonte
- Laboratory of Experimental Psychology, Suor Orsola Benincasa University, Naples, Italy
| |
Collapse
|
38
|
Thosar M, Mueller CA, Jäger G, Schleiss J, Pulugu N, Mallikarjun Chennaboina R, Rao Jeevangekar SV, Birk A, Pfingsthorn M, Zug S. From Multi-Modal Property Dataset to Robot-Centric Conceptual Knowledge About Household Objects. Front Robot AI 2021; 8:476084. [PMID: 33937343 PMCID: PMC8082111 DOI: 10.3389/frobt.2021.476084] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2019] [Accepted: 03/17/2021] [Indexed: 11/26/2022] Open
Abstract
Conceptual knowledge about objects is essential for humans, as well as for animals, to interact with their environment. On this basis, the objects can be understood as tools, a selection process can be implemented and their usage can be planned in order to achieve a specific goal. The conceptual knowledge, in this case, is primarily concerned about the physical properties and functional properties observed in the objects. Similarly tool-use applications in robotics require such conceptual knowledge about objects for substitute selection among other purposes. State-of-the-art methods employ a top-down approach where hand-crafted symbolic knowledge, which is defined from a human perspective, is grounded into sensory data afterwards. However, due to different sensing and acting capabilities of robots, a robot's conceptual understanding of objects (e.g., light/heavy) will vary and therefore should be generated from the robot's perspective entirely, which entails robot-centric conceptual knowledge about objects. A similar bottom-up argument has been put forth in cognitive science that humans and animals alike develop conceptual understanding of objects based on their own perceptual experiences with objects. With this goal in mind, we propose an extensible property estimation framework which consists of estimations methods to obtain the quantitative measurements of physical properties (rigidity, weight, etc.) and functional properties (containment, support, etc.) from household objects. This property estimation forms the basis for our second contribution: Generation of robot-centric conceptual knowledge. Our approach employs unsupervised clustering methods to transform numerical property data into symbols, and Bivariate Joint Frequency Distributions and Sample Proportion to generate conceptual knowledge about objects using the robot-centric symbols. A preliminary implementation of the proposed framework is employed to acquire a dataset comprising six physical and four functional properties of 110 household objects. This Robot-Centric dataSet (RoCS) is used to evaluate the framework regarding the property estimation methods and the semantics of the considered properties within the dataset. Furthermore, the dataset includes the derived robot-centric conceptual knowledge using the proposed framework. The application of the conceptual knowledge about objects is then evaluated by examining its usefulness in a tool substitution scenario.
Collapse
Affiliation(s)
- Madhura Thosar
- Faculty of Computer Science, Institute for Intelligent Cooperating Systems, Otto-von-Guericke University Magdeburg, Magdeburg, Germany
| | - Christian A Mueller
- Robotics, Computer Science & Electrical Engineering Department, Jacobs University, Bremen, Germany
| | - Georg Jäger
- Institute for Computer Science, Technische Universität Bergakademie Freiberg, Freiberg, Germany
| | - Johannes Schleiss
- Faculty of Computer Science, Institute for Intelligent Cooperating Systems, Otto-von-Guericke University Magdeburg, Magdeburg, Germany
| | - Narender Pulugu
- Faculty of Computer Science, Institute for Intelligent Cooperating Systems, Otto-von-Guericke University Magdeburg, Magdeburg, Germany
| | - Ravi Mallikarjun Chennaboina
- Faculty of Computer Science, Institute for Intelligent Cooperating Systems, Otto-von-Guericke University Magdeburg, Magdeburg, Germany
| | - Sai Vivek Rao Jeevangekar
- Faculty of Computer Science, Institute for Intelligent Cooperating Systems, Otto-von-Guericke University Magdeburg, Magdeburg, Germany
| | - Andreas Birk
- Robotics, Computer Science & Electrical Engineering Department, Jacobs University, Bremen, Germany
| | - Max Pfingsthorn
- OFFIS Institute for Information Technology, Oldenburg, Germany
| | - Sebastian Zug
- Institute for Computer Science, Technische Universität Bergakademie Freiberg, Freiberg, Germany
| |
Collapse
|
39
|
Mustile M, Giocondo F, Caligiore D, Borghi AM, Kourtis D. Motor Inhibition to Dangerous Objects: Electrophysiological Evidence for Task-dependent Aversive Affordances. J Cogn Neurosci 2021; 33:826-839. [PMID: 33571078 DOI: 10.1162/jocn_a_01690] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Previous work suggests that perception of an object automatically facilitates actions related to object grasping and manipulation. Recently, the notion of automaticity has been challenged by behavioral studies suggesting that dangerous objects elicit aversive affordances that interfere with encoding of an object's motor properties; however, related EEG studies have provided little support for these claims. We sought EEG evidence that would support the operation of an inhibitory mechanism that interferes with the motor encoding of dangerous objects, and we investigated whether such mechanism would be modulated by the perceived distance of an object and the goal of a given task. EEGs were recorded by 24 participants who passively perceived dangerous and neutral objects in their peripersonal, boundary, or extrapersonal space and performed either a reachability judgment task or a categorization task. Our results showed that greater attention, reflected in the visual P1 potential, was drawn by dangerous and reachable objects. Crucially, a frontal N2 potential, associated with motor inhibition, was larger for dangerous objects only when participants performed a reachability judgment task. Furthermore, a larger parietal P3b potential for dangerous objects indicated the greater difficulty in linking a dangerous object to the appropriate response, especially when it was located in the participants' extrapersonal space. Taken together, our results show that perception of dangerous objects elicits aversive affordances in a task-dependent way and provides evidence for the operation of a neural mechanism that does not code affordances of dangerous objects automatically, but rather on the basis of contextual information.
Collapse
Affiliation(s)
| | | | | | - Anna M Borghi
- National Research Council, Rome, Italy.,Sapienza University of Rome, Italy
| | | |
Collapse
|
40
|
Randerath J, Finkel L, Shigaki C, Burris J, Nanda A, Hwang P, Frey SH. Is This Within Reach? Left but Not Right Brain Damage Affects Affordance Judgment Tendencies. Front Hum Neurosci 2021; 14:531893. [PMID: 33584218 PMCID: PMC7873490 DOI: 10.3389/fnhum.2020.531893] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2020] [Accepted: 11/23/2020] [Indexed: 11/22/2022] Open
Abstract
The ability to judge accurately whether or not an action can be accomplished successfully is critical for selecting appropriate response options that enable adaptive behaviors. Such affordance judgments are thought to rely on the perceived fit between environmental properties and knowledge of one's current physical capabilities. Little, however, is currently known about the ability of individuals to judge their own affordances following a stroke, or about the underlying neural mechanisms involved. To address these issues, we employed a signal detection approach to investigate the impact of left or right hemisphere injuries on judgments of whether a visual object was located within reach while remaining still (i.e., reachability). Regarding perceptual sensitivity and accuracy in judging reachability, there were no significant group differences between healthy controls (N = 29), right brain damaged (RBD, N = 17) and left brain damaged stroke patients (LBD, N = 17). However, while healthy controls and RBD patients demonstrated a negative response criterion and thus overestimated their reach capability, LBD patients' average response criterion converged to zero, indicating no judgment tendency. Critically, the LBD group's judgment tendency pattern is consistent with previous findings in this same sample on an affordance judgment task that required estimating whether the hand can fit through apertures (Randerath et al., 2018). Lesion analysis suggests that this loss of judgment tendency may be associated with damage to the left insula, the left parietal and middle temporal lobe. Based on these results, we propose that damage to the left ventro-dorsal stream disrupts the retrieval and processing of a stable criterion, leading to stronger reliance on intact on-line body-perceptive processes computed within the preserved bilateral dorsal network.
Collapse
Affiliation(s)
- Jennifer Randerath
- Department of Psychology, University of Konstanz, Konstanz, Germany.,Lurija Institute for Rehabilitation Science and Health Research, Kliniken Schmieder, Allensbach, Germany.,Department of Psychological Sciences, University of Missouri, Columbia, MO, United States
| | - Lisa Finkel
- Department of Psychology, University of Konstanz, Konstanz, Germany.,Lurija Institute for Rehabilitation Science and Health Research, Kliniken Schmieder, Allensbach, Germany
| | - Cheryl Shigaki
- Department of Physical Medicine and Rehabilitation, University of Missouri, Columbia, MO, United States
| | - Joe Burris
- Department of Physical Medicine and Rehabilitation, University of Missouri, Columbia, MO, United States
| | - Ashish Nanda
- Department of Neurology, University Hospital, Columbia, MO, United States.,Stroke and Neurointerventional SSM Neurosciences, St. Clare Hospital, Fenton, MO, United States.,Department of Neurology, Saint Louis University Hospital, St. Louis, MO, United States
| | - Peter Hwang
- Department of Physical Medicine and Rehabilitation, University of Missouri, Columbia, MO, United States
| | - Scott H Frey
- Department of Psychological Sciences, University of Missouri, Columbia, MO, United States.,Department of Physical Medicine and Rehabilitation, University of Missouri, Columbia, MO, United States
| |
Collapse
|
41
|
Ianì F. Embodied cognition: So flexible as to be "disembodied"? Conscious Cogn 2021; 88:103075. [PMID: 33493962 DOI: 10.1016/j.concog.2021.103075] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2020] [Revised: 12/21/2020] [Accepted: 12/31/2020] [Indexed: 11/20/2022]
Abstract
This review aims to explore what I call the "Embodiment Cost Hypothesis" (ECH), according to which, when humans "embody" a part of the world other than their bodies, a measurable cost is detectable on their real bodies. The review analyzes experimental evidence in favor of the ECH by examining studies from different research fields, including studies of action observation (2), tool-use (3), rubber hand illusion (4), and full-body illusions (5). In light of this literature, this review argues that embodiment effects can profitably be seen as phenomena associated with both benefits (resulting from the embodiment of external objects/bodies) and costs (resulting from the disembodiment at various levels of the subject's own body). Implications are discussed in relation to the ongoing debate on the embodied cognition (EC) approach.
Collapse
Affiliation(s)
- Francesco Ianì
- Università di Torino, Dipartimento di Psicologia, Via Verdi, 10, 10123 Turin, Italy.
| |
Collapse
|
42
|
Lopez A, Germani A, Tinella L, Caffò AO, Postma A, Bosco A. The Road More Travelled: The Differential Effects of Spatial Experience in Young and Elderly Participants. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2021; 18:E709. [PMID: 33467572 PMCID: PMC7830856 DOI: 10.3390/ijerph18020709] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/01/2020] [Revised: 01/07/2021] [Accepted: 01/12/2021] [Indexed: 02/06/2023]
Abstract
Our spatial mental representations allow us to give refined descriptions of the environment in terms of the relative locations and distances between objects and landmarks. In this study, we investigated the effects of familiarity with the everyday environment, in terms of frequency of exploration and mode of transportation, on categorical and coordinate spatial relations, on young and elderly participants, controlling for socio-demographic factors. Participants were tested with a general anamnesis, a neuropsychological assessment, measures of explorations and the Landmark Positioning on a Map task. The results showed: (a) a modest difference in performance with categorical spatial relations; (b) a larger difference in coordinate spatial relations; (c) a significant moderating effect of age on the relationship between familiarity and spatial relations, with a stronger relation among the elderly than the young. Ceteris paribus, the role of direct experience with exploring their hometown on spatial mental representations appeared to be more important in the elderly than in the young. This advantage appears to make the elderly wiser and likely protects them from the detrimental effects of aging on spatial mental representations.
Collapse
Affiliation(s)
- Antonella Lopez
- Department of Educational Sciences, Psychology, Communication, University of Bari, 70121 Bari, Italy; (L.T.); (A.O.C.); (A.B.)
| | - Alessandro Germani
- Department of Philosophy, Social Sciences and Education, University of Perugia, 06123 Perugia, Italy;
| | - Luigi Tinella
- Department of Educational Sciences, Psychology, Communication, University of Bari, 70121 Bari, Italy; (L.T.); (A.O.C.); (A.B.)
| | - Alessandro Oronzo Caffò
- Department of Educational Sciences, Psychology, Communication, University of Bari, 70121 Bari, Italy; (L.T.); (A.O.C.); (A.B.)
| | - Albert Postma
- Helmholtz Institute, Experimental Psychology, Utrecht University, 3584 CS Utrecht, The Netherlands;
| | - Andrea Bosco
- Department of Educational Sciences, Psychology, Communication, University of Bari, 70121 Bari, Italy; (L.T.); (A.O.C.); (A.B.)
| |
Collapse
|
43
|
Ferretti G. A distinction concerning vision-for-action and affordance perception. Conscious Cogn 2021; 87:103028. [PMID: 33412389 DOI: 10.1016/j.concog.2020.103028] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2020] [Revised: 07/27/2020] [Accepted: 09/26/2020] [Indexed: 01/03/2023]
Abstract
In this paper, I offer a discussion concerning the conceptual connection between the notion of vision-for-action and the one of affordance perception. I first analyze the notion of vision-for-action. I then analyze a notion usually coupled with it: the notion of affordance perception, the main insights behind which are guiding several current neuroscientific enterprises and the related philosophical speculations. Then, I argue that we should not couple these two notions with a light heart: though these two processes can be, from a theoretical point of view, related, we should be careful in inferring the actual and effective occurrence of the latter in the presence of the former. This will be done by carrying out a conceptual analysis of the experimental evidence coming from the 'Two Visual Systems Model', which is the main reference in the literature on affordance perception and vision-for-action. My point has strong philosophical implications for our view concerning the best interpretation of how vision-for-action really works, and the specific relation it actually entertains with affordance perception.
Collapse
Affiliation(s)
- Gabriele Ferretti
- Eikones - Center for the Theory and History of the Image, University of Basel, Rheinsprung 11, 4051 Basel, Switzerland; Institute for Philosophy II, Ruhr-University Bochum, GA 3/151, Universitätsstr. 150, 44780 Bochum, Germany.
| |
Collapse
|
44
|
Federico G, Osiurak F, Brandimonte MA. Hazardous tools: the emergence of reasoning in human tool use. PSYCHOLOGICAL RESEARCH 2021; 85:3108-3118. [PMID: 33404904 DOI: 10.1007/s00426-020-01466-2] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2020] [Accepted: 12/14/2020] [Indexed: 02/03/2023]
Abstract
Humans are unique in the way they understand the causal relationships between the use of tools and achieving a goal. The idea at the core of the present research is that tool use can be considered as an instance of problem-solving situations supported by technical reasoning. In an eye-tracking study, we investigated the fixation patterns of participants (N = 32) looking at 3D images of thematically consistent (e.g., nail-steel hammer) and thematically inconsistent (e.g., scarf-steel hammer) object-tool pairs that could be either "hazardous" (accidentally electrified) or not. Results showed that under thematically consistent conditions, participants focused on the tool's manipulation area (e.g., the handle of a steel hammer). However, when electrified tools were present or when the visual scene was not action-prompting, regardless of the presence of electricity, the tools' functional/identity areas (e.g., the head of a steel hammer) were fixated longer than the tools' manipulation areas. These results support an integrated and reasoning-based approach to human tool use and document, for the first time, the crucial role of mechanical/semantic knowledge in tool visual exploration.
Collapse
Affiliation(s)
| | - François Osiurak
- Laboratoire d'Etude des Mécanismes Cognitifs, Université de Lyon, Lyon, France
- Institut Universitaire de France, Paris, France
| | - Maria A Brandimonte
- Laboratory of Experimental Psychology, Suor Orsola Benincasa University, Naples, Italy
| |
Collapse
|
45
|
Quesque F, Foncelle A, Chabanat É, Jacquin-Courtois S, Rossetti Y. Take a Seat and Get Into Its Shoes! When Humans Spontaneously Represent Visual Scenes From the Point of View of Inanimate Objects. Perception 2020; 49:1333-1347. [PMID: 33302777 DOI: 10.1177/0301006620976980] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Human description of the surrounding world may spontaneously rely on others' perspective, which is a crucial component of social cognition. In five studies, participants were asked to describe the spatial relations between objects in visual scenes including, or not, other agents. In Experiment 1, a substantial proportion of participants used an other-centered perspective in the presence of another agent, replicating classical findings. To our own surprise, we also observed that an even greater number of participants used an other-centered perspective when the human agent was replaced by an armchair. In order to explore this phenomenon, Experiments 2 to 5 compared the respective strength of chair-centered and agent-centered perspectives and/or set them into conflict. A significant proportion of participants spontaneously took the seat's perspective even when it may not be sat on (Experiments 3 and 4) and even when the seat was not referred to (Experiments 4 and 5). Altogether, these findings suggest that perspective taking may spontaneously apply to inanimate objects. These results question whether such tendencies originate from social cognitive skills-as classically assumed-or reveal a nonsocial phenomenon. Future works should specifically test the widely assumed social nature of spontaneous perspective-taking.
Collapse
Affiliation(s)
- François Quesque
- Centre de Recherche en Neurosciences de Lyon, France; Hôpital Henry-Gabrielle, Hospices Civils de Lyon, France
| | - Alexandre Foncelle
- Centre de Recherche en Neurosciences de Lyon, France; Hôpital Henry-Gabrielle, Hospices Civils de Lyon, France
| | - Éric Chabanat
- Centre de Recherche en Neurosciences de Lyon, France; Hôpital Henry-Gabrielle, Hospices Civils de Lyon, France
| | - Sophie Jacquin-Courtois
- Centre de Recherche en Neurosciences de Lyon, France; Hôpital Henry-Gabrielle, Hospices Civils de Lyon, France
| | - Yves Rossetti
- Centre de Recherche en Neurosciences de Lyon, France; Hôpital Henry-Gabrielle, Hospices Civils de Lyon, France
| |
Collapse
|
46
|
Osiurak F, Federico G, Brandimonte MA, Reynaud E, Lesourd M. On the Temporal Dynamics of Tool Use. Front Hum Neurosci 2020; 14:579378. [PMID: 33364928 PMCID: PMC7750203 DOI: 10.3389/fnhum.2020.579378] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2020] [Accepted: 11/06/2020] [Indexed: 12/27/2022] Open
Affiliation(s)
- François Osiurak
- Laboratoire d'Etude des Mécanismes Cognitifs, Université de Lyon, Lyon, France
- Institut Universitaire de France, Paris, France
| | - Giovanni Federico
- Laboratory of Experimental Psychology, Suor Orsola Benincasa University, Naples, Italy
| | - Maria A. Brandimonte
- Laboratory of Experimental Psychology, Suor Orsola Benincasa University, Naples, Italy
| | - Emanuelle Reynaud
- Laboratoire d'Etude des Mécanismes Cognitifs, Université de Lyon, Lyon, France
| | - Mathieu Lesourd
- Laboratoire de Psychologie, Université de Bourgogne Franche-Comté, Besançon, France
| |
Collapse
|
47
|
Ortenzi V, Cini F, Pardi T, Marturi N, Stolkin R, Corke P, Controzzi M. The Grasp Strategy of a Robot Passer Influences Performance and Quality of the Robot-Human Object Handover. Front Robot AI 2020; 7:542406. [PMID: 33501313 PMCID: PMC7806048 DOI: 10.3389/frobt.2020.542406] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2020] [Accepted: 08/31/2020] [Indexed: 11/13/2022] Open
Abstract
Task-aware robotic grasping is critical if robots are to successfully cooperate with humans. The choice of a grasp is multi-faceted; however, the task to perform primes this choice in terms of hand shaping and placement on the object. This grasping strategy is particularly important for a robot companion, as it can potentially hinder the success of the collaboration with humans. In this work, we investigate how different grasping strategies of a robot passer influence the performance and the perceptions of the interaction of a human receiver. Our findings suggest that a grasping strategy that accounts for the subsequent task of the receiver improves substantially the performance of the human receiver in executing the subsequent task. The time to complete the task is reduced by eliminating the need of a post-handover re-adjustment of the object. Furthermore, the human perceptions of the interaction improve when a task-oriented grasping strategy is adopted. The influence of the robotic grasp strategy increases as the constraints induced by the object's affordances become more restrictive. The results of this work can benefit the wider robotics community, with application ranging from industrial to household human-robot interaction for cooperative and collaborative object manipulation.
Collapse
Affiliation(s)
- Valerio Ortenzi
- Extreme Robotics Laboratory, School of Metallurgy and Materials, University of Birmingham, Birmingham, United Kingdom
| | - Francesca Cini
- The BioRobotics Institute, Scuola Superiore Sant'Anna, Pisa, Italy
- Department of Excellence in Robotics and Artificial Intelligence (AI), Scuola Superiore Sant'Anna, Pisa, Italy
| | - Tommaso Pardi
- Extreme Robotics Laboratory, School of Metallurgy and Materials, University of Birmingham, Birmingham, United Kingdom
| | - Naresh Marturi
- Extreme Robotics Laboratory, School of Metallurgy and Materials, University of Birmingham, Birmingham, United Kingdom
| | - Rustam Stolkin
- Extreme Robotics Laboratory, School of Metallurgy and Materials, University of Birmingham, Birmingham, United Kingdom
| | - Peter Corke
- Australian Research Council (ARC) Centre of Excellence for Robotic Vision, Queensland University of Technology, Brisbane, QLD, Australia
| | - Marco Controzzi
- The BioRobotics Institute, Scuola Superiore Sant'Anna, Pisa, Italy
- Department of Excellence in Robotics and Artificial Intelligence (AI), Scuola Superiore Sant'Anna, Pisa, Italy
| |
Collapse
|
48
|
The elephant in the China shop: When technical reasoning meets cumulative technological culture. Behav Brain Sci 2020; 43:e183. [PMID: 32772979 DOI: 10.1017/s0140525x20000291] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
The commentaries have both revealed the implications of and challenged our approach. In this response, we reply to these concerns, discuss why the technical-reasoning hypothesis does not minimize the role of social-learning mechanisms - nor assume that technical-reasoning skills make individuals omniscient technically - and make suggestions for overcoming the classical opposition between the cultural versus cognitive niche hypothesis of cumulative technological culture.
Collapse
|
49
|
Osiurak F, Lesourd M, Navarro J, Reynaud E. Technition: When Tools Come Out of the Closet. PERSPECTIVES ON PSYCHOLOGICAL SCIENCE 2020; 15:880-897. [DOI: 10.1177/1745691620902145] [Citation(s) in RCA: 22] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
People are ambivalently enthusiastic and anxious about how far technology can go. Therefore, understanding the neurocognitive bases of the human technical mind should be a major topic of the cognitive sciences. Surprisingly, however, scientists are not interested in this topic or address it only marginally in other mainstream domains (e.g., motor control, action observation, social cognition). In fact, this lack of interest may hinder our understanding of the necessary neurocognitive skills underlying our appetence for transforming our physical environment. Here, we develop the thesis that our technical mind originates in perhaps uniquely human neurocognitive skills, namely, technical-reasoning skills involving the area PF within the left inferior parietal lobe. This thesis creates an epistemological rupture with the state of the art that justifies the emergence of a new field in the cognitive sciences (i.e., technition) dedicated to the intelligence hidden behind tools and other forms of technologies, including constructions.
Collapse
Affiliation(s)
- François Osiurak
- Laboratoire d’Etude des Mécanismes Cognitifs, Université de Lyon
- Institut Universitaire de France
| | - Mathieu Lesourd
- Laboratoire de Psychologie, Université de Bourgogne Franche-Comté
| | - Jordan Navarro
- Laboratoire d’Etude des Mécanismes Cognitifs, Université de Lyon
- Institut Universitaire de France
| | | |
Collapse
|
50
|
Is a letterbox always a letterbox? The role of affordances in guiding perceptual categorization. PSYCHOLOGICAL RESEARCH 2020; 85:1673-1684. [PMID: 32279095 DOI: 10.1007/s00426-020-01328-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2019] [Accepted: 03/24/2020] [Indexed: 10/24/2022]
Abstract
Classically investigated in the context of judgment tasks about achievable actions, affordances have also been investigated in the context of the stimulus-response compatibility paradigm. Earlier work showed that perceptual categorization performance is significantly faster and more accurate when the orientation of the graspable part of a presented object, and the orientation of the participant's response are compatible, suggesting that the main function of affordances is restricted to action preparation. Here, we investigate the potential role of affordances in the categorization of ambiguous stimuli through a stimulus-response compatibility paradigm. In other words, we investigate if in ambiguous situations, such as ones in which a stimulus may give rise to two percepts, affordances would stabilize perception on one of these two and, therefore, helps in the subsequent categorizations. Two experiments were run, based on the forced-choice stimulus-response compatibility (SRC) paradigm, with a progressive series of ambiguous (bistable) lateral-graspable objects. In Experiment 1, subjects responded by pressing horizontally opposite keyboard keys, while in Experiment 2, the keyboard keys were vertically separated. Experiment 1 found that subjects perceived the initial object in a bistable series for longer, and exhibited greater response stability in compatible than incompatible situations. In Experiment 2, none of these modulations were significant. Overall, our results show that affordances operationalized through a SRC paradigm modulated how subjects categorized ambiguous stimuli. We argue that affordances may play a substantial role in ambiguous contexts by reducing the uncertainty of such situations.
Collapse
|