1
|
Liu S, Yu L, Ren J, Zhang M, Luo W. The neural representation of body orientation and emotion from biological motion. Neuroimage 2025; 310:121163. [PMID: 40118232 DOI: 10.1016/j.neuroimage.2025.121163] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2024] [Revised: 01/16/2025] [Accepted: 03/18/2025] [Indexed: 03/23/2025] Open
Abstract
The perception of human body orientation and emotion in others provides crucial insights into their intentions. While significant research has explored the brain's representation of body orientation and emotion processing, their possible combined representation remains less well understood. In this study, functional magnetic resonance imaging was employed to investigate this issue. Participants were shown point-light displays and tasked with recognizing both body emotion and orientation. The analysis of functional activation revealed that the extrastriate body area encodesd emotion, while the precentral gyrus and postcentral gyrus encoded body orientation. Additionally, results from multivariate pattern analysis and representational similarity analysis demonstrated that the lingual gyrus, precentral gyrus, and postcentral gyrus played a critical role in processing body orientation, whereas the lingual gyrus and extrastriate body area were crucial for processing emotion. Furthermore, the commonality analysis found that the neural representations of emotion and body orientation in the lingual and precentral gyrus were not interacting, but rather competing. Lastly, a remarkable interaction between hemisphere and body orientation revealed in the connection analysis showed that the coupling between the inferior parietal lobule and the left precentral gyrus was more sensitive to a 90° body orientation, while the coupling between the inferior parietal lobule and the right precentral gyrus was sensitive to 0° and 45° body orientation. Overall, these findings suggest that the conflicted relationship between the neural representation of body orientation and emotion in LING and PreCG when point-light displays were shown, and the different hemispheres play different role in encoding different body orientations.
Collapse
Affiliation(s)
- Shuaicheng Liu
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian 116029, China; Key Laboratory of Brain and Cognitive Neuroscience, Liaoning Province, Dalian 116029, China
| | - Lu Yu
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian 116029, China; Key Laboratory of Brain and Cognitive Neuroscience, Liaoning Province, Dalian 116029, China
| | - Jie Ren
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian 116029, China; Key Laboratory of Brain and Cognitive Neuroscience, Liaoning Province, Dalian 116029, China
| | - Mingming Zhang
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian 116029, China; Key Laboratory of Brain and Cognitive Neuroscience, Liaoning Province, Dalian 116029, China.
| | - Wenbo Luo
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian 116029, China; Key Laboratory of Brain and Cognitive Neuroscience, Liaoning Province, Dalian 116029, China.
| |
Collapse
|
2
|
Bellot E, Vandenberghe A, Vannuscorps G. Models of actor-specific range of motion are encoded in the extrastriate body area. Cereb Cortex 2025; 35:bhaf027. [PMID: 40103359 DOI: 10.1093/cercor/bhaf027] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2024] [Revised: 01/16/2025] [Accepted: 01/20/2025] [Indexed: 03/20/2025] Open
Abstract
Models of actor-specific range of motion (or biomechanical limits) shapes perception and (inter)actions. This functional magnetic resonance imaging study tested the hypothesis that these models are encoded in the extrastriate body area. Participants were first introduced with the maximal amplitude of arm and leg movements of a "rigid" and a "flexible" actor. Then, we measured the blood oxygenation level dependent response in 25 participants while they watched video clips depicting these actors performing either "small" movements that were "possible" to perform for both actors, "large" ones that were "impossible" for both actors and "intermediate" ones that were possible only for the "flexible" actor. Results aligned with the 2 predictions of our hypothesis: (i) extrastriate body area responded more strongly to impossible than possible movements; (ii) extrastriate body area categorized intermediate movements as "possible" or "impossible" depending on each actor's specific range of motion. The results of additional analyses suggested that extrastriate body area encodes actor-specific range of motion at the level of specific body parts, and as a probability function. Finally, the results of whole brain and functional connectivity analyses suggested that the right posterior superior temporal sulcus may also play an important role in encoding information about actor-specific biomechanical limits.
Collapse
Affiliation(s)
- Emmanuelle Bellot
- Psychological Sciences Research Institute, Université catholique de Louvain, Place Cardinal Mercier 10, 1348 Louvain-la-Neuve, Belgium
| | - Antoine Vandenberghe
- Psychological Sciences Research Institute, Université catholique de Louvain, Place Cardinal Mercier 10, 1348 Louvain-la-Neuve, Belgium
| | - Gilles Vannuscorps
- Psychological Sciences Research Institute, Université catholique de Louvain, Place Cardinal Mercier 10, 1348 Louvain-la-Neuve, Belgium
- Institute of Neuroscience, Université catholique de Louvain, Avenue E. Mounier 53, 1200 Woluwe-Saint-Lambert, Belgium
| |
Collapse
|
3
|
Cortinovis D, Peelen MV, Bracci S. Tool Representations in Human Visual Cortex. J Cogn Neurosci 2025; 37:515-531. [PMID: 39620956 DOI: 10.1162/jocn_a_02281] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/29/2025]
Abstract
Tools such as pens, forks, and scissors play an important role in many daily-life activities, an importance underscored by the presence in visual cortex of a set of tool-selective brain regions. This review synthesizes decades of neuroimaging research that investigated the representational spaces in the visual ventral stream for objects, such as tools, that are specifically characterized by action-related properties. Overall, results reveal a dissociation between representational spaces in ventral and lateral occipito-temporal cortex (OTC). While lateral OTC encodes both visual (shape) and action-related properties of objects, distinguishing between objects acting as end-effectors (e.g., tools, hands) versus similar noneffector manipulable objects (e.g., a glass), ventral OTC primarily represents objects' visual features such as their surface properties (e.g., material and texture). These areas act in concert with regions outside of OTC to support object interaction and tool use. The parallel investigation of the dimensions underlying object representations in artificial neural networks reveals both the possibilities and the difficulties in capturing the action-related dimensions that distinguish tools from other objects. Although artificial neural networks offer promise as models of visual cortex computations, challenges persist in replicating the action-related dimensions that go beyond mere visual features. Taken together, we propose that regions in OTC support the representation of tools based on a behaviorally relevant action code and suggest future paths to generate a computational model of this object space.
Collapse
|
4
|
Schnittjer AJ, Simon JE, Whittier TT, Grooms DR. The Neuroplastic Outcomes from Impaired Sensory Expectations (NOISE) hypothesis: How ACL dysfunction impacts sensory perception and knee stability. Musculoskelet Sci Pract 2025; 75:103222. [PMID: 39586196 PMCID: PMC11750607 DOI: 10.1016/j.msksp.2024.103222] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/17/2024] [Revised: 11/15/2024] [Accepted: 11/17/2024] [Indexed: 11/27/2024]
Abstract
BACKGROUND The anterior cruciate ligament (ACL) is integral to maintaining knee joint stability but is susceptible to rupture during physical activity. Despite surgical restoration of passive or mechanical stability, patients struggle to regain strength and prior level of function. Recent efforts have focused on understanding how ACL-related changes in the nervous system contribute to deficits in sensorimotor control following injury and reconstruction. We hypothesize that these challenges are partially due to an increase in sensorimotor uncertainty, a state that reduces the precision of movement control. OBJECTIVES This review proposes the ACL NOISE (Neuroplastic Outcomes from Impaired Sensory Expectations) hypothesis, reframing current literature to provide a case that increased sensory noise following ACL injury and reconstruction disrupts sensory predictions, which are anticipations of immediate sensory outcomes or motor commands. This disruption in sensory predictions may contribute to altered neurophysiology, such as cross-modal brain activity, and other persistent clinical deficits. DESIGN Narrative review RESULTS/FINDINGS: Following ACL injury and reconstruction, the knee and nervous system experience various neurophysiological alterations to overcome elevated sensory uncertainty and inaccurate sensory predictions, contributing to persistent motor deficits. CONCLUSIONS We provide a theoretical case based on compelling evidence that suggests prolonged impairment after ACL injury may be secondary to uncertainty in knee sensory perception. Future research should consider testing the NOISE hypothesis by creating a paradigm that examines dynamic joint stability in response to unexpected perturbations. This approach would help assess motor coordination errors and drive the development of clinical strategies aimed at reducing sensory uncertainty following ACL reconstruction.
Collapse
Affiliation(s)
- Amber J Schnittjer
- Translational Biomedical Sciences, Graduate College, Ohio University, Athens, OH, USA; Ohio Musculoskeletal and Neurological Institute (OMNI), Ohio University, Athens, OH, USA.
| | - Janet E Simon
- Ohio Musculoskeletal and Neurological Institute (OMNI), Ohio University, Athens, OH, USA; Department of Athletic Training, College of Health Sciences and Professions, Ohio University, Athens, OH, USA
| | - Tyler T Whittier
- Department of Food Systems, Nutrition, & Kinesiology, College of Education, Health, & Human Development, Montana State University, Bozeman, MT, USA
| | - Dustin R Grooms
- Ohio Musculoskeletal and Neurological Institute (OMNI), Ohio University, Athens, OH, USA; Department of Physical Therapy, College of Health Sciences and Professions, Ohio University, Athens, OH, USA
| |
Collapse
|
5
|
Gonzalez Alam TRJ, Krieger-Redwood K, Varga D, Gao Z, Horner AJ, Hartley T, Thiebaut de Schotten M, Sliwinska M, Pitcher D, Margulies DS, Smallwood J, Jefferies E. A double dissociation between semantic and spatial cognition in visual to default network pathways. eLife 2025; 13:RP94902. [PMID: 39841127 PMCID: PMC11753780 DOI: 10.7554/elife.94902] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/23/2025] Open
Abstract
Processing pathways between sensory and default mode network (DMN) regions support recognition, navigation, and memory but their organisation is not well understood. We show that functional subdivisions of visual cortex and DMN sit at opposing ends of parallel streams of information processing that support visually mediated semantic and spatial cognition, providing convergent evidence from univariate and multivariate task responses, intrinsic functional and structural connectivity. Participants learned virtual environments consisting of buildings populated with objects, drawn from either a single semantic category or multiple categories. Later, they made semantic and spatial context decisions about these objects and buildings during functional magnetic resonance imaging. A lateral ventral occipital to fronto-temporal DMN pathway was primarily engaged by semantic judgements, while a medial visual to medial temporal DMN pathway supported spatial context judgements. These pathways had distinctive locations in functional connectivity space: the semantic pathway was both further from unimodal systems and more balanced between visual and auditory-motor regions compared with the spatial pathway. When semantic and spatial context information could be integrated (in buildings containing objects from a single category), regions at the intersection of these pathways responded, suggesting that parallel processing streams interact at multiple levels of the cortical hierarchy to produce coherent memory-guided cognition.
Collapse
Affiliation(s)
- Tirso RJ Gonzalez Alam
- Department of Psychology, University of YorkNorth YorkshireUnited Kingdom
- York Neuroimaging Centre, Innovation Way, HeslingtonNorth YorkshireUnited Kingdom
- School of Human and Behavioural Sciences, Bangor University, Gwynedd, Wales, UKYorkUnited Kingdom
| | - Katya Krieger-Redwood
- Department of Psychology, University of YorkNorth YorkshireUnited Kingdom
- York Neuroimaging Centre, Innovation Way, HeslingtonNorth YorkshireUnited Kingdom
| | - Dominika Varga
- Sussex Neuroscience, School of Psychology, University of SussexBrighton and HoveUnited States
| | - Zhiyao Gao
- Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine StanfordStanfordUnited Kingdom
| | - Aidan J Horner
- Department of Psychology, University of YorkNorth YorkshireUnited Kingdom
- York Neuroimaging Centre, Innovation Way, HeslingtonNorth YorkshireUnited Kingdom
| | - Tom Hartley
- Department of Psychology, University of YorkNorth YorkshireUnited Kingdom
- York Neuroimaging Centre, Innovation Way, HeslingtonNorth YorkshireUnited Kingdom
| | - Michel Thiebaut de Schotten
- University of Bordeaux, CNRS, CEA, IMNBordeauxFrance
- Brain Connectivity and Behaviour Laboratory, Sorbonne UniversitiesParisFrance
| | - Magdalena Sliwinska
- Department of Psychology, Liverpool John Moores UniversityLiverpoolUnited Kingdom
| | - David Pitcher
- Department of Psychology, University of YorkNorth YorkshireUnited Kingdom
- York Neuroimaging Centre, Innovation Way, HeslingtonNorth YorkshireUnited Kingdom
| | - Daniel S Margulies
- Integrative Neuroscience and Cognition Center (UMR 8002), Centre National de la Recherche Scientifique (CNRS) and Université de ParisParisFrance
| | | | - Elizabeth Jefferies
- Department of Psychology, University of YorkNorth YorkshireUnited Kingdom
- York Neuroimaging Centre, Innovation Way, HeslingtonNorth YorkshireUnited Kingdom
| |
Collapse
|
6
|
Hussain A, Walbrin J, Tochadse M, Almeida J. Primary manipulation knowledge of objects is associated with the functional coupling of pMTG and aIPS. Neuropsychologia 2024; 205:109034. [PMID: 39536937 DOI: 10.1016/j.neuropsychologia.2024.109034] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2024] [Revised: 10/10/2024] [Accepted: 11/10/2024] [Indexed: 11/16/2024]
Abstract
Correctly using hand-held tools and manipulable objects typically relies not only on sensory and motor-related processes, but also centrally on conceptual knowledge about how objects are typically used (e.g. grasping the handle of a kitchen knife rather than the blade avoids injury). A wealth of fMRI connectivity-related evidence demonstrates that contributions from both ventral and dorsal stream areas are important for accurate tool knowledge and use. Here, we investigate the combined role of ventral and dorsal stream areas in representing "primary" manipulation knowledge - that is, knowledge that is hypothesized to be of central importance for day-to-day object use. We operationalize primary manipulation knowledge by extracting the first dimension from a multi-dimensional scaling solution over a behavioral judgement task where subjects arranged a set of 80 manipulable objects based on their overall manipulation similarity. We then relate this dimension to representational and time-course correlations between ventral and dorsal stream areas. Our results show that functional coupling between posterior middle temporal gyrus (pMTG) and anterior intraparietal sulcus (aIPS) is uniquely related to primary manipulation knowledge about objects, and that this effect is more pronounced for objects that require precision grasping. We reason this is due to precision-grasp objects requiring more ventral/temporal information relating to object shape, material and function to allow correct finger placement and controlled manipulation. These results demonstrate the importance of functional coupling across these ventral and dorsal stream areas in service of manipulation knowledge and accurate grasp-related behavior.
Collapse
Affiliation(s)
- Akbar Hussain
- Proaction Laboratory, Faculty of Psychology and Educational Sciences, University of Coimbra, Portugal; CINEICC, Faculty of Psychology and Educational Sciences, University of Coimbra, Portugal; Department of Cognitive Sciences, University of California, Irvine, California 92697-5100, USA
| | - Jon Walbrin
- Proaction Laboratory, Faculty of Psychology and Educational Sciences, University of Coimbra, Portugal; CINEICC, Faculty of Psychology and Educational Sciences, University of Coimbra, Portugal
| | - Marija Tochadse
- Charité - Universitätsmedizin Berlin (Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health), Department of Psychiatry and Psychotherapy, Berlin, Germany
| | - Jorge Almeida
- Proaction Laboratory, Faculty of Psychology and Educational Sciences, University of Coimbra, Portugal; CINEICC, Faculty of Psychology and Educational Sciences, University of Coimbra, Portugal.
| |
Collapse
|
7
|
Puce A. From Motion to Emotion: Visual Pathways and Potential Interconnections. J Cogn Neurosci 2024; 36:2594-2617. [PMID: 38527078 PMCID: PMC11416577 DOI: 10.1162/jocn_a_02141] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/27/2024]
Abstract
The two visual pathway description of Ungerleider and Mishkin changed the course of late 20th century systems and cognitive neuroscience. Here, I try to reexamine our laboratory's work through the lens of the Pitcher and Ungerleider new third visual pathway. I also briefly review the literature related to brain responses to static and dynamic visual displays, visual stimulation involving multiple individuals, and compare existing models of social information processing for the face and body. In this context, I examine how the posterior STS might generate unique social information relative to other brain regions that also respond to social stimuli. I discuss some of the existing challenges we face with assessing how information flow progresses between structures in the proposed functional pathways and how some stimulus types and experimental designs may have complicated our data interpretation and model generation. I also note a series of outstanding questions for the field. Finally, I examine the idea of a potential expansion of the third visual pathway, to include aspects of previously proposed "lateral" visual pathways. Doing this would yield a more general entity for processing motion/action (i.e., "[inter]action") that deals with interactions between people, as well as people and objects. In this framework, a brief discussion of potential hemispheric biases for function, and different forms of neuropsychological impairments created by focal lesions in the posterior brain is highlighted to help situate various brain regions into an expanded [inter]action pathway.
Collapse
|
8
|
Ren J, Zhang M, Liu S, He W, Luo W. Maintenance of Bodily Expressions Modulates Functional Connectivity Between Prefrontal Cortex and Extrastriate Body Area During Working Memory Processing. Brain Sci 2024; 14:1172. [PMID: 39766371 PMCID: PMC11674776 DOI: 10.3390/brainsci14121172] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2024] [Revised: 11/13/2024] [Accepted: 11/21/2024] [Indexed: 01/11/2025] Open
Abstract
Background/Objectives: As a form of visual input, bodily expressions can be maintained and manipulated in visual working memory (VWM) over a short period of time. While the prefrontal cortex (PFC) plays an indispensable role in top-down control, it remains largely unclear whether this region also modulates the VWM storage of bodily expressions during a delay period. Therefore, the two primary goals of this study were to examine whether the emotional bodies would elicit heightened brain activity among areas such as the PFC and extrastriate body area (EBA) and whether the emotional effects subsequently modulate the functional connectivity patterns for active maintenance during delay periods. Methods: During functional magnetic resonance imaging (fMRI) scanning, participants performed a delayed-response task in which they were instructed to view and maintain a body stimulus in working memory before emotion categorization (happiness, anger, and neutral). If processing happy and angry bodies consume increased cognitive demands, stronger PFC activation and its functional connectivity with perceptual areas would be observed. Results: Results based on univariate and multivariate analyses conducted on the data collected during stimulus presentation revealed an enhanced processing of the left PFC and left EBA. Importantly, subsequent functional connectivity analyses performed on delayed-period data using a psychophysiological interaction model indicated that functional connectivity between the PFC and EBA increases for happy and angry bodies compared to neutral bodies. Conclusions: The emotion-modulated coupling between the PFC and EBA during maintenance deepens our understanding of the functional organization underlying the VWM processing of bodily information.
Collapse
Affiliation(s)
- Jie Ren
- Key Laboratory of Brain and Cognitive Neuroscience, Liaoning Province, Dalian 116029, China; (J.R.); (M.Z.); (S.L.); (W.H.)
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian 116029, China
| | - Mingming Zhang
- Key Laboratory of Brain and Cognitive Neuroscience, Liaoning Province, Dalian 116029, China; (J.R.); (M.Z.); (S.L.); (W.H.)
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian 116029, China
| | - Shuaicheng Liu
- Key Laboratory of Brain and Cognitive Neuroscience, Liaoning Province, Dalian 116029, China; (J.R.); (M.Z.); (S.L.); (W.H.)
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian 116029, China
| | - Weiqi He
- Key Laboratory of Brain and Cognitive Neuroscience, Liaoning Province, Dalian 116029, China; (J.R.); (M.Z.); (S.L.); (W.H.)
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian 116029, China
| | - Wenbo Luo
- Key Laboratory of Brain and Cognitive Neuroscience, Liaoning Province, Dalian 116029, China; (J.R.); (M.Z.); (S.L.); (W.H.)
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian 116029, China
| |
Collapse
|
9
|
Cocuzza CV, Sanchez-Romero R, Ito T, Mill RD, Keane BP, Cole MW. Distributed network flows generate localized category selectivity in human visual cortex. PLoS Comput Biol 2024; 20:e1012507. [PMID: 39436929 PMCID: PMC11530028 DOI: 10.1371/journal.pcbi.1012507] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2023] [Revised: 11/01/2024] [Accepted: 09/24/2024] [Indexed: 10/25/2024] Open
Abstract
A central goal of neuroscience is to understand how function-relevant brain activations are generated. Here we test the hypothesis that function-relevant brain activations are generated primarily by distributed network flows. We focused on visual processing in human cortex, given the long-standing literature supporting the functional relevance of brain activations in visual cortex regions exhibiting visual category selectivity. We began by using fMRI data from N = 352 human participants to identify category-specific responses in visual cortex for images of faces, places, body parts, and tools. We then systematically tested the hypothesis that distributed network flows can generate these localized visual category selective responses. This was accomplished using a recently developed approach for simulating - in a highly empirically constrained manner - the generation of task-evoked brain activations by modeling activity flowing over intrinsic brain connections. We next tested refinements to our hypothesis, focusing on how stimulus-driven network interactions initialized in V1 generate downstream visual category selectivity. We found evidence that network flows directly from V1 were sufficient for generating visual category selectivity, but that additional, globally distributed (whole-cortex) network flows increased category selectivity further. Using null network architectures we also found that each region's unique intrinsic "connectivity fingerprint" was key to the generation of category selectivity. These results generalized across regions associated with all four visual categories tested (bodies, faces, places, and tools), and provide evidence that the human brain's intrinsic network organization plays a prominent role in the generation of functionally relevant, localized responses.
Collapse
Affiliation(s)
- Carrisa V. Cocuzza
- Center for Molecular and Behavioral Neuroscience, Rutgers University, Newark, New Jersey, United States of America
- Behavioral and Neural Sciences PhD Program, Rutgers University, Newark, New Jersey, United States of America
- Department of Psychology, Yale University, New Haven, Connecticut, United States of America
- Department of Psychiatry, Brain Health Institute, Rutgers University, Piscataway, New Jersey, United States of America
| | - Ruben Sanchez-Romero
- Center for Molecular and Behavioral Neuroscience, Rutgers University, Newark, New Jersey, United States of America
| | - Takuya Ito
- Department of Psychiatry, Yale University School of Medicine, New Haven, Connecticut, United States of America
| | - Ravi D. Mill
- Center for Molecular and Behavioral Neuroscience, Rutgers University, Newark, New Jersey, United States of America
| | - Brian P. Keane
- Department of Psychiatry and Neuroscience, University of Rochester Medical Center, Rochester, New York, United States of America
- Center for Visual Science, University of Rochester, Rochester, New York, United States of America
- Department of Brain and Cognitive Science, University of Rochester, Rochester, New York, United States of America
| | - Michael W. Cole
- Center for Molecular and Behavioral Neuroscience, Rutgers University, Newark, New Jersey, United States of America
| |
Collapse
|
10
|
Oswald F, Samra SK. A scoping review and index of body stimuli in psychological science. Behav Res Methods 2024; 56:5434-5455. [PMID: 38030921 DOI: 10.3758/s13428-023-02278-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/20/2023] [Indexed: 12/01/2023]
Abstract
Naturalistic body stimuli are necessary for understanding many aspects of human psychology, yet there are no centralized databases of body stimuli. Furthermore, there are a high number of independently developed stimulus sets lacking in standardization and reproducibility potential, and a general lack of organization, contributing to issues of both replicability and generalizability in body-related research. We conducted a comprehensive scoping review to index and explore existing naturalistic whole-body stimuli. Our research questions were as follows: (1) What sets of naturalistic human whole-body stimuli are present in the literature? And (2) On what factors (e.g., demographics, emotion expression) do these stimuli vary? To be included, stimulus sets had to (1) include human bodies as stimuli; (2) be photographs, videos, or other depictions of real human bodies (not computer generated, drawn, etc.); (3) include the whole body (defined as torso, arms, and legs); and (4) could include edited images, but still had to be recognizable as human bodies. We identified a relatively large number of existing stimulus sets (N = 79) which offered relative variability in terms of main manipulated factors and the degree of visual information included (i.e., inclusion of heads and/or faces). However, stimulus sets were demographically homogenous, skewed towards White, young adult, and female bodies. We identified significant issues in reporting and availability practices, posing a challenge to the generalizability, reliability, and reproducibility of body-related research. Accordingly, we urge researchers to adopt transparent and accessible practices and to take steps to diversify body stimuli.
Collapse
Affiliation(s)
- Flora Oswald
- Department of Psychology, The Pennsylvania State University, University Park, PA, USA.
- Department of Women's, Gender, and Sexuality Studies, The Pennsylvania State University, University Park, PA, USA.
- Department of Psychological Sciences, University of Connecticut, Storrs, CT, USA.
- Department of Psychology, University of Denver, Denver, CO, USA.
| | | |
Collapse
|
11
|
Bach P, Frank C, Kunde W. Why motor imagery is not really motoric: towards a re-conceptualization in terms of effect-based action control. PSYCHOLOGICAL RESEARCH 2024; 88:1790-1804. [PMID: 36515699 PMCID: PMC11315751 DOI: 10.1007/s00426-022-01773-w] [Citation(s) in RCA: 18] [Impact Index Per Article: 18.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2021] [Accepted: 11/11/2022] [Indexed: 12/15/2022]
Abstract
Overt and imagined action seem inextricably linked. Both have similar timing, activate shared brain circuits, and motor imagery influences overt action and vice versa. Motor imagery is, therefore, often assumed to recruit the same motor processes that govern action execution, and which allow one to play through or simulate actions offline. Here, we advance a very different conceptualization. Accordingly, the links between imagery and overt action do not arise because action imagery is intrinsically motoric, but because action planning is intrinsically imaginistic and occurs in terms of the perceptual effects one want to achieve. Seen like this, the term 'motor imagery' is a misnomer of what is more appropriately portrayed as 'effect imagery'. In this article, we review the long-standing arguments for effect-based accounts of action, which are often ignored in motor imagery research. We show that such views provide a straightforward account of motor imagery. We review the evidence for imagery-execution overlaps through this new lens and argue that they indeed emerge because every action we execute is planned, initiated and controlled through an imagery-like process. We highlight findings that this new view can now explain and point out open questions.
Collapse
Affiliation(s)
- Patric Bach
- School of Psychology, University of Aberdeen, William Guild Building, Kings College, Aberdeen, UK.
| | - Cornelia Frank
- Department of Sports and Movement Science, School of Educational and Cultural Studies, Osnabrück University, Osnabrück, Germany
| | - Wilfried Kunde
- Department of Psychology, Julius-Maximilians-Universität Würzburg, Röntgenring 11, Würzburg, Germany
| |
Collapse
|
12
|
Ten Brink AF, España MF, Navarro V, Dijkerman HC, Bultitude JH. Investigating Object Affordance in People with Complex Regional Pain Syndrome: No Alterations in the Automatic Activation of Motor Plans. THE JOURNAL OF PAIN 2024; 25:104479. [PMID: 38246251 DOI: 10.1016/j.jpain.2024.01.344] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/21/2023] [Revised: 01/05/2024] [Accepted: 01/15/2024] [Indexed: 01/23/2024]
Abstract
Complex Regional Pain Syndrome (CRPS) is a condition of chronic pain, predominantly affecting one limb. CRPS is characterised by motor changes including slowed or uncoordinated movements. Cognitive processes that drive movement planning and/or execution might contribute to these changes. We aimed to investigate the potential alterations to such cognitive mechanisms using an 'object affordance' paradigm. Object affordance refers to the observation that viewing an object modulates associated motor responses, presumably due to the automatic activation of a motor plan. We hypothesised that people with CRPS would show reduced object affordance effects for their affected compared to unaffected hand, and compared to pain-free controls. First, we validated an online object affordance task involving button press responses to everyday objects with handles, in pain-free participants (n = 63; Experiment 1). Object affordance was reflected by faster and more accurate responses when the object handle was aligned to the responding hand ("aligned") compared to when the handle was aligned to the other hand ("non-aligned"). These results were similar for the online task as when administered in person. Second, in a case-control study, we administered the online object affordance task to people with CRPS predominantly affecting the upper limb (n = 25), and age-matched pain-free controls (n = 68; Experiment 2). People with CRPS responded faster and more accurately in the aligned versus non-aligned condition (ie, an object affordance effect), both for the affected and unaffected hands. There were no differences to pain-free participants. Therefore, object affordance effects were seen in people with CRPS, providing no evidence for altered motor planning. PERSPECTIVE: This article presents research investigating cognitive processes related to motor planning in Complex Regional Pain Syndrome (CRPS). Using an online object affordance paradigm, validated in pain-free controls, the authors found that people with CRPS showed intact object affordance effects in the affected and unaffected hand, suggesting unaltered motor planning. DATA AVAILABILITY: The experiment materials, data, pre-processing scripts, and analysis scripts can be found via Open Science Framework (https://osf.io/nc825/files/osfstorage).
Collapse
Affiliation(s)
- Antonia F Ten Brink
- Department of Experimental Psychology, Helmholtz Institute, Utrecht University, the Netherlands
| | - María F España
- Department of Experimental Psychology, Helmholtz Institute, Utrecht University, the Netherlands
| | - Valentina Navarro
- Department of Experimental Psychology, Helmholtz Institute, Utrecht University, the Netherlands
| | - Hendrik Chris Dijkerman
- Department of Experimental Psychology, Helmholtz Institute, Utrecht University, the Netherlands
| | - Janet H Bultitude
- Department of Psychology, University of Bath, Bath, United Kingdom; Department of Psychology, Centre for Pain Research, University of Bath, Bath, United Kingdom
| |
Collapse
|
13
|
Zhu H, Ge Y, Bratch A, Yuille A, Kay K, Kersten D. Natural scenes reveal diverse representations of 2D and 3D body pose in the human brain. Proc Natl Acad Sci U S A 2024; 121:e2317707121. [PMID: 38830105 PMCID: PMC11181088 DOI: 10.1073/pnas.2317707121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2023] [Accepted: 04/25/2024] [Indexed: 06/05/2024] Open
Abstract
Human pose, defined as the spatial relationships between body parts, carries instrumental information supporting the understanding of motion and action of a person. A substantial body of previous work has identified cortical areas responsive to images of bodies and different body parts. However, the neural basis underlying the visual perception of body part relationships has received less attention. To broaden our understanding of body perception, we analyzed high-resolution fMRI responses to a wide range of poses from over 4,000 complex natural scenes. Using ground-truth annotations and an application of three-dimensional (3D) pose reconstruction algorithms, we compared similarity patterns of cortical activity with similarity patterns built from human pose models with different levels of depth availability and viewpoint dependency. Targeting the challenge of explaining variance in complex natural image responses with interpretable models, we achieved statistically significant correlations between pose models and cortical activity patterns (though performance levels are substantially lower than the noise ceiling). We found that the 3D view-independent pose model, compared with two-dimensional models, better captures the activation from distinct cortical areas, including the right posterior superior temporal sulcus (pSTS). These areas, together with other pose-selective regions in the LOTC, form a broader, distributed cortical network with greater view-tolerance in more anterior patches. We interpret these findings in light of the computational complexity of natural body images, the wide range of visual tasks supported by pose structures, and possible shared principles for view-invariant processing between articulated objects and ordinary, rigid objects.
Collapse
Affiliation(s)
- Hongru Zhu
- Department of Cognitive Science, Johns Hopkins University, Baltimore, MD21218
| | - Yijun Ge
- Department of Psychology, University of Minnesota, Minneapolis, MN55455
- Laboratory for Consciousness, Riken Center for Brain Science, Wako, Saitama3510198, Japan
| | - Alexander Bratch
- Department of Psychology, University of Minnesota, Minneapolis, MN55455
| | - Alan Yuille
- Department of Cognitive Science, Johns Hopkins University, Baltimore, MD21218
| | - Kendrick Kay
- Center for Magnetic Resonance Research, Department of Radiology, University of Minnesota, Minneapolis, MN55455
| | - Daniel Kersten
- Department of Psychology, University of Minnesota, Minneapolis, MN55455
| |
Collapse
|
14
|
Monaco S, Menghi N, Crawford JD. Action-specific feature processing in the human cortex: An fMRI study. Neuropsychologia 2024; 194:108773. [PMID: 38142960 DOI: 10.1016/j.neuropsychologia.2023.108773] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2023] [Revised: 11/29/2023] [Accepted: 12/18/2023] [Indexed: 12/26/2023]
Abstract
Sensorimotor integration involves feedforward and reentrant processing of sensory input. Grasp-related motor activity precedes and is thought to influence visual object processing. Yet, while the importance of reentrant feedback is well established in perception, the top-down modulations for action and the neural circuits involved in this process have received less attention. Do action-specific intentions influence the processing of visual information in the human cortex? Using a cue-separation fMRI paradigm, we found that action-specific instruction processing (manual alignment vs. grasp) became apparent only after the visual presentation of oriented stimuli, and occurred as early as in the primary visual cortex and extended to the dorsal visual stream, motor and premotor areas. Further, dorsal stream area aIPS, known to be involved in object manipulation, and the primary visual cortex showed task-related functional connectivity with frontal, parietal and temporal areas, consistent with the idea that reentrant feedback from dorsal and ventral visual stream areas modifies visual inputs to prepare for action. Importantly, both the task-dependent modulations and connections were linked specifically to the object presentation phase of the task, suggesting a role in processing the action goal. Our results show that intended manual actions have an early, pervasive, and differential influence on the cortical processing of vision.
Collapse
Affiliation(s)
- Simona Monaco
- CIMeC - Center for Mind/Brain Sciences, University of Trento, Rovereto (TN), Italy.
| | - Nicholas Menghi
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - J Douglas Crawford
- Center for Vision Research, York University, Toronto, Ontario M3J 1P3, Canada; Vision: Science to Applications (VISTA) Program, Neuroscience Graduate Diploma Program and Departments of Psychology, Biology, and Kinesiology and Health Science, York University, Toronto, Ontario M3J 1P3, Canada
| |
Collapse
|
15
|
Kabulska Z, Zhuang T, Lingnau A. Overlapping representations of observed actions and action-related features. Hum Brain Mapp 2024; 45:e26605. [PMID: 38379447 PMCID: PMC10879913 DOI: 10.1002/hbm.26605] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2023] [Revised: 12/21/2023] [Accepted: 01/12/2024] [Indexed: 02/22/2024] Open
Abstract
The lateral occipitotemporal cortex (LOTC) has been shown to capture the representational structure of a smaller range of actions. In the current study, we carried out an fMRI experiment in which we presented human participants with images depicting 100 different actions and used representational similarity analysis (RSA) to determine which brain regions capture the semantic action space established using judgments of action similarity. Moreover, to determine the contribution of a wide range of action-related features to the neural representation of the semantic action space we constructed an action feature model on the basis of ratings of 44 different features. We found that the semantic action space model and the action feature model are best captured by overlapping activation patterns in bilateral LOTC and ventral occipitotemporal cortex (VOTC). An RSA on eight dimensions resulting from principal component analysis carried out on the action feature model revealed partly overlapping representations within bilateral LOTC, VOTC, and the parietal lobe. Our results suggest spatially overlapping representations of the semantic action space of a wide range of actions and the corresponding action-related features. Together, our results add to our understanding of the kind of representations along the LOTC that support action understanding.
Collapse
Affiliation(s)
- Zuzanna Kabulska
- Faculty of Human Sciences, Institute of Psychology, Chair of Cognitive NeuroscienceUniversity of RegensburgRegensburgGermany
| | - Tonghe Zhuang
- Faculty of Human Sciences, Institute of Psychology, Chair of Cognitive NeuroscienceUniversity of RegensburgRegensburgGermany
| | - Angelika Lingnau
- Faculty of Human Sciences, Institute of Psychology, Chair of Cognitive NeuroscienceUniversity of RegensburgRegensburgGermany
| |
Collapse
|
16
|
Ciorli T, Pia L. Spatial perspective and identity in visual awareness of the bodily self-other distinction. Sci Rep 2023; 13:14994. [PMID: 37696861 PMCID: PMC10495455 DOI: 10.1038/s41598-023-42107-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2023] [Accepted: 09/05/2023] [Indexed: 09/13/2023] Open
Abstract
Spatial perspective and identity of visual bodily stimuli are two key cues for the self-other distinction. However, how they emerge into visual awareness is largely unknown. Here, self- or other-hands presented in first- or third-person perspective were compared in a breaking-Continuous Flash Suppression paradigm (Experiment 1) measuring the time the stimuli need to access visual awareness, and in a Binocular Rivalry paradigm (Experiment 2), measuring predominance in perceptual awareness. Results showed that, irrespectively of identity, first-person perspective speeded up the access, whereas the third-person one increased the dominance. We suggest that the effect of first-person perspective represents an unconscious prioritization of an egocentric body coding important for visuomotor control. On the other hand, the effect of third-person perspective indicates a conscious advantage of an allocentric body representation fundamental for detecting the presence of another intentional agent. Summarizing, the emergence of self-other distinction into visual awareness would strongly depend on the interplay between spatial perspectives, with an inverse prioritization before and after conscious perception. On the other hand, identity features might rely on post-perceptual processes.
Collapse
Affiliation(s)
- Tommaso Ciorli
- SAMBA (SpAtial, Motor and Bodily Awareness) Research Group, Department of Psychology, University of Turin, Via Verdi 10, 10123, Turin, Italy
| | - Lorenzo Pia
- SAMBA (SpAtial, Motor and Bodily Awareness) Research Group, Department of Psychology, University of Turin, Via Verdi 10, 10123, Turin, Italy.
- NIT (Neuroscience Institute of Turin), Turin, Italy.
| |
Collapse
|
17
|
Li C, Ficco L, Trapp S, Rostalski SM, Korn L, Kovács G. The effect of context congruency on fMRI repetition suppression for objects. Neuropsychologia 2023; 188:108603. [PMID: 37270029 DOI: 10.1016/j.neuropsychologia.2023.108603] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2022] [Revised: 05/31/2023] [Accepted: 05/31/2023] [Indexed: 06/05/2023]
Abstract
The recognition of objects is strongly facilitated when they are presented in the context of other objects (Biederman, 1972). Such contexts facilitate perception and induce expectations of context-congruent objects (Trapp and Bar, 2015). The neural mechanisms underlying these facilitatory effects of context on object processing, however, are not yet fully understood. In the present study, we investigate how context-induced expectations affect subsequent object processing. We used functional magnetic resonance imaging and measured repetition suppression as a proxy for prediction error processing. Participants viewed pairs of alternating or repeated object images which were preceded by context-congruent, context-incongruent or neutral cues. We found a stronger repetition suppression in congruent as compared to incongruent or neutral cues in the object sensitive lateral occipital cortex. Interestingly, this stronger effect was driven by enhanced responses to alternating stimulus pairs in the congruent contexts, rather than by suppressed responses to repeated stimulus pairs, which emphasizes the contribution of surprise-related response enhancement for the context modulation on RS when expectations are violated. In addition, in the congruent condition, we discovered significant functional connectivity between object-responsive and frontal cortical regions, as well as between object-responsive regions and the fusiform gyrus. Our findings indicate that prediction errors, reflected in enhanced brain responses to violated contextual expectations, underlie the facilitating effect of context during object perception.
Collapse
Affiliation(s)
- Chenglin Li
- School of Psychology, Zhejiang Normal University, China; Department of Biological Psychology and Cognitive Neurosciences, Institute of Psychology, Friedrich-Schiller-Universität Jena, Germany
| | - Linda Ficco
- Department of General Psychology and Cognitive Neuroscience, Institute of Psychology, Friedrich-Schiller-Universität Jena, Germany; Department of Linguistics and Cultural Evolution, International Max Planck Research School for the Science of Human History, Jena, Germany
| | - Sabrina Trapp
- Macromedia University of Applied Sciences, Munich, Germany
| | - Sophie-Marie Rostalski
- Department of Biological Psychology and Cognitive Neurosciences, Institute of Psychology, Friedrich-Schiller-Universität Jena, Germany
| | - Lukas Korn
- Department of Biological Psychology and Cognitive Neurosciences, Institute of Psychology, Friedrich-Schiller-Universität Jena, Germany
| | - Gyula Kovács
- Department of Biological Psychology and Cognitive Neurosciences, Institute of Psychology, Friedrich-Schiller-Universität Jena, Germany.
| |
Collapse
|
18
|
Rens G, Figley TD, Gallivan JP, Liu Y, Culham JC. Grasping with a Twist: Dissociating Action Goals from Motor Actions in Human Frontoparietal Circuits. J Neurosci 2023; 43:5831-5847. [PMID: 37474309 PMCID: PMC10423047 DOI: 10.1523/jneurosci.0009-23.2023] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2023] [Revised: 05/23/2023] [Accepted: 06/23/2023] [Indexed: 07/22/2023] Open
Abstract
In daily life, prehension is typically not the end goal of hand-object interactions but a precursor for manipulation. Nevertheless, functional MRI (fMRI) studies investigating manual manipulation have primarily relied on prehension as the end goal of an action. Here, we used slow event-related fMRI to investigate differences in neural activation patterns between prehension in isolation and prehension for object manipulation. Sixteen (seven males and nine females) participants were instructed either to simply grasp the handle of a rotatable dial (isolated prehension) or to grasp and turn it (prehension for object manipulation). We used representational similarity analysis (RSA) to investigate whether the experimental conditions could be discriminated from each other based on differences in task-related brain activation patterns. We also used temporal multivoxel pattern analysis (tMVPA) to examine the evolution of regional activation patterns over time. Importantly, we were able to differentiate isolated prehension and prehension for manipulation from activation patterns in the early visual cortex, the caudal intraparietal sulcus (cIPS), and the superior parietal lobule (SPL). Our findings indicate that object manipulation extends beyond the putative cortical grasping network (anterior intraparietal sulcus, premotor and motor cortices) to include the superior parietal lobule and early visual cortex.SIGNIFICANCE STATEMENT A simple act such as turning an oven dial requires not only that the CNS encode the initial state (starting dial orientation) of the object but also the appropriate posture to grasp it to achieve the desired end state (final dial orientation) and the motor commands to achieve that state. Using advanced temporal neuroimaging analysis techniques, we reveal how such actions unfold over time and how they differ between object manipulation (turning a dial) versus grasping alone. We find that a combination of brain areas implicated in visual processing and sensorimotor integration can distinguish between the complex and simple tasks during planning, with neural patterns that approximate those during the actual execution of the action.
Collapse
Affiliation(s)
- Guy Rens
- Department of Psychology, University of Western Ontario, London, Ontario N6A 5C2, Canada
- Laboratorium voor Neuro- en Psychofysiologie, Department of Neurosciences, Katholieke Universiteit Leuven, Leuven 3000, Belgium
- Leuven Brain Institute, Katholieke Universiteit Leuven, Leuven 3000, Belgium
| | - Teresa D Figley
- Graduate Program in Neuroscience, University of Western Ontario, London, Ontario N6A 5C2, Canada
| | - Jason P Gallivan
- Departments of Psychology & Biomedical and Molecular Sciences, Centre for Neuroscience Studies, Queen's University, Kingston, Ontario K7L 3N6, Canada
| | - Yuqi Liu
- Department of Neuroscience, Georgetown University Medical Center, Washington, DC 20057
- Institute of Neuroscience, Chinese Academy of Sciences Center for Excellence in Brain Sciences and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China
| | - Jody C Culham
- Department of Psychology, University of Western Ontario, London, Ontario N6A 5C2, Canada
- Graduate Program in Neuroscience, University of Western Ontario, London, Ontario N6A 5C2, Canada
| |
Collapse
|
19
|
Li YL, Liu X, Wu X, Li Y, Qiu Z, Xu L, Xu Y, Fang HS, Lu C. HAKE: A Knowledge Engine Foundation for Human Activity Understanding. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 2023; 45:8494-8506. [PMID: 37819797 DOI: 10.1109/tpami.2022.3232797] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/13/2023]
Abstract
Human activity understanding is of widespread interest in artificial intelligence and spans diverse applications like health care and behavior analysis. Although there have been advances with deep learning, it remains challenging. The object recognition-like solutions usually try to map pixels to semantics directly, but activity patterns are much different from object patterns, thus hindering another success. In this article, we propose a novel paradigm to reformulate this task in two-stage: first mapping pixels to an intermediate space spanned by atomic activity primitives, then programming detected primitives with interpretable logic rules to infer semantics. To afford a representative primitive space, we build a knowledge base including 26+ M primitive labels and logic rules from human priors or automatic discovering. Our framework, Human Activity Knowledge Engine (HAKE), exhibits superior generalization ability and performance upon canonical methods on challenging benchmarks. Code and data are available at http://hake-mvig.cn/.
Collapse
|
20
|
Yizhar O, Tal Z, Amedi A. Loss of action-related function and connectivity in the blind extrastriate body area. Front Neurosci 2023; 17:973525. [PMID: 36968509 PMCID: PMC10035577 DOI: 10.3389/fnins.2023.973525] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2022] [Accepted: 02/23/2023] [Indexed: 03/11/2023] Open
Abstract
The Extrastriate Body Area (EBA) participates in the visual perception and motor actions of body parts. We recently showed that EBA’s perceptual function develops independently of visual experience, responding to stimuli with body-part information in a supramodal fashion. However, it is still unclear if the EBA similarly maintains its action-related function. Here, we used fMRI to study motor-evoked responses and connectivity patterns in the congenitally blind brain. We found that, unlike the case of perception, EBA does not develop an action-related response without visual experience. In addition, we show that congenital blindness alters EBA’s connectivity profile in a counterintuitive way—functional connectivity with sensorimotor cortices dramatically decreases, whereas connectivity with perception-related visual occipital cortices remains high. To the best of our knowledge, we show for the first time that action-related functions and connectivity in the visual cortex could be contingent on visuomotor experience. We further discuss the role of the EBA within the context of visuomotor control and predictive coding theory.
Collapse
Affiliation(s)
- Or Yizhar
- Department of Cognitive and Brain Sciences, The Hebrew University of Jerusalem, Jerusalem, Israel
- Ivcher School of Psychology, The Institute for Brain, Mind and Technology, Reichman University, Herzliya, Israel
- Research Group Adaptive Memory and Decision Making, Max Planck Institute for Human Development, Berlin, Germany
- *Correspondence: Or Yizhar,
| | - Zohar Tal
- Faculty of Psychology and Educational Sciences, University of Coimbra, Coimbra, Portugal
| | - Amir Amedi
- Ivcher School of Psychology, The Institute for Brain, Mind and Technology, Reichman University, Herzliya, Israel
- The Ruth & Meir Rosenthal Brain Imaging Center, Reichman University, Herzliya, Israel
| |
Collapse
|
21
|
Soyuhos O, Baldauf D. Functional connectivity fingerprints of the frontal eye field and inferior frontal junction suggest spatial versus nonspatial processing in the prefrontal cortex. Eur J Neurosci 2023; 57:1114-1140. [PMID: 36789470 DOI: 10.1111/ejn.15936] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2022] [Revised: 01/28/2023] [Accepted: 02/08/2023] [Indexed: 02/16/2023]
Abstract
Neuroimaging evidence suggests that the frontal eye field (FEF) and inferior frontal junction (IFJ) govern the encoding of spatial and nonspatial (such as feature- or object-based) representations, respectively, both during visual attention and working memory tasks. However, it is still unclear whether such contrasting functional segregation is also reflected in their underlying functional connectivity patterns. Here, we hypothesized that FEF has predominant functional coupling with spatiotopically organized regions in the dorsal ('where') visual stream whereas IFJ has predominant functional connectivity with the ventral ('what') visual stream. We applied seed-based functional connectivity analyses to temporally high-resolving resting-state magnetoencephalography (MEG) recordings. We parcellated the brain according to the multimodal Glasser atlas and tested, for various frequency bands, whether the spontaneous activity of each parcel in the ventral and dorsal visual pathway has predominant functional connectivity with FEF or IFJ. The results show that FEF has a robust power correlation with the dorsal visual pathway in beta and gamma bands. In contrast, anterior IFJ (IFJa) has a strong power coupling with the ventral visual stream in delta, beta and gamma oscillations. Moreover, while FEF is phase-coupled with the superior parietal lobe in the beta band, IFJa is phase-coupled with the middle and inferior temporal cortex in delta and gamma oscillations. We argue that these intrinsic connectivity fingerprints are congruent with each brain region's function. Therefore, we conclude that FEF and IFJ have dissociable connectivity patterns that fit their respective functional roles in spatial versus nonspatial top-down attention and working memory control.
Collapse
Affiliation(s)
- Orhan Soyuhos
- Centre for Mind/Brain Sciences (CIMeC), University of Trento, Trento, Italy.,Center for Neuroscience, University of California, Davis, California, USA
| | - Daniel Baldauf
- Centre for Mind/Brain Sciences (CIMeC), University of Trento, Trento, Italy
| |
Collapse
|
22
|
Atilgan H, Koi JXJ, Wong E, Laakso I, Matilainen N, Pasqualotto A, Tanaka S, Chen SHA, Kitada R. Functional relevance of the extrastriate body area for visual and haptic object recognition: a preregistered fMRI-guided TMS study. Cereb Cortex Commun 2023; 4:tgad005. [PMID: 37188067 PMCID: PMC10176024 DOI: 10.1093/texcom/tgad005] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2023] [Revised: 03/22/2023] [Accepted: 03/27/2023] [Indexed: 05/17/2023] Open
Abstract
The extrastriate body area (EBA) is a region in the lateral occipito-temporal cortex (LOTC), which is sensitive to perceived body parts. Neuroimaging studies suggested that EBA is related to body and tool processing, regardless of the sensory modalities. However, how essential this region is for visual tool processing and nonvisual object processing remains a matter of controversy. In this preregistered fMRI-guided repetitive transcranial magnetic stimulation (rTMS) study, we examined the causal involvement of EBA in multisensory body and tool recognition. Participants used either vision or haptics to identify 3 object categories: hands, teapots (tools), and cars (control objects). Continuous theta-burst stimulation (cTBS) was applied over left EBA, right EBA, or vertex (control site). Performance for visually perceived hands and teapots (relative to cars) was more strongly disrupted by cTBS over left EBA than over the vertex, whereas no such object-specific effect was observed in haptics. The simulation of the induced electric fields confirmed that the cTBS affected regions including EBA. These results indicate that the LOTC is functionally relevant for visual hand and tool processing, whereas the rTMS over EBA may differently affect object recognition between the 2 sensory modalities.
Collapse
Affiliation(s)
- Hicret Atilgan
- Psychology, School of Social Sciences, Nanyang Technological University, 48 Nanyang Avenue, Singapore 639818, Singapore
| | - J X Janice Koi
- Psychology, School of Social Sciences, Nanyang Technological University, 48 Nanyang Avenue, Singapore 639818, Singapore
| | - Ern Wong
- IMT School for Advanced Studies Lucca, Piazza S. Francesco, 19, 55100 Lucca LU, Italy
| | - Ilkka Laakso
- Department of Electrical Engineering and Automation, Aalto University, Otakaari 3, 02150 Espoo, Finland
| | - Noora Matilainen
- Department of Electrical Engineering and Automation, Aalto University, Otakaari 3, 02150 Espoo, Finland
| | - Achille Pasqualotto
- Faculty of Human Sciences, University of Tsukuba, 1-1-1 Tennodai, Tsukuba, Ibaraki 305-8577, Japan
| | - Satoshi Tanaka
- Department of Psychology, Hamamatsu University School of Medicine, 1-20-1 Handayama, Higashi Ward, Hamamatsu, Shizuoka 431-3192, Japan
| | - S H Annabel Chen
- Psychology, School of Social Sciences, Nanyang Technological University, 48 Nanyang Avenue, Singapore 639818, Singapore
- Centre for Research and Development in Learning, Nanyang Technological University, 61 Nanyang Drive, Singapore 637335, Singapore
- Lee Kong Chian School of Medicine (LKCMedicine), Nanyang Technological University, 11 Mandalay Road, Singapore 308232, Singapore
| | - Ryo Kitada
- Corresponding author: Graduate School of Intercultural Studies, Kobe University, 12-1 Tsurukabuto, Nada Ward, Kobe, Hyogo 657-0013, Japan.
| |
Collapse
|
23
|
Abagnale C, Di Renzo A, Sebastianelli G, Casillo F, Tinelli E, Giuliani G, Tullo MG, Serrao M, Parisi V, Fiorelli M, Caramia F, Schoenen J, Di Piero V, Coppola G. Whole brain surface-based morphometry and tract-based spatial statistics in migraine with aura patients: difference between pure visual and complex auras. Front Hum Neurosci 2023; 17:1146302. [PMID: 37144161 PMCID: PMC10151576 DOI: 10.3389/fnhum.2023.1146302] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Accepted: 04/03/2023] [Indexed: 05/06/2023] Open
Abstract
Background The migrainous aura has different clinical phenotypes. While the various clinical differences are well-described, little is known about their neurophysiological underpinnings. To elucidate the latter, we compared white matter fiber bundles and gray matter cortical thickness between healthy controls (HC), patients with pure visual auras (MA) and patients with complex neurological auras (MA+). Methods 3T MRI data were collected between attacks from 20 patients with MA and 15 with MA+, and compared with those from 19 HCs. We analyzed white matter fiber bundles using tract-based spatial statistics (TBSS) of diffusion tensor imaging (DTI) and cortical thickness with surface-based morphometry of structural MRI data. Results Tract-based spatial statistics showed no significant difference in diffusivity maps between the three subject groups. As compared to HCs, both MA and MA+ patients had significant cortical thinning in temporal, frontal, insular, postcentral, primary and associative visual areas. In the MA group, the right high-level visual-information-processing areas, including lingual gyrus, and the Rolandic operculum were thicker than in HCs, while in the MA+ group they were thinner. Discussion These findings show that migraine with aura is associated with cortical thinning in multiple cortical areas and that the clinical heterogeneity of the aura is reflected by opposite thickness changes in high-level visual-information-processing, sensorimotor and language areas.
Collapse
Affiliation(s)
- Chiara Abagnale
- Department of Medico-Surgical Sciences and Biotechnologies, Sapienza University of Rome Polo Pontino ICOT, Latina, Italy
| | | | - Gabriele Sebastianelli
- Department of Medico-Surgical Sciences and Biotechnologies, Sapienza University of Rome Polo Pontino ICOT, Latina, Italy
| | - Francesco Casillo
- Department of Medico-Surgical Sciences and Biotechnologies, Sapienza University of Rome Polo Pontino ICOT, Latina, Italy
| | - Emanuele Tinelli
- Unit of Neuroradiology, Department of Medical and Surgical Sciences, Magna Græcia University, Catanzaro, Italy
| | - Giada Giuliani
- Department of Human Neurosciences, Sapienza University of Rome, Rome, Italy
| | - Maria Giulia Tullo
- Department of Human Neurosciences, Sapienza University of Rome, Rome, Italy
| | - Mariano Serrao
- Department of Medico-Surgical Sciences and Biotechnologies, Sapienza University of Rome Polo Pontino ICOT, Latina, Italy
| | | | - Marco Fiorelli
- Department of Human Neurosciences, Sapienza University of Rome, Rome, Italy
| | - Francesca Caramia
- Department of Human Neurosciences, Sapienza University of Rome, Rome, Italy
| | - Jean Schoenen
- Headache Research Unit, Department of Neurology, CHU de Liège, Citadelle Hospital, Liège, Belgium
| | - Vittorio Di Piero
- Department of Human Neurosciences, Sapienza University of Rome, Rome, Italy
| | - Gianluca Coppola
- Department of Medico-Surgical Sciences and Biotechnologies, Sapienza University of Rome Polo Pontino ICOT, Latina, Italy
- *Correspondence: Gianluca Coppola,
| |
Collapse
|
24
|
Lustenhouwer R, Cameron IG, van Alfen N, Toni I, Geurts AC, van Engelen BG, Groothuis JT, Helmich RC. Cerebral Adaptation Associated with Peripheral Nerve Recovery in Neuralgic Amyotrophy: A Randomized Controlled Trial. Neurorehabil Neural Repair 2023; 37:3-15. [PMID: 36575812 PMCID: PMC9896536 DOI: 10.1177/15459683221145149] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/29/2022]
Abstract
BACKGROUND Neuralgic amyotrophy (NA) is a common peripheral nerve disorder caused by auto-immune inflammation of nerves in the brachial plexus territory, characterized by acute pain and weakness of the shoulder muscles, followed by motor impairment. Recent work has confirmed that NA patients with residual motor dysfunction have abnormal cerebral sensorimotor representations of their affected upper extremity. OBJECTIVE To determine whether abnormal cerebral sensorimotor representations associated with NA can be altered by specialized, multidisciplinary outpatient rehabilitation focused on relearning motor control. METHODS 27 NA patients with residual lateralized symptoms in the right upper extremity participated in a randomized controlled trial, comparing 17 weeks of multidisciplinary rehabilitation (n = 16) to usual care (n = 11). We used task-based functional MRI and a hand laterality judgment task, which involves motor imagery and is sensitive to altered cerebral sensorimotor representations of the upper extremity. RESULTS Change in task performance and related brain activity did not differ significantly between the multidisciplinary rehabilitation and usual care groups, whereas the multidisciplinary rehabilitation group showed significantly greater clinical improvement on the Shoulder Rating Questionnaire. Both groups, however, showed a significant improvement in task performance from baseline to follow-up, and significantly increased activity in visuomotor occipito-parietal brain areas, both specific to their affected upper extremity. CONCLUSIONS Abnormal cerebral sensorimotor representations of the upper extremity after peripheral nerve damage in NA can recover toward normality. As adaptations occurred in visuomotor brain areas, multidisciplinary rehabilitation after peripheral nerve damage may be further optimized by applying visuomotor strategies. This study is registered at ClinicalTrials.gov (NCT03441347).
Collapse
Affiliation(s)
- Renee Lustenhouwer
- Department of Rehabilitation, Radboud
university medical center, Donders Institute for Brain, Cognition and Behaviour,
Nijmegen, the Netherlands,Donders Centre for Cognitive
Neuroimaging, Donders Institute for Brain, Cognition and Behaviour, Radboud
University, Nijmegen, the Netherlands
| | - Ian G.M. Cameron
- Donders Centre for Cognitive
Neuroimaging, Donders Institute for Brain, Cognition and Behaviour, Radboud
University, Nijmegen, the Netherlands,Faculty of Electrical Engineering,
Mathematics and Computer Science, University of Twente, Enschede, The
Netherlands
| | - Nens van Alfen
- Department of Neurology, Radboud
university medical center, Donders Institute for Brain, Cognition and Behaviour,
Nijmegen, the Netherlands
| | - Ivan Toni
- Donders Centre for Cognitive
Neuroimaging, Donders Institute for Brain, Cognition and Behaviour, Radboud
University, Nijmegen, the Netherlands
| | - Alexander C.H. Geurts
- Department of Rehabilitation, Radboud
university medical center, Donders Institute for Brain, Cognition and Behaviour,
Nijmegen, the Netherlands
| | - Baziel G.M. van Engelen
- Department of Neurology, Radboud
university medical center, Donders Institute for Brain, Cognition and Behaviour,
Nijmegen, the Netherlands
| | - Jan T. Groothuis
- Department of Rehabilitation, Radboud
university medical center, Donders Institute for Brain, Cognition and Behaviour,
Nijmegen, the Netherlands,Jan T. Groothuis, Radboud university
medical center, Department of Rehabilitation, P.O. Box 9101, Nijmegen, 6500 HB,
The Netherlands.
| | - Rick C. Helmich
- Donders Centre for Cognitive
Neuroimaging, Donders Institute for Brain, Cognition and Behaviour, Radboud
University, Nijmegen, the Netherlands,Department of Neurology, Radboud
university medical center, Donders Institute for Brain, Cognition and Behaviour,
Nijmegen, the Netherlands
| |
Collapse
|
25
|
Fernandez Z, Scheel N, Baker JH, Zhu DC. Functional connectivity of cortical resting-state networks is differentially affected by rest conditions. Brain Res 2022; 1796:148081. [PMID: 36100086 DOI: 10.1016/j.brainres.2022.148081] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2022] [Revised: 08/23/2022] [Accepted: 09/06/2022] [Indexed: 11/16/2022]
Abstract
Optimal conditions for resting-state functional magnetic resonance imaging (rs-fMRI) are still highly debated. Here, we comprehensively assessed the effects of various rest conditions on all cortical resting-state networks (RSNs) defined by an established atlas. Twenty-two healthy college students (22 ± 4 years old, 12 females) were scanned on a GE 3T MRI scanner. Rs-fMRI datasets were collected under four different conditions for each subject: (1) eyes open in dim light (Eyes-Open), (2) eyes closed and awake (Eyes-Closed), (3) eyes closed while remembering four numbers through the scan session (Eyes-Closed-Number) and (4) asked to watch a movie (Movie). We completed a thorough examination of the 17 functional RSNs defined by Yeo and colleagues. Importantly, the movie led to changes in global connectivity and should be avoided as a rest condition. Conversely, there were no significant connectivity differences between conditions within the frontoparietal control and limbic networks and the following subnetworks as defined by Yeo et al.: default-B, dorsal-attention-B and salience/ventral-attention-B. These were not even significant when compared to the highly stimulative Movie condition. A significant difference was not found between Eyes-Closed and Eyes-Closed-Number conditions in whole-brain, within-network and between-network comparisons. When considering other rest conditions, however, we observed connectivity changes in some subnetworks, including those of the default-mode network. Overall, we found conditions with more external stimulation led to more changes in functional connectivity during rs-fMRI. In conclusion, the comprehensive results of our study can aid in choosing rest conditions for the study of overall and specific functional networks.
Collapse
Affiliation(s)
- Zachary Fernandez
- Department of Radiology, Michigan State University, USA; Neuroscience Program, Michigan State University, USA; Cognitive Imaging Research Center, Michigan State University, USA
| | - Norman Scheel
- Department of Radiology, Michigan State University, USA; Cognitive Imaging Research Center, Michigan State University, USA
| | - Joshua H Baker
- Department of Radiology, Michigan State University, USA; Neuroscience Program, Michigan State University, USA; College of Osteopathic Medicine, Michigan State University, USA; Cognitive Imaging Research Center, Michigan State University, USA
| | - David C Zhu
- Department of Radiology, Michigan State University, USA; Neuroscience Program, Michigan State University, USA; Cognitive Imaging Research Center, Michigan State University, USA.
| |
Collapse
|
26
|
Grooms DR, Diekfuss JA, Slutsky-Ganesh AB, DiCesare CA, Bonnette S, Riley MA, Kiefer AW, Wohl TR, Criss CR, Lamplot J, Thomas SM, Foss KDB, Faigenbaum AD, Wong P, Simon JE, Myer GD. Preliminary Report on the Train the Brain Project, Part II: Neuroplasticity of Augmented Neuromuscular Training and Improved Injury-Risk Biomechanics. J Athl Train 2022; 57:911-920. [PMID: 35271709 PMCID: PMC9842124 DOI: 10.4085/1062-6050-0548.21] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/19/2023]
Abstract
CONTEXT Neuromuscular training (NMT) facilitates the acquisition of new movement patterns that reduce the anterior cruciate ligament injury risk. However, the neural mechanisms underlying these changes are unknown. OBJECTIVE To determine the relationship between brain activation and biomechanical changes after NMT with biofeedback. DESIGN Cohort study. SETTING Research laboratory. PATIENTS OR OTHER PARTICIPANTS Twenty female high school soccer athletes, with 10 in an augmented NMT group and 10 in a control (no training) group. MAIN OUTCOME MEASURE(S) Ten participants completed 6 weeks of NMT augmented with real-time biofeedback to reduce knee injury-risk movements, and 10 participants pursued no training. Augmented neuromuscular training (aNMT) was implemented with visual biofeedback that responded in real time to injury-risk biomechanical variables. A drop vertical jump with 3-dimensional motion capture was used to assess injury-risk neuromuscular changes before and after the 6-week intervention. Brain-activation changes were measured using functional magnetic resonance imaging during unilateral knee and multijoint motor tasks. RESULTS After aNMT, sensory (precuneus), visual-spatial (lingual gyrus), and motor-planning (premotor) brain activity increased for knee-specific movement; sensorimotor cortex activity for multijoint movement decreased. The knee-abduction moment during landing also decreased (4.66 ± 5.45 newton meters; P = .02; Hedges g = 0.82) in the aNMT group but did not change in the control group (P > .05). The training-induced increased brain activity with isolated knee movement was associated with decreases in knee-abduction moment (r = 0.67; P = .036) and sensorimotor cortex activity for multijoint movement (r = 0.87; P = .001). No change in brain activity was observed in the control group (P > .05). CONCLUSIONS The relationship between neural changes observed across tasks and reduced knee abduction suggests that aNMT facilitated recruitment of sensory integration centers to support reduced injury-risk mechanics and improve sensorimotor neural efficiency for multijoint control. Further research is warranted to determine if this training-related multimodal neuroplasticity enhances neuromuscular control during more complex sport-specific activities.
Collapse
Affiliation(s)
- Dustin R. Grooms
- Ohio Musculoskeletal and Neurological Institute, Waltham, MA
- Division of Physical Therapy, School of Rehabilitation and Communication Sciences, College of Health Sciences and Professions, Ohio University, Athens
- Division of Athletic Training, School of Applied Health Sciences and Wellness, College of Health Sciences and Professions, Ohio University, Athens
| | - Jed A. Diekfuss
- Emory Sports Performance And Research Center (SPARC), Flowery Branch, GA
- Emory Sports Medicine Center, Atlanta, GA
- Department of Orthopaedics, Emory University School of Medicine, Atlanta, GA
| | - Alexis B. Slutsky-Ganesh
- Emory Sports Performance And Research Center (SPARC), Flowery Branch, GA
- Emory Sports Medicine Center, Atlanta, GA
- Department of Orthopaedics, Emory University School of Medicine, Atlanta, GA
- Department of Kinesiology, University of North Carolina Greensboro
| | | | - Scott Bonnette
- Division of Sports Medicine, Cincinnati Children's Hospital Medical Center, OH
| | - Michael A. Riley
- Department of Rehabilitation, Exercise, and Nutrition Sciences, University of Cincinnati, OH
| | - Adam W. Kiefer
- Department of Exercise and Sport Science, University of North Carolina at Chapel Hill
| | - Timothy R. Wohl
- Ohio Musculoskeletal and Neurological Institute, Waltham, MA
| | - Cody R. Criss
- Ohio Musculoskeletal and Neurological Institute, Waltham, MA
| | - Joseph Lamplot
- Emory Sports Performance And Research Center (SPARC), Flowery Branch, GA
- Emory Sports Medicine Center, Atlanta, GA
- Department of Orthopaedics, Emory University School of Medicine, Atlanta, GA
| | - Staci M. Thomas
- Division of Sports Medicine, Cincinnati Children's Hospital Medical Center, OH
| | - Kim D. Barber Foss
- Emory Sports Performance And Research Center (SPARC), Flowery Branch, GA
- Emory Sports Medicine Center, Atlanta, GA
- Department of Orthopaedics, Emory University School of Medicine, Atlanta, GA
| | | | - Phil Wong
- Department of Diagnostic Radiology and Imaging Sciences, Division of Musculoskeletal Imaging, Emory University School of Medicine, Atlanta, GA
| | - Janet E. Simon
- Ohio Musculoskeletal and Neurological Institute, Waltham, MA
- Division of Athletic Training, School of Applied Health Sciences and Wellness, College of Health Sciences and Professions, Ohio University, Athens
| | - Gregory D. Myer
- Emory Sports Performance And Research Center (SPARC), Flowery Branch, GA
- Emory Sports Medicine Center, Atlanta, GA
- Department of Orthopaedics, Emory University School of Medicine, Atlanta, GA
- The Micheli Center for Sports Injury Prevention, Waltham, MA
| |
Collapse
|
27
|
Abstract
Visual representations of bodies, in addition to those of faces, contribute to the recognition of con- and heterospecifics, to action recognition, and to nonverbal communication. Despite its importance, the neural basis of the visual analysis of bodies has been less studied than that of faces. In this article, I review what is known about the neural processing of bodies, focusing on the macaque temporal visual cortex. Early single-unit recording work suggested that the temporal visual cortex contains representations of body parts and bodies, with the dorsal bank of the superior temporal sulcus representing bodily actions. Subsequent functional magnetic resonance imaging studies in both humans and monkeys showed several temporal cortical regions that are strongly activated by bodies. Single-unit recordings in the macaque body patches suggest that these represent mainly body shape features. More anterior patches show a greater viewpoint-tolerant selectivity for body features, which may reflect a processing principle shared with other object categories, including faces. Expected final online publication date for the Annual Review of Vision Science, Volume 8 is September 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.
Collapse
Affiliation(s)
- Rufin Vogels
- Laboratorium voor Neuro- en Psychofysiologie, KU Leuven, Belgium; .,Leuven Brain Institute, KU Leuven, Belgium
| |
Collapse
|
28
|
Caggiano P, Grossi G, De Mattia LC, vanVelzen J, Cocchini G. Objects with motor valence affect the visual processing of human body parts: Evidence from behavioural and ERP studies. Cortex 2022; 153:194-206. [DOI: 10.1016/j.cortex.2022.04.016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2021] [Revised: 01/06/2022] [Accepted: 04/14/2022] [Indexed: 11/16/2022]
|
29
|
Features and Extra-Striate Body Area Representations of Diagnostic Body Parts in Anger and Fear Perception. Brain Sci 2022; 12:brainsci12040466. [PMID: 35447997 PMCID: PMC9028525 DOI: 10.3390/brainsci12040466] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2022] [Revised: 03/19/2022] [Accepted: 03/29/2022] [Indexed: 02/04/2023] Open
Abstract
Social species perceive emotion via extracting diagnostic features of body movements. Although extensive studies have contributed to knowledge on how the entire body is used as context for decoding bodily expression, we know little about whether specific body parts (e.g., arms and legs) transmit enough information for body understanding. In this study, we performed behavioral experiments using the Bubbles paradigm on static body images to directly explore diagnostic body parts for categorizing angry, fearful and neutral expressions. Results showed that subjects recognized emotional bodies through diagnostic features from the torso with arms. We then conducted a follow-up functional magnetic resonance imaging (fMRI) experiment on body part images to examine whether diagnostic parts modulated body-related brain activity and corresponding neural representations. We found greater activations of the extra-striate body area (EBA) in response to both anger and fear than neutral for the torso and arms. Representational similarity analysis showed that neural patterns of the EBA distinguished different bodily expressions. Furthermore, the torso with arms and whole body had higher similarities in EBA representations relative to the legs and whole body, and to the head and whole body. Taken together, these results indicate that diagnostic body parts (i.e., torso with arms) can communicate bodily expression in a detectable manner.
Collapse
|
30
|
Errante A, Rossi Sebastiano A, Ziccarelli S, Bruno V, Rozzi S, Pia L, Fogassi L, Garbarini F. Structural connectivity associated with the sense of body ownership: a diffusion tensor imaging and disconnection study in patients with bodily awareness disorder. Brain Commun 2022; 4:fcac032. [PMID: 35233523 PMCID: PMC8882004 DOI: 10.1093/braincomms/fcac032] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2021] [Revised: 12/25/2021] [Accepted: 02/09/2022] [Indexed: 12/02/2022] Open
Abstract
The brain mechanisms underlying the emergence of a normal sense of body ownership can be investigated starting from pathological conditions in which body awareness is selectively impaired. Here, we focused on pathological embodiment, a body ownership disturbance observed in brain-damaged patients who misidentify other people’s limbs as their own. We investigated whether such body ownership disturbance can be classified as a disconnection syndrome, using three different approaches based on diffusion tensor imaging: (i) reconstruction of disconnectome maps in a large sample (N = 70) of stroke patients with and without pathological embodiment; (ii) probabilistic tractography, performed on the age-matched healthy controls (N = 16), to trace cortical connections potentially interrupted in patients with pathological embodiment and spared in patients without this pathological condition; (iii) probabilistic ‘in vivo’ tractography on two patients without and one patient with pathological embodiment. The converging results revealed the arcuate fasciculus and the third branch of the superior longitudinal fasciculus as mainly involved fibre tracts in patients showing pathological embodiment, suggesting that this condition could be related to the disconnection between frontal, parietal and temporal areas. This evidence raises the possibility of a ventral self-body recognition route including regions where visual (computed in occipito-temporal areas) and sensorimotor (stored in premotor and parietal areas) body representations are integrated, giving rise to a normal sense of body ownership.
Collapse
Affiliation(s)
- Antonino Errante
- Department of Medicine and Surgery, University of Parma, Parma, 43125, Italy
| | | | - Settimio Ziccarelli
- Department of Medicine and Surgery, University of Parma, Parma, 43125, Italy
| | - Valentina Bruno
- MANIBUS Lab, Psychology Department, University of Turin, Turin 10123, Italy
| | - Stefano Rozzi
- Department of Medicine and Surgery, University of Parma, Parma, 43125, Italy
| | - Lorenzo Pia
- SAMBA Research Group, Psychology Department, University of Turin, Turin 10123, Italy
- Neuroscience Institute of Turin (NIT), Turin 10123, Italy
| | - Leonardo Fogassi
- Department of Medicine and Surgery, University of Parma, Parma, 43125, Italy
| | - Francesca Garbarini
- MANIBUS Lab, Psychology Department, University of Turin, Turin 10123, Italy
- Neuroscience Institute of Turin (NIT), Turin 10123, Italy
| |
Collapse
|
31
|
Lustenhouwer R, Cameron IGM, Wolfs E, van Alfen N, Toni I, Geurts ACH, van Engelen BGM, Groothuis JT, Helmich RC. OUP accepted manuscript. Brain Commun 2022; 4:fcac034. [PMID: 35233524 PMCID: PMC8882006 DOI: 10.1093/braincomms/fcac034] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2021] [Revised: 12/03/2021] [Accepted: 02/14/2022] [Indexed: 11/14/2022] Open
Abstract
Neuralgic amyotrophy is a common peripheral nerve disorder caused by autoimmune inflammation of the brachial plexus, clinically characterized by acute pain and weakness of the shoulder muscles, followed by motor impairment. Despite recovery of the peripheral nerves, patients often have residual motor dysfunction of the upper extremity, leading to persistent pain related to altered biomechanics of the shoulder region. Building on clinical signs that suggest a role for cerebral mechanisms in these residual complaints, here we show and characterize cerebral alterations following neuralgic amyotrophy. Neuralgic amyotrophy patients often develop alternative motor strategies, which suggests that (mal)adaptations may occur in somatomotor and/or visuomotor brain areas. Here, we tested where changes in cerebral sensorimotor representations occur in neuralgic amyotrophy, while controlling for altered motor execution due to peripheral neuropathy. We additionally explore the relation between potential cerebral alterations in neuralgic amyotrophy and clinical symptoms. During functional MRI scanning, 39 neuralgic amyotrophy patients with persistent, lateralized symptoms in the right upper extremity and 23 matched healthy participants solved a hand laterality judgement task that can activate sensorimotor representations of the upper extremity, across somatomotor and visuomotor brain areas. Behavioural and cerebral responses confirmed the involvement of embodied, sensorimotor processes across groups. Compared with healthy participants, neuralgic amyotrophy patients were slower in hand laterality judgement and had decreased cerebral activity specific to their affected limb in two higher-order visual brain regions: the right extrastriate cortex and the parieto-occipital sulcus. Exploratory analyses revealed that across patients, extrastriate activity specific to the affected limb decreased as persistent pain increased, and affected limb-related parieto-occipital activity decreased as imagery performance of the affected limb became slower. These findings suggest that maladaptive cerebral plasticity in visuomotor areas involved in sensorimotor integration plays a role in residual motor dysfunction and subsequent persistent pain in neuralgic amyotrophy. Rehabilitation interventions that apply visuomotor strategies to improve sensorimotor integration may help to treat neuralgic amyotrophy patients.
Collapse
Affiliation(s)
- Renee Lustenhouwer
- Department of Rehabilitation, Radboud University Medical Center, Donders Institute for Brain, Cognition and Behaviour, Nijmegen, The Netherlands
- Donders Centre for Cognitive Neuroimaging, Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
| | - Ian G. M. Cameron
- Donders Centre for Cognitive Neuroimaging, Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
- Donders Centre for Neuroscience, Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
- Faculty of Electrical Engineering, Mathematics and Computer Science, University of Twente, PO BOX 217, 7500 AE Enschede, The Netherlands
| | - Elze Wolfs
- Donders Centre for Cognitive Neuroimaging, Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
- Department of Experimental Psychology, Helmholtz Institute, Utrecht University, Heidelberglaan 1, 3584 CS Utrecht, The Netherlands
| | - Nens van Alfen
- Department of Neurology, Radboud University Medical Center, Donders Institute for Brain, Cognition and Behaviour, Nijmegen, The Netherlands
| | - Ivan Toni
- Donders Centre for Cognitive Neuroimaging, Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
| | - Alexander C. H. Geurts
- Department of Rehabilitation, Radboud University Medical Center, Donders Institute for Brain, Cognition and Behaviour, Nijmegen, The Netherlands
| | - Baziel G. M. van Engelen
- Department of Neurology, Radboud University Medical Center, Donders Institute for Brain, Cognition and Behaviour, Nijmegen, The Netherlands
| | - Jan T. Groothuis
- Department of Rehabilitation, Radboud University Medical Center, Donders Institute for Brain, Cognition and Behaviour, Nijmegen, The Netherlands
| | - Rick C. Helmich
- Donders Centre for Cognitive Neuroimaging, Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
- Department of Neurology, Radboud University Medical Center, Donders Institute for Brain, Cognition and Behaviour, Nijmegen, The Netherlands
- Correspondence to: Rick Helmich Department of Neurology, Radboud University Medical Center PO Box 9101, 6500 HB Nijmegen, The Netherlands E-mail:
| |
Collapse
|
32
|
Bara I, Darda KM, Kurz AS, Ramsey R. Functional specificity and neural integration in the aesthetic appreciation of artworks with implied motion. Eur J Neurosci 2021; 54:7231-7259. [PMID: 34585450 DOI: 10.1111/ejn.15479] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2021] [Revised: 09/17/2021] [Accepted: 09/17/2021] [Indexed: 12/29/2022]
Abstract
Although there is growing interest in the neural foundations of aesthetic experience, it remains unclear how particular mental subsystems (e.g. perceptual, affective and cognitive) are involved in different types of aesthetic judgements. Here, we use fMRI to investigate the involvement of different neural networks during aesthetic judgements of visual artworks with implied motion cues. First, a behavioural experiment (N = 45) confirmed a preference for paintings with implied motion over static cues. Subsequently, in a preregistered fMRI experiment (N = 27), participants made aesthetic and motion judgements towards paintings representing human bodies in dynamic and static postures. Using functional region-of-interest and Bayesian multilevel modelling approaches, we provide no compelling evidence for unique sensitivity within or between neural systems associated with body perception, motion and affective processing during the aesthetic evaluation of paintings with implied motion. However, we show suggestive evidence that motion and body-selective systems may integrate signals via functional connections with a separate neural network in dorsal parietal cortex, which may act as a relay or integration site. Our findings clarify the roles of basic visual and affective brain circuitry in evaluating a central aesthetic feature-implied motion-while also pointing towards promising future research directions, which involve modelling aesthetic preferences as hierarchical interplay between visual and affective circuits and integration processes in frontoparietal cortex.
Collapse
Affiliation(s)
- Ionela Bara
- Wales Institute for Cognitive Neuroscience, School of Psychology, Bangor University, Bangor, UK
| | - Kohinoor Monish Darda
- University of Glasgow, Glasgow, UK.,Department of Psychology, Macquarie University, Sydney, Australia
| | - Andrew Solomon Kurz
- VISN 17 Center of Excellence for Research on Returning War Veterans, Central Texas Veterans Health Care System, Temple, Texas, USA
| | - Richard Ramsey
- Department of Psychology, Macquarie University, Sydney, Australia
| |
Collapse
|
33
|
Marrazzo G, Vaessen MJ, de Gelder B. Decoding the difference between explicit and implicit body expression representation in high level visual, prefrontal and inferior parietal cortex. Neuroimage 2021; 243:118545. [PMID: 34478822 DOI: 10.1016/j.neuroimage.2021.118545] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2020] [Revised: 08/30/2021] [Accepted: 08/31/2021] [Indexed: 11/28/2022] Open
Abstract
Recent studies provide an increasing understanding of how visual objects categories like faces or bodies are represented in the brain and also raised the question whether a category based or more dynamic network inspired models are more powerful. Two important and so far sidestepped issues in this debate are, first, how major category attributes like the emotional expression directly influence category representation and second, whether category and attribute representation are sensitive to task demands. This study investigated the impact of a crucial category attribute like emotional expression on category area activity and whether this varies with the participants' task. Using (fMRI) we measured BOLD responses while participants viewed whole body expressions and performed either an explicit (emotion) or an implicit (shape) recognition task. Our results based on multivariate methods show that the type of task is the strongest determinant of brain activity and can be decoded in EBA, VLPFC and IPL. Brain activity was higher for the explicit task condition in VLPFC and was not emotion specific. This pattern suggests that during explicit recognition of the body expression, body category representation may be strengthened, and emotion and action related activity suppressed. Taken together these results stress the importance of the task and of the role of category attributes for understanding the functional organization of high level visual cortex.
Collapse
Affiliation(s)
- Giuseppe Marrazzo
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Limburg 6200 MD, Maastricht, the Netherlands
| | - Maarten J Vaessen
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Limburg 6200 MD, Maastricht, the Netherlands
| | - Beatrice de Gelder
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Limburg 6200 MD, Maastricht, the Netherlands; Department of Computer Science, University College London, London WC1E 6BT, United Kingdom.
| |
Collapse
|
34
|
de Gelder B, Poyo Solanas M. A computational neuroethology perspective on body and expression perception. Trends Cogn Sci 2021; 25:744-756. [PMID: 34147363 DOI: 10.1016/j.tics.2021.05.010] [Citation(s) in RCA: 30] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2020] [Revised: 04/22/2021] [Accepted: 05/24/2021] [Indexed: 01/17/2023]
Abstract
Survival prompts organisms to prepare adaptive behavior in response to environmental and social threat. However, what are the specific features of the appearance of a conspecific that trigger such adaptive behaviors? For social species, the prime candidates for triggering defense systems are the visual features of the face and the body. We propose a novel approach for studying the ability of the brain to gather survival-relevant information from seeing conspecific body features. Specifically, we propose that behaviorally relevant information from bodies and body expressions is coded at the levels of midlevel features in the brain. These levels are relatively independent from higher-order cognitive and conscious perception of bodies and emotions. Instead, our approach is embedded in an ethological framework and mobilizes computational models for feature discovery.
Collapse
Affiliation(s)
- Beatrice de Gelder
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, Limburg 6200, MD, The Netherlands; Department of Computer Science, University College London, London WC1E 6BT, UK.
| | - Marta Poyo Solanas
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, Limburg 6200, MD, The Netherlands
| |
Collapse
|
35
|
Fabre M, Antoine M, Robitaille MG, Ribot-Ciscar E, Ackerley R, Aimonetti JM, Chavet P, Blouin J, Simoneau M, Mouchnino L. Large Postural Sways Prevent Foot Tactile Information From Fading: Neurophysiological Evidence. Cereb Cortex Commun 2021; 2:tgaa094. [PMID: 34296149 PMCID: PMC8152841 DOI: 10.1093/texcom/tgaa094] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2020] [Revised: 11/25/2020] [Accepted: 12/15/2020] [Indexed: 11/15/2022] Open
Abstract
Cutaneous foot receptors are important for balance control, and their activation during quiet standing depends on the speed and the amplitude of postural oscillations. We hypothesized that the transmission of cutaneous input to the cortex is reduced during prolonged small postural sways due to receptor adaptation during continued skin compression. Central mechanisms would trigger large sways to reactivate the receptors. We compared the amplitude of positive and negative post-stimulation peaks (P50N90) somatosensory cortical potentials evoked by the electrical stimulation of the foot sole during small and large sways in 16 young adults standing still with their eyes closed. We observed greater P50N90 amplitudes during large sways compared with small sways consistent with increased cutaneous transmission during large sways. Postural oscillations computed 200 ms before large sways had smaller amplitudes than those before small sways, providing sustained compression within a small foot sole area. Cortical source analyses revealed that during this interval, the activity of the somatosensory areas decreased, whereas the activity of cortical areas engaged in motor planning (supplementary motor area, dorsolateral prefrontal cortex) increased. We concluded that large sways during quiet standing represent self-generated functional behavior aiming at releasing skin compression to reactivate mechanoreceptors. Such balance motor commands create sensory reafference that help control postural sway.
Collapse
Affiliation(s)
- Marie Fabre
- Laboratoire de Neurosciences Cognitives, Aix Marseille Université, CNRS, FR 3C, Marseille 13331, France
| | - Marine Antoine
- Département de kinésiologie, Faculté de médecine, Université Laval, Québec, QC G1V 0A6, Canada
| | | | - Edith Ribot-Ciscar
- LNSC (Laboratoire de Neurosciences Sensorielles et Cognitives - UMR 7260, FR3C), Aix Marseille Université, CNRS, Marseille 13331, France
| | - Rochelle Ackerley
- LNSC (Laboratoire de Neurosciences Sensorielles et Cognitives - UMR 7260, FR3C), Aix Marseille Université, CNRS, Marseille 13331, France
| | - Jean-Marc Aimonetti
- LNSC (Laboratoire de Neurosciences Sensorielles et Cognitives - UMR 7260, FR3C), Aix Marseille Université, CNRS, Marseille 13331, France
| | - Pascale Chavet
- Institut des Sciences du Mouvement, Aix Marseille Université, CNRS, Marseille 13288, France
| | - Jean Blouin
- Laboratoire de Neurosciences Cognitives, Aix Marseille Université, CNRS, FR 3C, Marseille 13331, France
| | - Martin Simoneau
- Département de kinésiologie, Faculté de médecine, Université Laval, Québec, QC G1V 0A6, Canada
| | - Laurence Mouchnino
- Laboratoire de Neurosciences Cognitives, Aix Marseille Université, CNRS, FR 3C, Marseille 13331, France
| |
Collapse
|
36
|
Chen YC, Huang CC, Zhao CG, Hwang IS. Visual Effect on Brain Connectome That Scales Feedforward and Feedback Processes of Aged Postural System During Unstable Stance. Front Aging Neurosci 2021; 13:679412. [PMID: 34366825 PMCID: PMC8339373 DOI: 10.3389/fnagi.2021.679412] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2021] [Accepted: 06/29/2021] [Indexed: 12/04/2022] Open
Abstract
Older adults with degenerative declines in sensory systems depend strongly on visual input for postural control. By connecting advanced neural imaging and a postural control model, this study investigated the visual effect on the brain functional network that regulates feedback and feedforward processes of the postural system in older adults under somatosensory perturbations. Thirty-six older adults conducted bilateral stance on a foam surface in the eyes-open (EO) and eyes-closed (EC) conditions while their center of pressure (COP) and scalp EEG were recorded. The stochastic COP trajectory was modeled with non-linear stabilogram diffusion analysis (SDA) to characterize shifts in postural control in a continuum of feedback and feedforward processes. The EEG network was analyzed with the phase-lag index (PLI) and minimum spanning tree (MST). The results indicated that visual input rebalanced feedforward and feedback processes for postural sway, resulting in a greater critical point of displacement (CD), short-term effective diffusion coefficients (Ds) and short-term exponent (Hs), but the smaller critical point of time (CT) and long-term exponent (Hl) for the EC state. The EC network demonstrated stronger frontoparietal-occipital connectivity but weaker fronto-tempo-motor connectivity of the theta (4–7 Hz), alpha (8–12 Hz), and beta (13–35 Hz) bands than did the EO network. MST analysis revealed generally greater leaf fraction and maximal betweenness centrality (BCmax) and kappa of the EC network, as compared with those of the EO network. In contrast, the EC network exhibited a smaller diameter and average eccentricity than those of the EO network. The modulation of long-term negative feedback gain of the aged postural system with visual occlusion was positively correlated with leaf fraction, BCmax, and kappa, but negatively correlated with the diameter and average eccentricity for all EEG sub-bands. In conclusion, the aged brain functional network in older adults is tuned to visual information for modulating long-term negative feedback of the postural system under somatosensory perturbations.
Collapse
Affiliation(s)
- Yi-Ching Chen
- Department of Physical Therapy, College of Medical Science and Technology, Chung Shan Medical University, Taichung, Taiwan.,Physical Therapy Room, Chung Shan Medical University Hospital, Taichung, Taiwan
| | - Chien-Chun Huang
- Department of Environmental and Occupational Health, National Cheng Kung University, Tainan, Taiwan
| | - Chen-Guang Zhao
- Department of Physical Therapy, College of Medicine, National Cheng Kung University, Tainan, Taiwan
| | - Ing-Shiou Hwang
- Department of Physical Therapy, College of Medicine, National Cheng Kung University, Tainan, Taiwan.,Institute of Allied Health Sciences, College of Medicine, National Cheng Kung University, Tainan, Taiwan
| |
Collapse
|
37
|
Zhang Z, Zeidman P, Nelissen N, Filippini N, Diedrichsen J, Bracci S, Friston K, Rounis E. Neural Correlates of Hand-Object Congruency Effects during Action Planning. J Cogn Neurosci 2021; 33:1487-1503. [PMID: 34496373 DOI: 10.1162/jocn_a_01728] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Selecting hand actions to manipulate an object is affected both by perceptual factors and by action goals. Affordances may contribute to "stimulus-response" congruency effects driven by habitual actions to an object. In previous studies, we have demonstrated an influence of the congruency between hand and object orientations on response times when reaching to turn an object, such as a cup. In this study, we investigated how the representation of hand postures triggered by planning to turn a cup was influenced by this congruency effect, in an fMRI scanning environment. Healthy participants were asked to reach and turn a real cup that was placed in front of them either in an upright orientation or upside-down. They were instructed to use a hand orientation that was either congruent or incongruent with the cup orientation. As expected, the motor responses were faster when the hand and cup orientations were congruent. There was increased activity in a network of brain regions involving object-directed actions during action planning, which included bilateral primary and extrastriate visual, medial, and superior temporal areas, as well as superior parietal, primary motor, and premotor areas in the left hemisphere. Specific activation of the dorsal premotor cortex was associated with hand-object orientation congruency during planning and prior to any action taking place. Activity in that area and its connectivity with the lateral occipito-temporal cortex increased when planning incongruent (goal-directed) actions. The increased activity in premotor areas in trials where the orientation of the hand was incongruent to that of the object suggests a role in eliciting competing representations specified by hand postures in lateral occipito-temporal cortex.
Collapse
Affiliation(s)
| | | | | | | | | | | | | | - Elisabeth Rounis
- University of Oxford.,West Middlesex University Hospital, Isleworth
| |
Collapse
|
38
|
Sivakumar P, Quinlan DJ, Stubbs KM, Culham JC. Grasping performance depends upon the richness of hand feedback. Exp Brain Res 2021; 239:835-846. [PMID: 33403432 DOI: 10.1007/s00221-020-06025-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2020] [Accepted: 12/19/2020] [Indexed: 11/28/2022]
Abstract
Although visual feedback of the hand allows fast and accurate grasping actions, little is known about whether the nature of feedback of the hand affects performance. We investigated kinematics during precision grasping (with the index finger and thumb) when participants received different levels of hand feedback, with or without visual feedback of the target. Specifically, we compared performance when participants saw (1) no hand feedback; (2) only the two critical points on the index finger and thumb tips; (3) 21 points on all digit tips and hand joints; (4) 21 points connected by a "skeleton", or (5) full feedback of the hand wearing a glove. When less hand feedback was available, participants took longer to execute the movement because they allowed more time to slow the reach and close the hand. When target feedback was unavailable, participants took longer to plan the movement and reached with higher velocity. We were particularly interested in investigating maximum grip aperture (MGA), which can reflect the margin of error that participants allow to compensate for uncertainty. A trend suggested that MGA was smallest when ample feedback was available (skeleton and full hand feedback, regardless of target feedback) and when only essential information about hand and target was provided (2-point hand feedback + target feedback) but increased when non-essential points were included (21-point feedback). These results suggest that visual feedback of the hand affects grasping performance and that, while more feedback is usually beneficial, this is not necessarily always the case.
Collapse
Affiliation(s)
- Prajith Sivakumar
- Department of Biology, University of Western Ontario, London, Canada.,Brain and Mind Institute, University of Western Ontario, Western Interdisciplinary Research Building, London, ON, Canada
| | - Derek J Quinlan
- Brain and Mind Institute, University of Western Ontario, Western Interdisciplinary Research Building, London, ON, Canada.,BrainsCAN, University of Western Ontario, London, ON, Canada.,Department of Psychology, Huron University College, London, ON, Canada
| | - Kevin M Stubbs
- Brain and Mind Institute, University of Western Ontario, Western Interdisciplinary Research Building, London, ON, Canada.,BrainsCAN, University of Western Ontario, London, ON, Canada.,Department of Psychology, University of Western Ontario, London, ON, Canada
| | - Jody C Culham
- Brain and Mind Institute, University of Western Ontario, Western Interdisciplinary Research Building, London, ON, Canada. .,Department of Psychology, University of Western Ontario, London, ON, Canada.
| |
Collapse
|
39
|
Poyo Solanas M, Vaessen M, de Gelder B. Computation-Based Feature Representation of Body Expressions in the Human Brain. Cereb Cortex 2020; 30:6376-6390. [DOI: 10.1093/cercor/bhaa196] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2020] [Revised: 06/04/2020] [Accepted: 06/26/2020] [Indexed: 01/31/2023] Open
Abstract
Abstract
Humans and other primate species are experts at recognizing body expressions. To understand the underlying perceptual mechanisms, we computed postural and kinematic features from affective whole-body movement videos and related them to brain processes. Using representational similarity and multivoxel pattern analyses, we showed systematic relations between computation-based body features and brain activity. Our results revealed that postural rather than kinematic features reflect the affective category of the body movements. The feature limb contraction showed a central contribution in fearful body expression perception, differentially represented in action observation, motor preparation, and affect coding regions, including the amygdala. The posterior superior temporal sulcus differentiated fearful from other affective categories using limb contraction rather than kinematics. The extrastriate body area and fusiform body area also showed greater tuning to postural features. The discovery of midlevel body feature encoding in the brain moves affective neuroscience beyond research on high-level emotion representations and provides insights in the perceptual features that possibly drive automatic emotion perception.
Collapse
Affiliation(s)
- Marta Poyo Solanas
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, Limburg 6200 MD, The Netherlands
| | - Maarten Vaessen
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, Limburg 6200 MD, The Netherlands
| | - Beatrice de Gelder
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, Limburg 6200 MD, The Netherlands
- Department of Computer Science, University College London, London WC1E 6BT, UK
| |
Collapse
|
40
|
Galvez-Pol A, Forster B, Calvo-Merino B. Beyond action observation: Neurobehavioral mechanisms of memory for visually perceived bodies and actions. Neurosci Biobehav Rev 2020; 116:508-518. [PMID: 32544541 DOI: 10.1016/j.neubiorev.2020.06.014] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2019] [Revised: 05/28/2020] [Accepted: 06/08/2020] [Indexed: 12/16/2022]
Abstract
Examining the processing of others' body-related information in the perceivers' brain (action observation) is a key topic in cognitive neuroscience. However, what happens beyond the perceptual stage, when the body is not within view and it is transformed into an associative form that can be stored, updated, and later recalled, remains poorly understood. Here we examine neurobehavioural evidence on the memory processing of visually perceived bodily stimuli (dynamic actions and images of bodies). The reviewed studies indicate that encoding and maintaining bodily stimuli in memory recruits the sensorimotor system. This process arises when bodily stimuli are either recalled through action recognition or reproduction. Interestingly, the memory capacity for these stimuli is rather limited: only 2 or 3 bodily stimuli can be simultaneously held in memory. Moreover, this process is disrupted by increasing concurrent bodily operations; i.e., moving one's body, seeing or memorising additional bodies. Overall, the evidence suggests that the neural circuitry allowing us to move and feel ourselves supports the encoding, retention, and memory recall of others' visually perceived bodies.
Collapse
Affiliation(s)
- Alejandro Galvez-Pol
- Cognitive Neuroscience Research Unit, Department of Psychology, City, University of London, Northampton Square, EC1V 0HB, London, UK; University College London, Department of Clinical and Movement Neurosciences, Institute of Neurology. London WC1N 3BG, UK; Human Evolution and Cognition Research Group (EvoCog), University of the Balearic Islands, Psychology Department, 07122, Palma de Mallorca, Spain.
| | - Bettina Forster
- Cognitive Neuroscience Research Unit, Department of Psychology, City, University of London, Northampton Square, EC1V 0HB, London, UK.
| | - Beatriz Calvo-Merino
- Cognitive Neuroscience Research Unit, Department of Psychology, City, University of London, Northampton Square, EC1V 0HB, London, UK.
| |
Collapse
|
41
|
Criss CR, Onate JA, Grooms DR. Neural activity for hip-knee control in those with anterior cruciate ligament reconstruction: A task-based functional connectivity analysis. Neurosci Lett 2020; 730:134985. [PMID: 32380143 DOI: 10.1016/j.neulet.2020.134985] [Citation(s) in RCA: 49] [Impact Index Per Article: 9.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2020] [Revised: 04/09/2020] [Accepted: 04/13/2020] [Indexed: 01/17/2023]
Abstract
Anterior cruciate ligament injury may induce neurophysiological changes for sensorimotor control. Neuroimaging investigations have revealed unique brain activity patterns for knee movement following injury, indicating potential neural mechanisms underlying aberrant neuromuscular control that may contribute to heightened risk of secondary injury, altered movement patterns and poor patient outcomes. However, neuroimaging paradigms thus far have been limited to single joint, single motion knee tasks. Therefore, we sought to overcome prior limitations to understand the effects of injury on neural control of lower extremity movement by employing a multi-joint motor paradigm and determining differences in neural activity between ACL-reconstructed (ACLr) individuals relative to healthy matched controls. Fifteen patients with left anterior cruciate ligament reconstruction and fifteen matched healthy controls participated in this study. Neural activity was examined using functional magnetic resonance imaging during a block-designed knee-hip movement paradigm (similar to a supine heel-slide). Participants for each group were monitored and task performance was controlled via a metronome to ensure the same spatial-temporal parameters. We observed that those with ACL reconstruction displayed increased activation within the intracalcarine cortex, lingual gyrus, occipital fusiform gyrus, lateral occipital cortex, angular gyrus, and superior parietal lobule relative to controls. A follow-up task-based functional connectivity analyses using seed regions identified from the group analysis revealed connectivity among fronto-insular-temporal and sensorimotor regions within the ACLr participants. The results of this fMRI investigation suggest ACLr individuals require increased activity and connectivity in areas responsible for visual-spatial cognition and orientation, and attention for hip and knee motor control.
Collapse
Affiliation(s)
- Cody R Criss
- Ohio Musculoskeletal and Neurological Institute, Ohio University, Athens, OH, USA; Translational Biomedical Sciences Program, Graduate College, Ohio University, Athens, OH, USA; Heritage College of Osteopathic Medicine, Athens, OH, USA.
| | - James A Onate
- School of Health and Rehabilitation Sciences, The Ohio State University, Columbus, OH, USA
| | - Dustin R Grooms
- Ohio Musculoskeletal and Neurological Institute, Ohio University, Athens, OH, USA; Division of Athletic Training, School of Applied Health Sciences and Wellness, College of Health Sciences and Professions, Ohio University, Athens, OH, USA
| |
Collapse
|
42
|
Revealing the body in the brain: An ERP method to examine sensorimotor activity during visual perception of body-related information. Cortex 2020; 125:332-344. [DOI: 10.1016/j.cortex.2020.01.017] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2019] [Revised: 01/27/2020] [Accepted: 01/27/2020] [Indexed: 01/13/2023]
|
43
|
Lima Portugal LC, Alves RDCS, Junior OF, Sanchez TA, Mocaiber I, Volchan E, Smith Erthal F, David IA, Kim J, Oliveira L, Padmala S, Chen G, Pessoa L, Pereira MG. Interactions between emotion and action in the brain. Neuroimage 2020; 214:116728. [PMID: 32199954 PMCID: PMC7485650 DOI: 10.1016/j.neuroimage.2020.116728] [Citation(s) in RCA: 28] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2019] [Revised: 03/04/2020] [Accepted: 03/07/2020] [Indexed: 11/16/2022] Open
Abstract
A growing literature supports the existence of interactions between emotion and action in the brain, and the central participation of the anterior midcingulate cortex (aMCC) in this regard. In the present functional magnetic resonance imaging study, we sought to investigate the role of self-relevance during such interactions by varying the context in which threating pictures were presented (with guns pointed towards or away from the observer). Participants performed a simple visual detection task following exposure to such stimuli. Except for voxelwise tests, we adopted a Bayesian analysis framework which evaluated evidence for the hypotheses of interest, given the data, in a continuous fashion. Behaviorally, our results demonstrated a valence by context interaction such that there was a tendency of speeding up responses to targets after viewing threat pictures directed towards the participant. In the brain, interaction patterns that paralleled those observed behaviorally were observed most notably in the middle temporal gyrus, supplementary motor area, precentral gyrus, and anterior insula. In these regions, activity was overall greater during threat conditions relative to neutral ones, and this effect was enhanced in the directed towards context. A valence by context interaction was observed in the aMCC too, where we also observed a correlation (across participants) of evoked responses and reaction time data. Taken together, our study revealed the context-sensitive engagement of motor-related areas during emotional perception, thus supporting the idea that emotion and action interact in important ways in the brain.
Collapse
Affiliation(s)
- Liana Catarina Lima Portugal
- Department of Physiology and Pharmacology, Laboratory of Neurophysiology of Behavior, Biomedical Institute, Federal Fluminense University, Niterói, RJ, Brazil
| | - Rita de Cássia Soares Alves
- Department of Physiology and Pharmacology, Laboratory of Neurophysiology of Behavior, Biomedical Institute, Federal Fluminense University, Niterói, RJ, Brazil
| | - Orlando Fernandes Junior
- Laboratory of Neuroimaging and Psychophysiology, Department of Radiology, Faculty of Medicine, Federal University of Rio de Janeiro, Rio de Janeiro, RJ, Brazil
| | - Tiago Arruda Sanchez
- Laboratory of Neuroimaging and Psychophysiology, Department of Radiology, Faculty of Medicine, Federal University of Rio de Janeiro, Rio de Janeiro, RJ, Brazil
| | - Izabela Mocaiber
- Laboratory of Cognitive Psychophysiology, Department of Natural Sciences, Institute of Humanities and Health, Federal Fluminense University, Rio das Ostras, RJ, Brazil
| | - Eliane Volchan
- Laboratory of Neurobiology II, Institute of Biophysics Carlos Chagas Filho, Federal University of Rio de Janeiro, Rio de Janeiro, RJ, Brazil
| | - Fátima Smith Erthal
- Laboratory of Neurobiology II, Institute of Biophysics Carlos Chagas Filho, Federal University of Rio de Janeiro, Rio de Janeiro, RJ, Brazil
| | - Isabel Antunes David
- Department of Physiology and Pharmacology, Laboratory of Neurophysiology of Behavior, Biomedical Institute, Federal Fluminense University, Niterói, RJ, Brazil
| | - Jongwan Kim
- Department of Psychology, University of Maryland, College Park, MD, USA
| | - Leticia Oliveira
- Department of Physiology and Pharmacology, Laboratory of Neurophysiology of Behavior, Biomedical Institute, Federal Fluminense University, Niterói, RJ, Brazil
| | | | - Gang Chen
- Scientific and Statistical Computing Core, National Institute of Mental Health, USA
| | - Luiz Pessoa
- Department of Psychology, University of Maryland, College Park, MD, USA; Maryland Neuroimaging Center, University of Maryland, College Park, MD, USA
| | - Mirtes Garcia Pereira
- Department of Physiology and Pharmacology, Laboratory of Neurophysiology of Behavior, Biomedical Institute, Federal Fluminense University, Niterói, RJ, Brazil.
| |
Collapse
|
44
|
Integrating faces and bodies: Psychological and neural perspectives on whole person perception. Neurosci Biobehav Rev 2020; 112:472-486. [PMID: 32088346 DOI: 10.1016/j.neubiorev.2020.02.021] [Citation(s) in RCA: 26] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2019] [Revised: 12/19/2019] [Accepted: 02/15/2020] [Indexed: 11/20/2022]
Abstract
The human "person" is a common percept we encounter. Research on person perception has been focused either on face or body perception-with less attention paid to whole person perception. We review psychological and neuroscience studies aimed at understanding how face and body processing operate in concert to support intact person perception. We address this question considering: a.) the task to be accomplished (identification, emotion processing, detection), b.) the neural stage of processing (early/late visual mechanisms), and c.) the relevant brain regions for face/body/person processing. From the psychological perspective, we conclude that the integration of faces and bodies is mediated by the goal of the processing (e.g., emotion analysis, identification, etc.). From the neural perspective, we propose a hierarchical functional neural architecture of face-body integration that retains a degree of separation between the dorsal and ventral visual streams. We argue for two centers of integration: a ventral semantic integration hub that is the result of progressive, posterior-to-anterior, face-body integration; and a social agent integration hub in the dorsal stream STS.
Collapse
|
45
|
Fourie E, Palser ER, Pokorny JJ, Neff M, Rivera SM. Neural Processing and Production of Gesture in Children and Adolescents With Autism Spectrum Disorder. Front Psychol 2020; 10:3045. [PMID: 32038408 PMCID: PMC6987472 DOI: 10.3389/fpsyg.2019.03045] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2019] [Accepted: 12/23/2019] [Indexed: 02/02/2023] Open
Abstract
Individuals with autism spectrum disorder (ASD) demonstrate impairments in non-verbal communication, including gesturing and imitation deficits. Reduced sensitivity to biological motion (BM) in ASD may impair processing of dynamic social cues like gestures, which in turn may impede encoding and subsequent performance of these actions. Using both an fMRI task involving observation of action gestures and a charade style paradigm assessing gesture performance, this study examined the brain-behavior relationships between neural activity during gesture processing, gesturing abilities and social symptomology in a group of children and adolescents with and without ASD. Compared to typically developing (TD) controls, participants with ASD showed atypical sensitivity to movement in right posterior superior temporal sulcus (pSTS), a region implicated in action processing, and had poorer overall gesture performance with specific deficits in hand posture. The TD group showed associations between neural activity, gesture performance and social skills, that were weak or non-significant in the ASD group. These findings suggest that those with ASD demonstrate abnormalities in both processing and production of gestures and may reflect dysfunction in the mechanism underlying perception-action coupling resulting in atypical development of social and communicative skills.
Collapse
Affiliation(s)
- Emily Fourie
- Department of Psychology, University of California, Davis, Davis, CA, United States.,Center for Mind and Brain, University of California, Davis, Davis, CA, United States
| | - Eleanor R Palser
- Department of Neurology, University of California, San Francisco, San Francisco, CA, United States
| | - Jennifer J Pokorny
- Center for Mind and Brain, University of California, Davis, Davis, CA, United States
| | - Michael Neff
- Department of Computer Science, University of California, Davis, Davis, CA, United States.,Department of Cinema and Digital Media, University of California, Davis, Davis, CA, United States
| | - Susan M Rivera
- Department of Psychology, University of California, Davis, Davis, CA, United States.,Center for Mind and Brain, University of California, Davis, Davis, CA, United States.,MIND Institute, University of California, Davis, Sacramento, CA, United States
| |
Collapse
|
46
|
Neural correlates of visual aesthetic appreciation: insights from non-invasive brain stimulation. Exp Brain Res 2019; 238:1-16. [PMID: 31768577 PMCID: PMC6957540 DOI: 10.1007/s00221-019-05685-x] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2018] [Accepted: 11/07/2019] [Indexed: 10/25/2022]
Abstract
During the last decade, non-invasive brain stimulation techniques have been increasingly employed in the field of neuroaesthetics research to shed light on the possible causal role of different brain regions contributing to aesthetic appreciation. Here, I review studies that have employed transcranial magnetic stimulation (TMS) and transcranial direct current stimulation (tDCS) to investigate neurocognitive mechanisms mediating visual aesthetic appreciation for different stimuli categories (faces, bodies, paintings). The review first considers studies that have assessed the possible causal contribution of cortical regions in mediating aesthetic appreciation along the visual ventral and dorsal pathways (i.e., the extrastriate body area, the motion-sensitive region V5/MT+ , the lateral occipital complex and the posterior parietal cortex). It then considers TMS and tDCS studies that have targeted premotor and motor regions, as well as other areas involved in body and facial expression processing (such as the superior temporal sulcus and the somatosensory cortex) to assess their role in aesthetic evaluation. Finally, it discusses studies that have targeted medial and dorsolateral prefrontal regions leading to significant changes in aesthetic appreciation for both biological stimuli (faces and bodies) and artworks. Possible mechanisms mediating stimulation effects on aesthetic judgments are discussed. A final section considers both methodological limitations of the reviewed studies (including levels of statistical power and the need for further replication) and the future potential for non-invasive brain stimulation to significantly contribute to the understanding of the neural bases of visual aesthetic experiences.
Collapse
|
47
|
Fossataro C, Tieri G, Grollero D, Bruno V, Garbarini F. Hand blink reflex in virtual reality: The role of vision and proprioception in modulating defensive responses. Eur J Neurosci 2019; 51:937-951. [PMID: 31630450 DOI: 10.1111/ejn.14601] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2019] [Revised: 09/15/2019] [Accepted: 10/09/2019] [Indexed: 01/19/2023]
Abstract
Our research focused on the role of vision and proprioception in modulating a defensive reflex (hand blink reflex, HBR) whose magnitude is enhanced when the threatened hand is inside the peripersonal space of the face. We capitalized on virtual reality, which allows dissociating vision and proprioception by presenting a virtual limb in congruent/incongruent positions with respect to the participants' limb. In experiment 1, participants placed their own stimulated hand in far/near positions with respect to their face (postural manipulation task), while observing a virtual empty scenario. Vision was not informative, but the HBR was significantly enhanced in near compared with far position, suggesting that proprioception is sufficient for the HBR modulation to occur. In experiment 2, participants did not perform the postural manipulation but they (passively) observed the avatar's virtual limb performing it. Proprioceptive signals were not informative, but the HBR was significantly enhanced when the observed virtual limb was near to the face, suggesting that visual information plays a role in modulating the HBR. In experiment 3, both participants and avatar performed the postural manipulation, either congruently (both of them far/near) or incongruently (one of them far, the other near). The HBR modulation was present only in congruent conditions. In incongruent conditions, the conflict between vision and proprioception confounded the system, abolishing the difference between far and near positions. Taken together, these findings promote the view that observing a virtual limb modulates the HBR, providing also new evidence on the role of vision and proprioception in modulating this subcortical reflex.
Collapse
Affiliation(s)
| | - Gaetano Tieri
- IRCCS, Fondazione Santa Lucia, Rome, Italy.,Virtual Reality Lab, University of Rome Unitelma Sapienza, Rome, Italy
| | - Demetrio Grollero
- MANIBUS Lab, Psychology Department, University of Turin, Turin, Italy.,MoMi Lab, IMT School for Advanced Studies Lucca, Lucca, Italy
| | - Valentina Bruno
- MANIBUS Lab, Psychology Department, University of Turin, Turin, Italy
| | - Francesca Garbarini
- MANIBUS Lab, Psychology Department, University of Turin, Turin, Italy.,Neuroscience Institute of Turin, University of Turin, Turin, Italy
| |
Collapse
|
48
|
Kim Y, Usui N, Miyazaki A, Haji T, Matsumoto K, Taira M, Nakamura K, Katsuyama N. Cortical Regions Encoding Hardness Perception Modulated by Visual Information Identified by Functional Magnetic Resonance Imaging With Multivoxel Pattern Analysis. Front Syst Neurosci 2019; 13:52. [PMID: 31632245 PMCID: PMC6779815 DOI: 10.3389/fnsys.2019.00052] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2019] [Accepted: 09/11/2019] [Indexed: 01/09/2023] Open
Abstract
Recent studies have revealed that hardness perception is determined by visual information along with the haptic input. This study investigated the cortical regions involved in hardness perception modulated by visual information using functional magnetic resonance imaging (fMRI) and multivoxel pattern analysis (MVPA). Twenty-two healthy participants were enrolled. They were required to place their left and right hands at the front and back, respectively, of a mirror attached to a platform placed above them while lying in a magnetic resonance scanner. In conditions SFT, MED, and HRD, one of three polyurethane foam pads of varying hardness (soft, medium, and hard, respectively) was presented to the left hand in a given trial, while only the medium pad was presented to the right hand in all trials. MED was defined as the control condition, because the visual and haptic information was congruent. During the scan, the participants were required to push the pad with the both hands while observing the reflection of the left hand and estimate the hardness of the pad perceived by the right (hidden) hand based on magnitude estimation. Behavioral results showed that the perceived hardness was significantly biased toward softer or harder in >73% of the trials in conditions SFT and HRD; we designated these trials as visually modulated (SFTvm and HRDvm, respectively). The accuracy map was calculated individually for each of the pair-wise comparisons of (SFTvm vs. MED), (HRDvm vs. MED), and (SFTvm vs. HRDvm) by a searchlight MVPA, and the cortical regions encoding the perceived hardness with visual modulation were identified by conjunction of the three accuracy maps in group analysis. The cluster was observed in the right sensory motor cortex, left anterior intraparietal sulcus (aIPS), bilateral parietal operculum (PO), and occipito-temporal cortex (OTC). Together with previous findings on such cortical regions, we conclude that the visual information of finger movements processed in the OTC may be integrated with haptic input in the left aIPS, and the subjective hardness perceived by the right hand with visual modulation may be processed in the cortical network between the left PO and aIPS.
Collapse
Affiliation(s)
- Yuri Kim
- Primate Research Institute, Kyoto University, Inuyama, Japan.,Department of Cognitive Neurobiology, Tokyo Medical and Dental University, Tokyo, Japan.,Center for Brain Integration Research, Tokyo Medical and Dental University, Tokyo, Japan
| | - Nobuo Usui
- Department of Cognitive Neurobiology, Tokyo Medical and Dental University, Tokyo, Japan.,Center for Brain Integration Research, Tokyo Medical and Dental University, Tokyo, Japan
| | | | - Tomoki Haji
- Tamagawa University Brain Science Institute, Tokyo, Japan
| | | | - Masato Taira
- Department of Cognitive Neurobiology, Tokyo Medical and Dental University, Tokyo, Japan.,Center for Brain Integration Research, Tokyo Medical and Dental University, Tokyo, Japan
| | | | - Narumi Katsuyama
- Primate Research Institute, Kyoto University, Inuyama, Japan.,Department of Cognitive Neurobiology, Tokyo Medical and Dental University, Tokyo, Japan.,Center for Brain Integration Research, Tokyo Medical and Dental University, Tokyo, Japan
| |
Collapse
|
49
|
van den Heiligenberg FMZ, Orlov T, Macdonald SN, Duff EP, Henderson Slater D, Beckmann CF, Johansen-Berg H, Culham JC, Makin TR. Artificial limb representation in amputees. Brain 2019. [PMID: 29534154 PMCID: PMC5917779 DOI: 10.1093/brain/awy054] [Citation(s) in RCA: 40] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022] Open
Abstract
The human brain contains multiple hand-selective areas, in both the sensorimotor and visual systems. Could our brain repurpose neural resources, originally developed for supporting hand function, to represent and control artificial limbs? We studied individuals with congenital or acquired hand-loss (hereafter one-handers) using functional MRI. We show that the more one-handers use an artificial limb (prosthesis) in their everyday life, the stronger visual hand-selective areas in the lateral occipitotemporal cortex respond to prosthesis images. This was found even when one-handers were presented with images of active prostheses that share the functionality of the hand but not necessarily its visual features (e.g. a ‘hook’ prosthesis). Further, we show that daily prosthesis usage determines large-scale inter-network communication across hand-selective areas. This was demonstrated by increased resting state functional connectivity between visual and sensorimotor hand-selective areas, proportional to the intensiveness of everyday prosthesis usage. Further analysis revealed a 3-fold coupling between prosthesis activity, visuomotor connectivity and usage, suggesting a possible role for the motor system in shaping use-dependent representation in visual hand-selective areas, and/or vice versa. Moreover, able-bodied control participants who routinely observe prosthesis usage (albeit less intensively than the prosthesis users) showed significantly weaker associations between degree of prosthesis observation and visual cortex activity or connectivity. Together, our findings suggest that altered daily motor behaviour facilitates prosthesis-related visual processing and shapes communication across hand-selective areas. This neurophysiological substrate for prosthesis embodiment may inspire rehabilitation approaches to improve usage of existing substitutionary devices and aid implementation of future assistive and augmentative technologies.
Collapse
Affiliation(s)
- Fiona M Z van den Heiligenberg
- Institute of Cognitive Neuroscience, University College London, London, UK.,FMRIB Centre, Nuffield Department of Clinical Neuroscience, University of Oxford, Oxford, UK.,Donders Institute for Brain, Cognition and Behaviour, Radboud University Nijmegen, Nijmegen, The Netherlands
| | - Tanya Orlov
- Neurobiology Department, Life Sciences Institute, Hebrew University of Jerusalem, Jerusalem, Israel
| | - Scott N Macdonald
- Brain and Mind Institute, Department of Psychology, University of Western Ontario, Canada
| | - Eugene P Duff
- FMRIB Centre, Nuffield Department of Clinical Neuroscience, University of Oxford, Oxford, UK
| | - David Henderson Slater
- FMRIB Centre, Nuffield Department of Clinical Neuroscience, University of Oxford, Oxford, UK.,Oxford Centre for Enablement, Oxford University Hospitals NHS Foundation Trust, Oxford, UK
| | - Christian F Beckmann
- Donders Institute for Brain, Cognition and Behaviour, Radboud University Nijmegen, Nijmegen, The Netherlands
| | - Heidi Johansen-Berg
- FMRIB Centre, Nuffield Department of Clinical Neuroscience, University of Oxford, Oxford, UK
| | - Jody C Culham
- Brain and Mind Institute, Department of Psychology, University of Western Ontario, Canada
| | - Tamar R Makin
- Institute of Cognitive Neuroscience, University College London, London, UK.,FMRIB Centre, Nuffield Department of Clinical Neuroscience, University of Oxford, Oxford, UK.,Wellcome Centre for Human Neuroimaging, University College London, London, UK
| |
Collapse
|
50
|
Benito-León J, Serrano JI, Louis ED, Holobar A, Romero JP, Povalej-Bržan P, Kranjec J, Bermejo-Pareja F, Del Castillo MD, Posada IJ, Rocon E. Essential tremor severity and anatomical changes in brain areas controlling movement sequencing. Ann Clin Transl Neurol 2018; 6:83-97. [PMID: 30656186 PMCID: PMC6331315 DOI: 10.1002/acn3.681] [Citation(s) in RCA: 29] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2018] [Revised: 09/28/2018] [Accepted: 10/04/2018] [Indexed: 01/11/2023] Open
Abstract
Objective Although the cerebello‐thalamo‐cortical network has often been suggested to be of importance in the pathogenesis of essential tremor (ET), the origins of tremorgenic activity in this disease are not fully understood. We used a combination of cortical thickness imaging and neurophysiological studies to analyze whether the severity of tremor was associated with anatomical changes in the brain in ET patients. Methods Magnetic resonance imaging (MRI) and a neurophysiological assessment were performed in 13 nondemented ET patients. High field structural brain MRI images acquired in a 3T scanner and analyses of cortical thickness and surface were carried out. Cortical reconstruction and volumetric segmentation was performed with the FreeSurfer image analysis software. We used high‐density surface electromyography (hdEMG) and inertial measurement units (IMUs) to quantify the tremor severity in upper extrimities of patients. In particular, advanced computer tool was used to reliably identify discharge patterns of individual motor units from surface hdEMG and quantify motor unit synchronization. Results We found significant association between increased motor unit synchronization (i.e., more severe tremor) and cortical changes (i.e., atrophy) in widespread cerebral cortical areas, including the left medial orbitofrontal cortex, left isthmus of the cingulate gyrus, right paracentral lobule, right lingual gyrus, as well as reduced left supramarginal gyrus (inferior parietal cortex), right isthmus of the cingulate gyrus, left thalamus, and left amygdala volumes. Interpretation Given that most of these brain areas are involved in controlling movement sequencing, ET tremor could be the result of an involuntary activation of a program of motor behavior used in the genesis of voluntary repetitive movements.
Collapse
Affiliation(s)
- Julián Benito-León
- Department of Neurology University Hospital 12 de Octubre Madrid Spain.,Center of Biomedical Network Research on Neurodegenerative Diseases (CIBERNED) Madrid Spain.,Department of Medicine Faculty of Medicine Complutense University Madrid Spain
| | - José Ignacio Serrano
- Neural and Cognitive Engineering group Centre for Automation and Robotics (CAR) CSIC-UPM Arganda del Rey Spain
| | - Elan D Louis
- Department of Neurology Yale School of Medicine New Haven Connecticut.,Department of Chronic Disease Epidemiology Yale School of Public Health New Haven Connecticut.,Center for Neuroepidemiology and Clinical Neurological Research Yale School of Medicine and Yale School of Public Health New Haven Connecticut
| | - Ales Holobar
- Faculty of Electrical Engineering and Computer Science University of Maribor Maribor Slovenia
| | - Juan P Romero
- Faculty of Biosanitary Sciences Francisco de Vitoria University Pozuelo de Alarcón, Madrid Spain.,Brain Damage Service Hospital Beata Maria Ana Madrid Spain
| | - Petra Povalej-Bržan
- Faculty of Electrical Engineering and Computer Science University of Maribor Maribor Slovenia.,Faculty of Health Sciences University of Maribor Maribor Slovenia
| | - Jernej Kranjec
- Faculty of Electrical Engineering and Computer Science University of Maribor Maribor Slovenia
| | - Félix Bermejo-Pareja
- Center of Biomedical Network Research on Neurodegenerative Diseases (CIBERNED) Madrid Spain.,Department of Medicine Faculty of Medicine Complutense University Madrid Spain.,Clinical Research Unit University Hospital 12 de Octubre Madrid Spain
| | - María Dolores Del Castillo
- Neural and Cognitive Engineering group Centre for Automation and Robotics (CAR) CSIC-UPM Arganda del Rey Spain
| | - Ignacio Javier Posada
- Department of Neurology University Hospital 12 de Octubre Madrid Spain.,Department of Medicine Faculty of Medicine Complutense University Madrid Spain
| | - Eduardo Rocon
- Neural and Cognitive Engineering group Centre for Automation and Robotics (CAR) CSIC-UPM Arganda del Rey Spain
| |
Collapse
|