1
|
Bellot E, Vandenberghe A, Vannuscorps G. Models of actor-specific range of motion are encoded in the extrastriate body area. Cereb Cortex 2025; 35:bhaf027. [PMID: 40103359 DOI: 10.1093/cercor/bhaf027] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2024] [Revised: 01/16/2025] [Accepted: 01/20/2025] [Indexed: 03/20/2025] Open
Abstract
Models of actor-specific range of motion (or biomechanical limits) shapes perception and (inter)actions. This functional magnetic resonance imaging study tested the hypothesis that these models are encoded in the extrastriate body area. Participants were first introduced with the maximal amplitude of arm and leg movements of a "rigid" and a "flexible" actor. Then, we measured the blood oxygenation level dependent response in 25 participants while they watched video clips depicting these actors performing either "small" movements that were "possible" to perform for both actors, "large" ones that were "impossible" for both actors and "intermediate" ones that were possible only for the "flexible" actor. Results aligned with the 2 predictions of our hypothesis: (i) extrastriate body area responded more strongly to impossible than possible movements; (ii) extrastriate body area categorized intermediate movements as "possible" or "impossible" depending on each actor's specific range of motion. The results of additional analyses suggested that extrastriate body area encodes actor-specific range of motion at the level of specific body parts, and as a probability function. Finally, the results of whole brain and functional connectivity analyses suggested that the right posterior superior temporal sulcus may also play an important role in encoding information about actor-specific biomechanical limits.
Collapse
Affiliation(s)
- Emmanuelle Bellot
- Psychological Sciences Research Institute, Université catholique de Louvain, Place Cardinal Mercier 10, 1348 Louvain-la-Neuve, Belgium
| | - Antoine Vandenberghe
- Psychological Sciences Research Institute, Université catholique de Louvain, Place Cardinal Mercier 10, 1348 Louvain-la-Neuve, Belgium
| | - Gilles Vannuscorps
- Psychological Sciences Research Institute, Université catholique de Louvain, Place Cardinal Mercier 10, 1348 Louvain-la-Neuve, Belgium
- Institute of Neuroscience, Université catholique de Louvain, Avenue E. Mounier 53, 1200 Woluwe-Saint-Lambert, Belgium
| |
Collapse
|
2
|
Fló E, Fraiman D, Sitt JD. Assessing brain-muscle networks during motor imagery to detect covert command-following. BMC Med 2025; 23:68. [PMID: 39915775 PMCID: PMC11803995 DOI: 10.1186/s12916-025-03846-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/19/2023] [Accepted: 01/06/2025] [Indexed: 02/09/2025] Open
Abstract
BACKGROUND In this study, we evaluated the potential of a network approach to electromyography and electroencephalography recordings to detect covert command-following in healthy participants. The motivation underlying this study was the development of a diagnostic tool that can be applied in common clinical settings to detect awareness in patients that are unable to convey explicit motor or verbal responses, such as patients that suffer from disorders of consciousness (DoC). METHODS We examined the brain and muscle response during movement and imagined movement of simple motor tasks, as well as during resting state. Brain-muscle networks were obtained using non-negative matrix factorization (NMF) of the coherence spectra for all the channel pairs. For the 15/38 participants who showed motor imagery, as indexed by common spatial filters and linear discriminant analysis, we contrasted the configuration of the networks during imagined movement and resting state at the group level, and subject-level classifiers were implemented using as features the weights of the NMF together with trial-wise power modulations and heart response to classify resting state from motor imagery. RESULTS Kinesthetic motor imagery produced decreases in the mu-beta band compared to resting state, and a small correlation was found between mu-beta power and the kinesthetic imagery scores of the Movement Imagery Questionnaire-Revised Second version. The full-feature classifiers successfully distinguished between motor imagery and resting state for all participants, and brain-muscle functional networks did not contribute to the overall classification. Nevertheless, heart activity and cortical power were crucial to detect when a participant was mentally rehearsing a movement. CONCLUSIONS Our work highlights the importance of combining EEG and peripheral measurements to detect command-following, which could be important for improving the detection of covert responses consistent with volition in unresponsive patients.
Collapse
Affiliation(s)
- Emilia Fló
- Sorbonne Université, Institut du Cerveau - Paris Brain Institute - ICM, INSERM, CNRS, Paris, France.
| | - Daniel Fraiman
- Departamento de Matemática y Ciencias, Universidad de San Andrés, Buenos Aires, Argentina
- CONICET, Buenos Aires, Argentina
| | - Jacobo Diego Sitt
- Sorbonne Université, Institut du Cerveau - Paris Brain Institute - ICM, INSERM, CNRS, Paris, France.
| |
Collapse
|
3
|
Mitev DI, Koldewyn K, Downing PE. Are there cortical somatotopic motor maps outside of the human precentral gyrus? J Neurophysiol 2025; 133:177-192. [PMID: 39625385 DOI: 10.1152/jn.00160.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2024] [Revised: 10/18/2024] [Accepted: 11/18/2024] [Indexed: 01/11/2025] Open
Abstract
Human body movements are supported by a somatotopic map, primary motor cortex (M1), that is found along the precentral gyrus. Recent evidence has suggested two further motor maps that span the lateral occipitotemporal cortex (LOTC) and the precuneus. Confirmation of these maps is important, as they influence our understanding of the organization of motor behavior, for example by revealing how visual- and motor-related activity interact. However, evidence for these recently proposed maps is limited. We analyzed an open functional MRI (fMRI) dataset of 62 participants who performed 12 different body part movements. We analyzed the magnitude of responses evoked by movements with novel quantitative indices that test for maplike organization. We found strong evidence for bilateral somatotopic maps in precentral and postcentral gyri. In LOTC, we found much weaker responses to movement and little evidence of somatotopy. In the precuneus, we found only limited evidence for somatotopy. We also adopted a background connectivity approach to examine correlations between M1, LOTC, and the precuneus in the residual time series data. This revealed a ventral-posterior/dorsal-anterior distinction in the connectivity between precuneus and M1, favoring the head and arms, respectively. Posterior right hemisphere LOTC showed some evidence of preferential connectivity to arm-selective regions of M1. Overall, our results do not support the existence of a somatotopic motor map in LOTC but provide some support for a coarse map in the precuneus, especially as revealed in connectivity patterns. These findings help clarify the organization of human motor representations beyond the precentral gyrus.NEW & NOTEWORTHY We investigated previous claims about the existence of somatotopic motor maps in the human lateral occipitotemporal cortex (LOTC) and the precuneus, in comparison to known maps in the precentral and postcentral gyri. Consistent with previous findings, we identified clear somatotopic motor maps in the latter two regions. With multiple quantitative measures of activity and connectivity, however, we found no evidence for a map in the LOTC and limited evidence for a map in the precuneus.
Collapse
Affiliation(s)
| | - Kami Koldewyn
- Department of PsychologyBangor University, Bangor, United Kingdom
| | - Paul E Downing
- Department of PsychologyBangor University, Bangor, United Kingdom
| |
Collapse
|
4
|
Ramirez JG, Vanhoyland M, Ratan Murty NA, Decramer T, Van Paesschen W, Bracci S, Op de Beeck H, Kanwisher N, Janssen P, Theys T. Intracortical recordings reveal the neuronal selectivity for bodies and body parts in the human visual cortex. Proc Natl Acad Sci U S A 2024; 121:e2408871121. [PMID: 39652751 PMCID: PMC11665852 DOI: 10.1073/pnas.2408871121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2024] [Accepted: 10/22/2024] [Indexed: 02/13/2025] Open
Abstract
Body perception plays a fundamental role in social cognition. Yet, the neural mechanisms underlying this process in humans remain elusive given the spatiotemporal constraints of functional imaging. Here, we present intracortical recordings of single- and multiunit spiking activity in two epilepsy surgery patients in or near the extrastriate body area, a critical region for body perception. Our recordings revealed a strong preference for human bodies over a large range of control stimuli. Notably, body selectivity was driven by a distinct selectivity for body parts. The observed body selectivity generalized to nonphotographic depictions of bodies including silhouettes and stick figures. Overall, our study provides unique neural data that bridge the gap between human neuroimaging and macaque electrophysiology studies, laying a solid foundation for computational models of human body processing.
Collapse
Affiliation(s)
- Jesus Garcia Ramirez
- Research group Experimental Neurosurgery and Neuroanatomy, Katholieke Universiteit Leuven, and the Leuven Brain Institute, LeuvenB-3000, Belgium
- Laboratory for Neuro- and Psychophysiology, Department of Neurosciences, Katholieke Universiteit Leuven and the Leuven Brain Institute, LeuvenB-3000, Belgium
| | - Michael Vanhoyland
- Research group Experimental Neurosurgery and Neuroanatomy, Katholieke Universiteit Leuven, and the Leuven Brain Institute, LeuvenB-3000, Belgium
- Laboratory for Neuro- and Psychophysiology, Department of Neurosciences, Katholieke Universiteit Leuven and the Leuven Brain Institute, LeuvenB-3000, Belgium
- Department of Neurosurgery, Universitaire Ziekenhuizen Leuven, Katholieke Universiteit Leuven, LeuvenB-3000, Belgium
| | - N. A. Ratan Murty
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA02139
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA02139
- The Center for Brains, Minds and Machines, Massachusetts Institute of Technology, Cambridge, MA02139
| | - Thomas Decramer
- Research group Experimental Neurosurgery and Neuroanatomy, Katholieke Universiteit Leuven, and the Leuven Brain Institute, LeuvenB-3000, Belgium
- Department of Neurosurgery, Universitaire Ziekenhuizen Leuven, Katholieke Universiteit Leuven, LeuvenB-3000, Belgium
| | - Wim Van Paesschen
- Laboratory for Epilepsy Research, Katholieke Universiteit Leuven, LeuvenB-3000, Belgium
| | - Stefania Bracci
- Department of Psychology and Cognitive Science, University of Trento, Trento38068, Italy
| | - Hans Op de Beeck
- Laboratory for Biological Psychology, Katholieke Universiteit Leuven, LeuvenB-3000, Belgium
| | - Nancy Kanwisher
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA02139
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA02139
- The Center for Brains, Minds and Machines, Massachusetts Institute of Technology, Cambridge, MA02139
| | - Peter Janssen
- Laboratory for Neuro- and Psychophysiology, Department of Neurosciences, Katholieke Universiteit Leuven and the Leuven Brain Institute, LeuvenB-3000, Belgium
| | - Tom Theys
- Research group Experimental Neurosurgery and Neuroanatomy, Katholieke Universiteit Leuven, and the Leuven Brain Institute, LeuvenB-3000, Belgium
- Department of Neurosurgery, Universitaire Ziekenhuizen Leuven, Katholieke Universiteit Leuven, LeuvenB-3000, Belgium
| |
Collapse
|
5
|
Han J, Chauhan V, Philip R, Taylor MK, Jung H, Halchenko YO, Gobbini MI, Haxby JV, Nastase SA. Behaviorally-relevant features of observed actions dominate cortical representational geometry in natural vision. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.11.26.624178. [PMID: 39651248 PMCID: PMC11623629 DOI: 10.1101/2024.11.26.624178] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/11/2024]
Abstract
We effortlessly extract behaviorally relevant information from dynamic visual input in order to understand the actions of others. In the current study, we develop and test a number of models to better understand the neural representational geometries supporting action understanding. Using fMRI, we measured brain activity as participants viewed a diverse set of 90 different video clips depicting social and nonsocial actions in real-world contexts. We developed five behavioral models using arrangement tasks: two models reflecting behavioral judgments of the purpose (transitivity) and the social content (sociality) of the actions depicted in the video stimuli; and three models reflecting behavioral judgments of the visual content (people, objects, and scene) depicted in still frames of the stimuli. We evaluated how well these models predict neural representational geometry and tested them against semantic models based on verb and nonverb embeddings and visual models based on gaze and motion energy. Our results revealed that behavioral judgments of similarity better reflect neural representational geometry than semantic or visual models throughout much of cortex. The sociality and transitivity models in particular captured a large portion of unique variance throughout the action observation network, extending into regions not typically associated with action perception, like ventral temporal cortex. Overall, our findings expand the action observation network and indicate that the social content and purpose of observed actions are predominant in cortical representation.
Collapse
|
6
|
Zhang D, Huang Y, Zhang X, Liu W, Guan Y, Gao J, Lei X, Tang M, Ai K, Yan X. Potential effects of peripheral neuropathy on brain function in patients with type 2 diabetes mellitus. Front Endocrinol (Lausanne) 2024; 15:1448225. [PMID: 39588336 PMCID: PMC11586158 DOI: 10.3389/fendo.2024.1448225] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/12/2024] [Accepted: 10/14/2024] [Indexed: 11/27/2024] Open
Abstract
Background The mechanisms associated between diabetic peripheral neuropathy (DPN) and various brain function abnormalities in patients remains unclear. This study attempted to indirectly evaluate the effect of DPN on brain function in patients with type 2 diabetes mellitus (T2DM) by characterizing the resting-state functional connectivity (FC) of the lower limb sensorimotor cortex (LSM). Methods Forty-four T2DM patients with diabetic peripheral neuropathy (DPN), 39 T2DM patients without diabetic peripheral neuropathy (ND), and 43 healthy controls (HCs) underwent a neuropsychological assessment and resting-state functional magnetic resonance imaging examinations to examine the differences in FC between the LSM and the whole brain. The relationships of FC with clinical/cognitive variables were examined. Results In comparison with the HCs group, the ND group showed reduced FC of the LSM with the right lateral occipitotemporal cortex (LOTC) and increased FC with the medial superior frontal gyrus (SFGmed), while the DPN group showed reduced FC of the LSM with the right cerebellar lobule VI, the right LOTC, the rostral prefrontal cortex (rPFC), and the anterior cingulate gyrus (ACC). Moreover, in comparison with the ND group, the DPN group showed reduced FC of the LSM with the ACC, SFGmed, and rPFC. In the DPN group, the FC between the LSM and right cerebellar lobule VI was significantly correlated with fasting blood glucose levels (r = -0.490, p = 0.001), and that between the LSM and ACC was significantly correlated with the Montreal Cognitive Assessment score (r = 0.479, p = 0.001). Conclusions Patients with T2DM may show abnormal motion-related visual perceptual function before the appearance of DPN. Importantly, DPN can influence the brain regions that maintain motion and motor control, and this effect is not limited to motor function, which may be the central neuropathological basis for diabetic peripheral neuropathy.
Collapse
Affiliation(s)
- Dongsheng Zhang
- Department of MRI, Shaanxi Provincial People’s Hospital, Xi’an, China
| | - Yang Huang
- Department of MRI, Shaanxi Provincial People’s Hospital, Xi’an, China
| | - Xiaoling Zhang
- Department of MRI, Shaanxi Provincial People’s Hospital, Xi’an, China
| | - Wanting Liu
- Department of MRI, Shaanxi Provincial People’s Hospital, Xi’an, China
| | - Yitong Guan
- Department of MRI, Shaanxi Provincial People’s Hospital, Xi’an, China
| | - Jie Gao
- Department of MRI, Shaanxi Provincial People’s Hospital, Xi’an, China
| | - Xiaoyan Lei
- Department of MRI, Shaanxi Provincial People’s Hospital, Xi’an, China
| | - Min Tang
- Department of MRI, Shaanxi Provincial People’s Hospital, Xi’an, China
| | - Kai Ai
- Department of Clinical Science, Philips Healthcare, Xi’an, China
| | - Xuejiao Yan
- Department of MRI, Shaanxi Provincial People’s Hospital, Xi’an, China
| |
Collapse
|
7
|
Pillet I, Cerrahoğlu B, Philips RV, Dumoulin S, Op de Beeck H. A 7T fMRI investigation of hand and tool areas in the lateral and ventral occipitotemporal cortex. PLoS One 2024; 19:e0308565. [PMID: 39499698 PMCID: PMC11537398 DOI: 10.1371/journal.pone.0308565] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2023] [Accepted: 07/26/2024] [Indexed: 11/07/2024] Open
Abstract
Previous studies demonstrated the existence of hand and tool areas in lateral and ventral occipitotemporal cortex (OTC), as well as an overlap between them. We reinvestigated this organization using 7T fMRI, benefiting from a higher signal-to-noise ratio than 3T. This enabled us to include a wider array of categories to achieve a more holistic perspective, and to omit certain spatial preprocessing steps. Despite these improvements, univariate analysis confirmed the existence of hand-tool overlap across OTC, which is striking given the omission of the spatial preprocessing steps that can influence overlap. There was significantly more overlap between hands and tools, compared to other overlap types in the left hemisphere of OTC. The overlap was also larger in the left lateral OTC as compared to the right lateral OTC. We found in all hand areas a differentiation between tools and other types of objects, although they still responded more to bodies than to tools. Regarding the tool areas, we observed a differentiation between hands and other categories such as faces and non-tool objects. Left hemisphere tool areas also differentiated between hands and bodies. When excluding the overlapping voxels from the hand and tool areas, they still showed a significant response to tools or hands (compared to objects or faces) respectively. Multi-voxel pattern analysis indicated that neural representations in the hand areas showed greater similarity between hands and tools than between hands and other objects. In the tool areas, the neural representations between tools and hands and between tools and other type of objects were all equally similar. To summarize, capitalizing on the benefits of 7T fMRI, we further substantiate the evidence in favor of hand-tool overlap in several regions of occipitotemporal cortex.
Collapse
Affiliation(s)
- Ineke Pillet
- Department of Brain and Cognition, Leuven Brain Institute, KU Leuven, Leuven, Belgium
| | - Begüm Cerrahoğlu
- Department of Brain and Cognition, Leuven Brain Institute, KU Leuven, Leuven, Belgium
- 2LPN (Laboratoire Lorrain de Psychologie et Neurosciences de la Dynamique des Comportements), Université de Lorraine, Nancy, France
| | - Roxane Victoria Philips
- Department of Brain and Cognition, Leuven Brain Institute, KU Leuven, Leuven, Belgium
- Department of Cognitive and Behavioral Sciences, University of Luxembourg, Esch-sur-Alzette, Luxembourg
| | - Serge Dumoulin
- Spinoza Centre for Neuroimaging, Amsterdam, Netherlands
- Computational Cognitive Neuroscience and Neuroimaging, Netherlands Institute for Neuroscience, Amsterdam, Netherlands
- Experimental and Applied Psychology, Vrije University Amsterdam, Amsterdam, Netherlands
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, Netherlands
| | - Hans Op de Beeck
- Department of Brain and Cognition, Leuven Brain Institute, KU Leuven, Leuven, Belgium
| |
Collapse
|
8
|
Margalit E, Lee H, Finzi D, DiCarlo JJ, Grill-Spector K, Yamins DLK. A unifying framework for functional organization in early and higher ventral visual cortex. Neuron 2024; 112:2435-2451.e7. [PMID: 38733985 PMCID: PMC11257790 DOI: 10.1016/j.neuron.2024.04.018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2023] [Revised: 12/08/2023] [Accepted: 04/15/2024] [Indexed: 05/13/2024]
Abstract
A key feature of cortical systems is functional organization: the arrangement of functionally distinct neurons in characteristic spatial patterns. However, the principles underlying the emergence of functional organization in the cortex are poorly understood. Here, we develop the topographic deep artificial neural network (TDANN), the first model to predict several aspects of the functional organization of multiple cortical areas in the primate visual system. We analyze the factors driving the TDANN's success and find that it balances two objectives: learning a task-general sensory representation and maximizing the spatial smoothness of responses according to a metric that scales with cortical surface area. In turn, the representations learned by the TDANN are more brain-like than in spatially unconstrained models. Finally, we provide evidence that the TDANN's functional organization balances performance with between-area connection length. Our results offer a unified principle for understanding the functional organization of the primate ventral visual system.
Collapse
Affiliation(s)
- Eshed Margalit
- Neurosciences Graduate Program, Stanford University, Stanford, CA 94305, USA.
| | - Hyodong Lee
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139, USA
| | - Dawn Finzi
- Department of Psychology, Stanford University, Stanford, CA 94305, USA; Department of Computer Science, Stanford University, Stanford, CA 94305, USA
| | - James J DiCarlo
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139, USA; McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139, USA; Center for Brains Minds and Machines, Massachusetts Institute of Technology, Cambridge, MA 02139, USA
| | - Kalanit Grill-Spector
- Department of Psychology, Stanford University, Stanford, CA 94305, USA; Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA 94305, USA
| | - Daniel L K Yamins
- Department of Psychology, Stanford University, Stanford, CA 94305, USA; Department of Computer Science, Stanford University, Stanford, CA 94305, USA; Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA 94305, USA
| |
Collapse
|
9
|
Zhu H, Ge Y, Bratch A, Yuille A, Kay K, Kersten D. Natural scenes reveal diverse representations of 2D and 3D body pose in the human brain. Proc Natl Acad Sci U S A 2024; 121:e2317707121. [PMID: 38830105 PMCID: PMC11181088 DOI: 10.1073/pnas.2317707121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2023] [Accepted: 04/25/2024] [Indexed: 06/05/2024] Open
Abstract
Human pose, defined as the spatial relationships between body parts, carries instrumental information supporting the understanding of motion and action of a person. A substantial body of previous work has identified cortical areas responsive to images of bodies and different body parts. However, the neural basis underlying the visual perception of body part relationships has received less attention. To broaden our understanding of body perception, we analyzed high-resolution fMRI responses to a wide range of poses from over 4,000 complex natural scenes. Using ground-truth annotations and an application of three-dimensional (3D) pose reconstruction algorithms, we compared similarity patterns of cortical activity with similarity patterns built from human pose models with different levels of depth availability and viewpoint dependency. Targeting the challenge of explaining variance in complex natural image responses with interpretable models, we achieved statistically significant correlations between pose models and cortical activity patterns (though performance levels are substantially lower than the noise ceiling). We found that the 3D view-independent pose model, compared with two-dimensional models, better captures the activation from distinct cortical areas, including the right posterior superior temporal sulcus (pSTS). These areas, together with other pose-selective regions in the LOTC, form a broader, distributed cortical network with greater view-tolerance in more anterior patches. We interpret these findings in light of the computational complexity of natural body images, the wide range of visual tasks supported by pose structures, and possible shared principles for view-invariant processing between articulated objects and ordinary, rigid objects.
Collapse
Affiliation(s)
- Hongru Zhu
- Department of Cognitive Science, Johns Hopkins University, Baltimore, MD21218
| | - Yijun Ge
- Department of Psychology, University of Minnesota, Minneapolis, MN55455
- Laboratory for Consciousness, Riken Center for Brain Science, Wako, Saitama3510198, Japan
| | - Alexander Bratch
- Department of Psychology, University of Minnesota, Minneapolis, MN55455
| | - Alan Yuille
- Department of Cognitive Science, Johns Hopkins University, Baltimore, MD21218
| | - Kendrick Kay
- Center for Magnetic Resonance Research, Department of Radiology, University of Minnesota, Minneapolis, MN55455
| | - Daniel Kersten
- Department of Psychology, University of Minnesota, Minneapolis, MN55455
| |
Collapse
|
10
|
Mazurchuk S, Fernandino L, Tong JQ, Conant LL, Binder JR. The neural representation of body part concepts. Cereb Cortex 2024; 34:bhae213. [PMID: 38863113 PMCID: PMC11166504 DOI: 10.1093/cercor/bhae213] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2023] [Revised: 04/26/2024] [Accepted: 04/27/2024] [Indexed: 06/13/2024] Open
Abstract
Neuropsychological and neuroimaging studies provide evidence for a degree of category-related organization of conceptual knowledge in the brain. Some of this evidence indicates that body part concepts are distinctly represented from other categories; yet, the neural correlates and mechanisms underlying these dissociations are unclear. We expand on the limited prior data by measuring functional magnetic resonance imaging responses induced by body part words and performing a series of analyses investigating the cortical representation of this semantic category. Across voxel-level contrasts, pattern classification, representational similarity analysis, and vertex-wise encoding analyses, we find converging evidence that the posterior middle temporal gyrus, the supramarginal gyrus, and the ventral premotor cortex in the left hemisphere play important roles in the preferential representation of this category compared to other concrete objects.
Collapse
Affiliation(s)
- Stephen Mazurchuk
- Department of Neurology, Medical College of Wisconsin, 8701 Watertown Plank Road, Milwaukee, WI 53226, United States
- Department of Biophysics, Medical College of Wisconsin, 8701 Watertown Plank Road, Milwaukee, WI 53226, United States
| | - Leonardo Fernandino
- Department of Neurology, Medical College of Wisconsin, 8701 Watertown Plank Road, Milwaukee, WI 53226, United States
- Department of Biomedical Engineering, Medical College of Wisconsin, 8701 Watertown Plank Road, Milwaukee, WI 53226, United States
| | - Jia-Qing Tong
- Department of Neurology, Medical College of Wisconsin, 8701 Watertown Plank Road, Milwaukee, WI 53226, United States
- Department of Biophysics, Medical College of Wisconsin, 8701 Watertown Plank Road, Milwaukee, WI 53226, United States
| | - Lisa L Conant
- Department of Neurology, Medical College of Wisconsin, 8701 Watertown Plank Road, Milwaukee, WI 53226, United States
| | - Jeffrey R Binder
- Department of Neurology, Medical College of Wisconsin, 8701 Watertown Plank Road, Milwaukee, WI 53226, United States
- Department of Biophysics, Medical College of Wisconsin, 8701 Watertown Plank Road, Milwaukee, WI 53226, United States
| |
Collapse
|
11
|
Ip K, Kusyk N, Stephen ID, Brooks KR. Did you skip leg day? The neural mechanisms of muscle perception for body parts. Cortex 2024; 171:75-89. [PMID: 37980724 DOI: 10.1016/j.cortex.2023.10.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2023] [Revised: 09/18/2023] [Accepted: 10/02/2023] [Indexed: 11/21/2023]
Abstract
While the neural mechanisms underpinning the perception of muscularity are poorly understood, recent progress has been made using the psychophysical technique of visual adaptation. Prolonged visual exposure to high (low) muscularity bodies causes subsequently viewed bodies to appear less (more) muscular, revealing a recalibration of the neural populations encoding muscularity. Here, we use visual adaptation to further elucidate the tuning properties of the neural processes underpinning muscle perception for the upper and lower halves of the body. Participants manipulated the apparent muscularity of upper and lower bodies until they appeared 'normal', prior to and following exposure to a series of top/bottom halves of bodies that were either high or low in muscularity. In Experiment 1, participants were adapted to isolated own-gender body halves from one of four conditions; increased (muscularity) upper (body half), increased lower, decreased upper, or decreased lower. Despite the presence of muscle aftereffects when the body halves the participants viewed and manipulated were congruent, there was only weak evidence of muscle aftereffect transfer between the upper and lower halves of the body. Aftereffects were significantly weaker when body halves were incongruent, implying minimal overlap in the neural mechanisms encoding muscularity for body half. Experiment 2 examined the generalisability of Experiment 1's findings in a more ecologically valid context using whole-body stimuli, producing a similar pattern of results as Experiment 1, but with no evidence of cross-adaptation. Taken together, the findings are most consistent with muscle-encoding neural populations that are body-half selective. As visual adaptation has been implicated in cases of body size and shape misperception, the present study furthers our current understanding of how these perceptual inaccuracies, particularly those involving muscularity, are developed, maintained, and may potentially be treated.
Collapse
Affiliation(s)
- Keefe Ip
- School of Psychological Sciences, Macquarie University, Sydney, NSW, Australia.
| | - Nicole Kusyk
- School of Psychological Sciences, Macquarie University, Sydney, NSW, Australia
| | - Ian D Stephen
- NTU Psychology, Nottingham Trent University, Nottingham, England, UK
| | - Kevin R Brooks
- School of Psychological Sciences, Macquarie University, Sydney, NSW, Australia; Perception and Action Research Centre (PARC), Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney, NSW, Australia; Lifespan Health & Wellbeing Research Centre, Macquarie University, Sydney, NSW, Australia
| |
Collapse
|
12
|
Kirsch LP, Tanzer M, Filippetti ML, von Mohr M, Fotopoulou A. Mother knows best: Mothers are more egocentric towards their own child's bodily feelings. COMMUNICATIONS PSYCHOLOGY 2023; 1:s44271-023-00038-5. [PMID: 38694256 PMCID: PMC7615916 DOI: 10.1038/s44271-023-00038-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/09/2022] [Accepted: 11/17/2023] [Indexed: 05/04/2024]
Abstract
Our emotional state can influence how we understand other people's emotions, leading to biases in social understanding. Yet emotional egocentric biases in specific relationships such as parent-child dyads, where not only understanding but also emotional and bodily regulation is key, remain relatively unexplored. To investigate these biases and control for sensory priors, we first conducted two experiments in dyads of adult strangers (total N=75) using a bodily Emotional Egocentricity Task that enables simultaneous affective tactile stimulation within a dyad. We showed its effectiveness in eliciting both classical and sensory-controlled egocentric biases. We then recruited 68 mother-child dyads and found that mothers exhibit higher classical and sensory-controlled emotional egocentric biases towards their own child compared to an unfamiliar child. Results suggest that mothers tend to rely on their bodily feelings more when judging the states of their own child than those of other children, possibly consistent with their regulatory parental role.
Collapse
Affiliation(s)
- Louise P. Kirsch
- Université Paris Cité, CNRS, Integrative Neuroscience and Cognition Center, F-75006 Paris, France
| | - Michal Tanzer
- Research Department of Clinical, Educational and Health Psychology, University College London, London, UK
| | | | - Mariana von Mohr
- Lab of Action and Body, Department of Psychology, Royal Holloway, University of London, London, United Kingdom
| | - Aikaterini Fotopoulou
- Research Department of Clinical, Educational and Health Psychology, University College London, London, UK
| |
Collapse
|
13
|
Vannuscorps G, Caramazza A. Effector-specific motor simulation supplements core action recognition processes in adverse conditions. Soc Cogn Affect Neurosci 2023; 18:nsad046. [PMID: 37688518 PMCID: PMC10576201 DOI: 10.1093/scan/nsad046] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2023] [Revised: 08/10/2023] [Accepted: 09/05/2023] [Indexed: 09/11/2023] Open
Abstract
Observing other people acting activates imitative motor plans in the observer. Whether, and if so when and how, such 'effector-specific motor simulation' contributes to action recognition remains unclear. We report that individuals born without upper limbs (IDs)-who cannot covertly imitate upper-limb movements-are significantly less accurate at recognizing degraded (but not intact) upper-limb than lower-limb actions (i.e. point-light animations). This finding emphasizes the need to reframe the current controversy regarding the role of effector-specific motor simulation in action recognition: instead of focusing on the dichotomy between motor and non-motor theories, the field would benefit from new hypotheses specifying when and how effector-specific motor simulation may supplement core action recognition processes to accommodate the full variety of action stimuli that humans can recognize.
Collapse
Affiliation(s)
- Gilles Vannuscorps
- Psychological Sciences Research Institute, Université catholique de Louvain, Place Cardinal Mercier 10, 1348, Louvain-la-Neuve, Belgium
- Institute of Neuroscience, Université catholique de Louvain, Avenue E. Mounier 53, Brussels 1200, Belgium
- Department of Psychology, Harvard University, Kirkland Street 33, Cambridge, MA 02138, USA
| | - Alfonso Caramazza
- Department of Psychology, Harvard University, Kirkland Street 33, Cambridge, MA 02138, USA
- CIMEC (Center for Mind-Brain Sciences), University of Trento, Via delle Regole 101, Mattarello TN 38123, Italy
| |
Collapse
|
14
|
Ambroziak KB, Bofill MA, Azañón E, Longo MR. Perceptual aftereffects of adiposity transfer from hands to whole bodies. Exp Brain Res 2023; 241:2371-2379. [PMID: 37620437 DOI: 10.1007/s00221-023-06686-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2023] [Accepted: 08/08/2023] [Indexed: 08/26/2023]
Abstract
Adaptation aftereffects for features such as identity and gender have been shown to transfer between faces and bodies, and faces and body parts, i.e. hands. However, no studies have investigated transfer of adaptation aftereffects between whole bodies and body parts. The present study investigated whether visual adaptation aftereffects transfer between hands and whole bodies in the context of adiposity judgements (i.e. how thin or fat a body is). On each trial, participants had to decide whether the body they saw was thinner or fatter than average. Participants performed the task before and after exposure to a thin/fat hand. Consistent with body adaptation studies, after exposure to a slim hand participants judged subsequently presented bodies to be fatter than after adaptation to a fat hand. These results suggest that there may be links between visual representations of body adiposity for whole bodies and body parts.
Collapse
Affiliation(s)
- Klaudia B Ambroziak
- Department of Psychological Sciences, Birkbeck, University of London, Malet Street, London, WC1E 7HX, UK.
| | - Marina Araujo Bofill
- Department of Psychological Sciences, Birkbeck, University of London, Malet Street, London, WC1E 7HX, UK
| | - Elena Azañón
- Institute of Psychology, Otto-Von-Guericke University, Universitätsplatz 2, 39016, Magdeburg, Germany
- Center for Behavioral Brain Sciences, Universitätsplatz 2, 39106, Magdeburg, Germany
- Department of Behavioral Neurology, Leibniz Institute for Neurobiology, Brenneckestraße 6, 39118, Magdeburg, Germany
| | - Matthew R Longo
- Department of Psychological Sciences, Birkbeck, University of London, Malet Street, London, WC1E 7HX, UK.
| |
Collapse
|
15
|
Moreau Q, Parrotta E, Pesci UG, Era V, Candidi M. Early categorization of social affordances during the visual encoding of bodily stimuli. Neuroimage 2023; 274:120151. [PMID: 37191657 DOI: 10.1016/j.neuroimage.2023.120151] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2022] [Revised: 04/27/2023] [Accepted: 04/30/2023] [Indexed: 05/17/2023] Open
Abstract
Interpersonal interactions rely on various communication channels, both verbal and non-verbal, through which information regarding one's intentions and emotions are perceived. Here, we investigated the neural correlates underlying the visual processing of hand postures conveying social affordances (i.e., hand-shaking), compared to control stimuli such as hands performing non-social actions (i.e., grasping) or showing no movement at all. Combining univariate and multivariate analysis on electroencephalography (EEG) data, our results indicate that occipito-temporal electrodes show early differential processing of stimuli conveying social information compared to non-social ones. First, the amplitude of the Early Posterior Negativity (EPN, an Event-Related Potential related to the perception of body parts) is modulated differently during the perception of social and non-social content carried by hands. Moreover, our multivariate classification analysis (MultiVariate Pattern Analysis - MVPA) expanded the univariate results by revealing early (<200 ms) categorization of social affordances over occipito-parietal sites. In conclusion, we provide new evidence suggesting that the encoding of socially relevant hand gestures is categorized in the early stages of visual processing.
Collapse
Affiliation(s)
- Q Moreau
- Department of Psychology, Sapienza University, Rome, Italy; IRCCS Fondazione Santa Lucia, Rome, Italy.
| | - E Parrotta
- Department of Psychology, Sapienza University, Rome, Italy; IRCCS Fondazione Santa Lucia, Rome, Italy
| | - U G Pesci
- Department of Psychology, Sapienza University, Rome, Italy; IRCCS Fondazione Santa Lucia, Rome, Italy
| | - V Era
- Department of Psychology, Sapienza University, Rome, Italy; IRCCS Fondazione Santa Lucia, Rome, Italy
| | - M Candidi
- Department of Psychology, Sapienza University, Rome, Italy; IRCCS Fondazione Santa Lucia, Rome, Italy.
| |
Collapse
|
16
|
Margalit E, Lee H, Finzi D, DiCarlo JJ, Grill-Spector K, Yamins DLK. A Unifying Principle for the Functional Organization of Visual Cortex. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.05.18.541361. [PMID: 37292946 PMCID: PMC10245753 DOI: 10.1101/2023.05.18.541361] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
A key feature of many cortical systems is functional organization: the arrangement of neurons with specific functional properties in characteristic spatial patterns across the cortical surface. However, the principles underlying the emergence and utility of functional organization are poorly understood. Here we develop the Topographic Deep Artificial Neural Network (TDANN), the first unified model to accurately predict the functional organization of multiple cortical areas in the primate visual system. We analyze the key factors responsible for the TDANN's success and find that it strikes a balance between two specific objectives: achieving a task-general sensory representation that is self-supervised, and maximizing the smoothness of responses across the cortical sheet according to a metric that scales relative to cortical surface area. In turn, the representations learned by the TDANN are lower dimensional and more brain-like than those in models that lack a spatial smoothness constraint. Finally, we provide evidence that the TDANN's functional organization balances performance with inter-area connection length, and use the resulting models for a proof-of-principle optimization of cortical prosthetic design. Our results thus offer a unified principle for understanding functional organization and a novel view of the functional role of the visual system in particular.
Collapse
Affiliation(s)
- Eshed Margalit
- Neurosciences Graduate Program, Stanford University, Stanford, CA 94305
| | - Hyodong Lee
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139
| | - Dawn Finzi
- Department of Psychology, Stanford University, Stanford, CA 94305
- Department of Computer Science, Stanford University, Stanford, CA 94305
| | - James J DiCarlo
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139
- Center for Brains Minds and Machines, Massachusetts Institute of Technology, Cambridge, MA 02139
| | - Kalanit Grill-Spector
- Department of Psychology, Stanford University, Stanford, CA 94305
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA 94305
| | - Daniel L K Yamins
- Department of Psychology, Stanford University, Stanford, CA 94305
- Department of Computer Science, Stanford University, Stanford, CA 94305
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA 94305
| |
Collapse
|
17
|
Yizhar O, Tal Z, Amedi A. Loss of action-related function and connectivity in the blind extrastriate body area. Front Neurosci 2023; 17:973525. [PMID: 36968509 PMCID: PMC10035577 DOI: 10.3389/fnins.2023.973525] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2022] [Accepted: 02/23/2023] [Indexed: 03/11/2023] Open
Abstract
The Extrastriate Body Area (EBA) participates in the visual perception and motor actions of body parts. We recently showed that EBA’s perceptual function develops independently of visual experience, responding to stimuli with body-part information in a supramodal fashion. However, it is still unclear if the EBA similarly maintains its action-related function. Here, we used fMRI to study motor-evoked responses and connectivity patterns in the congenitally blind brain. We found that, unlike the case of perception, EBA does not develop an action-related response without visual experience. In addition, we show that congenital blindness alters EBA’s connectivity profile in a counterintuitive way—functional connectivity with sensorimotor cortices dramatically decreases, whereas connectivity with perception-related visual occipital cortices remains high. To the best of our knowledge, we show for the first time that action-related functions and connectivity in the visual cortex could be contingent on visuomotor experience. We further discuss the role of the EBA within the context of visuomotor control and predictive coding theory.
Collapse
Affiliation(s)
- Or Yizhar
- Department of Cognitive and Brain Sciences, The Hebrew University of Jerusalem, Jerusalem, Israel
- Ivcher School of Psychology, The Institute for Brain, Mind and Technology, Reichman University, Herzliya, Israel
- Research Group Adaptive Memory and Decision Making, Max Planck Institute for Human Development, Berlin, Germany
- *Correspondence: Or Yizhar,
| | - Zohar Tal
- Faculty of Psychology and Educational Sciences, University of Coimbra, Coimbra, Portugal
| | - Amir Amedi
- Ivcher School of Psychology, The Institute for Brain, Mind and Technology, Reichman University, Herzliya, Israel
- The Ruth & Meir Rosenthal Brain Imaging Center, Reichman University, Herzliya, Israel
| |
Collapse
|
18
|
He H, Zhuo Y, He S, Zhang J. The transition from invariant to action-dependent visual object representation in human dorsal pathway. Cereb Cortex 2022; 32:5503-5511. [PMID: 35165684 DOI: 10.1093/cercor/bhac030] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2021] [Revised: 01/12/2022] [Accepted: 01/13/2021] [Indexed: 01/25/2023] Open
Abstract
The human brain can efficiently process action-related visual information, which supports our ability to quickly understand and learn others' actions. The visual information of goal-directed action is extensively represented in the parietal and frontal cortex, but how actions and goal-objects are represented within this neural network is not fully understood. Specifically, which part of this dorsal network represents the identity of goal-objects? Is such goal-object information encoded at an abstract level or highly interactive with action representations? Here, we used functional magnetic resonance imaging with a large number of participants (n = 94) to investigate the neural representation of goal-objects and actions when participants viewed goal-directed action videos. Our results showed that the goal-directed action information could be decoded across much of the dorsal pathway, but in contrast, the invariant goal-object information independent of action was mainly localized in the early stage of dorsal pathway in parietal cortex rather than the down-stream areas of the parieto-frontal cortex. These results help us to understand the relationship between action and goal-object representations in the dorsal pathway, and the evolution of interactive representation of goal-objects and actions along the dorsal pathway during goal-directed action observation.
Collapse
Affiliation(s)
- HuiXia He
- Institute of Biophysics, Chinese Academy of Sciences, 15 Datun Road, Chaoyang District, Beijing 100101, China.,University of Chinese Academy of Sciences, 19(A) Yuquan Road, Shijingshan District, Beijing 100049, China
| | - Yan Zhuo
- Institute of Biophysics, Chinese Academy of Sciences, 15 Datun Road, Chaoyang District, Beijing 100101, China.,University of Chinese Academy of Sciences, 19(A) Yuquan Road, Shijingshan District, Beijing 100049, China.,CAS Center for Excellence in Brain Science and Intelligence Technology, 320 Yueyang Road, Shanghai 20031, China
| | - Sheng He
- Institute of Biophysics, Chinese Academy of Sciences, 15 Datun Road, Chaoyang District, Beijing 100101, China.,University of Chinese Academy of Sciences, 19(A) Yuquan Road, Shijingshan District, Beijing 100049, China.,CAS Center for Excellence in Brain Science and Intelligence Technology, 320 Yueyang Road, Shanghai 20031, China.,School of Artificial Intelligence, University of Chinese Academy of Sciences, 19(A) Yuquan Road, Shijingshan District, Beijing 100049, China
| | - Jiedong Zhang
- Institute of Biophysics, Chinese Academy of Sciences, 15 Datun Road, Chaoyang District, Beijing 100101, China.,University of Chinese Academy of Sciences, 19(A) Yuquan Road, Shijingshan District, Beijing 100049, China
| |
Collapse
|
19
|
Gallant SN, Kennedy BL, Bachman SL, Huang R, Cho C, Lee TH, Mather M. Behavioral and fMRI evidence that arousal enhances bottom-up selectivity in young but not older adults. Neurobiol Aging 2022; 120:149-166. [PMID: 36198230 PMCID: PMC9805381 DOI: 10.1016/j.neurobiolaging.2022.08.006] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2021] [Revised: 08/09/2022] [Accepted: 08/12/2022] [Indexed: 01/03/2023]
Abstract
The locus coeruleus-noradrenergic system integrates signals about arousal states throughout the brain and helps coordinate cognitive selectivity. However, age-related changes in this system may impact how arousal coordinates selectivity in older adults. To examine this, we compared how increases in emotional arousal modulates cognitive selectivity for images differing in perceptual salience in young and older adults. Using functional magnetic resonance imaging, we found that relative to older adults, hearing an arousing sound enhanced young adults' bottom-up processing and incidental memory for high versus low salience category-selective body images. We also examined how arousing sounds impacted a top-down goal to detect dot-probes that appeared immediately after high or low salience images. We found that young adults were slower to detect probes appearing after high salience body images on arousing trials, whereas older adults showed this pattern on non-arousing trials. Taken together, our findings show that arousal's effect on selectivity changes with age and differs across bottom-up and top-down processing.
Collapse
Affiliation(s)
- Sara N. Gallant
- Davis School of Gerontology, University of Southern California, Los Angeles, CA
| | - Briana L. Kennedy
- School of Psychological Science, University of Western Australia, Perth, Australia
| | - Shelby L. Bachman
- Davis School of Gerontology, University of Southern California, Los Angeles, CA
| | - Ringo Huang
- Department of Psychology, University of California, Los Angeles, Los Angeles, CA
| | - Christine Cho
- Davis School of Gerontology, University of Southern California, Los Angeles, CA
| | - Tae-Ho Lee
- Department of Psychology, Virginia Tech, Blacksburg, VA, United States
| | - Mara Mather
- Davis School of Gerontology, University of Southern California, Los Angeles, CA
| |
Collapse
|
20
|
Park J, Josephs E, Konkle T. Ramp-shaped neural tuning supports graded population-level representation of the object-to-scene continuum. Sci Rep 2022; 12:18081. [PMID: 36302932 PMCID: PMC9613906 DOI: 10.1038/s41598-022-21768-2] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2022] [Accepted: 09/30/2022] [Indexed: 01/24/2023] Open
Abstract
We can easily perceive the spatial scale depicted in a picture, regardless of whether it is a small space (e.g., a close-up view of a chair) or a much larger space (e.g., an entire class room). How does the human visual system encode this continuous dimension? Here, we investigated the underlying neural coding of depicted spatial scale, by examining the voxel tuning and topographic organization of brain responses. We created naturalistic yet carefully-controlled stimuli by constructing virtual indoor environments, and rendered a series of snapshots to smoothly sample between a close-up view of the central object and far-scale view of the full environment (object-to-scene continuum). Human brain responses were measured to each position using functional magnetic resonance imaging. We did not find evidence for a smooth topographic mapping for the object-to-scene continuum on the cortex. Instead, we observed large swaths of cortex with opposing ramp-shaped profiles, with highest responses to one end of the object-to-scene continuum or the other, and a small region showing a weak tuning to intermediate scale views. However, when we considered the population code of the entire ventral occipito-temporal cortex, we found smooth and linear representation of the object-to-scene continuum. Our results together suggest that depicted spatial scale information is encoded parametrically in large-scale population codes across the entire ventral occipito-temporal cortex.
Collapse
Affiliation(s)
- Jeongho Park
- Department of Psychology, Harvard University, Cambridge, USA.
| | - Emilie Josephs
- Computer Science & Artificial Intelligence Lab, Massachusetts Institute of Technology, Cambridge, USA
| | - Talia Konkle
- Department of Psychology, Harvard University, Cambridge, USA
| |
Collapse
|
21
|
Abstract
Visual representations of bodies, in addition to those of faces, contribute to the recognition of con- and heterospecifics, to action recognition, and to nonverbal communication. Despite its importance, the neural basis of the visual analysis of bodies has been less studied than that of faces. In this article, I review what is known about the neural processing of bodies, focusing on the macaque temporal visual cortex. Early single-unit recording work suggested that the temporal visual cortex contains representations of body parts and bodies, with the dorsal bank of the superior temporal sulcus representing bodily actions. Subsequent functional magnetic resonance imaging studies in both humans and monkeys showed several temporal cortical regions that are strongly activated by bodies. Single-unit recordings in the macaque body patches suggest that these represent mainly body shape features. More anterior patches show a greater viewpoint-tolerant selectivity for body features, which may reflect a processing principle shared with other object categories, including faces. Expected final online publication date for the Annual Review of Vision Science, Volume 8 is September 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.
Collapse
Affiliation(s)
- Rufin Vogels
- Laboratorium voor Neuro- en Psychofysiologie, KU Leuven, Belgium; .,Leuven Brain Institute, KU Leuven, Belgium
| |
Collapse
|
22
|
Caggiano P, Grossi G, De Mattia LC, vanVelzen J, Cocchini G. Objects with motor valence affect the visual processing of human body parts: Evidence from behavioural and ERP studies. Cortex 2022; 153:194-206. [DOI: 10.1016/j.cortex.2022.04.016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2021] [Revised: 01/06/2022] [Accepted: 04/14/2022] [Indexed: 11/16/2022]
|
23
|
Gao X, Wen M, Sun M, Rossion B. A Genuine Interindividual Variability in Number and Anatomical Localization of Face-Selective Regions in the Human Brain. Cereb Cortex 2022; 32:4834-4856. [PMID: 35088077 DOI: 10.1093/cercor/bhab519] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2021] [Revised: 12/15/2021] [Accepted: 12/16/2021] [Indexed: 12/13/2022] Open
Abstract
Neuroimaging studies have reported regions with more neural activation to face than nonface stimuli in the human occipitotemporal cortex for three decades. Here we used a highly sensitive and reliable frequency-tagging functional magnetic resonance imaging paradigm measuring high-level face-selective neural activity to assess interindividual variability in the localization and number of face-selective clusters. Although the majority of these clusters are located in the same cortical gyri and sulci across 25 adult brains, a volume-based analysis of unsmoothed data reveals a large amount of interindividual variability in their spatial distribution and number, particularly in the ventral occipitotemporal cortex. In contrast to the widely held assumption, these face-selective clusters cannot be objectively related on a one-to-one basis across individual brains, do not correspond to a single cytoarchitectonic region, and are not clearly demarcated by estimated posteroanterior cytoarchitectonic borders. Interindividual variability in localization and number of cortical face-selective clusters does not appear to be due to the measurement noise but seems to be genuine, casting doubt on definite labeling and interindividual correspondence of face-selective "areas" and questioning their a priori definition based on cytoarchitectony or probabilistic atlases of independent datasets. These observations challenge conventional models of human face recognition based on a fixed number of discrete neurofunctional information processing stages.
Collapse
Affiliation(s)
- Xiaoqing Gao
- Center for Psychological Sciences, Zhejiang University, Hangzhou 310028, China
| | - Minjie Wen
- Department of Psychology, Zhejiang University, Hangzhou 310028, China
| | - Mengdan Sun
- Center for Psychological Sciences, Zhejiang University, Hangzhou 310028, China
| | - Bruno Rossion
- Université de Lorraine, CNRS, CRAN, F-54000, Nancy, France
- Université de Lorraine, CHRU-Nancy, Service de Neurologie, F-54000 Nancy, France
| |
Collapse
|
24
|
One object, two networks? Assessing the relationship between the face and body-selective regions in the primate visual system. Brain Struct Funct 2021; 227:1423-1438. [PMID: 34792643 DOI: 10.1007/s00429-021-02420-7] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2021] [Accepted: 10/22/2021] [Indexed: 10/19/2022]
Abstract
Faces and bodies are often treated as distinct categories that are processed separately by face- and body-selective brain regions in the primate visual system. These regions occupy distinct regions of visual cortex and are often thought to constitute independent functional networks. Yet faces and bodies are part of the same object and their presence inevitably covary in naturalistic settings. Here, we re-evaluate both the evidence supporting the independent processing of faces and bodies and the organizational principles that have been invoked to explain this distinction. We outline four hypotheses ranging from completely separate networks to a single network supporting the perception of whole people or animals. The current evidence, especially in humans, is compatible with all of these hypotheses, making it presently unclear how the representation of faces and bodies is organized in the cortex.
Collapse
|
25
|
Ritchie JB, Zeman AA, Bosmans J, Sun S, Verhaegen K, Op de Beeck HP. Untangling the Animacy Organization of Occipitotemporal Cortex. J Neurosci 2021; 41:7103-7119. [PMID: 34230104 PMCID: PMC8372013 DOI: 10.1523/jneurosci.2628-20.2021] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2020] [Revised: 04/20/2021] [Accepted: 05/20/2021] [Indexed: 11/21/2022] Open
Abstract
Some of the most impressive functional specializations in the human brain are found in the occipitotemporal cortex (OTC), where several areas exhibit selectivity for a small number of visual categories, such as faces and bodies, and spatially cluster based on stimulus animacy. Previous studies suggest this animacy organization reflects the representation of an intuitive taxonomic hierarchy, distinct from the presence of face- and body-selective areas in OTC. Using human functional magnetic resonance imaging, we investigated the independent contribution of these two factors-the face-body division and taxonomic hierarchy-in accounting for the animacy organization of OTC and whether they might also be reflected in the architecture of several deep neural networks that have not been explicitly trained to differentiate taxonomic relations. We found that graded visual selectivity, based on animal resemblance to human faces and bodies, masquerades as an apparent animacy continuum, which suggests that taxonomy is not a separate factor underlying the organization of the ventral visual pathway.SIGNIFICANCE STATEMENT Portions of the visual cortex are specialized to determine whether types of objects are animate in the sense of being capable of self-movement. Two factors have been proposed as accounting for this animacy organization: representations of faces and bodies and an intuitive taxonomic continuum of humans and animals. We performed an experiment to assess the independent contribution of both of these factors. We found that graded visual representations, based on animal resemblance to human faces and bodies, masquerade as an apparent animacy continuum, suggesting that taxonomy is not a separate factor underlying the organization of areas in the visual cortex.
Collapse
Affiliation(s)
- J Brendan Ritchie
- Laboratory of Biological Psychology, Department of Brain and Cognition, Leuven Brain Institute, Katholieke Universiteit Leuven, 3000 Leuven, Belgium
| | - Astrid A Zeman
- Laboratory of Biological Psychology, Department of Brain and Cognition, Leuven Brain Institute, Katholieke Universiteit Leuven, 3000 Leuven, Belgium
| | - Joyce Bosmans
- Faculty of Medicine and Health Sciences, University of Antwerp, 2000 Antwerp, Belgium
| | - Shuo Sun
- Laboratory of Biological Psychology, Department of Brain and Cognition, Leuven Brain Institute, Katholieke Universiteit Leuven, 3000 Leuven, Belgium
| | - Kirsten Verhaegen
- Laboratory of Biological Psychology, Department of Brain and Cognition, Leuven Brain Institute, Katholieke Universiteit Leuven, 3000 Leuven, Belgium
| | - Hans P Op de Beeck
- Laboratory of Biological Psychology, Department of Brain and Cognition, Leuven Brain Institute, Katholieke Universiteit Leuven, 3000 Leuven, Belgium
| |
Collapse
|
26
|
Okamoto Y, Kitada R, Tanabe HC, Sasaki AT, Kochiyama T, Yahata N, Sadato N. The extrastriate body area is involved in reciprocal imitation of hand gestures, vocalizations, and facial expressions: A univariate and multivariate fMRI study. Soc Neurosci 2021; 16:448-465. [PMID: 34133907 DOI: 10.1080/17470919.2021.1944908] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
The extrastriate body area (EBA) in the lateral occipito-temporal cortex has an important role in reciprocal interaction, as it detects congruence between self and other's hand actions. However, it is unclear whether the EBA can detect congruence regardless of the type of action. In the present study, we examined the neural substrate underlying congruence detection of three types of actions: hand gestures, vocalizations, and facial expressions. A univariate analysis revealed a congruency effect, especially for imitating action, for all three types of actions in the EBA. A multi-voxel pattern analysis classifier in the EBA was able to distinguish between initiating interaction from responding to interaction in all experiments. Correspondingly, the congruency effect in the EBA revealed by univariate analysis was stronger for responding to than for initiating interaction. These findings suggest that the EBA might contribute to detect congruence regardless of the body part used (i.e. face or hand) and the type of action (i.e. gestural or vocal). Moreover, initiating and responding to interaction might be processed differently within the EBA. This study highlights the role of the EBA in comparing between self and other's actions beyond hand actions.Running head: Function of EBA in reciprocal imitation.
Collapse
Affiliation(s)
- Yuko Okamoto
- Waseda Institute for Advanced Study (WIAS), Waseda University, Tokyo, Japan
| | - Ryo Kitada
- Division of Psychology, School of Social Sciences, Nanyang Technological University, Singapore.,Faculty of Intercultural Studies, Kobe University, Hyogo, Japan
| | - Hiroki C Tanabe
- Department of Cognitive and Psychological Sciences, Graduate School of Informatics, Nagoya University, Nagoya, Japan
| | - Akihiro T Sasaki
- RIKEN Compass to Healthy Life Research Complex Program, Hyogo, Japan
| | | | - Noriaki Yahata
- Institute for Quantum Life Science, National Institutes for Quantum and Radiological Science and Technology, Chiba, Japan
| | - Norihiro Sadato
- Department of Cerebral Research, Division of Cerebral Integration, National Institute for Physiological Sciences, Aichi, Japan
| |
Collapse
|
27
|
de Haas B, Sereno MI, Schwarzkopf DS. Inferior Occipital Gyrus Is Organized along Common Gradients of Spatial and Face-Part Selectivity. J Neurosci 2021; 41:5511-5521. [PMID: 34016715 PMCID: PMC8221599 DOI: 10.1523/jneurosci.2415-20.2021] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2020] [Revised: 04/02/2021] [Accepted: 04/05/2021] [Indexed: 11/21/2022] Open
Abstract
The ventral visual stream of the human brain is subdivided into patches with categorical stimulus preferences, like faces or scenes. However, the functional organization within these areas is less clear. Here, we used functional magnetic resonance imaging and vertex-wise tuning models to independently probe spatial and face-part preferences in the inferior occipital gyrus (IOG) of healthy adult males and females. The majority of responses were well explained by Gaussian population tuning curves for both retinotopic location and the preferred relative position within a face. Parameter maps revealed a common gradient of spatial and face-part selectivity, with the width of tuning curves drastically increasing from posterior to anterior IOG. Tuning peaks clustered more idiosyncratically but were also correlated across maps of visual and face space. Preferences for the upper visual field went along with significantly increased coverage of the upper half of the face, matching recently discovered biases in human perception. Our findings reveal a broad range of neural face-part selectivity in IOG, ranging from narrow to "holistic." IOG is functionally organized along this gradient, which in turn is correlated with retinotopy.SIGNIFICANCE STATEMENT Brain imaging has revealed a lot about the large-scale organization of the human brain and visual system. For example, occipital cortex contains map-like representations of the visual field, while neurons in ventral areas cluster into patches with categorical preferences, like faces or scenes. Much less is known about the functional organization within these areas. Here, we focused on a well established face-preferring area-the inferior occipital gyrus (IOG). A novel neuroimaging paradigm allowed us to map the retinotopic and face-part tuning of many recording sites in IOG independently. We found a steep posterior-anterior gradient of decreasing face-part selectivity, which correlated with retinotopy. This suggests the functional role of ventral areas is not uniform and may follow retinotopic "protomaps."
Collapse
Affiliation(s)
- Benjamin de Haas
- Department of Psychology, Justus Liebig Universität, 35394 Giessen, Germany
- Experimental Psychology, University College London, London WC1E 6BT, United Kingdom
| | - Martin I Sereno
- Experimental Psychology, University College London, London WC1E 6BT, United Kingdom
- SDSU Imaging Center, San Diego State University, San Diego, California 92182
| | - D Samuel Schwarzkopf
- Experimental Psychology, University College London, London WC1E 6BT, United Kingdom
- School of Optometry and Vision Science, University of Auckland, Auckland 1142, New Zealand
| |
Collapse
|
28
|
Dressing A, Kaller CP, Martin M, Nitschke K, Kuemmerer D, Beume LA, Schmidt CSM, Musso M, Urbach H, Rijntjes M, Weiller C. Anatomical correlates of recovery in apraxia: A longitudinal lesion-mapping study in stroke patients. Cortex 2021; 142:104-121. [PMID: 34265734 DOI: 10.1016/j.cortex.2021.06.001] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2020] [Revised: 05/07/2021] [Accepted: 06/01/2021] [Indexed: 11/24/2022]
Abstract
OBJECTIVE This study investigates the clinical course of recovery of apraxia after left-hemisphere stroke and the underlying neuroanatomical correlates for persisting or recovering deficits in relation to the major processing streams in the network for motor cognition. METHODS 90 patients were examined during the acute (4.74 ± 2.73 days) and chronic (14.3 ± 15.39 months) stage after left-hemisphere stroke for deficits in meaningless imitation, as well as production and conceptual errors in tool use pantomime. Lesion correlates for persisting or recovering deficits were analyzed with an extension of the non-parametric Brunner-Munzel rank-order test for multi-factorial designs (two-way repeated-measures ANOVA) using acute images. RESULTS Meaningless imitation and tool use production deficits persisted into the chronic stage. Conceptual errors in tool use pantomime showed an almost complete recovery. Imitation errors persisted after occipitotemporal and superior temporal lesions in the dorso-dorsal stream. Chronic pantomime production errors were related to the supramarginal gyrus, the key structure of the ventro-dorsal stream. More anterior lesions in the ventro-dorsal stream (ventral premotor cortex) were additionally associated with poor recovery of production errors in pantomime. Conceptual errors in pantomime after temporal and supramarginal gyrus lesions persisted into the chronic stage. However, they resolved completely when related to angular gyrus or insular lesions. CONCLUSION The diverging courses of recovery in different apraxia tasks can be related to different mechanisms. Critical lesions to key structures of the network or entrance areas of the processing streams lead to persisting deficits in the corresponding tasks. Contrary, lesions located outside the core network but inducing a temporary network dysfunction allow good recovery e.g., of conceptual errors in pantomime. The identification of lesion correlates for different long-term recovery patterns in apraxia might also allow early clinical prediction of the course of recovery.
Collapse
Affiliation(s)
- Andrea Dressing
- Department of Neurology and Clinical Neuroscience, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany; Freiburg Brain Imaging Center, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany; BrainLinks-BrainTools Cluster of Excellence, University of Freiburg, Freiburg, Germany.
| | - Christoph P Kaller
- Freiburg Brain Imaging Center, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany; BrainLinks-BrainTools Cluster of Excellence, University of Freiburg, Freiburg, Germany; Dept. of Neuroradiology, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Markus Martin
- Department of Neurology and Clinical Neuroscience, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany; Freiburg Brain Imaging Center, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany; BrainLinks-BrainTools Cluster of Excellence, University of Freiburg, Freiburg, Germany
| | - Kai Nitschke
- Department of Neurology and Clinical Neuroscience, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany; Freiburg Brain Imaging Center, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Dorothee Kuemmerer
- Department of Neurology and Clinical Neuroscience, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany; Freiburg Brain Imaging Center, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Lena-A Beume
- Department of Neurology and Clinical Neuroscience, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany; Freiburg Brain Imaging Center, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Charlotte S M Schmidt
- Department of Neurology and Clinical Neuroscience, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany; Freiburg Brain Imaging Center, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Mariacristina Musso
- Department of Neurology and Clinical Neuroscience, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany; Freiburg Brain Imaging Center, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany; BrainLinks-BrainTools Cluster of Excellence, University of Freiburg, Freiburg, Germany
| | - Horst Urbach
- Dept. of Neuroradiology, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Michel Rijntjes
- Department of Neurology and Clinical Neuroscience, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany; Freiburg Brain Imaging Center, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Cornelius Weiller
- Department of Neurology and Clinical Neuroscience, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany; Freiburg Brain Imaging Center, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany; BrainLinks-BrainTools Cluster of Excellence, University of Freiburg, Freiburg, Germany
| |
Collapse
|
29
|
Weiner KS, Gomez J. Third Visual Pathway, Anatomy, and Cognition across Species. Trends Cogn Sci 2021; 25:548-549. [PMID: 34024730 DOI: 10.1016/j.tics.2021.04.002] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2021] [Revised: 03/31/2021] [Accepted: 04/01/2021] [Indexed: 11/25/2022]
Affiliation(s)
- Kevin S Weiner
- Department of Psychology, University of California, Berkeley, Berkeley, CA 94720, USA; Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA 94720, USA.
| | - Jesse Gomez
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ 08544, USA; Psychology Department, Princeton University, Princeton, NJ 08544, USA
| |
Collapse
|
30
|
Pann A, Bonnard M, Felician O, Romaiguère P. The Extrastriate Body Area and identity processing: An fMRI guided TMS study. Physiol Rep 2021; 9:e14711. [PMID: 33938163 PMCID: PMC8090840 DOI: 10.14814/phy2.14711] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2020] [Revised: 12/11/2020] [Accepted: 12/14/2020] [Indexed: 12/03/2022] Open
Abstract
The extrastriate body area (EBA) is a body‐selective focal region located in the lateral occipito‐temporal cortex that responds strongly to images of human bodies and body parts in comparison with other classes of stimuli. Whether EBA contributes also to the body recognition of self versus others remains in debate. We investigated whether EBA contributes to self‐other distinction and whether there might be a hemispheric‐side specificity to that contribution using double‐pulse transcranial magnetic stimulation (TMS) in right‐handed participants. Prior to the TMS experiment, all participants underwent an fMRI localizer task to determine individual EBA location. TMS was then applied over either right EBA, left EBA or vertex, while participants performed an identification task in which images of self or others' right, or left hands were presented. TMS over both EBAs slowed responses, with no identity‐specific effect. However, TMS applied over right EBA induced significantly more errors on other's hands than noTMS, TMS over left EBA or over the Vertex, when applied at 100–110 ms after image onset. The last three conditions did not differ, nor was there any difference for self‐hands. These findings suggest that EBA participates in self/other discrimination.
Collapse
Affiliation(s)
- Alizée Pann
- Aix Marseille Univ, INSERM, INS, Inst Neurosc Syst, Marseille, France
| | - Mireille Bonnard
- Aix Marseille Univ, INSERM, INS, Inst Neurosc Syst, Marseille, France
| | - Olivier Felician
- Aix Marseille Univ, APHM, INS, Hôpital de la Timone, Service de Neurologie et de Neuropsychologie, Marseille, France
| | | |
Collapse
|
31
|
Bratch A, Chen Y, Engel SA, Kersten DJ. Visual adaptation selective for individual limbs reveals hierarchical human body representation. J Vis 2021; 21:18. [PMID: 34007989 PMCID: PMC8142707 DOI: 10.1167/jov.21.5.18] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2020] [Accepted: 02/24/2021] [Indexed: 11/24/2022] Open
Abstract
The spatial relationships between body parts are a rich source of information for person perception, with even simple pairs of parts providing highly valuable information. Computation of these relationships would benefit from a hierarchical representation, where body parts are represented individually. We hypothesized that the human visual system makes use of such representations. To test this hypothesis, we used adaptation to determine whether observers were sensitive to changes in the length of one body part relative to another. Observers viewed forearm/upper arm pairs where the forearm had been either lengthened or shortened, judging the perceived length of the forearm. Observers then adapted to a variety of different stimuli (e.g., arms, objects, etc.) in different orientations and visual field locations. We found that following adaptation to distorted limbs, but not non-limb objects, observers experienced a shift in perceived forearm length. Furthermore, this effect partially transferred across different orientations and visual field locations. Taken together, these results suggest the effect arises in high level mechanisms specialized for specific body parts, providing evidence for a representation of bodies based on parts and their relationships.
Collapse
Affiliation(s)
- Alexander Bratch
- Department of Psychology, University of Minnesota, Minneapolis, MN, USA
- Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN, USA
| | - Yixiong Chen
- Department of Psychology, University of Minnesota, Minneapolis, MN, USA
| | - Stephen A Engel
- Department of Psychology, University of Minnesota, Minneapolis, MN, USA
| | - Daniel J Kersten
- Department of Psychology, University of Minnesota, Minneapolis, MN, USA
| |
Collapse
|
32
|
Expert Tool Users Show Increased Differentiation between Visual Representations of Hands and Tools. J Neurosci 2021; 41:2980-2989. [PMID: 33563728 PMCID: PMC8018880 DOI: 10.1523/jneurosci.2489-20.2020] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2020] [Revised: 12/20/2020] [Accepted: 12/23/2020] [Indexed: 11/21/2022] Open
Abstract
The idea that when we use a tool we incorporate it into the neural representation of our body (embodiment) has been a major inspiration for philosophy, science, and engineering. While theoretically appealing, there is little direct evidence for tool embodiment at the neural level. Using functional magnetic resonance imaging (fMRI) in male and female human subjects, we investigated whether expert tool users (London litter pickers: n = 7) represent their expert tool more like a hand (neural embodiment) or less like a hand (neural differentiation), as compared with a group of tool novices (n = 12). During fMRI scans, participants viewed first-person videos depicting grasps performed by either a hand, litter picker, or a non-expert grasping tool. Using representational similarity analysis (RSA), differences in the representational structure of hands and tools were measured within occipitotemporal cortex (OTC). Contrary to the neural embodiment theory, we find that the experts group represent their own tool less like a hand (not more) relative to novices. Using a case-study approach, we further replicated this effect, independently, in five of the seven individual expert litter pickers, as compared with the novices. An exploratory analysis in left parietal cortex, a region implicated in visuomotor representations of hands and tools, also indicated that experts do not visually represent their tool more similar to hands, compared with novices. Together, our findings suggest that extensive tool use leads to an increased neural differentiation between visual representations of hands and tools. This evidence provides an important alternative framework to the prominent tool embodiment theory.SIGNIFICANCE STATEMENT It is commonly thought that tool use leads to the assimilation of the tool into the neural representation of the body, a process referred to as embodiment. Here, we demonstrate that expert tool users (London litter pickers) neurally represent their own tool less like a hand (not more), compared with novices. Our findings advance our current understanding for how experience shapes functional organization in high-order visual cortex. Further, this evidence provides an alternative framework to the prominent tool embodiment theory, suggesting instead that experience with tools leads to more distinct, separable hand and tool representations.
Collapse
|
33
|
Sivakumar P, Quinlan DJ, Stubbs KM, Culham JC. Grasping performance depends upon the richness of hand feedback. Exp Brain Res 2021; 239:835-846. [PMID: 33403432 DOI: 10.1007/s00221-020-06025-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2020] [Accepted: 12/19/2020] [Indexed: 11/28/2022]
Abstract
Although visual feedback of the hand allows fast and accurate grasping actions, little is known about whether the nature of feedback of the hand affects performance. We investigated kinematics during precision grasping (with the index finger and thumb) when participants received different levels of hand feedback, with or without visual feedback of the target. Specifically, we compared performance when participants saw (1) no hand feedback; (2) only the two critical points on the index finger and thumb tips; (3) 21 points on all digit tips and hand joints; (4) 21 points connected by a "skeleton", or (5) full feedback of the hand wearing a glove. When less hand feedback was available, participants took longer to execute the movement because they allowed more time to slow the reach and close the hand. When target feedback was unavailable, participants took longer to plan the movement and reached with higher velocity. We were particularly interested in investigating maximum grip aperture (MGA), which can reflect the margin of error that participants allow to compensate for uncertainty. A trend suggested that MGA was smallest when ample feedback was available (skeleton and full hand feedback, regardless of target feedback) and when only essential information about hand and target was provided (2-point hand feedback + target feedback) but increased when non-essential points were included (21-point feedback). These results suggest that visual feedback of the hand affects grasping performance and that, while more feedback is usually beneficial, this is not necessarily always the case.
Collapse
Affiliation(s)
- Prajith Sivakumar
- Department of Biology, University of Western Ontario, London, Canada.,Brain and Mind Institute, University of Western Ontario, Western Interdisciplinary Research Building, London, ON, Canada
| | - Derek J Quinlan
- Brain and Mind Institute, University of Western Ontario, Western Interdisciplinary Research Building, London, ON, Canada.,BrainsCAN, University of Western Ontario, London, ON, Canada.,Department of Psychology, Huron University College, London, ON, Canada
| | - Kevin M Stubbs
- Brain and Mind Institute, University of Western Ontario, Western Interdisciplinary Research Building, London, ON, Canada.,BrainsCAN, University of Western Ontario, London, ON, Canada.,Department of Psychology, University of Western Ontario, London, ON, Canada
| | - Jody C Culham
- Brain and Mind Institute, University of Western Ontario, Western Interdisciplinary Research Building, London, ON, Canada. .,Department of Psychology, University of Western Ontario, London, ON, Canada.
| |
Collapse
|
34
|
Brand J, Piccirelli M, Hepp-Reymond MC, Eng K, Michels L. Brain Activation During Visually Guided Finger Movements. Front Hum Neurosci 2020; 14:309. [PMID: 32922274 PMCID: PMC7456884 DOI: 10.3389/fnhum.2020.00309] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2020] [Accepted: 07/13/2020] [Indexed: 11/13/2022] Open
Abstract
Computer interaction via visually guided hand movements often employs either abstract cursor-based feedback or virtual hand (VH) representations of varying degrees of realism. The effect of changing this visual feedback in virtual reality settings is currently unknown. In this study, 19 healthy right-handed adults performed index finger movements (“action”) and observed movements (“observation”) with four different types of visual feedback: a simple circular cursor (CU), a point light (PL) pattern indicating finger joint positions, a shadow cartoon hand (SH) and a realistic VH. Finger movements were recorded using a data glove, and eye-tracking was recorded optically. We measured brain activity using functional magnetic resonance imaging (fMRI). Both action and observation conditions showed stronger fMRI signal responses in the occipitotemporal cortex compared to baseline. The action conditions additionally elicited elevated bilateral activations in motor, somatosensory, parietal, and cerebellar regions. For both conditions, feedback of a hand with a moving finger (SH, VH) led to higher activations than CU or PL feedback, specifically in early visual regions and the occipitotemporal cortex. Our results show the stronger recruitment of a network of cortical regions during visually guided finger movements with human hand feedback when compared to a visually incomplete hand and abstract feedback. This information could have implications for the design of visually guided tasks involving human body parts in both research and application or training-related paradigms.
Collapse
Affiliation(s)
- Johannes Brand
- Institute of Neuroinformatics, University of Zurich and ETH Zurich, Zurich, Switzerland.,Neuroscience Center Zurich, Zurich, Switzerland
| | - Marco Piccirelli
- Department of Neuroradiology, University Hospital Zurich, Zurich, Switzerland.,Klinisches Neurozentrum, University Hospital Zurich, Zurich, Switzerland
| | - Marie-Claude Hepp-Reymond
- Institute of Neuroinformatics, University of Zurich and ETH Zurich, Zurich, Switzerland.,Neuroscience Center Zurich, Zurich, Switzerland
| | - Kynan Eng
- Institute of Neuroinformatics, University of Zurich and ETH Zurich, Zurich, Switzerland.,Neuroscience Center Zurich, Zurich, Switzerland
| | - Lars Michels
- Department of Neuroradiology, University Hospital Zurich, Zurich, Switzerland.,Klinisches Neurozentrum, University Hospital Zurich, Zurich, Switzerland
| |
Collapse
|
35
|
Tamè L, Longo MR. Probing the neural representations of body-related stimuli: Comment on "Revealing the body in the brain: an ERP method to examine sensorimotor activity during visual perception of the body-related information" by Alejandro Galvez-Pol, Beatriz Calvo-Merino and Bettina Forster. Cortex 2020; 134:358-361. [PMID: 33012526 DOI: 10.1016/j.cortex.2020.08.019] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2020] [Revised: 07/16/2020] [Accepted: 08/07/2020] [Indexed: 01/06/2023]
Affiliation(s)
- Luigi Tamè
- School of Psychology, University of Kent, Canterbury, United Kingdom.
| | - Matthew R Longo
- Department of Psychological Sciences, Birkbeck, University of London, London, United Kingdom.
| |
Collapse
|
36
|
Makin TR, Flor H. Brain (re)organisation following amputation: Implications for phantom limb pain. Neuroimage 2020; 218:116943. [PMID: 32428706 PMCID: PMC7422832 DOI: 10.1016/j.neuroimage.2020.116943] [Citation(s) in RCA: 78] [Impact Index Per Article: 15.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2019] [Revised: 05/10/2020] [Accepted: 05/11/2020] [Indexed: 12/11/2022] Open
Abstract
Following arm amputation the region that represented the missing hand in primary somatosensory cortex (S1) becomes deprived of its primary input, resulting in changed boundaries of the S1 body map. This remapping process has been termed 'reorganisation' and has been attributed to multiple mechanisms, including increased expression of previously masked inputs. In a maladaptive plasticity model, such reorganisation has been associated with phantom limb pain (PLP). Brain activity associated with phantom hand movements is also correlated with PLP, suggesting that preserved limb functional representation may serve as a complementary process. Here we review some of the most recent evidence for the potential drivers and consequences of brain (re)organisation following amputation, based on human neuroimaging. We emphasise other perceptual and behavioural factors consequential to arm amputation, such as non-painful phantom sensations, perceived limb ownership, intact hand compensatory behaviour or prosthesis use, which have also been related to both cortical changes and PLP. We also discuss new findings based on interventions designed to alter the brain representation of the phantom limb, including augmented/virtual reality applications and brain computer interfaces. These studies point to a close interaction of sensory changes and alterations in brain regions involved in body representation, pain processing and motor control. Finally, we review recent evidence based on methodological advances such as high field neuroimaging and multivariate techniques that provide new opportunities to interrogate somatosensory representations in the missing hand cortical territory. Collectively, this research highlights the need to consider potential contributions of additional brain mechanisms, beyond S1 remapping, and the dynamic interplay of contextual factors with brain changes for understanding and alleviating PLP.
Collapse
Affiliation(s)
- Tamar R Makin
- Institute of Cognitive Neuroscience, University College London, London, United Kingdom; Wellcome Centre for Human Neuroimaging, University College London, London, UK.
| | - Herta Flor
- Institute of Cognitive and Clinical Neuroscience, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany; Department of Psychology, School of Social Sciences, University of Mannheim, Germany; Center for Neuroplasticity and Pain (CNAP), Department of Health Science and Technology, Aalborg University, Aalborg, Denmark
| |
Collapse
|
37
|
Rosenke M, Davidenko N, Grill-Spector K, Weiner KS. Combined Neural Tuning in Human Ventral Temporal Cortex Resolves the Perceptual Ambiguity of Morphed 2D Images. Cereb Cortex 2020; 30:4882-4898. [PMID: 32372098 PMCID: PMC7391265 DOI: 10.1093/cercor/bhaa081] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/25/2022] Open
Abstract
We have an amazing ability to categorize objects in the world around us. Nevertheless, how cortical regions in human ventral temporal cortex (VTC), which is critical for categorization, support this behavioral ability, is largely unknown. Here, we examined the relationship between neural responses and behavioral performance during the categorization of morphed silhouettes of faces and hands, which are animate categories processed in cortically adjacent regions in VTC. Our results reveal that the combination of neural responses from VTC face- and body-selective regions more accurately explains behavioral categorization than neural responses from either region alone. Furthermore, we built a model that predicts a person's behavioral performance using estimated parameters of brain-behavior relationships from a different group of people. Moreover, we show that this brain-behavior model generalizes to adjacent face- and body-selective regions in lateral occipitotemporal cortex. Thus, while face- and body-selective regions are located within functionally distinct domain-specific networks, cortically adjacent regions from both networks likely integrate neural responses to resolve competing and perceptually ambiguous information from both categories.
Collapse
Affiliation(s)
- Mona Rosenke
- Psychology Department, Stanford University, Stanford, CA 94305, USA
| | - Nicolas Davidenko
- Psychology Department, University of California, Santa Cruz, Santa Cruz, CA 95064, USA
| | - Kalanit Grill-Spector
- Psychology Department, Stanford University, Stanford, CA 94305, USA
- Neuroscience Institute, Stanford University, Stanford, CA 94305, USA
| | - Kevin S Weiner
- Psychology Department, University of California, Berkeley, Berkeley, CA 94720, USA
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA 94720, USA
| |
Collapse
|
38
|
Cocchini G, Beschin N. The Fluff test: Improved scoring system to account for different degrees of contralesional and ipsilesional personal neglect in brain damaged patients. Neuropsychol Rehabil 2020; 32:69-83. [PMID: 32723030 DOI: 10.1080/09602011.2020.1797828] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
Abstract
The Fluff test is a simple test to assess evidence of personal neglect (PN) in brain-damaged patients. While blindfolded, patients are asked to remove targets previously attached to their body and the number of targets detached provides information about possible spatial bias. This test has been widely used for clinical and research purposes. However, the current scoring system presents some limitations, which make difficult to interpret patients' performance in terms of both contralalesional and ipsilesional PN when they omit targets on the ipsilesional side. Moreover, it does not consider possible confounding variables, such as non-spatial cognitive deficits or lack of compliance that may affect patients' performance and lead to incorrect diagnosis. The present paper proposes a new scoring method overcoming the limitations mentioned above and it analyses data from a large sample of 243 brain-damaged patients. Findings showed that contralesional PN was significantly more severe, but not more frequent, following right (31%) than left (21%) brain damage. We also found evidence of left ipsilesional PN and cases of potential mis-diagnosis that would have passed unnoticed with the original scoring system. The new scoring method allows to identify different degrees of contralesional and ipsilesional PN and potential confounding variable.
Collapse
Affiliation(s)
- Gianna Cocchini
- Psychology Department, Goldsmiths University of London, London, UK
| | | |
Collapse
|
39
|
Garcea FE, Greene C, Grafton ST, Buxbaum LJ. Structural Disconnection of the Tool Use Network after Left Hemisphere Stroke Predicts Limb Apraxia Severity. Cereb Cortex Commun 2020; 1:tgaa035. [PMID: 33134927 PMCID: PMC7573742 DOI: 10.1093/texcom/tgaa035] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2020] [Revised: 07/10/2020] [Accepted: 07/13/2020] [Indexed: 12/23/2022] Open
Abstract
Producing a tool use gesture is a complex process drawing upon the integration of stored knowledge of tools and their associated actions with sensory-motor mechanisms supporting the planning and control of hand and arm actions. Understanding how sensory-motor systems in parietal cortex interface with semantic representations of actions and objects in the temporal lobe remains a critical issue and is hypothesized to be a key determinant of the severity of limb apraxia, a deficit in producing skilled action after left hemisphere stroke. We used voxel-based and connectome-based lesion-symptom mapping with data from 57 left hemisphere stroke participants to assess the lesion sites and structural disconnection patterns associated with poor tool use gesturing. We found that structural disconnection among the left inferior parietal lobule, lateral and ventral temporal cortices, and middle and superior frontal gyri predicted the severity of tool use gesturing performance. Control analyses demonstrated that reductions in right-hand grip strength were associated with motor system disconnection, largely bypassing regions supporting tool use gesturing. Our findings provide evidence that limb apraxia may arise, in part, from a disconnection between conceptual representations in the temporal lobe and mechanisms enabling skilled action production in the inferior parietal lobule.
Collapse
Affiliation(s)
- Frank E Garcea
- Moss Rehabilitation Research Institute, Elkins Park, PA 19027, USA
- University of Pennsylvania, Philadelphia, PA 19104, USA
| | - Clint Greene
- Department of Psychological and Brain Sciences, University of California at Santa Barbara, Santa Barbara, CA 93016, USA
| | - Scott T Grafton
- Department of Psychological and Brain Sciences, University of California at Santa Barbara, Santa Barbara, CA 93016, USA
| | - Laurel J Buxbaum
- Moss Rehabilitation Research Institute, Elkins Park, PA 19027, USA
- Department of Rehabilitation Medicine, Thomas Jefferson University, Philadelphia, PA 19107, USA
| |
Collapse
|
40
|
Maimon-Mor RO, Makin TR. Is an artificial limb embodied as a hand? Brain decoding in prosthetic limb users. PLoS Biol 2020; 18:e3000729. [PMID: 32511238 PMCID: PMC7302856 DOI: 10.1371/journal.pbio.3000729] [Citation(s) in RCA: 33] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2019] [Revised: 06/18/2020] [Accepted: 05/20/2020] [Indexed: 02/07/2023] Open
Abstract
The potential ability of the human brain to represent an artificial limb as a body part (embodiment) has been inspiring engineers, clinicians, and scientists as a means to optimise human-machine interfaces. Using functional MRI (fMRI), we studied whether neural embodiment actually occurs in prosthesis users' occipitotemporal cortex (OTC). Compared with controls, different prostheses types were visually represented more similarly to each other, relative to hands and tools, indicating the emergence of a dissociated prosthesis categorisation. Greater daily life prosthesis usage correlated positively with greater prosthesis categorisation. Moreover, when comparing prosthesis users' representation of their own prosthesis to controls' representation of a similar looking prosthesis, prosthesis users represented their own prosthesis more dissimilarly to hands, challenging current views of visual prosthesis embodiment. Our results reveal a use-dependent neural correlate for wearable technology adoption, demonstrating adaptive use-related plasticity within the OTC. Because these neural correlates were independent of the prostheses' appearance and control, our findings offer new opportunities for prosthesis design by lifting restrictions imposed by the embodiment theory for artificial limbs.
Collapse
Affiliation(s)
- Roni O. Maimon-Mor
- Institute of Cognitive Neuroscience, University College London, London, United Kingdom
- WIN Centre, Nuffield Department of Clinical Neuroscience, University of Oxford, Oxford, United Kingdom
| | - Tamar R. Makin
- Institute of Cognitive Neuroscience, University College London, London, United Kingdom
- WIN Centre, Nuffield Department of Clinical Neuroscience, University of Oxford, Oxford, United Kingdom
- Wellcome Centre for Human Neuroimaging, University College London, London, United Kingdom
| |
Collapse
|
41
|
Vannuscorps G, Andres M, Caramazza A. Efficient recognition of facial expressions does not require motor simulation. eLife 2020; 9:54687. [PMID: 32364498 PMCID: PMC7217693 DOI: 10.7554/elife.54687] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2019] [Accepted: 05/03/2020] [Indexed: 12/03/2022] Open
Abstract
What mechanisms underlie facial expression recognition? A popular hypothesis holds that efficient facial expression recognition cannot be achieved by visual analysis alone but additionally requires a mechanism of motor simulation — an unconscious, covert imitation of the observed facial postures and movements. Here, we first discuss why this hypothesis does not necessarily follow from extant empirical evidence. Next, we report experimental evidence against the central premise of this view: we demonstrate that individuals can achieve normotypical efficient facial expression recognition despite a congenital absence of relevant facial motor representations and, therefore, unaided by motor simulation. This underscores the need to reconsider the role of motor simulation in facial expression recognition.
Collapse
Affiliation(s)
- Gilles Vannuscorps
- Department of Psychology, Harvard University, Cambridge, United States.,Institute of Neuroscience, Université catholique de Louvain, Ottignies-Louvain-la-Neuve, Belgium.,Psychological Sciences Research Institute, Université catholique de Louvain, Ottignies-Louvain-la-Neuve, Belgium
| | - Michael Andres
- Institute of Neuroscience, Université catholique de Louvain, Ottignies-Louvain-la-Neuve, Belgium.,Psychological Sciences Research Institute, Université catholique de Louvain, Ottignies-Louvain-la-Neuve, Belgium
| | - Alfonso Caramazza
- Department of Psychology, Harvard University, Cambridge, United States.,Center for Mind/Brain Sciences, Università degli Studi di Trento, Mattarello, Italy
| |
Collapse
|
42
|
Okamoto Y, Kitada R, Kochiyama T, Naruse H, Makita K, Miyahara M, Okazawa H, Kosaka H. Visual Body Part Representation in the Lateral Occipitotemporal Cortex in Children/Adolescents and Adults. Cereb Cortex Commun 2020; 1:tgaa007. [PMID: 34296088 PMCID: PMC8152859 DOI: 10.1093/texcom/tgaa007] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2020] [Revised: 02/25/2020] [Accepted: 03/25/2020] [Indexed: 12/13/2022] Open
Abstract
The lateral occipitotemporal cortex (LOTC) that responds to human bodies and body parts has been implicated in social development and neurodevelopmental disorders like autism spectrum disorder (ASD). Neuroimaging studies using a representational similarity analysis (RSA) revealed that body representation in the LOTC of typically developing (TD) adults is categorized into 3 clusters: action effector body parts, noneffector body parts, and face parts. However, its organization of younger people (i.e., children and adolescents) and its association with individual traits remain unclear. In this functional MRI study, TD adults and children/adolescents observed photographs of hands, feet, arms, legs, chests, waists, upper/lower faces, the whole body, and chairs. The univariate analysis showed that fewer child/adolescent participants showed left LOTC activation in response to whole-body images (relative to those of chairs) than adult participants. Contrastingly, the RSA on both age groups revealed a comparable body representation with 3 clusters of body parts in the bilateral LOTC. Hence, this result indicates that, although response to whole-body images can differ, LOTC body part representations for children/ adolescents and adults are highly similar. Furthermore, sensory atypicality is associated with spatial LOTC organization, suggesting the importance of this region for understanding individual difference, which is frequently observed in ASD.
Collapse
Affiliation(s)
- Yuko Okamoto
- Advanced Telecommunications Research Institute International, Seika-cho, Sorakugun, Kyoto 619-0288, Japan.,Brain Activity Imaging Center, ATR-Promotions, Seika-cho, Sorakugun, Kyoto 619-0288, Japan
| | - Ryo Kitada
- School of Social Sciences, Nanyang Technological University, 48 Nanyang Avenue, HSS-04-13, Singapore 639818
| | - Takanori Kochiyama
- Advanced Telecommunications Research Institute International, Seika-cho, Sorakugun, Kyoto 619-0288, Japan.,Brain Activity Imaging Center, ATR-Promotions, Seika-cho, Sorakugun, Kyoto 619-0288, Japan
| | - Hiroaki Naruse
- Division of Physical Therapy and Rehabilitation, University of Fukui Hospital, Eiheiji-cho, Yoshida-gun, Fukui 910-1193, Japan
| | - Kai Makita
- Research Center for Child Mental Development, University of Fukui, Eiheiji-cho, Yoshida-gun, Fukui 910-1193, Japan
| | - Motohide Miyahara
- Department of Clinical Psychological Science, School of Medicine, Hirosaki University, 1 Bunkyo-cho, Hirosaki, Aomori, 036-8560, Japan
| | - Hidehiko Okazawa
- Biomedical Imaging Research Center, University of Fukui, Eiheiji-cho, Yoshida-gun, Fukui, 910-1193 Japan
| | - Hirotaka Kosaka
- Department of Neuropsychiatry, Faculty of Medical Sciences, University of Fukui, Eiheiji-cho, Yoshida-gun, Fukui 910-1193, Japan
| |
Collapse
|
43
|
Schulte-Goecking H, Azqueta-Gavaldon M, Storz C, Woiczinski M, Fraenkel P, Leukert J, Azad SC, Kraft E. Psychological, social and biological correlates of body perception disturbance in complex regional pain syndrome. CURRENT PSYCHOLOGY 2020. [DOI: 10.1007/s12144-020-00635-1] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Abstract
AbstractBody Perception Disturbance (BPD) in Complex Regional Pain Syndrome (CRPS) still represents a poorly understood phenomenon. Research has shown that knowledge about changes in body perception can yield relevant information for understanding and treating the disease. This study addressed possible connections between BPD and psychological and social factors, pain intensity, and disease duration. Sixty patients with chronic CRPS Type I of the hand were recruited. Body Perception Disturbance was assessed using the Galer and Jensen Neurobehavioral Questionnaire (GJ) and the BATH CRPS Body Perception Disturbance Scale (BATH). Depression, anxiety, stress, childhood trauma and other life events were assessed using standardized and validated questionnaires. This study found that BPD in CRPS was significantly correlated with measures of depression, anxiety, current stress, quality of life, and pain intensity, but not with stress experienced in the twelve months preceding onset of illness, childhood trauma, or duration of illness. Future research needs to identify which patients are most likely to develop these psychological conditions of CRPS, so that early, preventive intervention is possible. This study establishes a relationship between depression, anxiety, current stress, quality of life, pain intensity, and BPD severity. It also supports literature suggesting that preexisting stress, childhood trauma, and disease duration have no influence on BPD. The findings suggest that there is a bidirectional influence between brain alterations, psychological symptoms, and illness severity.
Collapse
|
44
|
Tarhan L, Konkle T. Reliability-based voxel selection. Neuroimage 2020; 207:116350. [DOI: 10.1016/j.neuroimage.2019.116350] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2019] [Revised: 10/09/2019] [Accepted: 11/10/2019] [Indexed: 10/25/2022] Open
|
45
|
Moreau Q, Parrotta E, Era V, Martelli ML, Candidi M. Role of the occipito-temporal theta rhythm in hand visual identification. J Neurophysiol 2020; 123:167-177. [DOI: 10.1152/jn.00267.2019] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/12/2023] Open
Abstract
Neuroimaging and EEG studies have shown that passive observation of the full body and of specific body parts is associated with 1) activity of an occipito-temporal region named the extrastriate body area (EBA), 2) amplitude modulations of a specific posterior event-related potential (ERP) component (N1/N190), and 3) a theta-band (4–7 Hz) synchronization recorded from occipito-temporal electrodes compatible with the location of EBA. To characterize the functional role of the occipito-temporal theta-band increase during the processing of body-part stimuli, we recorded EEG from healthy participants while they were engaged in an identification task (match-to-sample) of images of hands and nonbody control images (leaves). In addition to confirming that occipito-temporal electrodes show a larger N1 for hand images compared with control stimuli, cluster-based analysis revealed an occipito-temporal cluster showing an increased theta power when hands are presented (compared with leaves) and show that this theta increase is higher for identified hands compared with nonidentified ones while not being significantly different between not identified nonhand stimuli. Finally, single trial multivariate pattern analysis revealed that time-frequency modulation in the theta band is a better marker for classifying the identification of hand images than the ERP modulation. The present results support the notion that theta activity over the occipito-temporal cortex is an informative marker of hand visual processing and may reflect the activity of a network coding for stimulus identity. NEW & NOTEWORTHY Hands provide crucial information regarding the identity of others, which is a key information for social processes. We recorded EEG activity of healthy participants during the visual identification of hand images. The combination of univariate and multivariate pattern analysis in time- and time-frequency domain highlights the functional role of theta (4–7 Hz) activity over visual areas during hand identification and emphasizes the robustness of this neuromarker in occipito-temporal visual processing dynamics.
Collapse
Affiliation(s)
- Quentin Moreau
- Department of Psychology, Sapienza University of Rome, Rome, Italy
- Istituto di Ricovero e Cura a Carattere Scientifico, Fondazione Santa Lucia, Rome
| | - Eleonora Parrotta
- Department of Psychology, Sapienza University of Rome, Rome, Italy
- Istituto di Ricovero e Cura a Carattere Scientifico, Fondazione Santa Lucia, Rome
| | - Vanessa Era
- Department of Psychology, Sapienza University of Rome, Rome, Italy
- Istituto di Ricovero e Cura a Carattere Scientifico, Fondazione Santa Lucia, Rome
| | - Maria Luisa Martelli
- Department of Psychology, Sapienza University of Rome, Rome, Italy
- Istituto di Ricovero e Cura a Carattere Scientifico, Fondazione Santa Lucia, Rome
| | - Matteo Candidi
- Department of Psychology, Sapienza University of Rome, Rome, Italy
- Istituto di Ricovero e Cura a Carattere Scientifico, Fondazione Santa Lucia, Rome
| |
Collapse
|
46
|
Wang L, Baumgartner F, Kaule FR, Hanke M, Pollmann S. Individual face- and house-related eye movement patterns distinctively activate FFA and PPA. Nat Commun 2019; 10:5532. [PMID: 31797874 PMCID: PMC6892816 DOI: 10.1038/s41467-019-13541-3] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2019] [Accepted: 11/12/2019] [Indexed: 11/23/2022] Open
Abstract
We investigated if the fusiform face area (FFA) and the parahippocampal place area (PPA) contain a representation of fixation sequences that are typically used when looking at faces or houses. Here, we instructed observers to follow a dot presented on a uniform background. The dot’s movements represented gaze paths acquired separately from observers looking at face or house pictures. Even when gaze dispersion differences were controlled, face- and house-associated gaze patterns could be discriminated by fMRI multivariate pattern analysis in FFA and PPA, more so for the current observer’s own gazes than for another observer’s gaze. The discrimination of the observer’s own gaze patterns was not observed in early visual areas (V1 – V4) or superior parietal lobule and frontal eye fields. These findings indicate a link between perception and action—the complex gaze patterns that are used to explore faces and houses—in the FFA and PPA. The fusiform face area and parahippocampal place area respond to face and scene stimuli respectively. Here, the authors show using fMRI that these brain areas are also preferentially activated by eye movements associated with looking at faces and scenes even when no images are shown.
Collapse
Affiliation(s)
- Lihui Wang
- Department of Experimental Psychology, Otto-von-Guericke University, Magdeburg, Germany.,Center for Behavioral Brain Sciences, Magdeburg, Germany.,Institute of Psychology and Behavioral Science, Shanghai Jiao Tong University, Shanghai, China.,Shanghai Key Laboratory of Psychotic Disorders, Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Florian Baumgartner
- Department of Experimental Psychology, Otto-von-Guericke University, Magdeburg, Germany
| | - Falko R Kaule
- Department of Experimental Psychology, Otto-von-Guericke University, Magdeburg, Germany
| | - Michael Hanke
- Institute of Neuroscience and Medicine, Brain & Behaviour (INM-7), Research Centre Jülich, Jülich, Germany.,Institute of Systems Neuroscience, Medical Faculty, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
| | - Stefan Pollmann
- Department of Experimental Psychology, Otto-von-Guericke University, Magdeburg, Germany. .,Center for Behavioral Brain Sciences, Magdeburg, Germany. .,Beijing Key Laboratory of Learning and Cognition and School of Psychology, Capital Normal University, Beijing, China.
| |
Collapse
|
47
|
Lateral occipitotemporal cortex encodes perceptual components of social actions rather than abstract representations of sociality. Neuroimage 2019; 202:116153. [DOI: 10.1016/j.neuroimage.2019.116153] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2019] [Revised: 07/25/2019] [Accepted: 08/31/2019] [Indexed: 11/18/2022] Open
|
48
|
Kim Y, Usui N, Miyazaki A, Haji T, Matsumoto K, Taira M, Nakamura K, Katsuyama N. Cortical Regions Encoding Hardness Perception Modulated by Visual Information Identified by Functional Magnetic Resonance Imaging With Multivoxel Pattern Analysis. Front Syst Neurosci 2019; 13:52. [PMID: 31632245 PMCID: PMC6779815 DOI: 10.3389/fnsys.2019.00052] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2019] [Accepted: 09/11/2019] [Indexed: 01/09/2023] Open
Abstract
Recent studies have revealed that hardness perception is determined by visual information along with the haptic input. This study investigated the cortical regions involved in hardness perception modulated by visual information using functional magnetic resonance imaging (fMRI) and multivoxel pattern analysis (MVPA). Twenty-two healthy participants were enrolled. They were required to place their left and right hands at the front and back, respectively, of a mirror attached to a platform placed above them while lying in a magnetic resonance scanner. In conditions SFT, MED, and HRD, one of three polyurethane foam pads of varying hardness (soft, medium, and hard, respectively) was presented to the left hand in a given trial, while only the medium pad was presented to the right hand in all trials. MED was defined as the control condition, because the visual and haptic information was congruent. During the scan, the participants were required to push the pad with the both hands while observing the reflection of the left hand and estimate the hardness of the pad perceived by the right (hidden) hand based on magnitude estimation. Behavioral results showed that the perceived hardness was significantly biased toward softer or harder in >73% of the trials in conditions SFT and HRD; we designated these trials as visually modulated (SFTvm and HRDvm, respectively). The accuracy map was calculated individually for each of the pair-wise comparisons of (SFTvm vs. MED), (HRDvm vs. MED), and (SFTvm vs. HRDvm) by a searchlight MVPA, and the cortical regions encoding the perceived hardness with visual modulation were identified by conjunction of the three accuracy maps in group analysis. The cluster was observed in the right sensory motor cortex, left anterior intraparietal sulcus (aIPS), bilateral parietal operculum (PO), and occipito-temporal cortex (OTC). Together with previous findings on such cortical regions, we conclude that the visual information of finger movements processed in the OTC may be integrated with haptic input in the left aIPS, and the subjective hardness perceived by the right hand with visual modulation may be processed in the cortical network between the left PO and aIPS.
Collapse
Affiliation(s)
- Yuri Kim
- Primate Research Institute, Kyoto University, Inuyama, Japan.,Department of Cognitive Neurobiology, Tokyo Medical and Dental University, Tokyo, Japan.,Center for Brain Integration Research, Tokyo Medical and Dental University, Tokyo, Japan
| | - Nobuo Usui
- Department of Cognitive Neurobiology, Tokyo Medical and Dental University, Tokyo, Japan.,Center for Brain Integration Research, Tokyo Medical and Dental University, Tokyo, Japan
| | | | - Tomoki Haji
- Tamagawa University Brain Science Institute, Tokyo, Japan
| | | | - Masato Taira
- Department of Cognitive Neurobiology, Tokyo Medical and Dental University, Tokyo, Japan.,Center for Brain Integration Research, Tokyo Medical and Dental University, Tokyo, Japan
| | | | - Narumi Katsuyama
- Primate Research Institute, Kyoto University, Inuyama, Japan.,Department of Cognitive Neurobiology, Tokyo Medical and Dental University, Tokyo, Japan.,Center for Brain Integration Research, Tokyo Medical and Dental University, Tokyo, Japan
| |
Collapse
|
49
|
A Whole-Body Sensory-Motor Gradient is Revealed in the Medial Wall of the Parietal Lobe. J Neurosci 2019; 39:7882-7892. [PMID: 31405923 DOI: 10.1523/jneurosci.0727-18.2019] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2018] [Revised: 07/23/2019] [Accepted: 07/26/2019] [Indexed: 11/21/2022] Open
Abstract
In 1954, Penfield and Jasper's findings based on electric stimulation of epileptic patients led them to hypothesize that a sensory representation of the body should be found in the precuneus. They termed this representation the "supplementary sensory" area and emphasized that the exact form of this homunculus could not be specified on the basis of their results. In the decades that followed, their prediction was neglected. The precuneus was found to be involved in numerous motor, cognitive and visual processes, but no work was done on its somatotopic organization. Here, we used a periodic experimental design in which 16 human subjects (eight women) moved 20 body parts to investigate the possible body part topography of the precuneus. We found an anterior-to-posterior, dorsal-to-ventral, toes-to-tongue gradient in a mirror orientation to the SMA. When inspecting body-part-specific functional connectivity, we found differential connectivity patterns for the different body parts to the primary and secondary motor areas and parietal and visual areas, and a shared connectivity to the extrastriate body area, another topographically organized area. We suggest that a whole-body gradient can be found in the precuneus and is connected to multiple brain areas with different connectivity for different body parts. Its exact role and relations to the other known functions of the precuneus such as self-processing, motor imagery, reaching, visuomotor and other body-mind functions should be investigated.SIGNIFICANCE STATEMENT Using fMRI, as well as sensitive spectral analysis, we found a new homunculus in the precuneus: an anterior-to-posterior, dorsal-to-ventral, toes-to-tongue somatotopic gradient in a mirror orientation to the SMA. When inspecting body-part-specific functional connectivity, we found differential connectivity patterns for the different body parts to the primary and secondary motor areas, parietal and visual areas, and a shared connectivity to the extrastriate body area, another topographically organized area. We suggest that a whole-body gradient can be found in the precuneus and is connected to multiple brain areas in a body-part-specific manner.
Collapse
|
50
|
Op de Beeck HP, Pillet I, Ritchie JB. Factors Determining Where Category-Selective Areas Emerge in Visual Cortex. Trends Cogn Sci 2019; 23:784-797. [PMID: 31327671 DOI: 10.1016/j.tics.2019.06.006] [Citation(s) in RCA: 43] [Impact Index Per Article: 7.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2019] [Revised: 06/21/2019] [Accepted: 06/21/2019] [Indexed: 11/26/2022]
Abstract
A hallmark of functional localization in the human brain is the presence of areas in visual cortex specialized for representing particular categories such as faces and words. Why do these areas appear where they do during development? Recent findings highlight several general factors to consider when answering this question. Experience-driven category selectivity arises in regions that have: (i) pre-existing selectivity for properties of the stimulus, (ii) are appropriately placed in the computational hierarchy of the visual system, and (iii) exhibit domain-specific patterns of connectivity to nonvisual regions. In other words, cortical location of category selectivity is constrained by what category will be represented, how it will be represented, and why the representation will be used.
Collapse
Affiliation(s)
- Hans P Op de Beeck
- Department of Brain and Cognition and Leuven Brain Institute, KU Leuven, Belgium. @kuleuven.be
| | - Ineke Pillet
- Department of Brain and Cognition and Leuven Brain Institute, KU Leuven, Belgium
| | - J Brendan Ritchie
- Department of Brain and Cognition and Leuven Brain Institute, KU Leuven, Belgium
| |
Collapse
|