1
|
Bognár A, Nejad GG, Rens G, Raman R, Vogels R. Expanding the stimulus domain: Co-occurrence of motion and body-category selectivity in the macaque ventral STS. Prog Neurobiol 2025; 249:102769. [PMID: 40254177 PMCID: PMC12095119 DOI: 10.1016/j.pneurobio.2025.102769] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2024] [Revised: 04/11/2025] [Accepted: 04/17/2025] [Indexed: 04/22/2025]
Abstract
The primate Superior Temporal Sulcus (STS) plays a pivotal role in the recognition of bodies and their actions, which is essential for survival and social interaction with conspecifics. Here, we show that, surprisingly, a sizable proportion of macaque middle ventral STS units are selective for static bodies and random dot motion. They show a faithful representation of random dot motion direction, with motion directions differing by 180 degrees being represented distinctly, although responding more strongly to complex optic flow patterns. This aligns with an fMRI experiment in which we show that the mid-STS body patch, defined by a greater activation to static bodies compared to faces and objects, is also more strongly activated by moving random dot patterns compared to static ones, especially when including complex optic flow patterns. More anterior ventral STS body-selective units demonstrate a less pronounced random dot motion selectivity and this is mainly for complex optic flow patterns. Moreover, middle STS units, but rarely those of the anterior STS, respond selectively to dynamic dot patterns in which body parts are visible solely through motion, and their preference correlates with those for videos of acting monkeys. Overall, these findings highlight an association between body and motion processing in the macaque ventral STS, which might result from the co-occurrence of body features and motion during the observation of bodily actions.
Collapse
Affiliation(s)
- Anna Bognár
- Deparment of Neurosciences, KU Leuven, Leuven, Belgium; Leuven Brain Institute, KU Leuven, Leuven, Belgium
| | - Ghazaleh Ghamkhari Nejad
- Deparment of Neurosciences, KU Leuven, Leuven, Belgium; Leuven Brain Institute, KU Leuven, Leuven, Belgium
| | - Guy Rens
- Deparment of Neurosciences, KU Leuven, Leuven, Belgium; Leuven Brain Institute, KU Leuven, Leuven, Belgium
| | - Rajani Raman
- Deparment of Neurosciences, KU Leuven, Leuven, Belgium; Leuven Brain Institute, KU Leuven, Leuven, Belgium
| | - Rufin Vogels
- Deparment of Neurosciences, KU Leuven, Leuven, Belgium; Leuven Brain Institute, KU Leuven, Leuven, Belgium.
| |
Collapse
|
2
|
Ip K, Kusyk N, Stephen ID, Brooks KR. Did you skip leg day? The neural mechanisms of muscle perception for body parts. Cortex 2024; 171:75-89. [PMID: 37980724 DOI: 10.1016/j.cortex.2023.10.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2023] [Revised: 09/18/2023] [Accepted: 10/02/2023] [Indexed: 11/21/2023]
Abstract
While the neural mechanisms underpinning the perception of muscularity are poorly understood, recent progress has been made using the psychophysical technique of visual adaptation. Prolonged visual exposure to high (low) muscularity bodies causes subsequently viewed bodies to appear less (more) muscular, revealing a recalibration of the neural populations encoding muscularity. Here, we use visual adaptation to further elucidate the tuning properties of the neural processes underpinning muscle perception for the upper and lower halves of the body. Participants manipulated the apparent muscularity of upper and lower bodies until they appeared 'normal', prior to and following exposure to a series of top/bottom halves of bodies that were either high or low in muscularity. In Experiment 1, participants were adapted to isolated own-gender body halves from one of four conditions; increased (muscularity) upper (body half), increased lower, decreased upper, or decreased lower. Despite the presence of muscle aftereffects when the body halves the participants viewed and manipulated were congruent, there was only weak evidence of muscle aftereffect transfer between the upper and lower halves of the body. Aftereffects were significantly weaker when body halves were incongruent, implying minimal overlap in the neural mechanisms encoding muscularity for body half. Experiment 2 examined the generalisability of Experiment 1's findings in a more ecologically valid context using whole-body stimuli, producing a similar pattern of results as Experiment 1, but with no evidence of cross-adaptation. Taken together, the findings are most consistent with muscle-encoding neural populations that are body-half selective. As visual adaptation has been implicated in cases of body size and shape misperception, the present study furthers our current understanding of how these perceptual inaccuracies, particularly those involving muscularity, are developed, maintained, and may potentially be treated.
Collapse
Affiliation(s)
- Keefe Ip
- School of Psychological Sciences, Macquarie University, Sydney, NSW, Australia.
| | - Nicole Kusyk
- School of Psychological Sciences, Macquarie University, Sydney, NSW, Australia
| | - Ian D Stephen
- NTU Psychology, Nottingham Trent University, Nottingham, England, UK
| | - Kevin R Brooks
- School of Psychological Sciences, Macquarie University, Sydney, NSW, Australia; Perception and Action Research Centre (PARC), Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney, NSW, Australia; Lifespan Health & Wellbeing Research Centre, Macquarie University, Sydney, NSW, Australia
| |
Collapse
|
3
|
Kuhnke P, Kiefer M, Hartwigsen G. Conceptual representations in the default, control and attention networks are task-dependent and cross-modal. BRAIN AND LANGUAGE 2023; 244:105313. [PMID: 37595340 DOI: 10.1016/j.bandl.2023.105313] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/30/2023] [Revised: 07/03/2023] [Accepted: 08/10/2023] [Indexed: 08/20/2023]
Abstract
Conceptual knowledge is central to human cognition. Neuroimaging studies suggest that conceptual processing involves modality-specific and multimodal brain regions in a task-dependent fashion. However, it remains unclear (1) to what extent conceptual feature representations are also modulated by the task, (2) whether conceptual representations in multimodal regions are indeed cross-modal, and (3) how the conceptual system relates to the large-scale functional brain networks. To address these issues, we conducted multivariate pattern analyses on fMRI data. 40 participants performed three tasks-lexical decision, sound judgment, and action judgment-on written words. We found that (1) conceptual feature representations are strongly modulated by the task, (2) conceptual representations in several multimodal regions are cross-modal, and (3) conceptual feature retrieval involves the default, frontoparietal control, and dorsal attention networks. Conceptual representations in these large-scale networks are task-dependent and cross-modal. Our findings support theories that assume conceptual processing to rely on a flexible, multi-level architecture.
Collapse
Affiliation(s)
- Philipp Kuhnke
- Wilhelm Wundt Institute for Psychology, Leipzig University, Germany; Lise Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany.
| | | | - Gesa Hartwigsen
- Wilhelm Wundt Institute for Psychology, Leipzig University, Germany; Lise Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| |
Collapse
|
4
|
Similarity in activity and laterality patterns in the angular gyrus during autobiographical memory retrieval and self-referential processing. Brain Struct Funct 2023; 228:219-238. [PMID: 36166073 DOI: 10.1007/s00429-022-02569-9] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2022] [Accepted: 09/07/2022] [Indexed: 01/07/2023]
Abstract
Long-term memory is arguably one of the key cognitive functions. At the neural level, the lateral parietal cortex and the angular gyrus, particularly in the left hemisphere, exhibit strong activations during autobiographical and episodic memory retrieval. In a separate sub-field, left-lateralized activations of the angular gyrus are also found during self-referential processing, defined as higher activity when a trait term is judged by participants as being related to them vs. related to someone else. The question is whether episodic/autobiographical memory retrieval and self-referential processing effects are related. In the present study, thirty participants participated in the fMRI study with two separate experiments: autobiographical memory retrieval (Experiment 1) and self-referential processing (Experiment 2). In a series of analyses, including the most critical spatial correlation analysis between experiments, we found neural similarity between autobiographical memory retrieval and self-referential processing. Given that self-referential processing was identified in a selective way, the most plausible interpretation of our findings is that self-referential processing might partly explain the activation of the left angular gyrus during autobiographical memory retrieval. Our results are in line with the seminal view of Endel Tulving that the sense of self is a fundamental attribute of long-term memory recollection. However, it should be emphasized that: a) our results do not imply that the left angular gyrus is not involved in the retrieval of episodic memory details; and b) given that our experiment included an autobiographical memory task, generalization of our results to the episodic memory laboratory tasks has yet to be tested.
Collapse
|
5
|
Duarte JV, Abreu R, Castelo-Branco M. A two-stage framework for neural processing of biological motion. Neuroimage 2022; 259:119403. [PMID: 35738331 DOI: 10.1016/j.neuroimage.2022.119403] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2022] [Revised: 05/18/2022] [Accepted: 06/19/2022] [Indexed: 11/26/2022] Open
Abstract
It remains to be understood how biological motion is hierarchically computed, from discrimination of local biological motion animacy to global dynamic body perception. Here, we addressed this functional separation of the correlates of the perception of local biological motion from perception of global motion of a body. We hypothesized that local biological motion processing can be isolated, by using a single dot motion perceptual decision paradigm featuring the biomechanical details of local realistic motion of a single joint. To ensure that we were indeed tackling processing of biological motion properties we used a discrimination instead of detection task. We discovered using representational similarity analysis that two key early dorsal and two ventral stream regions (visual motion selective hMT+ and V3A, extrastriate body area EBA and a region within fusiform gyrus FFG) showed robust and separable signals related to encoding of local biological motion and global motion-mediated shape. These signals reflected two independent processing stages, as revealed by representational similarity analysis and deconvolution of fMRI responses to each motion pattern. This study showed that higher level pSTS encodes both classes of biological motion in a similar way, revealing a higher-level integrative stage, reflecting scale independent biological motion perception. Our results reveal a two-stage framework for neural computation of biological motion, with an independent contribution of dorsal and ventral regions for the initial stage.
Collapse
Affiliation(s)
- João Valente Duarte
- Centre of Biomedical Imaging and Translational Research (CIBIT), Institute of Nuclear Sciences Applied to Health (ICNAS), University of Coimbra, Portugal; Faculty of Medicine, University of Coimbra, Portugal
| | - Rodolfo Abreu
- Centre of Biomedical Imaging and Translational Research (CIBIT), Institute of Nuclear Sciences Applied to Health (ICNAS), University of Coimbra, Portugal
| | - Miguel Castelo-Branco
- Centre of Biomedical Imaging and Translational Research (CIBIT), Institute of Nuclear Sciences Applied to Health (ICNAS), University of Coimbra, Portugal; Faculty of Medicine, University of Coimbra, Portugal.
| |
Collapse
|
6
|
The neural coding of face and body orientation in occipitotemporal cortex. Neuroimage 2021; 246:118783. [PMID: 34879251 DOI: 10.1016/j.neuroimage.2021.118783] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2021] [Revised: 11/09/2021] [Accepted: 12/04/2021] [Indexed: 11/20/2022] Open
Abstract
Face and body orientation convey important information for us to understand other people's actions, intentions and social interactions. It has been shown that several occipitotemporal areas respond differently to faces or bodies of different orientations. However, whether face and body orientation are processed by partially overlapping or completely separate brain networks remains unclear, as the neural coding of face and body orientation is often investigated separately. Here, we recorded participants' brain activity using fMRI while they viewed faces and bodies shown from three different orientations, while attending to either orientation or identity information. Using multivoxel pattern analysis we investigated which brain regions process face and body orientation respectively, and which regions encode both face and body orientation in a stimulus-independent manner. We found that patterns of neural responses evoked by different stimulus orientations in the occipital face area, extrastriate body area, lateral occipital complex and right early visual cortex could generalise across faces and bodies, suggesting a stimulus-independent encoding of person orientation in occipitotemporal cortex. This finding was consistent across functionally defined regions of interest and a whole-brain searchlight approach. The fusiform face area responded to face but not body orientation, suggesting that orientation responses in this area are face-specific. Moreover, neural responses to orientation were remarkably consistent regardless of whether participants attended to the orientation of faces and bodies or not. Together, these results demonstrate that face and body orientation are processed in a partially overlapping brain network, with a stimulus-independent neural code for face and body orientation in occipitotemporal cortex.
Collapse
|
7
|
Bara I, Darda KM, Kurz AS, Ramsey R. Functional specificity and neural integration in the aesthetic appreciation of artworks with implied motion. Eur J Neurosci 2021; 54:7231-7259. [PMID: 34585450 DOI: 10.1111/ejn.15479] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2021] [Revised: 09/17/2021] [Accepted: 09/17/2021] [Indexed: 12/29/2022]
Abstract
Although there is growing interest in the neural foundations of aesthetic experience, it remains unclear how particular mental subsystems (e.g. perceptual, affective and cognitive) are involved in different types of aesthetic judgements. Here, we use fMRI to investigate the involvement of different neural networks during aesthetic judgements of visual artworks with implied motion cues. First, a behavioural experiment (N = 45) confirmed a preference for paintings with implied motion over static cues. Subsequently, in a preregistered fMRI experiment (N = 27), participants made aesthetic and motion judgements towards paintings representing human bodies in dynamic and static postures. Using functional region-of-interest and Bayesian multilevel modelling approaches, we provide no compelling evidence for unique sensitivity within or between neural systems associated with body perception, motion and affective processing during the aesthetic evaluation of paintings with implied motion. However, we show suggestive evidence that motion and body-selective systems may integrate signals via functional connections with a separate neural network in dorsal parietal cortex, which may act as a relay or integration site. Our findings clarify the roles of basic visual and affective brain circuitry in evaluating a central aesthetic feature-implied motion-while also pointing towards promising future research directions, which involve modelling aesthetic preferences as hierarchical interplay between visual and affective circuits and integration processes in frontoparietal cortex.
Collapse
Affiliation(s)
- Ionela Bara
- Wales Institute for Cognitive Neuroscience, School of Psychology, Bangor University, Bangor, UK
| | - Kohinoor Monish Darda
- University of Glasgow, Glasgow, UK.,Department of Psychology, Macquarie University, Sydney, Australia
| | - Andrew Solomon Kurz
- VISN 17 Center of Excellence for Research on Returning War Veterans, Central Texas Veterans Health Care System, Temple, Texas, USA
| | - Richard Ramsey
- Department of Psychology, Macquarie University, Sydney, Australia
| |
Collapse
|
8
|
Borghesani V, Dale CL, Lukic S, Hinkley LBN, Lauricella M, Shwe W, Mizuiri D, Honma S, Miller Z, Miller B, Houde JF, Gorno-Tempini ML, Nagarajan SS. Neural dynamics of semantic categorization in semantic variant of primary progressive aphasia. eLife 2021; 10:e63905. [PMID: 34155973 PMCID: PMC8241439 DOI: 10.7554/elife.63905] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2020] [Accepted: 06/21/2021] [Indexed: 12/28/2022] Open
Abstract
Semantic representations are processed along a posterior-to-anterior gradient reflecting a shift from perceptual (e.g., it has eight legs) to conceptual (e.g., venomous spiders are rare) information. One critical region is the anterior temporal lobe (ATL): patients with semantic variant primary progressive aphasia (svPPA), a clinical syndrome associated with ATL neurodegeneration, manifest a deep loss of semantic knowledge. We test the hypothesis that svPPA patients perform semantic tasks by over-recruiting areas implicated in perceptual processing. We compared MEG recordings of svPPA patients and healthy controls during a categorization task. While behavioral performance did not differ, svPPA patients showed indications of greater activation over bilateral occipital cortices and superior temporal gyrus, and inconsistent engagement of frontal regions. These findings suggest a pervasive reorganization of brain networks in response to ATL neurodegeneration: the loss of this critical hub leads to a dysregulated (semantic) control system, and defective semantic representations are seemingly compensated via enhanced perceptual processing.
Collapse
Affiliation(s)
- V Borghesani
- Memory and Aging Center, Department of Neurology, University of California, San FranciscoSan FranciscoUnited States
| | - CL Dale
- Department of Radiology and Biomedical Imaging, University of California, San FranciscoSan FranciscoUnited States
| | - S Lukic
- Memory and Aging Center, Department of Neurology, University of California, San FranciscoSan FranciscoUnited States
| | - LBN Hinkley
- Department of Radiology and Biomedical Imaging, University of California, San FranciscoSan FranciscoUnited States
| | - M Lauricella
- Memory and Aging Center, Department of Neurology, University of California, San FranciscoSan FranciscoUnited States
| | - W Shwe
- Memory and Aging Center, Department of Neurology, University of California, San FranciscoSan FranciscoUnited States
| | - D Mizuiri
- Department of Radiology and Biomedical Imaging, University of California, San FranciscoSan FranciscoUnited States
| | - S Honma
- Department of Radiology and Biomedical Imaging, University of California, San FranciscoSan FranciscoUnited States
| | - Z Miller
- Memory and Aging Center, Department of Neurology, University of California, San FranciscoSan FranciscoUnited States
| | - B Miller
- Memory and Aging Center, Department of Neurology, University of California, San FranciscoSan FranciscoUnited States
| | - JF Houde
- Department of Otolaryngology, University of California, San FranciscoSan FranciscoUnited States
| | - ML Gorno-Tempini
- Memory and Aging Center, Department of Neurology, University of California, San FranciscoSan FranciscoUnited States
- Department of Neurology, Dyslexia Center University of California, San FranciscoSan FranciscoUnited States
| | - SS Nagarajan
- Department of Radiology and Biomedical Imaging, University of California, San FranciscoSan FranciscoUnited States
- Department of Otolaryngology, University of California, San FranciscoSan FranciscoUnited States
| |
Collapse
|
9
|
Stehr DA, Zhou X, Tisby M, Hwu PT, Pyles JA, Grossman ED. Top-Down Attention Guidance Shapes Action Encoding in the pSTS. Cereb Cortex 2021; 31:3522-3535. [PMID: 33629729 DOI: 10.1093/cercor/bhab029] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2020] [Revised: 01/07/2021] [Accepted: 01/25/2021] [Indexed: 11/12/2022] Open
Abstract
The posterior superior temporal sulcus (pSTS) is a brain region characterized by perceptual representations of human body actions that promote the understanding of observed behavior. Increasingly, action observation is recognized as being strongly shaped by the expectations of the observer (Kilner 2011; Koster-Hale and Saxe 2013; Patel et al. 2019). Therefore, to characterize top-down influences on action observation, we evaluated the statistical structure of multivariate activation patterns from the action observation network (AON) while observers attended to the different dimensions of action vignettes (the action kinematics, goal, or identity of avatars jumping or crouching). Decoding accuracy varied as a function of attention instruction in the right pSTS and left inferior frontal cortex (IFC), with the right pSTS classifying actions most accurately when observers attended to the action kinematics and the left IFC classifying most accurately when observed attended to the actor's goal. Functional connectivity also increased between the right pSTS and right IFC when observers attended to the actions portrayed in the vignettes. Our findings are evidence that the attentive state of the viewer modulates sensory representations in the pSTS, consistent with proposals that the pSTS occupies an interstitial zone mediating top-down context and bottom-up perceptual cues during action observation.
Collapse
Affiliation(s)
- Daniel A Stehr
- Department of Cognitive Sciences, University of California, Irvine, Irvine, CA 92697, USA
| | - Xiaojue Zhou
- Department of Cognitive Sciences, University of California, Irvine, Irvine, CA 92697, USA
| | - Mariel Tisby
- Department of Cognitive Sciences, University of California, Irvine, Irvine, CA 92697, USA
| | - Patrick T Hwu
- Department of Cognitive Sciences, University of California, Irvine, Irvine, CA 92697, USA
| | - John A Pyles
- Department of Psychology, Carnegie Mellon University, Pittsburgh, PA 15213, USA
| | - Emily D Grossman
- Department of Cognitive Sciences, University of California, Irvine, Irvine, CA 92697, USA
| |
Collapse
|
10
|
Geers L, Pesenti M, Derosiere G, Duque J, Dricot L, Andres M. Role of the fronto-parietal cortex in prospective action judgments. Sci Rep 2021; 11:7454. [PMID: 33811223 PMCID: PMC8018944 DOI: 10.1038/s41598-021-86719-9] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2020] [Accepted: 03/19/2021] [Indexed: 11/09/2022] Open
Abstract
Prospective judgments about one's capability to perform an action are assumed to involve mental simulation of the action. Previous studies of motor imagery suggest this simulation is supported by a large fronto-parietal network including the motor system. Experiment 1 used fMRI to assess the contribution of this fronto-parietal network to judgments about one's capacity to grasp objects of different sizes between index and thumb. The neural network underlying prospective graspability judgments overlapped the fronto-parietal network involved in explicit motor imagery of grasping. However, shared areas were located in the right hemisphere, outside the motor cortex, and were also activated during perceptual length judgments, suggesting a contribution to object size estimate rather than motor simulation. Experiment 2 used TMS over the motor cortex to probe transient excitability changes undetected with fMRI. Results show that graspability judgments elicited a selective increase of excitability in the thumb and index muscles, which was maximal before the object display and intermediate during the judgment. Together, these findings suggest that prospective action judgments do not rely on the motor system to simulate the action per se but to refresh the memory of one's maximal grip aperture and facilitate its comparison with object size in right fronto-parietal areas.
Collapse
Affiliation(s)
- Laurie Geers
- Psychological Sciences Research Institute, Université catholique de Louvain, Place Cardinal Mercier 10, Louvain-la-Neuve, Belgium
| | - Mauro Pesenti
- Psychological Sciences Research Institute, Université catholique de Louvain, Place Cardinal Mercier 10, Louvain-la-Neuve, Belgium.,Institute of Neuroscience, Université catholique de Louvain, Avenue Mounier 53, Brussels, Belgium
| | - Gerard Derosiere
- Institute of Neuroscience, Université catholique de Louvain, Avenue Mounier 53, Brussels, Belgium
| | - Julie Duque
- Institute of Neuroscience, Université catholique de Louvain, Avenue Mounier 53, Brussels, Belgium
| | - Laurence Dricot
- Institute of Neuroscience, Université catholique de Louvain, Avenue Mounier 53, Brussels, Belgium
| | - Michael Andres
- Psychological Sciences Research Institute, Université catholique de Louvain, Place Cardinal Mercier 10, Louvain-la-Neuve, Belgium. .,Institute of Neuroscience, Université catholique de Louvain, Avenue Mounier 53, Brussels, Belgium.
| |
Collapse
|
11
|
Bellot E, Abassi E, Papeo L. Moving Toward versus Away from Another: How Body Motion Direction Changes the Representation of Bodies and Actions in the Visual Cortex. Cereb Cortex 2021; 31:2670-2685. [PMID: 33401307 DOI: 10.1093/cercor/bhaa382] [Citation(s) in RCA: 26] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2020] [Revised: 11/05/2020] [Accepted: 11/25/2020] [Indexed: 11/12/2022] Open
Abstract
Representing multiple agents and their mutual relations is a prerequisite to understand social events such as interactions. Using functional magnetic resonance imaging on human adults, we show that visual areas dedicated to body form and body motion perception contribute to processing social events, by holding the representation of multiple moving bodies and encoding the spatial relations between them. In particular, seeing animations of human bodies facing and moving toward (vs. away from) each other increased neural activity in the body-selective cortex [extrastriate body area (EBA)] and posterior superior temporal sulcus (pSTS) for biological motion perception. In those areas, representation of body postures and movements, as well as of the overall scene, was more accurate for facing body (vs. nonfacing body) stimuli. Effective connectivity analysis with dynamic causal modeling revealed increased coupling between EBA and pSTS during perception of facing body stimuli. The perceptual enhancement of multiple-body scenes featuring cues of interaction (i.e., face-to-face positioning, spatial proximity, and approaching signals) was supported by the participants' better performance in a recognition task with facing body versus nonfacing body stimuli. Thus, visuospatial cues of interaction in multiple-person scenarios affect the perceptual representation of body and body motion and, by promoting functional integration, streamline the process from body perception to action representation.
Collapse
Affiliation(s)
- Emmanuelle Bellot
- Institut des Sciences Cognitives-Marc Jeannerod, UMR5229, Centre National de la Recherche Scientifique (CNRS) & Université Claude Bernard Lyon 1, 69675 Bron, France
| | - Etienne Abassi
- Institut des Sciences Cognitives-Marc Jeannerod, UMR5229, Centre National de la Recherche Scientifique (CNRS) & Université Claude Bernard Lyon 1, 69675 Bron, France
| | - Liuba Papeo
- Institut des Sciences Cognitives-Marc Jeannerod, UMR5229, Centre National de la Recherche Scientifique (CNRS) & Université Claude Bernard Lyon 1, 69675 Bron, France
| |
Collapse
|
12
|
Du M, Basyouni R, Parkinson C. How does the brain navigate knowledge of social relations? Testing for shared neural mechanisms for shifting attention in space and social knowledge. Neuroimage 2021; 235:118019. [PMID: 33789132 DOI: 10.1016/j.neuroimage.2021.118019] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2020] [Revised: 03/05/2021] [Accepted: 03/22/2021] [Indexed: 11/24/2022] Open
Abstract
How does the human brain support reasoning about social relations (e.g., social status, friendships)? Converging theories suggest that navigating knowledge of social relations may co-opt neural circuitry with evolutionarily older functions (e.g., shifting attention in space). Here, we analyzed multivoxel response patterns of fMRI data to examine the neural mechanisms for shifting attention in knowledge of a social hierarchy. The "directions" in which participants mentally navigated social knowledge were encoded in multivoxel patterns in superior parietal cortex, which also encoded directions of attentional shifts in space. Exploratory analyses implicated additional regions of posterior parietal and occipital cortex in encoding analogous mental operations in space and social knowledge. However, cross-domain analyses suggested that attentional shifts in space and social knowledge are likely encoded in functionally independent response patterns. Additionally, cross-participant multivoxel pattern similarity analyses indicated that "directions'' of mental navigation in social knowledge are signaled consistently across participants and across different social hierarchies in a set of brain regions, including the right superior parietal lobule. Taken together, these results elucidate the neural basis of navigating abstract knowledge of social relations, and its connection to more basic mental operations.
Collapse
Affiliation(s)
- Meng Du
- UCLA Department of Psychology, 1285 Psychology Building, Los Angeles, CA 90095, United States
| | - Ruby Basyouni
- UCLA Department of Psychology, 1285 Psychology Building, Los Angeles, CA 90095, United States
| | - Carolyn Parkinson
- UCLA Department of Psychology, 1285 Psychology Building, Los Angeles, CA 90095, United States; UCLA Brain Research Institute, Los Angeles, CA 90095, United States.
| |
Collapse
|
13
|
Pitcher D, Ungerleider LG. Evidence for a Third Visual Pathway Specialized for Social Perception. Trends Cogn Sci 2021; 25:100-110. [PMID: 33334693 PMCID: PMC7811363 DOI: 10.1016/j.tics.2020.11.006] [Citation(s) in RCA: 232] [Impact Index Per Article: 58.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2020] [Revised: 11/18/2020] [Accepted: 11/18/2020] [Indexed: 11/20/2022]
Abstract
Existing models propose that primate visual cortex is divided into two functionally distinct pathways. The ventral pathway computes the identity of an object; the dorsal pathway computes the location of an object, and the actions related to that object. Despite remaining influential, the two visual pathways model requires revision. Both human and non-human primate studies reveal the existence of a third visual pathway on the lateral brain surface. This third pathway projects from early visual cortex, via motion-selective areas, into the superior temporal sulcus (STS). Studies demonstrating that the STS computes the actions of moving faces and bodies (e.g., expressions, eye-gaze, audio-visual integration, intention, and mood) show that the third visual pathway is specialized for the dynamic aspects of social perception.
Collapse
Affiliation(s)
- David Pitcher
- Department of Psychology, University of York, York, YO10 5DD, UK.
| | - Leslie G Ungerleider
- Section on Neurocircuitry, Laboratory of Brain and Cognition, National Institute of Mental Health, Bethesda, MD 20892, USA
| |
Collapse
|
14
|
Wen X, Sun Y, Hu Y, Yu D, Zhou Y, Yuan K. Identification of internet gaming disorder individuals based on ventral tegmental area resting-state functional connectivity. Brain Imaging Behav 2020; 15:1977-1985. [PMID: 33037577 DOI: 10.1007/s11682-020-00391-7] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/31/2020] [Indexed: 12/24/2022]
Abstract
Objective neuroimaging markers are imminently in need for more accurate clinical diagnosis of Internet gaming disorder (IGD). Recent neuroimaging evidence suggested that IGD is associated with abnormalities in the mesolimbic dopamine (DA) system. As the key nodes of the DA pathways, ventral tegmental area (VTA) and substantia nigra (SN) and their connected brain regions may serve as potential markers to identify IGD. Therefore, we aimed to develop optimal classifiers to identify IGD individuals by using VTA and bilateral SN resting-state functional connectivity (RSFC) patterns. A dataset including 146 adolescents (66 IGDs and 80 healthy controls (HCs)) was used to build classification models and another independent dataset including 28 subjects (14 IGDs and 14 HCs) was employed to validate the generalization ability of the models. Multi-voxel pattern analysis (MVPA) with linear support vector machine (SVM) was used to select the features. Our results demonstrated that the VTA RSFC circuits successfully identified IGD individuals (mean accuracy: 86.1%, mean sensitivity: 84.5%, mean specificity: 86.6%, the mean area under the receiver operating characteristic curve: 0.91). Furthermore, the independent generalization ability of the VTA RSFC classifier model was also satisfied (accuracy = 78.5%, sensitivity = 71.4%, specificity = 85.8%). The VTA connectivity circuits that were selected as distinguishing features were mainly included bilateral thalamus, right hippocampus, right pallidum, right temporal pole superior gyrus and bilateral temporal superior gyrus. These findings demonstrated that the potential of the resting-state neuroimaging features of VTA RSFC as objective biomarkers for the IGD clinical diagnosis in the future.
Collapse
Affiliation(s)
- Xinwen Wen
- School of Life Science and Technology, Xidian University, Xi'an, Shaanxi, 710071, People's Republic of China.,Engineering Research Center of Molecular & Neuroimaging, Ministry of Education, Xi'an, China
| | - Yawen Sun
- Department of Radiology, Ren Ji Hospital, School of Medicine, Shanghai Jiao Tong University, Shanghai, China
| | - Yuzheng Hu
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, Zhejiang, 310058, People's Republic of China
| | - Dahua Yu
- Information Processing Laboratory, School of Information Engineering, Inner Mongolia University of Science and Technology, Baotou, Inner Mongolia, 014010, People's Republic of China
| | - Yan Zhou
- Department of Radiology, Ren Ji Hospital, School of Medicine, Shanghai Jiao Tong University, Shanghai, China.
| | - Kai Yuan
- School of Life Science and Technology, Xidian University, Xi'an, Shaanxi, 710071, People's Republic of China. .,Engineering Research Center of Molecular & Neuroimaging, Ministry of Education, Xi'an, China. .,Information Processing Laboratory, School of Information Engineering, Inner Mongolia University of Science and Technology, Baotou, Inner Mongolia, 014010, People's Republic of China.
| |
Collapse
|
15
|
Weaverdyck ME, Lieberman MD, Parkinson C. Tools of the Trade Multivoxel pattern analysis in fMRI: a practical introduction for social and affective neuroscientists. Soc Cogn Affect Neurosci 2020; 15:487-509. [PMID: 32364607 PMCID: PMC7308652 DOI: 10.1093/scan/nsaa057] [Citation(s) in RCA: 74] [Impact Index Per Article: 14.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2019] [Revised: 04/08/2020] [Accepted: 04/15/2020] [Indexed: 12/26/2022] Open
Abstract
The family of neuroimaging analytical techniques known as multivoxel pattern analysis (MVPA) has dramatically increased in popularity over the past decade, particularly in social and affective neuroscience research using functional magnetic resonance imaging (fMRI). MVPA examines patterns of neural responses, rather than analyzing single voxel- or region-based values, as is customary in conventional univariate analyses. Here, we provide a practical introduction to MVPA and its most popular variants (namely, representational similarity analysis (RSA) and decoding analyses, such as classification using machine learning) for social and affective neuroscientists of all levels, particularly those new to such methods. We discuss how MVPA differs from traditional mass-univariate analyses, the benefits MVPA offers to social neuroscientists, experimental design and analysis considerations, step-by-step instructions for how to implement specific analyses in one's own dataset and issues that are currently facing research using MVPA methods.
Collapse
Affiliation(s)
- Miriam E Weaverdyck
- Department of Psychology, University of California, Los Angeles, CA 90095, USA
| | - Matthew D Lieberman
- Department of Psychology, University of California, Los Angeles, CA 90095, USA
| | - Carolyn Parkinson
- Department of Psychology, University of California, Los Angeles, CA 90095, USA
- Brain Research Institute, University of California, Los Angeles, CA 90095, USA
| |
Collapse
|
16
|
Johnstone LT, Karlsson EM, Carey DP. The validity and reliability of quantifying hemispheric specialisation using fMRI: Evidence from left and right handers on three different cerebral asymmetries. Neuropsychologia 2020; 138:107331. [DOI: 10.1016/j.neuropsychologia.2020.107331] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2019] [Revised: 12/16/2019] [Accepted: 01/05/2020] [Indexed: 12/21/2022]
|
17
|
Fourie E, Palser ER, Pokorny JJ, Neff M, Rivera SM. Neural Processing and Production of Gesture in Children and Adolescents With Autism Spectrum Disorder. Front Psychol 2020; 10:3045. [PMID: 32038408 PMCID: PMC6987472 DOI: 10.3389/fpsyg.2019.03045] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2019] [Accepted: 12/23/2019] [Indexed: 02/02/2023] Open
Abstract
Individuals with autism spectrum disorder (ASD) demonstrate impairments in non-verbal communication, including gesturing and imitation deficits. Reduced sensitivity to biological motion (BM) in ASD may impair processing of dynamic social cues like gestures, which in turn may impede encoding and subsequent performance of these actions. Using both an fMRI task involving observation of action gestures and a charade style paradigm assessing gesture performance, this study examined the brain-behavior relationships between neural activity during gesture processing, gesturing abilities and social symptomology in a group of children and adolescents with and without ASD. Compared to typically developing (TD) controls, participants with ASD showed atypical sensitivity to movement in right posterior superior temporal sulcus (pSTS), a region implicated in action processing, and had poorer overall gesture performance with specific deficits in hand posture. The TD group showed associations between neural activity, gesture performance and social skills, that were weak or non-significant in the ASD group. These findings suggest that those with ASD demonstrate abnormalities in both processing and production of gestures and may reflect dysfunction in the mechanism underlying perception-action coupling resulting in atypical development of social and communicative skills.
Collapse
Affiliation(s)
- Emily Fourie
- Department of Psychology, University of California, Davis, Davis, CA, United States.,Center for Mind and Brain, University of California, Davis, Davis, CA, United States
| | - Eleanor R Palser
- Department of Neurology, University of California, San Francisco, San Francisco, CA, United States
| | - Jennifer J Pokorny
- Center for Mind and Brain, University of California, Davis, Davis, CA, United States
| | - Michael Neff
- Department of Computer Science, University of California, Davis, Davis, CA, United States.,Department of Cinema and Digital Media, University of California, Davis, Davis, CA, United States
| | - Susan M Rivera
- Department of Psychology, University of California, Davis, Davis, CA, United States.,Center for Mind and Brain, University of California, Davis, Davis, CA, United States.,MIND Institute, University of California, Davis, Sacramento, CA, United States
| |
Collapse
|
18
|
Tucciarelli R, Wurm M, Baccolo E, Lingnau A. The representational space of observed actions. eLife 2019; 8:47686. [PMID: 31804177 PMCID: PMC6894926 DOI: 10.7554/elife.47686] [Citation(s) in RCA: 29] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2019] [Accepted: 11/21/2019] [Indexed: 11/25/2022] Open
Abstract
Categorizing and understanding other people’s actions is a key human capability. Whereas there exists a growing literature regarding the organization of objects, the representational space underlying the organization of observed actions remains largely unexplored. Here we examined the organizing principles of a large set of actions and the corresponding neural representations. Using multiple regression representational similarity analysis of fMRI data, in which we accounted for variability due to major action components (body parts, scenes, movements, objects, sociality, transitivity) and three control models (distance between observer and actor, number of people, HMAX-C1), we found that the semantic dissimilarity structure was best captured by patterns of activation in the lateral occipitotemporal cortex (LOTC). Together, our results demonstrate that the organization of observed actions in the LOTC resembles the organizing principles used by participants to classify actions behaviorally, in line with the view that this region is crucial for accessing the meaning of actions.
Collapse
Affiliation(s)
- Raffaele Tucciarelli
- Department of Psychology, Royal Holloway University of London, Egham, United Kingdom
| | - Moritz Wurm
- Center for Mind/Brain Sciences (CIMeC), University of Trento, Rovereto, Italy
| | - Elisa Baccolo
- Center for Mind/Brain Sciences (CIMeC), University of Trento, Rovereto, Italy
| | - Angelika Lingnau
- Department of Psychology, Royal Holloway University of London, Egham, United Kingdom.,Center for Mind/Brain Sciences (CIMeC), University of Trento, Rovereto, Italy.,Institute of Psychology, University of Regensburg, Regensburg, Germany
| |
Collapse
|
19
|
Carey M, Knight R, Preston C. Distinct neural response to visual perspective and body size in the extrastriate body area. Behav Brain Res 2019; 372:112063. [PMID: 31255673 DOI: 10.1016/j.bbr.2019.112063] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2019] [Revised: 06/08/2019] [Accepted: 06/26/2019] [Indexed: 01/08/2023]
Abstract
Neuroimaging research has independently implicated the extrastriate body area (EBA) in distinguishing between different visual perspectives and morphologies of bodies within visual processing. However, the combined processing of these physical attributes towards neural EBA response remains unclear, and may be crucial in influencing higher-order, aesthetic evaluation of bodies. Indeed, EBA alterations amongst eating disorder patients have been associated with disturbances in body image, and disruption to EBA activity amongst healthy individuals has been shown to influence aesthetic evaluations made towards bodies. Therefore, the present study used images of slim and large female bodies viewed from egocentric and allocentric perspectives, to investigate neural EBA response amongst healthy females (N = 30). In addition, participants provided behavioural aesthetic and weight evaluations of all model stimuli. Results revealed an interaction, bilaterally, between visual perspective and body size towards EBA activity, with multi-voxel pattern analysis revealing distinct neural patterns between the four conditions. However, EBA activity did not relate to non-clinical eating disorder psychopathology. No direct relationship was found between EBA activity and behavioural evaluations of model stimuli; however, a whole brain analysis revealed that higher-order, prefrontal regions were associated with cognitive evaluations of large bodies. Taken together, our results suggest that the EBA is an integral core region in discriminating between multiple physical attributes of the body, which is likely to provide important information to higher-order brain regions which make aesthetic evaluations towards bodies.
Collapse
Affiliation(s)
- Mark Carey
- Department of Psychology, University of York, York, United Kingdom.
| | - Ruth Knight
- Department of Psychology, University of York, York, United Kingdom
| | | |
Collapse
|
20
|
Pitcher D, Ianni G, Ungerleider LG. A functional dissociation of face-, body- and scene-selective brain areas based on their response to moving and static stimuli. Sci Rep 2019; 9:8242. [PMID: 31160680 PMCID: PMC6546694 DOI: 10.1038/s41598-019-44663-9] [Citation(s) in RCA: 43] [Impact Index Per Article: 7.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2018] [Accepted: 05/07/2019] [Indexed: 11/20/2022] Open
Abstract
The human brain contains areas that respond selectively to faces, bodies and scenes. Neuroimaging studies have shown that a subset of these areas preferentially respond more to moving than static stimuli, but the reasons for this functional dissociation remain unclear. In the present study, we simultaneously mapped the responses to motion in face-, body- and scene-selective areas in the right hemisphere using moving and static stimuli. Participants (N = 22) were scanned using functional magnetic resonance imaging (fMRI) while viewing videos containing bodies, faces, objects, scenes or scrambled objects, and static pictures from the beginning, middle and end of each video. Results demonstrated that lateral areas, including face-selective areas in the posterior and anterior superior temporal sulcus (STS), the extrastriate body area (EBA) and the occipital place area (OPA) responded more to moving than static stimuli. By contrast, there was no difference between the response to moving and static stimuli in ventral and medial category-selective areas, including the fusiform face area (FFA), occipital face area (OFA), amygdala, fusiform body area (FBA), retrosplenial complex (RSC) and parahippocampal place area (PPA). This functional dissociation between lateral and ventral/medial brain areas that respond selectively to different visual categories suggests that face-, body- and scene-selective networks may be functionally organized along a common dimension.
Collapse
Affiliation(s)
- David Pitcher
- Department of Psychology, University of York, Heslington, York, YO105DD, UK.
| | - Geena Ianni
- Weill Cornell/Rockefeller/Sloan Kettering Tri-Institutional MD-PhD Program, New York, 10065, USA.,Section on Neurocircuitry, Laboratory of Brain and Cognition, National Institute of Mental Health, Bethesda, MD, 20892, USA
| | - Leslie G Ungerleider
- Section on Neurocircuitry, Laboratory of Brain and Cognition, National Institute of Mental Health, Bethesda, MD, 20892, USA
| |
Collapse
|
21
|
Savaki HE, Raos V. Action perception and motor imagery: Mental practice of action. Prog Neurobiol 2019; 175:107-125. [PMID: 30711619 DOI: 10.1016/j.pneurobio.2019.01.007] [Citation(s) in RCA: 29] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2018] [Revised: 01/21/2019] [Accepted: 01/28/2019] [Indexed: 02/06/2023]
Abstract
Motor cognition is related to the planning and generation of actions as well as to the recognition and imagination of motor acts. Recently, there is evidence that the motor system participates not only in overt actions but also in mental processes supporting covert actions. Within this framework, we have investigated the cortical areas engaged in execution, observation, and imagination of the same action, by the use of the high resolution quantitative 14C-deoxyglucose method in monkeys and by fMRI in humans, throughout the entire primate brain. Our data demonstrated that observing or imagining an action excites virtually the same sensory-motor cortical network which supports execution of that same action. In general agreement with the results of five relevant meta-analyses that we discuss extensively, our results imply mental practice, i.e. internal rehearsal of the action including movements and their sensory effects. We suggest that we actively perceive and imagine actions by selecting and running off-line restored sensory-motor memories, by mentally simulating the actions. We provide empirical evidence that mental simulation of actions underlies motor cognition, and conceptual representations are grounded in sensory-motor codes. Motor cognition may, therefore, be embodied and modal. Finally, we consider questions regarding agency attribution and the possible causal or epiphenomenal role the involved sensory-motor network could play in motor cognition.
Collapse
Affiliation(s)
- Helen E Savaki
- Department of Basic Sciences, School of Medicine, University of Crete, Vassilika Vouton, 70013, Iraklion, Crete, Greece; Computational Neuroscience Group, Institute of Applied and Computational Mathematics, Foundation for Research and Technology-Hellas, Plastira N 100 str, 70013, Iraklion, Crete, Greece.
| | - Vassilis Raos
- Department of Basic Sciences, School of Medicine, University of Crete, Vassilika Vouton, 70013, Iraklion, Crete, Greece; Computational Neuroscience Group, Institute of Applied and Computational Mathematics, Foundation for Research and Technology-Hellas, Plastira N 100 str, 70013, Iraklion, Crete, Greece
| |
Collapse
|
22
|
Repetitive Transcranial Magnetic Stimulation Over the Left Posterior Middle Temporal Gyrus Reduces Wrist Velocity During Emblematic Hand Gesture Imitation. Brain Topogr 2018; 32:332-341. [PMID: 30411178 PMCID: PMC6373290 DOI: 10.1007/s10548-018-0684-1] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2018] [Accepted: 10/26/2018] [Indexed: 12/22/2022]
Abstract
Results from neuropsychological studies, and neuroimaging and behavioural experiments with healthy individuals, suggest that the imitation of meaningful and meaningless actions may be reliant on different processing routes. The left posterior middle temporal gyrus (pMTG) is one area that might be important for the recognition and imitation of meaningful actions. We studied the role of the left pMTG in imitation using repetitive transcranial magnetic stimulation (rTMS) and two-person motion-tracking. Participants imitated meaningless and emblematic meaningful hand and finger gestures performed by a confederate actor whilst both individuals were motion-tracked. rTMS was applied during action observation (before imitation) over the left pMTG or a vertex control site. Since meaningless action imitation has been previously associated with a greater wrist velocity and longer correction period at the end of the movement, we hypothesised that stimulation over the left pMTG would increase wrist velocity and extend the correction period of meaningful actions (i.e., due to interference with action recognition). We also hypothesised that imitator accuracy (actor-imitator correspondence) would be reduced following stimulation over the left pMTG. Contrary to our hypothesis, we found that stimulation over the pMTG, but not the vertex, during action observation reduced wrist velocity when participants later imitated meaningful, but not meaningless, hand gestures. These results provide causal evidence for a role of the left pMTG in the imitation of meaningful gestures, and may also be in keeping with proposals that left posterior temporal regions play a role in the production of postural components of gesture.
Collapse
|
23
|
Abstract
Gender dysphoria (GD) is characterized by incongruence between one's identity and gender assigned at birth. The biological mechanisms of GD are unclear. We investigated brain network connectivity patterns involved in own body perception in the context of self in GD. Twenty-seven female-to-male (FtM) individuals with GD, 27 male controls, and 27 female controls underwent resting state fMRI. We compared functional connections within intrinsic connectivity networks involved in self-referential processes and own body perception -default mode network (DMN) and salience network - and visual networks, using independent components analyses. Behavioral correlates of network connectivity were also tested using self-perception ratings while viewing own body images morphed to their sex assigned at birth, and to the sex of their gender identity. FtM exhibited decreased connectivity of anterior and posterior cingulate and precuneus within the DMN compared with controls. In FtM, higher "self" ratings for bodies morphed towards the sex of their gender identity were associated with greater connectivity of the anterior cingulate within the DMN, during long viewing times. In controls, higher ratings for bodies morphed towards their gender assigned at birth were associated with right insula connectivity within the salience network, during short viewing times. Within visual networks FtM showed weaker connectivity in occipital and temporal regions. Results suggest disconnectivity within networks involved in own body perception in the context of self in GD. Moreover, perception of bodies in relation to self may be reflective rather than reflexive, as a function of mesial prefrontal processes. These may represent neurobiological correlates to the subjective disconnection between perception of body and self-identification.
Collapse
|
24
|
Abstract
Body shape cues inferences regarding personality and health, but the neural processes underpinning such inferences remain poorly understood. Across two fMRI experiments, we test the extent to which neural networks associated with body perception and theory-of-mind (ToM) support social inferences based on body shape. Participants observed obese, muscular, and slim bodies that cued distinct social inferences as revealed in behavioural pilot experiments. To investigate judgment intentionality, the first fMRI experiment required participants to detect repeat presentations of bodies, whereas in fMRI Experiment 2 participants intentionally formed an impression. Body and ToM networks were localized using independent functional localisers. Experiment 1 revealed no differential network engagement for muscular or obese compared to slim bodies. By contrast, in Experiment 2, compared to slim bodies, forming impressions of muscular bodies engaged the body-network more, whereas the ToM-network was engaged more when forming impressions of obese bodies. These results demonstrate that social judgments based on body shape do not rely on a single neural mechanism, but rather on multiple mechanisms that are separately sensitive to body fat and muscularity. Moreover, dissociable responses are only apparent when intentionally forming an impression. Thus, these experiments show how segregated networks operate to extract socially-relevant information cued by body shape.
Collapse
Affiliation(s)
- Inez M Greven
- a Wales Institute for Cognitive Neuroscience, School of Psychology , Bangor University , Bangor , Gwynedd , Wales, UK
| | - Paul E Downing
- a Wales Institute for Cognitive Neuroscience, School of Psychology , Bangor University , Bangor , Gwynedd , Wales, UK
| | - Richard Ramsey
- a Wales Institute for Cognitive Neuroscience, School of Psychology , Bangor University , Bangor , Gwynedd , Wales, UK
| |
Collapse
|
25
|
Investigating the neural basis of basic human movement perception using multi-voxel pattern analysis. Exp Brain Res 2018; 236:907-918. [DOI: 10.1007/s00221-018-5175-9] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2017] [Accepted: 01/09/2018] [Indexed: 10/18/2022]
|
26
|
Hodgetts CJ, Shine JP, Lawrence AD, Downing PE, Graham KS. Evidencing a place for the hippocampus within the core scene processing network. Hum Brain Mapp 2018; 37:3779-3794. [PMID: 27257784 PMCID: PMC5082524 DOI: 10.1002/hbm.23275] [Citation(s) in RCA: 29] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2015] [Revised: 04/18/2016] [Accepted: 05/17/2016] [Indexed: 01/09/2023] Open
Abstract
Functional neuroimaging studies have identified several “core” brain regions that are preferentially activated by scene stimuli, namely posterior parahippocampal gyrus (PHG), retrosplenial cortex (RSC), and transverse occipital sulcus (TOS). The hippocampus (HC), too, is thought to play a key role in scene processing, although no study has yet investigated scene‐sensitivity in the HC relative to these other “core” regions. Here, we characterised the frequency and consistency of individual scene‐preferential responses within these regions by analysing a large dataset (n = 51) in which participants performed a one‐back working memory task for scenes, objects, and scrambled objects. An unbiased approach was adopted by applying independently‐defined anatomical ROIs to individual‐level functional data across different voxel‐wise thresholds and spatial filters. It was found that the majority of subjects had preferential scene clusters in PHG (max = 100% of participants), RSC (max = 76%), and TOS (max = 94%). A comparable number of individuals also possessed significant scene‐related clusters within their individually defined HC ROIs (max = 88%), evidencing a HC contribution to scene processing. While probabilistic overlap maps of individual clusters showed that overlap “peaks” were close to those identified in group‐level analyses (particularly for TOS and HC), inter‐individual consistency varied across regions and statistical thresholds. The inter‐regional and inter‐individual variability revealed by these analyses has implications for how scene‐sensitive cortex is localised and interrogated in functional neuroimaging studies, particularly in medial temporal lobe regions, such as the HC. Hum Brain Mapp 37:3779–3794, 2016. © 2016 Wiley Periodicals, Inc.
Collapse
Affiliation(s)
- C J Hodgetts
- Wales Institute of Cognitive Neuroscience, School of Psychology, Cardiff University, Cardiff, United Kingdom. .,Cardiff University Brain Research Imaging Centre (CUBRIC), School of Psychology, Cardiff University, Cardiff, United Kingdom.
| | - J P Shine
- Wales Institute of Cognitive Neuroscience, School of Psychology, Cardiff University, Cardiff, United Kingdom.,Cardiff University Brain Research Imaging Centre (CUBRIC), School of Psychology, Cardiff University, Cardiff, United Kingdom
| | - A D Lawrence
- Wales Institute of Cognitive Neuroscience, School of Psychology, Cardiff University, Cardiff, United Kingdom.,Cardiff University Brain Research Imaging Centre (CUBRIC), School of Psychology, Cardiff University, Cardiff, United Kingdom
| | - P E Downing
- Wales Institute of Cognitive Neuroscience, School of Psychology, Bangor University, Bangor, United Kingdom
| | - K S Graham
- Wales Institute of Cognitive Neuroscience, School of Psychology, Cardiff University, Cardiff, United Kingdom.,Cardiff University Brain Research Imaging Centre (CUBRIC), School of Psychology, Cardiff University, Cardiff, United Kingdom
| |
Collapse
|
27
|
Yang X, Xu J, Cao L, Li X, Wang P, Wang B, Liu B. Linear Representation of Emotions in Whole Persons by Combining Facial and Bodily Expressions in the Extrastriate Body Area. Front Hum Neurosci 2018; 11:653. [PMID: 29375348 PMCID: PMC5767685 DOI: 10.3389/fnhum.2017.00653] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2017] [Accepted: 12/21/2017] [Indexed: 11/13/2022] Open
Abstract
Our human brain can rapidly and effortlessly perceive a person’s emotional state by integrating the isolated emotional faces and bodies into a whole. Behavioral studies have suggested that the human brain encodes whole persons in a holistic rather than part-based manner. Neuroimaging studies have also shown that body-selective areas prefer whole persons to the sum of their parts. The body-selective areas played a crucial role in representing the relationships between emotions expressed by different parts. However, it remains unclear in which regions the perception of whole persons is represented by a combination of faces and bodies, and to what extent the combination can be influenced by the whole person’s emotions. In the present study, functional magnetic resonance imaging data were collected when participants performed an emotion distinction task. Multi-voxel pattern analysis was conducted to examine how the whole person-evoked responses were associated with the face- and body-evoked responses in several specific brain areas. We found that in the extrastriate body area (EBA), the whole person patterns were most closely correlated with weighted sums of face and body patterns, using different weights for happy expressions but equal weights for angry and fearful ones. These results were unique for the EBA. Our findings tentatively support the idea that the whole person patterns are represented in a part-based manner in the EBA, and modulated by emotions. These data will further our understanding of the neural mechanism underlying perceiving emotional persons.
Collapse
Affiliation(s)
- Xiaoli Yang
- School of Computer Science and Technology, Tianjin Key Laboratory of Cognitive Computing and Applications, Tianjin University, Tianjin, China
| | - Junhai Xu
- School of Computer Science and Technology, Tianjin Key Laboratory of Cognitive Computing and Applications, Tianjin University, Tianjin, China
| | - Linjing Cao
- School of Computer Science and Technology, Tianjin Key Laboratory of Cognitive Computing and Applications, Tianjin University, Tianjin, China
| | - Xianglin Li
- Medical Imaging Research Institute, Binzhou Medical University, Yantai, China
| | - Peiyuan Wang
- Department of Radiology, Yantai Affiliated Hospital of Binzhou Medical University, Yantai, China
| | - Bin Wang
- Medical Imaging Research Institute, Binzhou Medical University, Yantai, China
| | - Baolin Liu
- School of Computer Science and Technology, Tianjin Key Laboratory of Cognitive Computing and Applications, Tianjin University, Tianjin, China.,Research State Key Laboratory of Intelligent Technology and Systems, National Laboratory for Information Science and Technology, Tsinghua University, Beijing, China
| |
Collapse
|
28
|
Fujita K, Sako W, Vo A, Bressman SB, Eidelberg D. Disruption of network for visual perception of natural motion in primary dystonia. Hum Brain Mapp 2017; 39:1163-1174. [PMID: 29214728 DOI: 10.1002/hbm.23907] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2017] [Revised: 10/30/2017] [Accepted: 11/29/2017] [Indexed: 11/07/2022] Open
Abstract
In healthy subjects, brain activation in motor regions is greater during the visual perception of "natural" target motion, which complies with the two-thirds power law, than of "unnatural" motion, which does not. It is unknown whether motion perception is normally mediated by a specific network that can be altered in the setting of disease. We used block-design functional magnetic resonance imaging and covariance analysis to identify normal network topographies activated in response to "natural" versus "unnatural" motion. A visual motion perception-related pattern (VPRP) was identified in 12 healthy subjects, characterized by covarying activation responses in the inferior parietal lobule, frontal operculum, lateral occipitotemporal cortex, amygdala, and cerebellum (Crus I). Selective VPRP activation during "natural" motion was confirmed in 12 testing scans from healthy subjects. Consistent network activation was not seen, however, in 29 patients with dystonia, a neurodevelopmental disorder in which motion perception pathways may be involved. Using diffusion tractography, we evaluated the integrity of anatomical connections between the major VPRP nodes. Indeed, fiber counts in these pathways were substantially reduced in the dystonia subjects. In aggregate, the findings associate normal motion perception with a discrete brain network which can be disrupted under pathological conditions.
Collapse
Affiliation(s)
- Koji Fujita
- Center for Neurosciences, The Feinstein Institute for Medical Research, Manhasset, NY, 11030
| | - Wataru Sako
- Center for Neurosciences, The Feinstein Institute for Medical Research, Manhasset, NY, 11030
| | - An Vo
- Center for Neurosciences, The Feinstein Institute for Medical Research, Manhasset, NY, 11030
| | - Susan B Bressman
- Mirken Department of Neurology, Mount Sinai Beth Israel, New York, NY, 10003
| | - David Eidelberg
- Center for Neurosciences, The Feinstein Institute for Medical Research, Manhasset, NY, 11030
| |
Collapse
|
29
|
Object Representations in Human Visual Cortex Formed Through Temporal Integration of Dynamic Partial Shape Views. J Neurosci 2017; 38:659-678. [PMID: 29196319 DOI: 10.1523/jneurosci.1318-17.2017] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2017] [Revised: 11/13/2017] [Accepted: 11/15/2017] [Indexed: 11/21/2022] Open
Abstract
We typically recognize visual objects using the spatial layout of their parts, which are present simultaneously on the retina. Therefore, shape extraction is based on integration of the relevant retinal information over space. The lateral occipital complex (LOC) can represent shape faithfully in such conditions. However, integration over time is sometimes required to determine object shape. To study shape extraction through temporal integration of successive partial shape views, we presented human participants (both men and women) with artificial shapes that moved behind a narrow vertical or horizontal slit. Only a tiny fraction of the shape was visible at any instant at the same retinal location. However, observers perceived a coherent whole shape instead of a jumbled pattern. Using fMRI and multivoxel pattern analysis, we searched for brain regions that encode temporally integrated shape identity. We further required that the representation of shape should be invariant to changes in the slit orientation. We show that slit-invariant shape information is most accurate in the LOC. Importantly, the slit-invariant shape representations matched the conventional whole-shape representations assessed during full-image runs. Moreover, when the same slit-dependent shape slivers were shuffled, thereby preventing their spatiotemporal integration, slit-invariant shape information was reduced dramatically. The slit-invariant representation of the various shapes also mirrored the structure of shape perceptual space as assessed by perceptual similarity judgment tests. Therefore, the LOC is likely to mediate temporal integration of slit-dependent shape views, generating a slit-invariant whole-shape percept. These findings provide strong evidence for a global encoding of shape in the LOC regardless of integration processes required to generate the shape percept.SIGNIFICANCE STATEMENT Visual objects are recognized through spatial integration of features available simultaneously on the retina. The lateral occipital complex (LOC) represents shape faithfully in such conditions even if the object is partially occluded. However, shape must sometimes be reconstructed over both space and time. Such is the case in anorthoscopic perception, when an object is moving behind a narrow slit. In this scenario, spatial information is limited at any moment so the whole-shape percept can only be inferred by integration of successive shape views over time. We find that LOC carries shape-specific information recovered using such temporal integration processes. The shape representation is invariant to slit orientation and is similar to that evoked by a fully viewed image. Existing models of object recognition lack such capabilities.
Collapse
|
30
|
Greven IM, Ramsey R. Neural network integration during the perception of in-group and out-group members. Neuropsychologia 2017; 106:225-235. [DOI: 10.1016/j.neuropsychologia.2017.09.036] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2017] [Revised: 09/07/2017] [Accepted: 09/28/2017] [Indexed: 02/08/2023]
|
31
|
Zhang Z, Jiang Y, Sun Y, Zhang H. Potential for false positive results from multi-voxel pattern analysis on functional imaging data. Technol Health Care 2017; 25:287-294. [PMID: 28582917 DOI: 10.3233/thc-171332] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
BACKGROUND Multi-voxel pattern analysis (MVPA) provides a powerful tool to investigate neural mechanisms for various cognitive processes under functional brain imaging. However, the high sensitivity of the MVPA method could bring about false positive results, which has been overlooked by previous research. OBJECTIVE We investigated the potential for obtaining false positives from the MVPA method. METHODS We conducted MVPA on a public functional MRI dataset on the neural encoding of various object categories. Different scenarios for pattern classification were involved by varying the number of voxels for each region of interest (ROI) and the number of object categories. RESULTS The classification accuracy became higher with more voxels involved, and false positive results emerged for the primary auditory cortex and even a white matter ROI, where object-related neural processing was not supposed to occur. CONCLUSIONS Our results imply that the classification accuracy obtained from MVPA may be inflated due to the high sensitivity of the method. Therefore, we suggest involving control ROIs in future MVPA studies and comparing the classification accuracy for a target ROI with that for a control ROI, instead of comparing the obtained accuracy with the chance-level accuracy.
Collapse
Affiliation(s)
- Zuo Zhang
- Department of Computer Science and Technology, Tongji University, Shanghai, China.,Department of Computer Science and Technology, Tongji University, Shanghai, China
| | - Youhao Jiang
- Department of Control Science and Engineering, Tongji University, Shanghai, China.,Putuo Hospital Affiliated to Shanghai University of Traditional Chinese Medicine, Shanghai, China.,Department of Computer Science and Technology, Tongji University, Shanghai, China
| | - Yaoru Sun
- Department of Computer Science and Technology, Tongji University, Shanghai, China
| | - Hong Zhang
- Department of Computer Science and Technology, Tongji University, Shanghai, China.,Department of Mathematics, Taiyuan Normal University, Taiyuan, Shanxi, China
| |
Collapse
|
32
|
Is the extrastriate body area part of the dorsal visuomotor stream? Brain Struct Funct 2017; 223:31-46. [PMID: 28702735 PMCID: PMC5772142 DOI: 10.1007/s00429-017-1469-0] [Citation(s) in RCA: 46] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2016] [Accepted: 07/01/2017] [Indexed: 01/17/2023]
Abstract
The extrastriate body area (EBA) processes visual information about body parts, and it is considered one among a series of category-specific perceptual modules distributed across the occipito-temporal cortex. However, recent evidence raises the possibility that EBA might also provide an interface between perception and action, linking the ventral and dorsal streams of visual information processing. Here, we assess anatomical evidence supporting this possibility. We localise EBA in individual subjects using a perceptual task and compare the characteristics of its functional and structural connectivity to those of two perceptual areas, the lateral occipital complex (LOC) and the fusiform body area (FBA), separately for each hemisphere. We apply complementary analyses of resting-state fMRI and diffusion-weighted MRI data in a group of healthy right-handed human subjects (N = 31). Functional and structural connectivity profiles indicate that EBA interacts more strongly with dorsal-stream regions compared to other portions of the occipito-temporal cortex involved in processing body parts (FBA) and object identification (LOC). These findings provide anatomical ground for a revision of the functional role of EBA. Building on a number of recent observations, we suggest that EBA contributes to planning goal-directed actions, possibly by specifying a desired postural configuration to parieto-frontal areas involved in computing movement parameters.
Collapse
|
33
|
Hendriks MHA, Daniels N, Pegado F, Op de Beeck HP. The Effect of Spatial Smoothing on Representational Similarity in a Simple Motor Paradigm. Front Neurol 2017; 8:222. [PMID: 28611726 PMCID: PMC5446978 DOI: 10.3389/fneur.2017.00222] [Citation(s) in RCA: 33] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2016] [Accepted: 05/08/2017] [Indexed: 11/13/2022] Open
Abstract
Multi-voxel pattern analyses (MVPA) are often performed on unsmoothed data, which is very different from the general practice of large smoothing extents in standard voxel-based analyses. In this report, we studied the effect of smoothing on MVPA results in a motor paradigm. Subjects pressed four buttons with two different fingers of the two hands in response to auditory commands. Overall, independent of the degree of smoothing, correlational MVPA showed distinctive patterns for the different hands in all studied regions of interest (motor cortex, prefrontal cortex, and auditory cortices). With regard to the effect of smoothing, our findings suggest that results from correlational MVPA show a minor sensitivity to smoothing. Moderate amounts of smoothing (in this case, 1−4 times the voxel size) improved MVPA correlations, from a slight improvement to large improvements depending on the region involved. None of the regions showed signs of a detrimental effect of moderate levels of smoothing. Even higher amounts of smoothing sometimes had a positive effect, most clearly in low-level auditory cortex. We conclude that smoothing seems to have a minor positive effect on MVPA results, thus researchers should be mindful about the choices they make regarding the level of smoothing.
Collapse
Affiliation(s)
- Michelle H A Hendriks
- Laboratory of Biological Psychology, Brain and Cognition, KU Leuven, Leuven, Belgium
| | - Nicky Daniels
- Laboratory of Biological Psychology, Brain and Cognition, KU Leuven, Leuven, Belgium
| | - Felipe Pegado
- Laboratory of Biological Psychology, Brain and Cognition, KU Leuven, Leuven, Belgium
| | - Hans P Op de Beeck
- Laboratory of Biological Psychology, Brain and Cognition, KU Leuven, Leuven, Belgium
| |
Collapse
|
34
|
Modality-independent encoding of individual concepts in the left parietal cortex. Neuropsychologia 2017; 105:39-49. [PMID: 28476573 DOI: 10.1016/j.neuropsychologia.2017.05.001] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2016] [Revised: 04/29/2017] [Accepted: 05/02/2017] [Indexed: 02/02/2023]
Abstract
The organization of semantic information in the brain has been mainly explored through category-based models, on the assumption that categories broadly reflect the organization of conceptual knowledge. However, the analysis of concepts as individual entities, rather than as items belonging to distinct superordinate categories, may represent a significant advancement in the comprehension of how conceptual knowledge is encoded in the human brain. Here, we studied the individual representation of thirty concrete nouns from six different categories, across different sensory modalities (i.e., auditory and visual) and groups (i.e., sighted and congenitally blind individuals) in a core hub of the semantic network, the left angular gyrus, and in its neighboring regions within the lateral parietal cortex. Four models based on either perceptual or semantic features at different levels of complexity (i.e., low- or high-level) were used to predict fMRI brain activity using representational similarity encoding analysis. When controlling for the superordinate component, high-level models based on semantic and shape information led to significant encoding accuracies in the intraparietal sulcus only. This region is involved in feature binding and combination of concepts across multiple sensory modalities, suggesting its role in high-level representation of conceptual knowledge. Moreover, when the information regarding superordinate categories is retained, a large extent of parietal cortex is engaged. This result indicates the need to control for the coarse-level categorial organization when performing studies on higher-level processes related to the retrieval of semantic information.
Collapse
|
35
|
Neural foundations of overt and covert actions. Neuroimage 2017; 152:482-496. [PMID: 28323166 DOI: 10.1016/j.neuroimage.2017.03.036] [Citation(s) in RCA: 31] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2016] [Revised: 03/05/2017] [Accepted: 03/17/2017] [Indexed: 12/18/2022] Open
|
36
|
Zhang Z, Sun Y, Humphreys GW, Song Y. Different activity patterns for action and language within their shared neural areas: An fMRI study on action observation and language phonology. Neuropsychologia 2017; 99:112-120. [PMID: 28259773 DOI: 10.1016/j.neuropsychologia.2017.02.025] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2016] [Revised: 02/23/2017] [Accepted: 02/28/2017] [Indexed: 11/26/2022]
Abstract
The neural processes for action and language activate shared brain regions including the left inferior frontal, parietal and temporal-occipital cortices. However, it still remains unclear how action and language are related and what neural activity patterns are elicited within these shared cortical regions. In this study we examined the neural activation for action observation and language phonology in their shared cortical regions by conducting three experiments in a single fMRI session: a mixed-task experiment involving both action and language phonological processing, and two independent experiments involving language phonology and action observation respectively. To control for differences in the visual processing and to enable a direct comparison between the tasks, the same visual stimuli were used for the mixed-tasks. Common neural areas for action observation and language phonology were located in the junction of the left inferior frontal/precentral gyrus, the left intraparietal sulcus and the left temporal-occipital cortex. Nevertheless, multi-voxel pattern analysis on the shared neural areas revealed that different patterns of neural activity were elicited for the action and language phonological tasks. Our results provide the first neuroimaging evidence that the common neural structures are engaged differently by action and language phonological processing.
Collapse
Affiliation(s)
- Zuo Zhang
- Department of Computer Science and Technology, Tongji University, Shanghai, PR China
| | - Yaoru Sun
- Department of Computer Science and Technology, Tongji University, Shanghai, PR China.
| | - Glyn W Humphreys
- Department of Experimental Psychology, University of Oxford, Oxford, UK
| | - Yalin Song
- Department of Computer Science and Technology, Tongji University, Shanghai, PR China; Complex Intelligent Network Institute, Henan University, Kaifeng, Henan, PR China
| |
Collapse
|
37
|
Person perception involves functional integration between the extrastriate body area and temporal pole. Neuropsychologia 2017; 96:52-60. [DOI: 10.1016/j.neuropsychologia.2017.01.003] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2016] [Revised: 12/14/2016] [Accepted: 01/06/2017] [Indexed: 11/17/2022]
|
38
|
Borghesani V, Pedregosa F, Buiatti M, Amadon A, Eger E, Piazza M. Word meaning in the ventral visual path: a perceptual to conceptual gradient of semantic coding. Neuroimage 2016; 143:128-140. [DOI: 10.1016/j.neuroimage.2016.08.068] [Citation(s) in RCA: 39] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2015] [Revised: 08/29/2016] [Accepted: 08/31/2016] [Indexed: 10/21/2022] Open
|
39
|
Dahan A, Reiner M. Recognition of the semantics and kinematics of gestures: Neural responses to "what" and "how"? Int J Psychophysiol 2016; 122:6-16. [PMID: 27756546 DOI: 10.1016/j.ijpsycho.2016.10.009] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2015] [Revised: 10/10/2016] [Accepted: 10/13/2016] [Indexed: 11/30/2022]
Abstract
The extensive use of gestures for human-human communication, independently of culture and language, suggests an underlying universal neural mechanism for gesture recognition. The mirror neuron system (MNS) is known to respond to observed human actions, and overlaps with self-action. The minimal cues needed for activation of the MNS for gesture recognition, facial expressions and bodily dynamics, is not yet defined. Using LED-point representations of gestures, we compared two types of brain activations: 1) in response to human recognizable vs non-recognizable motion and 2) in response to human vs non-human motion. Our preliminary results show that parts of the MNS respond only to human kinematics, and not to nonhuman kinematics, suggesting that the brain has a mechanism of discriminating human from nonhuman motion, even if the pattern of motion is meaningless, but still follows biological motion patterns. This implies that mechanisms of learning-mimicking, empathy and emotional communication, are possibly constrained by biological motion patterns. We then suggest a two-tier-model of human-bodily-communication: (1) recognition of human biological kinematics; (2) recognition of meaning. Implications are both theoretical (understanding the underlying mechanism for action recognition) and applicative (in digital graphical social representations, motion should be reasonably biological to generate the same emotional and mimicking automatic mechanisms as in face-to-face social interactions).
Collapse
Affiliation(s)
- Anat Dahan
- Virtual-Reality & NeuroCognition Lab, Technion - Israel Institute of Technology, Haifa, Israel.
| | - Miriam Reiner
- Virtual-Reality & NeuroCognition Lab, Technion - Israel Institute of Technology, Haifa, Israel
| |
Collapse
|
40
|
Eddy CM. The junction between self and other? Temporo-parietal dysfunction in neuropsychiatry. Neuropsychologia 2016; 89:465-477. [PMID: 27457686 DOI: 10.1016/j.neuropsychologia.2016.07.030] [Citation(s) in RCA: 68] [Impact Index Per Article: 7.6] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2016] [Revised: 05/13/2016] [Accepted: 07/22/2016] [Indexed: 11/18/2022]
Affiliation(s)
- Clare M Eddy
- Department of Neuropsychiatry, BSMHFT The Barberry, National Centre for Mental Health, Birmingham, UK; School of Clinical and Experimental Medicine, College of Medical and Dental Sciences, University of Birmingham, Birmingham, UK.
| |
Collapse
|
41
|
Abstract
Here we propose that earlier-demonstrated details in the primate visual cortical map may account for an otherwise puzzling (and problematic) finding in the current human fMRI literature. Specifically, the well-known regions LO and MT(+) reportedly overlap in the human cortical visual map, when those two regions are localized using standard stimulus comparisons in conventional fMRI experiments. Here we describe evidence supporting the idea that the apparent functional overlap between LO and MT arises from a third area (the MT crescent: “MTc”), which is well known to surround posterior MT based on earlier histological, neuroanatomical, and electrophysiological studies in nonhuman primates. If we assume that MTc also exists in human visual cortex, and that it has a location and functional properties intermediate to those in LO and MT, simplistic modeling confirmed that this arrangement could produce apparent overlap between localizers for LO and MT in conventional fMRI maps in human visual cortex.
Collapse
|
42
|
Perceptual Integration Deficits in Autism Spectrum Disorders Are Associated with Reduced Interhemispheric Gamma-Band Coherence. J Neurosci 2016; 35:16352-61. [PMID: 26674862 DOI: 10.1523/jneurosci.1442-15.2015] [Citation(s) in RCA: 52] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
Abstract
UNLABELLED The integration of visual details into a holistic percept is essential for object recognition. This integration has been reported as a key deficit in patients with autism spectrum disorders (ASDs). The weak central coherence account posits an altered disposition to integrate features into a coherent whole in ASD. Here, we test the hypothesis that such weak perceptual coherence may be reflected in weak neural coherence across different cortical sites. We recorded magnetoencephalography from 20 adult human participants with ASD and 20 matched controls, who performed a slit-viewing paradigm, in which objects gradually passed behind a vertical or horizontal slit so that only fragments of the object were visible at any given moment. Object recognition thus required perceptual integration over time and, in case of the horizontal slit, also across visual hemifields. ASD participants were selectively impaired in the horizontal slit condition, indicating specific difficulties in long-range synchronization between the hemispheres. Specifically, the ASD group failed to show condition-related enhancement of imaginary coherence between the posterior superior temporal sulci in both hemispheres during horizontal slit-viewing in contrast to controls. Moreover, local synchronization reflected in occipitocerebellar beta-band power was selectively reduced for horizontal compared with vertical slit-viewing in ASD. Furthermore, we found disturbed connectivity between right posterior superior temporal sulcus and left cerebellum. Together, our results suggest that perceptual integration deficits co-occur with specific patterns of abnormal global and local synchronization in ASD. SIGNIFICANCE STATEMENT The weak central coherence account proposes a tendency of individuals with autism spectrum disorders (ASDs) to focus on details at the cost of an integrated coherent whole. Here, we provide evidence, at the behavioral and the neural level, that visual integration in object recognition is impaired in ASD, when details had to be integrated across both visual hemifields. We found enhanced interhemispheric gamma-band coherence in typically developed participants when communication between cortical hemispheres was required by the task. Importantly, participants with ASD failed to show this enhanced coherence between bilateral posterior superior temporal sulci. The findings suggest that visual integration is disturbed at the local and global synchronization scale, which might bear implications for object recognition in ASD.
Collapse
|
43
|
Harry BB, Umla-Runge K, Lawrence AD, Graham KS, Downing PE. Evidence for Integrated Visual Face and Body Representations in the Anterior Temporal Lobes. J Cogn Neurosci 2016; 28:1178-93. [PMID: 27054399 DOI: 10.1162/jocn_a_00966] [Citation(s) in RCA: 30] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
Research on visual face perception has revealed a region in the ventral anterior temporal lobes, often referred to as the anterior temporal face patch (ATFP), which responds strongly to images of faces. To date, the selectivity of the ATFP has been examined by contrasting responses to faces against a small selection of categories. Here, we assess the selectivity of the ATFP in humans with a broad range of visual control stimuli to provide a stronger test of face selectivity in this region. In Experiment 1, participants viewed images from 20 stimulus categories in an event-related fMRI design. Faces evoked more activity than all other 19 categories in the left ATFP. In the right ATFP, equally strong responses were observed for both faces and headless bodies. To pursue this unexpected finding, in Experiment 2, we used multivoxel pattern analysis to examine whether the strong response to face and body stimuli reflects a common coding of both classes or instead overlapping but distinct representations. On a voxel-by-voxel basis, face and whole-body responses were significantly positively correlated in the right ATFP, but face and body-part responses were not. This finding suggests that there is shared neural coding of faces and whole bodies in the right ATFP that does not extend to individual body parts. In contrast, the same approach revealed distinct face and body representations in the right fusiform gyrus. These results are indicative of an increasing convergence of distinct sources of person-related perceptual information proceeding from the posterior to the anterior temporal cortex.
Collapse
|
44
|
Di Nota PM, Levkov G, Bar R, DeSouza JFX. Lateral occipitotemporal cortex (LOTC) activity is greatest while viewing dance compared to visualization and movement: learning and expertise effects. Exp Brain Res 2016; 234:2007-2023. [PMID: 26960739 DOI: 10.1007/s00221-016-4607-7] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2015] [Accepted: 02/22/2016] [Indexed: 10/22/2022]
Abstract
The lateral occipitotemporal cortex (LOTC) is comprised of subregions selectively activated by images of human bodies (extrastriate body area, EBA), objects (lateral occipital complex, LO), and motion (MT+). However, their role in motor imagery and movement processing is unclear, as are the influences of learning and expertise on its recruitment. The purpose of our study was to examine putative changes in LOTC activation during action processing following motor learning of novel choreography in professional ballet dancers. Subjects were scanned with functional magnetic resonance imaging up to four times over 34 weeks and performed four tasks: viewing and visualizing a newly learned ballet dance, visualizing a dance that was not being learned, and movement of the foot. EBA, LO, and MT+ were activated most while viewing dance compared to visualization and movement. Significant increases in activation were observed over time in left LO only during visualization of the unlearned dance, and all subregions were activated bilaterally during the viewing task after 34 weeks of performance, suggesting learning-induced plasticity. Finally, we provide novel evidence for modulation of EBA with dance experience during the motor task, with significant activation elicited in a comparison group of novice dancers only. These results provide a composite of LOTC activation during action processing of newly learned ballet choreography and movement of the foot. The role of these areas is confirmed as primarily subserving observation of complex sequences of whole-body movement, with new evidence for modification by experience and over the course of real world ballet learning.
Collapse
Affiliation(s)
- Paula M Di Nota
- Department of Psychology, York University, Toronto, ON, Canada.,Neuroscience Graduate Diploma Program, York University, Toronto, ON, Canada.,Centre for Vision Research, York University, 4700 Keele Street, Toronto, ON, M3J 1P3, Canada
| | - Gabriella Levkov
- Centre for Vision Research, York University, 4700 Keele Street, Toronto, ON, M3J 1P3, Canada.,Department of Biology, York University, Toronto, ON, Canada
| | - Rachel Bar
- Department of Psychology, Ryerson University, Toronto, ON, Canada.,Canada's National Ballet School, Toronto, ON, Canada
| | - Joseph F X DeSouza
- Department of Psychology, York University, Toronto, ON, Canada. .,Neuroscience Graduate Diploma Program, York University, Toronto, ON, Canada. .,Centre for Vision Research, York University, 4700 Keele Street, Toronto, ON, M3J 1P3, Canada. .,Department of Biology, York University, Toronto, ON, Canada. .,Canadian Action and Perception Network (CAPnet), Toronto, ON, Canada.
| |
Collapse
|
45
|
Greven IM, Downing PE, Ramsey R. Linking person perception and person knowledge in the human brain. Soc Cogn Affect Neurosci 2016; 11:641-51. [PMID: 26920683 PMCID: PMC4814794 DOI: 10.1093/scan/nsv148] [Citation(s) in RCA: 22] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2015] [Accepted: 11/30/2015] [Indexed: 11/14/2022] Open
Abstract
Neuroscience research has examined separately how we detect human agents on the basis of their face and body (person perception) and how we reason about their thoughts, traits or intentions (person knowledge). Neuroanatomically distinct networks have been associated with person perception and person knowledge, but it remains unknown how multiple features of a person (e.g. thin and kind) are linked to form a holistic identity representation. In this fMRI experiment, we investigated the hypothesis that when encountering another person specialised person perception circuits would be functionally coupled with circuits involved in person knowledge. In a factorial design, we paired bodies or names with trait-based or neutral statements, and independent localiser scans identified body-selective and mentalising networks. When observing a body paired with a trait-implying statement, functional connectivity analyses demonstrated that body-selective patches in bilateral fusiform gyri were functionally coupled with nodes of the mentalising network. We demonstrate that when forming a representation of a person circuits for representing another person's physical appearance are linked to circuits that are engaged when reasoning about trait-based character. These data support the view that a 'who' system for social cognition involves communication between perceptual and inferential mechanisms when forming a representation of another's identity.
Collapse
Affiliation(s)
- Inez M Greven
- Wales Institute for Cognitive Neuroscience, School of Psychology, Bangor University, Bangor, Gwynedd, Wales LL57 2AS, UK
| | - Paul E Downing
- Wales Institute for Cognitive Neuroscience, School of Psychology, Bangor University, Bangor, Gwynedd, Wales LL57 2AS, UK
| | - Richard Ramsey
- Wales Institute for Cognitive Neuroscience, School of Psychology, Bangor University, Bangor, Gwynedd, Wales LL57 2AS, UK
| |
Collapse
|
46
|
Kim NY, McCarthy G. Task influences pattern discriminability for faces and bodies in ventral occipitotemporal cortex. Soc Neurosci 2016; 11:627-36. [PMID: 26787515 DOI: 10.1080/17470919.2015.1131194] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
Abstract
Our prior research showed that faces and bodies activate overlapping regions of the ventral occipitotemporal cortex (VOTC). However, faces and bodies were nonetheless discriminable in these same overlapping regions when their spatial patterns of activity were classified using multivoxel pattern analysis (MVPA). Here we investigated whether these spatial patterns and their time courses were influenced by different categorization tasks. Participants viewed pictures of faces or headless bodies depicting a happy or fearful emotion. In one task, they categorized the picture as a face or a body regardless of emotion. In the other task, they categorized the emotion regardless of whether it was depicted by a face or body. Using a classifier trained on independent data, we found higher face-body classification accuracy for the emotion categorization task. The classifier was applied to each post-stimulus time-point to characterize the temporal course of classification. Accuracy initially rose equivalently above chance for both tasks, but then increased over a longer duration when participants categorized emotions. Thus, the temporal course of pattern differences between faces and bodies in VOTC was modulated by the behavioral goal of the observer, suggesting the top-down modulatory effect of task context on the category-selectivity activity in the VOTC.
Collapse
Affiliation(s)
- Na Yeon Kim
- a Department of Psychology , Yale University , New Haven , CT , USA
| | - Gregory McCarthy
- a Department of Psychology , Yale University , New Haven , CT , USA
| |
Collapse
|
47
|
Kaiser D, Azzalini DC, Peelen MV. Shape-independent object category responses revealed by MEG and fMRI decoding. J Neurophysiol 2016; 115:2246-50. [PMID: 26740535 DOI: 10.1152/jn.01074.2015] [Citation(s) in RCA: 52] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2015] [Accepted: 01/04/2016] [Indexed: 11/22/2022] Open
Abstract
Neuroimaging research has identified category-specific neural response patterns to a limited set of object categories. For example, faces, bodies, and scenes evoke activity patterns in visual cortex that are uniquely traceable in space and time. It is currently debated whether these apparently categorical responses truly reflect selectivity for categories or instead reflect selectivity for category-associated shape properties. In the present study, we used a cross-classification approach on functional MRI (fMRI) and magnetoencephalographic (MEG) data to reveal both category-independent shape responses and shape-independent category responses. Participants viewed human body parts (hands and torsos) and pieces of clothing that were closely shape-matched to the body parts (gloves and shirts). Category-independent shape responses were revealed by training multivariate classifiers on discriminating shape within one category (e.g., hands versus torsos) and testing these classifiers on discriminating shape within the other category (e.g., gloves versus shirts). This analysis revealed significant decoding in large clusters in visual cortex (fMRI) starting from 90 ms after stimulus onset (MEG). Shape-independent category responses were revealed by training classifiers on discriminating object category (bodies and clothes) within one shape (e.g., hands versus gloves) and testing these classifiers on discriminating category within the other shape (e.g., torsos versus shirts). This analysis revealed significant decoding in bilateral occipitotemporal cortex (fMRI) and from 130 to 200 ms after stimulus onset (MEG). Together, these findings provide evidence for concurrent shape and category selectivity in high-level visual cortex, including category-level responses that are not fully explicable by two-dimensional shape properties.
Collapse
Affiliation(s)
- Daniel Kaiser
- Center for Mind/Brain Sciences, University of Trento, Rovereto, Trentino, Italy
| | - Damiano C Azzalini
- Center for Mind/Brain Sciences, University of Trento, Rovereto, Trentino, Italy
| | - Marius V Peelen
- Center for Mind/Brain Sciences, University of Trento, Rovereto, Trentino, Italy
| |
Collapse
|
48
|
Abstract
Regions in human lateral and ventral occipitotemporal cortices (OTC) respond selectively to pictures of the human body and its parts. What are the organizational principles underlying body part responses in these regions? Here we used representational similarity analysis (RSA) of fMRI data to test multiple possible organizational principles: shape similarity, physical proximity, cortical homunculus proximity, and semantic similarity. Participants viewed pictures of whole persons, chairs, and eight body parts (hands, arms, legs, feet, chests, waists, upper faces, and lower faces). The similarity of multivoxel activity patterns for all body part pairs was established in whole person-selective OTC regions. The resulting neural similarity matrices were then compared with similarity matrices capturing the hypothesized organizational principles. Results showed that the semantic similarity model best captured the neural similarity of body parts in lateral and ventral OTC, which followed an organization in three clusters: (1) body parts used as action effectors (hands, feet, arms, and legs), (2) noneffector body parts (chests and waists), and (3) face parts (upper and lower faces). Whole-brain RSA revealed, in addition to OTC, regions in parietal and frontal cortex in which neural similarity was related to semantic similarity. In contrast, neural similarity in occipital cortex was best predicted by shape similarity models. We suggest that the semantic organization of body parts in high-level visual cortex relates to the different functions associated with the three body part clusters, reflecting the unique processing and connectivity demands associated with the different types of information (e.g., action, social) different body parts (e.g., limbs, faces) convey. Significance statement: While the organization of body part representations in motor and somatosensory cortices has been well characterized, the principles underlying body part representations in visual cortex have not yet been explored. In the present fMRI study we used multivoxel pattern analysis and representational similarity analysis to characterize the organization of body maps in human occipitotemporal cortex (OTC). Results indicate that visual and shape dimensions do not fully account for the organization of body part representations in OTC. Instead, the representational structure of body maps in OTC appears strongly related to functional-semantic properties of body parts. We suggest that this organization reflects the unique processing and connectivity demands associated with the different types of information different body parts convey.
Collapse
|
49
|
Distinct contributions of extrastriate body area and temporoparietal junction in perceiving one's own and others' body. COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2015; 15:211-28. [PMID: 25047105 DOI: 10.3758/s13415-014-0312-9] [Citation(s) in RCA: 39] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/30/2022]
Abstract
The right temporoparietal cortex plays a critical role in body representation. Here, we applied repetitive transcranial magnetic stimulation (rTMS) over right extrastriate body area (EBA) and temporoparietal junction (TPJ) to investigate their causative roles in perceptual representations of one's own and others' body. Healthy women adjusted size-distorted pictures of their own body or of the body of another person according to how they perceived the body (subjective task) or how others perceived it (intersubjective task). In keeping with previous reports, at baseline, we found an overall underestimation of body size. Crucially, EBA-rTMS increased the underestimation bias when participants adjusted the images according to how others perceived their own or the other woman's body, suggesting a specific role of EBA in allocentric body representations. Conversely, TPJ-rTMS increased the underestimation bias when participants adjusted the body of another person, either a familiar other or a close friend, in both subjective and intersubjective tasks, suggesting an involvement of TPJ in representing others' bodies. These effects were body-specific, since no TMS-induced modulation was observed when participants judged a familiar object. The results suggest that right EBA and TPJ play active and complementary roles in the complex interaction between the perceptions of one's own and other people's body.
Collapse
|
50
|
Goldberg H, Christensen A, Flash T, Giese MA, Malach R. Brain activity correlates with emotional perception induced by dynamic avatars. Neuroimage 2015. [DOI: 10.1016/j.neuroimage.2015.07.056] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022] Open
|