Characterizing object- and position-dependent response profiles to uni- and bilateral stimulus configurations in human higher visual cortex: a 7T fMRI study

Examining the Coding Strength of Object Identity and Nonidentity Features in Human Occipito-Temporal Cortex and Convolutional Neural Networks

A visual object is characterized by multiple visual features, including its identity, position and size. Despite the usefulness of identity and nonidentity features in vision and their joint coding throughout the primate ventral visual processing pathway, they have so far been studied relatively independently. Here in both female and male human participants, the coding of identity and nonidentity features was examined together across the human ventral visual pathway. The nonidentity features tested included two Euclidean features (position and size) and two non-Euclidean features (image statistics and spatial frequency (SF) content of an image). Overall, identity representation increased and nonidentity feature representation decreased along the ventral visual pathway, with identity outweighing the non-Euclidean but not the Euclidean features at higher levels of visual processing. In 14 convolutional neural networks (CNNs) pretrained for object categorization with varying architecture, depth, and with/without recurrent processing, nonidentity feature representation showed an initial large increase from early to mid-stage of processing, followed by a decrease at later stages of processing, different from brain responses. Additionally, from lower to higher levels of visual processing, position became more underrepresented and image statistics and SF became more overrepresented compared with identity in CNNs than in the human brain. Similar results were obtained in a CNN trained with stylized images that emphasized shape representations. Overall, by measuring the coding strength of object identity and nonidentity features together, our approach provides a new tool for characterizing feature coding in the human brain and the correspondence between the brain and CNNs.SIGNIFICANCE STATEMENT This study examined the coding strength of object identity and four types of nonidentity features along the human ventral visual processing pathway and compared brain responses with those of 14 convolutional neural networks (CNNs) pretrained to perform object categorization. Overall, identity representation increased and nonidentity feature representation decreased along the ventral visual pathway, with some notable differences among the different nonidentity features. CNNs differed from the brain in a number of aspects in their representations of identity and nonidentity features over the course of visual processing. Our approach provides a new tool for characterizing feature coding in the human brain and the correspondence between the brain and CNNs.

Somatotopic mapping of the human breast using 7 T functional MRI

How are tactile sensations in the breast represented in the female and male brain? Using ultra high-field 7 T MRI in ten females and ten males, we demonstrate that the representation of tactile breast information shows a somatotopic organization, with cortical magnification of the nipple. Furthermore, we show that the core representation of the breast is organized according to the specific nerve architecture that underlies breast sensation, where the medial and lateral sides of one breast are asymmetrically represented in bilateral primary somatosensory cortex. Finally, gradual selectivity signatures allude to a somatotopic organization of the breast area with overlapping, but distinctive, cortical representations of breast segments. Our univariate and multivariate analyses consistently showed similar somatosensory breast representations in males and females. The findings can guide future research on neuroplastic reorganization of the breast area, across reproductive life stages, and after breast surgery.

Addressing challenges of high spatial resolution UHF fMRI for group analysis of higher-order cognitive tasks: An inter-sensory task directing attention between visual and somatosensory domains

Functional MRI at ultra‐high field (UHF, ≥7 T) provides significant increases in BOLD contrast‐to‐noise ratio (CNR) compared with conventional field strength (3 T), and has been exploited for reduced field‐of‐view, high spatial resolution mapping of primary sensory areas. Applying these high spatial resolution methods to investigate whole brain functional responses to higher‐order cognitive tasks leads to a number of challenges, in particular how to perform robust group‐level statistical analyses. This study addresses these challenges using an inter‐sensory cognitive task which modulates top‐down attention at graded levels between the visual and somatosensory domains. At the individual level, highly focal functional activation to the task and task difficulty (modulated by attention levels) were detectable due to the high CNR at UHF. However, to assess group level effects, both anatomical and functional variability must be considered during analysis. We demonstrate the importance of surface over volume normalisation and the requirement of no spatial smoothing when assessing highly focal activity. Using novel group analysis on anatomically parcellated brain regions, we show that in higher cognitive areas (parietal and dorsal‐lateral‐prefrontal cortex) fMRI responses to graded attention levels were modulated quadratically, whilst in visual cortex and VIP, responses were modulated linearly. These group fMRI responses were not seen clearly using conventional second‐level GLM analyses, illustrating the limitations of a conventional approach when investigating such focal responses in higher cognitive regions which are more anatomically variable. The approaches demonstrated here complement other advanced analysis methods such as multivariate pattern analysis, allowing UHF to be fully exploited in cognitive neuroscience.