High-Level Representations in Human Occipito-Temporal Cortex Are Indexed by Distal Connectivity

Reciprocal interactions among parietal and occipito-temporal representations support everyday object-directed actions

Everyday interactions with common manipulable objects require the integration of conceptual knowledge about objects and actions with real-time sensory information about the position, orientation and volumetric structure of the grasp target. The ability to successfully interact with everyday objects involves analysis of visual form and shape, surface texture, material properties, conceptual attributes such as identity, function and typical context, and visuomotor processing supporting hand transport, grasp form, and object manipulation. Functionally separable brain regions across the dorsal and ventral visual pathways support the processing of these different object properties and, in cohort, are necessary for functional object use. Object-directed grasps display end-state-comfort: they anticipate in form and force the shape and material properties of the grasp target, and how the object will be manipulated after it is grasped. End-state-comfort is the default for everyday interactions with manipulable objects and implies integration of information across the ventral and dorsal visual pathways. We propose a model of how visuomotor and action representations in parietal cortex interact with object representations in ventral and lateral occipito-temporal cortex. One pathway, from the supramarginal gyrus to the middle and inferior temporal gyrus, supports the integration of action-related information, including hand and limb position (supramarginal gyrus) with conceptual attributes and an appreciation of the action goal (middle temporal gyrus). A second pathway, from posterior IPS to the fusiform gyrus and collateral sulcus supports the integration of grasp parameters (IPS) with the surface texture and material properties (e.g., weight distribution) of the grasp target. Reciprocal interactions among these regions are part of a broader network of regions that support everyday functional object interactions.

Characterizing the discriminability of visual categorical information in strongly connected voxels

Functional brain responses are strongly influenced by connectivity. Recently, we demonstrated a major example of this: category discriminability within occipitotemporal cortex (OTC) is enhanced for voxel sets that share strong functional connectivity to distal brain areas, relative to those that share lesser connectivity. That is, within OTC regions, sets of 'most-connected' voxels show improved multivoxel pattern discriminability for tool-, face-, and place stimuli relative to voxels with weaker connectivity to the wider brain. However, understanding whether these effects generalize to other domains (e.g. body perception network), and across different levels of the visual processing streams (e.g. dorsal as well as ventral stream areas) is an important extension of this work. Here, we show that this so-called connectivity-guided decoding (CGD) effect broadly generalizes across a wide range of categories (tools, faces, bodies, hands, places). This effect is robust across dorsal stream areas, but less consistent in earlier ventral stream areas. In the latter regions, category discriminability is generally very high, suggesting that extraction of category-relevant visual properties is less reliant on connectivity to downstream areas. Further, CGD effects are primarily expressed in a category-specific manner: For example, within the network of tool regions, discriminability of tool information is greater than non-tool information. The connectivity-guided decoding approach shown here provides a novel demonstration of the crucial relationship between wider brain connectivity and complex local-level functional responses at different levels of the visual processing streams. Further, this approach generates testable new hypotheses about the relationships between connectivity and local selectivity.

Temporal differences and commonalities between hand and tool neural processing

Object recognition is a complex cognitive process that relies on how the brain organizes object-related information. While spatial principles have been extensively studied, less studied temporal dynamics may also offer valuable insights into this process, particularly when neural processing overlaps for different categories, as it is the case of the categories of hands and tools. Here we focus on the differences and/or similarities between the time-courses of hand and tool processing under electroencephalography (EEG). Using multivariate pattern analysis, we compared, for different time points, classification accuracy for images of hands or tools when compared to images of animals. We show that for particular time intervals (~ 136-156 ms and ~ 252-328 ms), classification accuracy for hands and for tools differs. Furthermore, we show that classifiers trained to differentiate between tools and animals generalize their learning to classification of hand stimuli between ~ 260-320 ms and ~ 376-500 ms after stimulus onset. Classifiers trained to distinguish between hands and animals, on the other hand, were able to extend their learning to the classification of tools at ~ 150 ms. These findings suggest variations in semantic features and domain-specific differences between the two categories, with later-stage similarities potentially related to shared action processing for hands and tools.

Neural and behavioral signatures of the multidimensionality of manipulable object processing

Understanding how we recognize objects requires unravelling the variables that govern the way we think about objects and the neural organization of object representations. A tenable hypothesis is that the organization of object knowledge follows key object-related dimensions. Here, we explored, behaviorally and neurally, the multidimensionality of object processing. We focused on within-domain object information as a proxy for the decisions we typically engage in our daily lives - e.g., identifying a hammer in the context of other tools. We extracted object-related dimensions from subjective human judgments on a set of manipulable objects. We show that the extracted dimensions are cognitively interpretable and relevant - i.e., participants are able to consistently label them, and these dimensions can guide object categorization; and are important for the neural organization of knowledge - i.e., they predict neural signals elicited by manipulable objects. This shows that multidimensionality is a hallmark of the organization of manipulable object knowledge.

The cerebellum is causally involved in episodic memory under aging

Episodic memory decline is a major signature of both normal and pathological aging. Many neural regions have been implicated in the processes subserving both episodic memory and typical aging decline. Here, we demonstrate that the cerebellum is causally involved episodic memory under aging. We show that a 12-day neurostimulation program delivered to the right cerebellum led to improvements in episodic memory performance under healthy aging that long outlast the stimulation period - healthy elderly individuals show episodic memory improvement both immediately after the intervention program and in a 4-month follow-up. These results demonstrate the causal relevance of the cerebellum in processes associated with long-term episodic memory, potentially highlighting its role in regulating and maintaining cognitive processing. Moreover, they point to the importance of non-pharmacological interventions that prevent or diminish cognitive decline in healthy aging.

Alternative Brain Connectivity Underscores Age-Related Differences in the Processing of Interactive Biological Motion

Rapidly recognizing and understanding others' social interactions is an important ability that relies on deciphering multiple sources of information, for example, perceiving body information and inferring others' intentions. Despite recent advances in characterizing the brain basis of this ability in adults, its developmental underpinnings are virtually unknown. Here, we used fMRI to investigate which sources of social information support superior temporal sulcus responses to interactive biological motion (i.e., 2 interacting point-light human figures) at different developmental intervals in human participants (of either sex): Children show supportive functional connectivity with key nodes of the mentalizing network, while adults show stronger reliance on regions associated with body- and dynamic social interaction/biological motion processing. We suggest that adults use efficient action-intention understanding via body and biological motion information, while children show a stronger reliance on hidden mental state inferences as a potential means of learning to better understand others' interactive behavior.SIGNIFICANCE STATEMENT Recognizing others' interactive behavior is a critical human skill that depends on different sources of social information (e.g., observable body-action information, inferring others' hidden mental states, etc.). Understanding the brain-basis of this ability and characterizing how it emerges across development are important goals in social neuroscience. Here, we used fMRI to investigate which sources of social information support interactive biological motion processing in children (6-12 years) and adults. These results reveal a striking developmental difference in terms of how wider-brain connectivity shapes functional responses to interactive biological motion that suggests a reliance on distinct neuro-cognitive strategies in service of interaction understanding (i.e., children and adults show a greater reliance on explicit and implicit intentional inference, respectively).

Disentangling hand and tool processing: Distal effects of neuromodulation

Neural processing within a local brain region that responds to more than one object category (e.g., hands and tools) nonetheless have different functional connectivity patterns with other distal brain areas, which suggests that local processing can affect and/or be affected by processing in distal areas, in a category-specific way. Here we wanted to test whether administering either a hand- or tool-related training task in tandem with transcranial direct current stimulation (tDCS) to a region that responds both to hands and tools (posterior middle temporal gyrus; pMTG), modulated local and distal neural processing more for the trained than the untrained category in a subsequent fMRI task. After each combined tDCS/training session, participants viewed images of tools, hands, and animals, in an fMRI scanner. Using multivoxel pattern analysis, we found that tDCS stimulation to pMTG indeed improved the classification accuracy between tools vs. animals, but only when combined with a tool and not a hand training task. Surprisingly, tDCS stimulation to pMTG also improved classification accuracy between hands vs. animals when combined with a tool but not a hand training task. Our findings suggest that overlapping but functionally-specific networks may be engaged separately by using a category-specific training task together with tDCS - a strategy that can be applied more broadly to other cognitive domains using tDCS. By hypothesis, these effects on local processing are a direct result of within-domain connectivity constraints from domain-specific networks that are at play in the processing and organization of object representations.

Tool heads prime saccades

Tools are wielded by their handles, but a lot of information about their function comes from their heads (the action-ends). Here we investigated whether eye saccadic movements are primed by tool handles, or whether they are primed by tool heads. We measured human saccadic reaction times while subjects were performing an attentional task. We found that saccades were executed quicker when performed to the side congruent with the tool head, even though "toolness" was irrelevant for the task. Our results show that heads are automatically processed by the visual system to orient eye movements, indicating that eyes are attracted by functional parts of manipulable objects and by the characteristic information these parts convey.

Knowing how to do it or doing it? A double dissociation between tool-gesture production and tool-gesture knowledge

Deciding how to manipulate an object to fulfill a goal requires accessing different types of object-related information. How these different types of information are integrated and represented in the brain is still an open question. Here, we focus on examining two types of object-related information-tool-gesture knowledge (i.e., how to manipulate an object), and tool-gesture production (i.e., the actual manipulation of an object). We show a double dissociation between tool-gesture knowledge and tool-gesture production: Patient FP presents problems in pantomiming tool use in the context of a spared ability to perform judgments about an object's manipulation, whereas Patient LS can pantomime tool use, but is impaired at performing manipulation judgments. Moreover, we compared the location of the lesions in FP and LS with those sustained by two classic ideomotor apraxic patients (IMA), using a cortical thickness approach. Patient FP presented lesions in common with our classic IMA that included the left inferior parietal lobule (IPL), and specifically the supramarginal gyrus, the left parietal operculum, the left premotor cortex and the left inferior frontal gyrus, whereas Patient LS and our classic IMA patients presented common lesions in regions of the superior parietal lobule (SPL), motor areas (as primary somatosensory cortex, premotor cortex and primary motor cortex), and frontal areas. Our results show that tool-gesture production and tool-gesture knowledge can be behaviorally and neurally doubly dissociated and put strong constraints on extant theories of action and object recognition and use.