Object and spatial imagery dimensions in visuo-haptic representations

Distinct Functional MRI Connectivity Patterns and Cortical Volume Variations Associated with Repetitive Blast Exposure in Special Operations Forces Members

Background Special operations forces members often face multiple blast injuries and have a higher risk of traumatic brain injury. However, the relationship between neuroimaging markers, the cumulative severity of injury, and long-term symptoms has not previously been well-established in the literature. Purpose To determine the relationship between the frequency of blast injuries, persistent clinical symptoms, and related cortical volumetric and functional connectivity (FC) changes observed at brain MRI in special operations forces members. Materials and Methods A cohort of 220 service members from a prospective study between January 2021 and May 2023 with a history of repetitive blast exposure underwent psychodiagnostics and a comprehensive neuroimaging evaluation, including structural and resting-state functional MRI (fMRI). Of these, 212 met the inclusion criteria. Participants were split into two datasets for model development and validation, and each dataset was divided into high- and low-exposure groups based on participants' exposure to various explosives. Differences in FC were analyzed using a general linear model, and cortical gray matter volumes were compared using the Mann-Whitney U test. An external age- and sex-matched healthy control group of 212 participants was extracted from the SRPBS Multidisorder MRI Dataset for volumetric analyses. A multiple linear regression model was used to assess correlations between clinical scores and FC, while a logistic regression model was used to predict exposure group from fMRI scans. Results In the 212 participants (mean age, 43.0 years ± 8.6 [SD]; 160 male [99.5%]) divided into groups with low or high blast exposure, the high-exposure group had higher scores for the Neurobehavioral Symptom Inventory (NSI) (t = 3.16, P < .001) and Posttraumatic Stress Disorder Checklist for Diagnostic and Statistical Manual of Mental Disorders (Fifth Edition) (PCL-5) (t = 2.72, P = .01). FC differences were identified in the bilateral superior and inferior lateral occipital cortex (LOC) (P value range, .001-.04), frontal medial cortex (P < .001), left superior frontal gyrus (P < .001), and precuneus (P value range, .02-.03). Clinical scores from NSI and PCL-5 were inversely correlated with FC in the LOC, superior parietal lobule, precuneus, and default mode networks (r = -0.163 to -0.384; P value range, <.001 to .04). The high-exposure group showed increased cortical volume in regions of the LOC compared with healthy controls and the low-exposure group (P value range, .01-.04). The predictive model helped accurately classify participants into high- and low-exposure groups based on fMRI data with 88.00 sensitivity (95% CI: 78.00, 98.00), 67% specificity (95% CI: 53.00, 81.00), and 73% accuracy (95% CI: 60.00, 86.00). Conclusion Repetitive blast exposure leads to distinct alterations in FC and cortical volume, which correlate with neurobehavioral symptoms. The predictive model suggests that even in the absence of observable anatomic changes, FC may indicate blast-related trauma. © RSNA, 2025 Supplemental material is available for this article.

Distinct but related abilities for visual and haptic object recognition

People vary in their ability to recognize objects visually. Individual differences for matching and recognizing objects visually is supported by a domain-general ability capturing common variance across different tasks (e.g., Richler et al., Psychological Review, 126, 226-251, 2019). Behavioral (e.g., Cooke et al., Neuropsychologia, 45, 484-495, 2007) and neural evidence (e.g., Amedi, Cerebral Cortex, 12, 1202-1212, 2002) suggest overlapping mechanisms in the processing of visual and haptic information in the service of object recognition, but it is unclear whether such group-average results generalize to individual differences. Psychometrically validated measures are required, which have been lacking in the haptic modality. We investigate whether object recognition ability is specific to vision or extends to haptics using psychometric measures we have developed. We use multiple visual and haptic tests with different objects and different formats to measure domain-general visual and haptic abilities and to test for relations across them. We measured object recognition abilities using two visual tests and four haptic tests (two each for two kinds of haptic exploration) in 97 participants. Partial correlation and confirmatory factor analyses converge to support the existence of a domain-general haptic object recognition ability that is moderately correlated with domain-general visual object recognition ability. Visual and haptic abilities share about 25% of their variance, supporting the existence of a multisensory domain-general ability while leaving a substantial amount of residual variance for modality-specific abilities. These results extend our understanding of the structure of object recognition abilities; while there are mechanisms that may generalize across categories, tasks, and modalities, there are still other mechanisms that are distinct between modalities.

The importance of multisensory-motor learning on subsequent visual recognition

Speed of visual object recognition is facilitated after active manual exploration of objects relative to passive visual processing alone. Manual exploration allows viewers to select important information about object structure that may facilitate recognition. Viewpoints where the objects' axis of elongation is perpendicular or parallel to the line of sight are selected more during exploration, recognized faster than other viewpoints, and afford the most information about structure when object movement is controlled by the viewer. Prior work used virtual object exploration in active and passive viewing conditions, limiting multisensory structural object information. Adding multisensory information to encoding may change accuracy of overall recognition, viewpoint selection, and viewpoint recognition. We tested whether the known active advantage for object recognition would change when real objects were studied, affording visual and haptic information. Participants interacted with 3D novel objects during manual exploration or passive viewing of another's object interactions. Object recognition was tested using several viewpoints of rendered objects. We found that manually explored objects were recognized more accurately than objects studied through passive exploration and that recognition of viewpoints differed from previous work.

Haptic and visuo-haptic impairments for object recognition in children with autism spectrum disorder: focus on the sensory and multisensory processing dysfunctions

Dysfunctions in sensory processing are widely described in individuals with autism spectrum disorder (ASD), although little is known about the developmental course and the impact of these difficulties on the learning processes during the preschool and school ages of ASD children. Specifically, as regards the interplay between visual and haptic information in ASD during developmental age, knowledge is very scarce and controversial. In this study, we investigated unimodal (visual and haptic) and cross-modal (visuo-haptic) processing skills aimed at object recognition through a behavioural paradigm already used in children with typical development (TD), with cerebral palsy and with peripheral visual impairments. Thirty-five children with ASD (age range: 5-11 years) and thirty-five age-matched and gender-matched typically developing peers were recruited. The procedure required participants to perform an object-recognition task relying on only the visual modality (black-and-white photographs), only the haptic modality (manipulation of real objects) and visuo-haptic transfer of these two types of information. Results are consistent with the idea that visuo-haptic transfer may be significantly worse in ASD children than in TD peers, leading to significant impairment in multisensory interactions for object recognition facilitation. Furthermore, ASD children tended to show a specific deficit in haptic information processing, while a similar trend of maturation of visual modality between the two groups is reported. This study adds to the current literature by suggesting that ASD differences in multisensory processes also regard visuo-haptic abilities necessary to identify and recognise objects of daily life.

Cross-Modal Interactions of the Tactile System

The sensory systems responsible for perceptions of touch, vision, hearing, etc. have traditionally been regarded as mostly separate, only converging at late stages of processing. Contrary to this dogma, recent work has shown that interactions between the senses are robust and abundant. Touch and vision are both commonly used to obtain information about a number of object properties, and share perceptual and neural representations in many domains. Additionally, visuotactile interactions are implicated in the sense of body ownership, as revealed by powerful illusions that can be evoked by manipulating these interactions. Touch and hearing both rely in part on temporal frequency information, leading to a number of audiotactile interactions reflecting a good deal of perceptual and neural overlap. The focus in sensory neuroscience and psychophysics is now on characterizing the multisensory interactions that lead to our panoply of perceptual experiences.

Enhanced verbal abilities in the congenitally blind

Numerous studies have found that congenitally blind individuals have better verbal memory than their normally sighted counterparts. However, it is not known whether this reflects superiority of verbal or memory abilities. In order to distinguish between these possibilities, we tested congenitally blind participants and normally sighted control participants, matched for age and education, on a range of verbal and spatial tasks. Congenitally blind participants were significantly better than sighted controls on all the verbal tasks but the groups did not differ significantly on the spatial tasks. Thus, the congenitally blind appear to have superior verbal, but not spatial, abilities. This may reflect greater reliance on verbal information and the involvement of visual cortex in language processing in the congenitally blind.

Engagement of the left extrastriate body area during body-part metaphor comprehension

Grounded cognition explanations of metaphor comprehension predict activation of sensorimotor cortices relevant to the metaphor's source domain. We tested this prediction for body-part metaphors using functional magnetic resonance imaging while participants heard sentences containing metaphorical or literal references to body parts, and comparable control sentences. Localizer scans identified body-part-specific motor, somatosensory and visual cortical regions. Both subject- and item-wise analyses showed that, relative to control sentences, metaphorical but not literal sentences evoked limb metaphor-specific activity in the left extrastriate body area (EBA), paralleling the EBA's known visual limb-selectivity. The EBA focus exhibited resting-state functional connectivity with ipsilateral semantic processing regions. In some of these regions, the strength of resting-state connectivity correlated with individual preference for verbal processing. Effective connectivity analyses showed that, during metaphor comprehension, activity in some semantic regions drove that in the EBA. These results provide converging evidence for grounding of metaphor processing in domain-specific sensorimotor cortical activity.

Haptic Object Recognition is View-Independent in Early Blind but not Sighted People

Object recognition, whether visual or haptic, is impaired in sighted people when objects are rotated between learning and test, relative to an unrotated condition, that is, recognition is view-dependent. Loss of vision early in life results in greater reliance on haptic perception for object identification compared with the sighted. Therefore, we hypothesized that early blind people may be more adept at recognizing objects despite spatial transformations. To test this hypothesis, we compared early blind and sighted control participants on a haptic object recognition task. Participants studied pairs of unfamiliar three-dimensional objects and performed a two-alternative forced-choice identification task, with the learned objects presented both unrotated and rotated 180° about they-axis. Rotation impaired the recognition accuracy of sighted, but not blind, participants. We propose that, consistent with our hypothesis, haptic view-independence in the early blind reflects their greater experience with haptic object perception.

Visuo-haptic multisensory object recognition, categorization, and representation

Visual and haptic unisensory object processing show many similarities in terms of categorization, recognition, and representation. In this review, we discuss how these similarities contribute to multisensory object processing. In particular, we show that similar unisensory visual and haptic representations lead to a shared multisensory representation underlying both cross-modal object recognition and view-independence. This shared representation suggests a common neural substrate and we review several candidate brain regions, previously thought to be specialized for aspects of visual processing, that are now known also to be involved in analogous haptic tasks. Finally, we lay out the evidence for a model of multisensory object recognition in which top-down and bottom-up pathways to the object-selective lateral occipital complex are modulated by object familiarity and individual differences in object and spatial imagery.

Spatial imagery in haptic shape perception

We have proposed that haptic activation of the shape-selective lateral occipital complex (LOC) reflects a model of multisensory object representation in which the role of visual imagery is modulated by object familiarity. Supporting this, a previous functional magnetic resonance imaging (fMRI) study from our laboratory used inter-task correlations of blood oxygenation level-dependent (BOLD) signal magnitude and effective connectivity (EC) patterns based on the BOLD signals to show that the neural processes underlying visual object imagery (objIMG) are more similar to those mediating haptic perception of familiar (fHS) than unfamiliar (uHS) shapes. Here we employed fMRI to test a further hypothesis derived from our model, that spatial imagery (spIMG) would evoke activation and effective connectivity patterns more related to uHS than fHS. We found that few of the regions conjointly activated by spIMG and either fHS or uHS showed inter-task correlations of BOLD signal magnitudes, with parietal foci featuring in both sets of correlations. This may indicate some involvement of spIMG in HS regardless of object familiarity, contrary to our hypothesis, although we cannot rule out alternative explanations for the commonalities between the networks, such as generic imagery or spatial processes. EC analyses, based on inferred neuronal time series obtained by deconvolution of the hemodynamic response function from the measured BOLD time series, showed that spIMG shared more common paths with uHS than fHS. Re-analysis of our previous data, using the same EC methods as those used here, showed that, by contrast, objIMG shared more common paths with fHS than uHS. Thus, although our model requires some refinement, its basic architecture is supported: a stronger relationship between spIMG and uHS compared to fHS, and a stronger relationship between objIMG and fHS compared to uHS.

Loss of form vision impairs spatial imagery

Previous studies have reported inconsistent results when comparing spatial imagery performance in the blind and the sighted, with some, but not all, studies demonstrating deficits in the blind. Here, we investigated the effect of visual status and individual preferences ("cognitive style") on performance of a spatial imagery task. Participants with blindness resulting in the loss of form vision at or after age 6, and age- and gender-matched sighted participants, performed a spatial imagery task requiring memorization of a 4 × 4 lettered matrix and subsequent mental construction of shapes within the matrix from four-letter auditory cues. They also completed the Santa Barbara Sense of Direction Scale (SBSoDS) and a self-evaluation of cognitive style. The sighted participants also completed the Object-Spatial Imagery and Verbal Questionnaire (OSIVQ). Visual status affected performance on the spatial imagery task: the blind performed significantly worse than the sighted, independently of the age at which form vision was completely lost. Visual status did not affect the distribution of preferences based on self-reported cognitive style. Across all participants, self-reported verbalizer scores were significantly negatively correlated with accuracy on the spatial imagery task. There was a positive correlation between the SBSoDS score and accuracy on the spatial imagery task, across all participants, indicating that a better sense of direction is related to a more proficient spatial representation and that the imagery task indexes ecologically relevant spatial abilities. Moreover, the older the participants were, the worse their performance was, indicating a detrimental effect of age on spatial imagery performance. Thus, spatial skills represent an important target for rehabilitative approaches to visual impairment, and individual differences, which can modulate performance, should be taken into account in such approaches.