Memory for an imagined pathway and strategy effects in sighted and in totally congenitally blind individuals

Cognitive map formation supported by auditory, haptic, and multimodal information in persons with blindness

For efficient navigation, the brain needs to adequately represent the environment in a cognitive map. In this review, we sought to give an overview of literature about cognitive map formation based on non-visual modalities in persons with blindness (PWBs) and sighted persons. The review is focused on the auditory and haptic modalities, including research that combines multiple modalities and real-world navigation. Furthermore, we addressed implications of route and survey representations. Taking together, PWBs as well as sighted persons can build up cognitive maps based on non-visual modalities, although the accuracy sometime somewhat differs between PWBs and sighted persons. We provide some speculations on how to deploy information from different modalities to support cognitive map formation. Furthermore, PWBs and sighted persons seem to be able to construct route as well as survey representations. PWBs can experience difficulties building up a survey representation, but this is not always the case, and research suggests that they can acquire this ability with sufficient spatial information or training. We discuss possible explanations of these inconsistencies.

A Haptic Nonverbal Cognitive Test for Children and Adolescents With Visual Impairment

Introduction: The objective of the current study was to design and pilot-test a nonverbal intelligence test for children and adolescents with visual impairment (i.e., blindness and low vision) aged 10 to 16 years. Method: A three-dimensional haptic matrix test of nonverbal cognitive abilities (3-DHMT-CA), initially developed for adults with visual impairment, was adapted and administered to 25 juveniles with severe low vision or blindness and 25 sighted peers. The test consisted of 22 tactual matrices with a missing element, and juveniles were asked to understand the logical scheme underlying each matrix and to complete it. Convergent validity was assessed in the sighted group with the Standard Progressive Matrices. Divergent validity was measured with the Verbal Comprehension Index (VCI) and the Working Memory Index (WMI) of the Italian version of the Wechsler Intelligence Scale for Children–Fourth Edition. Between-group differences were analyzed with Student’s t-test and ANOVA. Results: Results show a high correlation with the convergent measure (with the Standard Progressive Matrices), and the moderate correlations with divergent measures (VCI and WMI). Between-group differences showed significantly higher scores for sighted peers than juveniles with visual impairment at 3-DHMT-CA, and non-significant differences at VCI and WMI. Discussion: This haptic nonverbal cognitive test showed good psychometric properties, but it needs to be validated in a larger sample with a qualitative analysis of solution strategies because juveniles with visual impairment seem to use different verbal and working memory strategies. Implications for Practitioners: The 3-DHMT-CA and the haptic two-hands modality seem to be suitable to test nonverbal cognitive abilities in juveniles with visual impairment. Practitioners should focus on empowering verbal and working memory abilities, since they may affect nonverbal cognitive abilities as well.

Commonalities of visual and auditory working memory in a spatial-updating task

Although visual and auditory inputs are initially processed in separate perception systems, studies have built on the idea that to maintain spatial information these modalities share a component of working memory. The present study used working memory navigation tasks to examine functional similarities and dissimilarities in the performance of updating tasks. Participants mentally updated the spatial location of a target in a virtual array in response to sequential pictorial and sonant directional cues before identifying the target's final location. We predicted that if working memory representations are modality-specific, mixed-modality cues would demonstrate a cost of modality switching relative to unimodal cues. The results indicate that updating performance using visual unimodal cues positively correlated with that using auditory unimodal cues. Task performance using unimodal cues was comparable to that using mixed modality cues. The results of a subsequent experiment involving updating of target traces were consistent with those of the preceding experiments and support the view of modality-nonspecific memory.

How visual is the « number sense »? Insights from the blind

Is vision a necessary building block for the foundations of mathematical cognition? A straightforward model to test the causal role visual experience plays in the development of numerical abilities is to study people born without sight. In this review we will demonstrate that congenitally blind people can develop numerical abilities that equal or even surpass those of sighted individuals, despite representing numbers using a qualitatively different representational format. We will also show that numerical thinking in blind people maps onto regions typically involved in visuo-spatial processing in the sighted, highlighting how intrinsic computational biases may constrain the reorganization of numerical networks in case of early visual deprivation. More generally, we will illustrate how the study of arithmetic abilities in congenitally blind people represents a compelling model to understand how sensory experience scaffolds the development of higher-level cognitive representations.

Improved access to museum collections without vision: How museum visitors with very low or no vision perceive and process tactile–auditory pictures

This study investigated how museum visitors with very low or no vision perceived and processed tactile pictures and/or audio-descriptions of visual paintings. Two visual paintings were selected and a focus group was established ( N = 8). Qualitative interview and observation data were collected. This study found two types of museum visitors: those who explored the tactile picture first and those who rather listened to the audio-description. When exploring each element in the tactile picture, they all started by exploring the element’s global (shape) outline and, when struggling to recognise it, turned to the audio-description. They preferred the audio-description to start describing where their fingers were. Tactile texture attracted their attention, sparked their curiosity, and enabled them to create a mental image of the tactile picture, but also confused them. They preferred the global (element shape) outline to be straightened out, so that curves become angular, and texture only for targeting certain elements.

Improving spatial working memory in blind and sighted youngsters using programmable tactile displays

OBJECTIVE

To investigate whether training with tactile matrices displayed with a programmable tactile display improves recalling performance of spatial images in blind, low-vision and sighted youngsters. To code and understand the behavioral underpinnings of learning two-dimensional tactile dispositions, in terms of spontaneous exploration strategies.

METHODS

Three groups of blind, low-vision and sighted youngsters between 6 and 18 years old performed four training sessions with a weekly schedule in which they were asked to memorize single or double spatial layouts, featured as two-dimensional matrices.

RESULTS

Results showed that all groups of participants significantly improved their recall performance compared to the first session baseline in the single-matrix task. No statistical difference in performance between groups emerged in this task. Instead, the learning effect in visually impaired participants is reduced in the double-matrix task, whereas it is still robust in blindfolded sighted controls. We also coded tactile exploration strategies in both tasks and their correlation with performance. Sighted youngsters, in particular, favored a proprioceptive exploration strategy. Finally, performance in the double-matrix task negatively correlated with using one hand and positively correlated with a proprioceptive strategy.

CONCLUSION

The results of our study indicate that blind persons do not easily process two separate spatial layouts. However, rehabilitation programs promoting bi-manual and proprioceptive approaches to tactile exploration might help improve spatial abilities. Finally, programmable tactile displays are an effective way to make spatial and graphical configurations accessible to visually impaired youngsters and they can be profitably exploited in rehabilitation.

A novel paradigm to study spatial memory skills in blind individuals through the auditory modality

Spatial memory is a multimodal representation of the environment, which can be mediated by different sensory signals. Here we investigate how the auditory modality influences memorization, contributing to the mental representation of a scene. We designed an audio test inspired by a validated spatial memory test, the Corsi-Block test for blind individuals. The test was carried out in two different conditions, with non-semantic and semantic stimuli, presented in different sessions and displaced on an audio-tactile device. Furthermore, the semantic sounds were spatially displaced in order to reproduce an audio scene, explored by participants during the test. Thus, we verified if semantic rather than non-semantic sounds are better recalled and whether exposure to an auditory scene can enhance memorization skills. Our results show that sighted subjects performed better than blind participants after the exploration of the semantic scene. This suggests that blind participants focus on the perceived sound positions and do not use items’ locations learned during the exploration. We discuss these results in terms of the role of visual experience on spatial memorization skills and the ability to take advantage of semantic information stored in the memory.

Mental Imagery Follows Similar Cortical Reorganization as Perception: Intra-Modal and Cross-Modal Plasticity in Congenitally Blind

Cortical plasticity in congenitally blind individuals leads to cross-modal activation of the visual cortex and may lead to superior perceptual processing in the intact sensory domains. Although mental imagery is often defined as a quasi-perceptual experience, it is unknown whether it follows similar cortical reorganization as perception in blind individuals. In this study, we show that auditory versus tactile perception evokes similar intra-modal discriminative patterns in congenitally blind compared with sighted participants. These results indicate that cortical plasticity following visual deprivation does not influence broad intra-modal organization of auditory and tactile perception as measured by our task. Furthermore, not only the blind, but also the sighted participants showed cross-modal discriminative patterns for perception modality in the visual cortex. During mental imagery, both groups showed similar decoding accuracies for imagery modality in the intra-modal primary sensory cortices. However, no cross-modal discriminative information for imagery modality was found in early visual cortex of blind participants, in contrast to the sighted participants. We did find evidence of cross-modal activation of higher visual areas in blind participants, including the representation of specific-imagined auditory features in visual area V4.

How individuals who are blind locate targets

How do individuals who are blind locate, for example, the ‘@’ in an email address, the black king on a chessboard or their own house on a map? To locate information in peri-personal (non-rotated) tabletop space is a two-phase process: Phase 1 is to detect and identify the target; Phase 2 is to discover its position. This study investigated the relationship between Phase 1 and Phase 2 of the location process. A total of 23 individuals who are blind participated. Their accuracy in Phase 2 was affected by what strategy they had adopted in Phase 1; their location time was not. Three location strategies were identified in Phase 2 – the routing strategy, the global view strategy, and the touch vision strategy: the location time and accuracy not affected by which strategy had been adopted. 50% adopted the same strategy for ranking (Phase 1) target-discriminating features and (Phase 2) target-locating cues in order of importance.

Allocentric and contra-aligned spatial representations of a town environment in blind people

Evidence concerning the representation of space by blind individuals is still unclear, as sometimes blind people behave like sighted people do, while other times they present difficulties. A better understanding of blind people's difficulties, especially with reference to the strategies used to form the representation of the environment, may help to enhance knowledge of the consequences of the absence of vision. The present study examined the representation of the locations of landmarks of a real town by using pointing tasks that entailed either allocentric points of reference with mental rotations of different degrees, or contra-aligned representations. Results showed that, in general, people met difficulties when they had to point from a different perspective to aligned landmarks or from the original perspective to contra-aligned landmarks, but this difficulty was particularly evident for the blind. The examination of the strategies adopted to perform the tasks showed that only a small group of blind participants used a survey strategy and that this group had a better performance with respect to people who adopted route or verbal strategies. Implications for the comprehension of the consequences on spatial cognition of the absence of visual experience are discussed, focusing in particular on conceivable interventions.

Enhanced verbal abilities in the congenitally blind

Numerous studies have found that congenitally blind individuals have better verbal memory than their normally sighted counterparts. However, it is not known whether this reflects superiority of verbal or memory abilities. In order to distinguish between these possibilities, we tested congenitally blind participants and normally sighted control participants, matched for age and education, on a range of verbal and spatial tasks. Congenitally blind participants were significantly better than sighted controls on all the verbal tasks but the groups did not differ significantly on the spatial tasks. Thus, the congenitally blind appear to have superior verbal, but not spatial, abilities. This may reflect greater reliance on verbal information and the involvement of visual cortex in language processing in the congenitally blind.

Virtual environments for the transfer of navigation skills in the blind: a comparison of directed instruction vs. video game based learning approaches

For profoundly blind individuals, navigating in an unfamiliar building can represent a significant challenge. We investigated the use of an audio-based, virtual environment called Audio-based Environment Simulator (AbES) that can be explored for the purposes of learning the layout of an unfamiliar, complex indoor environment. Furthermore, we compared two modes of interaction with AbES. In one group, blind participants implicitly learned the layout of a target environment while playing an exploratory, goal-directed video game. By comparison, a second group was explicitly taught the same layout following a standard route and instructions provided by a sighted facilitator. As a control, a third group interacted with AbES while playing an exploratory, goal-directed video game however, the explored environment did not correspond to the target layout. Following interaction with AbES, a series of route navigation tasks were carried out in the virtual and physical building represented in the training environment to assess the transfer of acquired spatial information. We found that participants from both modes of interaction were able to transfer the spatial knowledge gained as indexed by their successful route navigation performance. This transfer was not apparent in the control participants. Most notably, the game-based learning strategy was also associated with enhanced performance when participants were required to find alternate routes and short cuts within the target building suggesting that a ludic-based training approach may provide for a more flexible mental representation of the environment. Furthermore, outcome comparisons between early and late blind individuals suggested that greater prior visual experience did not have a significant effect on overall navigation performance following training. Finally, performance did not appear to be associated with other factors of interest such as age, gender, and verbal memory recall. We conclude that the highly interactive and immersive exploration of the virtual environment greatly engages a blind user to develop skills akin to positive near transfer of learning. Learning through a game play strategy appears to confer certain behavioral advantages with respect to how spatial information is acquired and ultimately manipulated for navigation.

Loss of form vision impairs spatial imagery

Previous studies have reported inconsistent results when comparing spatial imagery performance in the blind and the sighted, with some, but not all, studies demonstrating deficits in the blind. Here, we investigated the effect of visual status and individual preferences ("cognitive style") on performance of a spatial imagery task. Participants with blindness resulting in the loss of form vision at or after age 6, and age- and gender-matched sighted participants, performed a spatial imagery task requiring memorization of a 4 × 4 lettered matrix and subsequent mental construction of shapes within the matrix from four-letter auditory cues. They also completed the Santa Barbara Sense of Direction Scale (SBSoDS) and a self-evaluation of cognitive style. The sighted participants also completed the Object-Spatial Imagery and Verbal Questionnaire (OSIVQ). Visual status affected performance on the spatial imagery task: the blind performed significantly worse than the sighted, independently of the age at which form vision was completely lost. Visual status did not affect the distribution of preferences based on self-reported cognitive style. Across all participants, self-reported verbalizer scores were significantly negatively correlated with accuracy on the spatial imagery task. There was a positive correlation between the SBSoDS score and accuracy on the spatial imagery task, across all participants, indicating that a better sense of direction is related to a more proficient spatial representation and that the imagery task indexes ecologically relevant spatial abilities. Moreover, the older the participants were, the worse their performance was, indicating a detrimental effect of age on spatial imagery performance. Thus, spatial skills represent an important target for rehabilitative approaches to visual impairment, and individual differences, which can modulate performance, should be taken into account in such approaches.

Action video game play and transfer of navigation and spatial cognition skills in adolescents who are blind

For individuals who are blind, navigating independently in an unfamiliar environment represents a considerable challenge. Inspired by the rising popularity of video games, we have developed a novel approach to train navigation and spatial cognition skills in adolescents who are blind. Audio-based Environment Simulator (AbES) is a software application that allows for the virtual exploration of an existing building set in an action video game metaphor. Using this ludic-based approach to learning, we investigated the ability and efficacy of adolescents with early onset blindness to acquire spatial information gained from the exploration of a target virtual indoor environment. Following game play, participants were assessed on their ability to transfer and mentally manipulate acquired spatial information on a set of navigation tasks carried out in the real environment. Success in transfer of navigation skill performance was markedly high suggesting that interacting with AbES leads to the generation of an accurate spatial mental representation. Furthermore, there was a positive correlation between success in game play and navigation task performance. The role of virtual environments and gaming in the development of mental spatial representations is also discussed. We conclude that this game based learning approach can facilitate the transfer of spatial knowledge and further, can be used by individuals who are blind for the purposes of navigation in real-world environments.

"To see or not to see: that is the question." The "Protection-Against-Schizophrenia" (PaSZ) model: evidence from congenital blindness and visuo-cognitive aberrations

The causes of schizophrenia are still unknown. For the last 100 years, though, both “absent” and “perfect” vision have been associated with a lower risk for schizophrenia. Hence, vision itself and aberrations in visual functioning may be fundamental to the development and etiological explanations of the disorder. In this paper, we present the “Protection-Against-Schizophrenia” (PaSZ) model, which grades the risk for developing schizophrenia as a function of an individual's visual capacity. We review two vision perspectives: (1) “Absent” vision or how congenital blindness contributes to PaSZ and (2) “perfect” vision or how aberrations in visual functioning are associated with psychosis. First, we illustrate that, although congenitally blind and sighted individuals acquire similar world representations, blind individuals compensate for behavioral shortcomings through neurofunctional and multisensory reorganization. These reorganizations may indicate etiological explanations for their PaSZ. Second, we demonstrate that visuo-cognitive impairments are fundamental for the development of schizophrenia. Deteriorated visual information acquisition and processing contribute to higher-order cognitive dysfunctions and subsequently to schizophrenic symptoms. Finally, we provide different specific therapeutic recommendations for individuals who suffer from visual impairments (who never developed “normal” vision) and individuals who suffer from visual deterioration (who previously had “normal” visual skills). Rather than categorizing individuals as “normal” and “mentally disordered,” the PaSZ model uses a continuous scale to represent psychiatrically relevant human behavior. This not only provides a scientific basis for more fine-grained diagnostic assessments, earlier detection, and more appropriate therapeutic assignments, but it also outlines a trajectory for unraveling the causes of abnormal psychotic human self- and world-perception.

Refractive errors affect the vividness of visual mental images

The hypothesis that visual perception and mental imagery are equivalent has never been explored in individuals with vision defects not preventing the visual perception of the world, such as refractive errors. Refractive error (i.e., myopia, hyperopia or astigmatism) is a condition where the refracting system of the eye fails to focus objects sharply on the retina. As a consequence refractive errors cause blurred vision. We subdivided 84 individuals according to their spherical equivalent refraction into Emmetropes (control individuals without refractive errors) and Ametropes (individuals with refractive errors). Participants performed a vividness task and completed a questionnaire that explored their cognitive style of thinking before their vision was checked by an ophthalmologist. Although results showed that Ametropes had less vivid mental images than Emmetropes this did not affect the development of their cognitive style of thinking; in fact, Ametropes were able to use both verbal and visual strategies to acquire and retrieve information. Present data are consistent with the hypothesis of equivalence between imagery and perception.

Spatial representations in blind people: the role of strategies and mobility skills

The role of vision in the construction of spatial representations has been the object of numerous studies and heated debate. The core question of whether visual experience is necessary to form spatial representations has found different, often contradictory answers. The present paper examines mental images generated from verbal descriptions of spatial environments. Previous evidence had shown that blind individuals have difficulty remembering information about spatial environments. By testing a group of congenitally blind people, we replicated this result and found that it is also present when the overall mental model of the environment is assessed. This was not always the case, however, but appeared to correlate with some blind participants' lower use of a mental imagery strategy and preference for a verbal rehearsal strategy, which was adopted particularly by blind people with more limited mobility skills. The more independent blind people who used a mental imagery strategy performed as well as sighted participants, suggesting that the difficulty blind people may have in processing spatial descriptions is not due to the absence of vision per se, but could be the consequence of both, their using less efficient verbal strategies and having poor mobility skills.

The role of vision in the development of finger-number interactions: Finger-counting and finger-montring in blind children

Previous research has suggested that the use of the fingers may play a functional role in the development of a mature counting system. However, the role of developmental vision in the elaboration of a finger numeral representation remains unexplored. In the current study, 14 congenitally blind children and 14 matched sighted controls undertook three different test batteries that examined (a) general cognitive abilities, (b) the spontaneous use of finger-counting and finger-montring strategies (where "finger-montring" is a term used to characterize the way people raise their fingers to show numerosities to other people), and (c) the canonicity level of the finger-counting and finger-montring habits. Compared with sighted controls, blind children used their fingers less spontaneously to count and in a less canonical way to count and show quantities. These results demonstrate that the absence of vision precludes the development of a typical finger numeral representation and suggest that the use of canonical finger-counting and finger-montring strategies relies on the visual recognition of particular hand shapes.

Haptic recognition of two-dimensional raised-line patterns by early-blind, late-blind, and blindfolded sighted adults

We investigated the role of visual experience and visual imagery in the processing of two-dimensional (2-D) tactile patterns. The performance of early-blind (EB), late-blind (LB), and blindfolded sighted (S) adults in the recognition of 2-D raised-line patterns was compared. We also examined whether recognition of 2-D tactile patterns depends on the type of memory strategy (eg spatial, visuo-spatial, verbal, and kinesthetic) used by EB, LB, and S participants to perform the task. Significant between-group differences in the recognition performance have not been found despite significant between-group differences in self-reported memory strategies. Recognition performance does not vary significantly with the strategy, but correlates positively with visuo-spatial imagery abilities in the S participants. These findings may be taken to suggest that the difficulties some blind people experience with tactile pictures are not due to difficulties in processing 2-D tactile patterns.

What is the link between language and spatial images? Behavioral and neural findings in blind and sighted individuals

In order to find objects or places in the world, multiple sources of information, such as visual input, auditory input and asking for directions, can help you. These different sources of information can be converged into a spatial image, which represents configurational characteristics of the world. This paper discusses the findings on the nature of spatial images and the role of spatial language in generating these spatial images in both blind and sighted individuals. Congenitally blind individuals have never experienced visual input, yet they are able to perform several tasks traditionally associated with spatial imagery, such as mental scanning, mental pathway completions and mental clock time comparison, though perhaps not always in a similar manner as sighted. Therefore, they offer invaluable insights into the exact nature of spatial images. We will argue that spatial imagery exceeds the input from different input modalities to form an abstract mental representation while maintaining connections with the input modalities. This suggests that the nature of spatial images is supramodal, which can explain functional equivalent results from verbal and perceptual inputs for spatial situations and subtle to moderate behavioral differences between the blind and sighted.