Face shape processing via visual-to-auditory sensory substitution activates regions within the face processing networks in the absence of visual experience

Highly compromised auditory spatial perception in aided congenitally hearing-impaired and rapid improvement with tactile technology

Spatial understanding is a multisensory construct while hearing is the only natural sense enabling the simultaneous perception of the entire 3D space. To test whether such spatial understanding is dependent on auditory experience, we study congenitally hearing-impaired users of assistive devices. We apply an in-house technology, which, inspired by the auditory system, performs intensity-weighting to represent external spatial positions and motion on the fingertips. We see highly impaired auditory spatial capabilities for tracking moving sources, which based on the "critical periods" theory emphasizes the role of nature in sensory development. Meanwhile, for tactile and audio-tactile spatial motion perception, the hearing-impaired show performance similar to typically hearing individuals. The immediate availability of 360° external space representation through touch, despite the lack of such experience during the lifetime, points to the significant role of nurture in spatial perception development, and to its amodal character. The findings show promise toward advancing multisensory solutions for rehabilitation.

Functional performance of a vibrotactile sensory substitution device in people with profound vision loss

SIGNIFICANCE

This study has shown a vibrotactile sensory substitution device (SSD) prototype, VibroSight, has the potential to improve functional outcomes (i.e., obstacle avoidance, face detection) for people with profound vision loss, even with brief familiarization (<20 minutes).

PURPOSE

Mobility aids such as long canes are still the mainstay of support for most people with vision loss, but they do have limitations. Emerging technologies such as SSDs are gaining widespread interest in the low vision community. The aim of this project was to assess the efficacy of a prototype vibrotactile SSD for people with profound vision loss in the face detection and obstacle avoidance tasks.

METHODS

The VibroSight device was tested in a movement laboratory setting. The first task involved obstacle avoidance, in which participants were asked to walk through an obstacle course. The second was a face detection task, in which participants were asked to step toward the first face they detected. Exit interviews were also conducted to gather user experience data. Both people with low vision (n = 7) and orientation and mobility instructors (n = 4) completed the tasks.

RESULTS

In obstacle avoidance task, participants were able to use the device to detect (p<0.001) and avoid (p<0.001) the obstacles within a significantly larger range, but were slower (p<0.001), when compared with without the device. In face detection task, participants demonstrated a great level of accuracy, precision, and sensitivity when using the device. Interviews revealed a positive user experience, although participants identified that they would require a lighter and compact design for real-world use.

CONCLUSIONS

Overall, the results verified the functionality of vibrotactile SSD prototype. Further research is warranted to evaluate the user performance after an extended training program and to add new features, such as object recognition software algorithms, into the device.

Developing cortex is functionally pluripotent: Evidence from blindness

How rigidly does innate architecture constrain function of developing cortex? What is the contribution of early experience? We review insights into these questions from visual cortex function in people born blind. In blindness, occipital cortices are active during auditory and tactile tasks. What 'cross-modal' plasticity tells us about cortical flexibility is debated. On the one hand, visual networks of blind people respond to higher cognitive information, such as sentence grammar, suggesting drastic repurposing. On the other, in line with 'metamodal' accounts, sighted and blind populations show shared domain preferences in ventral occipito-temporal cortex (vOTC), suggesting visual areas switch input modality but perform the same or similar perceptual functions (e.g., face recognition) in blindness. Here we bring these disparate literatures together, reviewing and synthesizing evidence that speaks to whether visual cortices have similar or different functions in blind and sighted people. Together, the evidence suggests that in blindness, visual cortices are incorporated into higher-cognitive (e.g., fronto-parietal) networks, which are a major source long-range input to the visual system. We propose the connectivity-constrained experience-dependent account. Functional development is constrained by innate anatomical connectivity, experience and behavioral needs. Infant cortex is pluripotent, the same anatomical constraints develop into different functional outcomes.