Sight restoration

Face-specific identification impairments following sight-providing treatment may be alleviated by an initial period of low visual acuity

Identifying faces requires configural processing of visual information. We previously proposed that the poor visual acuity experienced by newborns in their first year of life lays the groundwork for such configural processing by forcing integration over larger spatial fields. This hypothesis predicts that children treated for congenital cataracts late in life will exhibit persistent impairments in face- but not object-identification, because they begin their visual journey with higher than newborn acuity. This would not be the case for patients whose pretreatment condition has allowed for initial low acuity vision, like that of a newborn. Here, we test this prediction by assessing the development of facial identification skill in three groups: patients treated for congenital cataracts whose pretreatment visual acuity was worse than that of a newborn, patients whose pretreatment acuity was better than that of a newborn, and age-matched controls. We find that while both patient groups show significant gains in object-identification, the emergence of face identification is determined by pretreatment acuity: patients with pre-operative acuity worse than a newborn did not show any improvements on face-identification tasks despite years of visual experience, whereas those with pretreatment acuity comparable to a newborn improved on both the object- and face-identification tasks. These findings not only answer our research question but also provide new insights into the role of early visual acuity in facial identification development. We discuss these results in the context of both typical and atypical visual development.

Vulnerability of facial attractiveness perception to early and multi-year visual deprivation

Judgments of facial attractiveness invariably accompany our perception of faces. Even neonates appear to be capable of making such judgments in a manner consistent with adults. This suggests that the processes supporting facial attractiveness require little, if any, visual experience to manifest. Here we investigate the resilience of these processes to several years of early-onset visual deprivation. Specifically, we study whether congenitally blind children treated several years after birth possess the ability to rate facial attractiveness in a manner congruent to normally sighted individuals. The data reveal significant individual variability in the way each newly sighted child perceives attractiveness. This is in marked contrast to data from normally sighted controls who exhibit strong across-subject agreement in facial attractiveness ratings. This variability may be attributable, in part, to atypical facial encoding strategies used by the newly sighted children. Overall, our results suggest that the development of facial attractiveness perception is likely to be vulnerable to early visual deprivation, pointing to the existence of a possible sensitive period early in the developmental trajectory.

Learning to see after early and extended blindness: A scoping review

Purpose

If an individual has been blind since birth due to a treatable eye condition, ocular treatment is urgent. Even a brief period of visual deprivation can alter the development of the visual system. The goal of our structured scoping review was to understand how we might better support children with delayed access to ocular treatment for blinding conditions.

Method

We searched MEDLINE, Embase and Global Health for peer-reviewed publications that described the impact of early (within the first year) and extended (lasting at least 2 years) bilateral visual deprivation.

Results

Of 551 reports independently screened by two authors, 42 studies met our inclusion criteria. Synthesizing extracted data revealed several trends. The data suggests persistent deficits in visual acuity, contrast sensitivity, global motion, and visual-motor integration, and suspected concerns for understanding complex objects and faces. There is evidence for resilience in color perception, understanding of simple shapes, discriminating between a face and non-face, and the perception of biological motion. There is currently insufficient data about specific (re)habilitation strategies to update low vision services, but there are several insights to guide future research in this domain.

Conclusion

This summary will help guide the research and services provision to help children learn to see after early and extended blindness.

Head turning is an effective cue for gaze following: Evidence from newly sighted individuals, school children and adults

In referential communication, gaze is often interpreted as a social cue that facilitates comprehension and enables word learning. Here we investigated the degree to which head turning facilitates gaze following. We presented participants with static pictures of a man looking at a target object in a first and third block of trials (pre- and post-intervention), while they saw short videos of the same man turning towards the target in the second block of trials (intervention). In Experiment 1, newly sighted individuals (treated for congenital cataracts; N = 8) benefited from the motion cues, both when comparing their initial performance with static gaze cues to their performance with dynamic head turning, and their performance with static cues before and after the videos. In Experiment 2, neurotypical school children (ages 5-10 years; N = 90) and adults (N = 30) also revealed improved performance with motion cues, although most participants had started to follow the static gaze cues before they saw the videos. Our results confirm that head turning is an effective social cue when interpreting new words, offering new insights for a pathways approach to development.

Typical resting state activity of the brain requires visual input during an early sensitive period

Sensory deprivation, following a total loss of one sensory modality e.g. vision, has been demonstrated to result in compensatory plasticity. It is yet not known to which extent neural changes, e.g. higher resting-state activity in visual areas (cross-modal plasticity) as a consequence of blindness, reverse, when sight is restored. Here, we used functional MRI to acquire blood oxygen level-dependent resting-state activity during an eyes open and an eyes closed state in congenital cataract-reversal individuals, developmental cataract-reversal individuals, congenitally permanently blind individuals and sighted controls. The amplitude of low frequency fluctuation of the blood oxygen level-dependent signal—a neural marker of spontaneous brain activity during rest—was analyzed. In accordance with previous reports, in normally sighted controls we observed an increase in amplitude of low-frequency fluctuation during rest with the eyes open compared with rest with eyes closed in visual association areas and in parietal cortex but a decrease in auditory and sensorimotor regions. In congenital cataract-reversal individuals, we found an increase of the amplitude of slow blood oxygen level-dependent fluctuations in visual cortex during rest with eyes open compared with rest with eyes closed too but this increase was larger in amplitude than in normally sighted controls. In contrast, congenital cataract-reversal individuals lagged a similar increase in parietal regions and did not show the typical decrease of amplitude of low-frequency fluctuation in auditory cortex. Congenitally blind individuals displayed an overall higher amplitude in slow blood oxygen level-dependent fluctuations in visual cortex compared with sighted individuals and compared with congenital cataract-reversal individuals in the eyes closed condition. Higher amplitude of low-frequency fluctuation in visual cortex of congenital cataract-reversal individuals than in normally sighted controls during eyes open might indicate an altered excitatory–inhibitory balance of visual neural circuits. By contrast, the lower parietal increase and the missing downregulation in auditory regions suggest a reduced influence of the visual system on multisensory and the other sensory systems after restoring sight in congenitally blind individuals. These results demonstrate a crucial dependence of visual and multisensory neural system functioning on visual experience during a sensitive phase in human brain development.

Development of Visual Memory Capacity Following Early-Onset and Extended Blindness

It is unknown whether visual memory capacity can develop if onset of pattern vision is delayed for several years following birth. We had an opportunity to address this question through our work with an unusual population of 12 congenitally blind individuals ranging in age from 8 to 22 years. After providing them with sight surgery, we longitudinally evaluated their visual memory capacity using an image-memorization task. Our findings revealed poor visual memory capacity soon after surgery but significant improvement in subsequent months. Although there may be limits to this improvement, performance 1 year after surgery was found to be comparable with that of control participants with matched visual acuity. These findings provide evidence for plasticity of visual memory mechanisms into late childhood but do not rule out vulnerability to early deprivation. Our computational simulations suggest that a potential mechanism to account for changes in memory performance may be progressive representational elaboration in image encoding.

An electrophysiological biomarker for the classification of cataract-reversal patients: A case-control study

BACKGROUND

Untreated congenital blindness through cataracts leads to lasting visual brain system changes, including substantial alterations of extrastriate visual areas. Consequently, late-treated individuals (> 5 months of age) with dense congenital bilateral cataracts (CC) exhibit poorer visual function recovery compared to individuals with bilateral developmental cataracts (DC). Reliable methods to differentiate between patients with congenital and developmental cataracts are often lacking, impeding efficient rehabilitation management and introducing confounds in clinical and basic research on recovery prognosis and optimal timing of surgery. A persistent reduction of the P1 wave of visual event-related potentials (VERPs), associated with extrastriate visual cortical activity, has been reported in CC but not in DC individuals. Using two experiments, this study developed and validated P1-based biomarkers for diagnosing a history of congenital blindness in cataract-reversal individuals.

METHODS

Congenital and developmental cataract-reversal individuals as well as typically sighted matched controls took part in a first experiment used for exploring an electrophysiological biomarker (N _CC = 13, N _DC = 13, N _Control = 26). Circular stimuli containing gratings were presented in one of the visual field quadrants while visual event-related potentials (VERPs) were recorded. Two biomarkers were derived from the P1 wave of the VERP: (1) The mean of the normalized P1 amplitude at posterior electrodes, and (2) a classifier obtained from a linear support vector machine (SVM). A second experiment with partially new CC/DC individuals and their matched controls (N _CC = 14, N _DC = 15, N _Control = 29) was consecutively used to validate the classification based on both biomarkers. Performance of the classifiers were evaluated using receiver operating characteristic (ROC) curve analyses. All cataract-reversal individuals were tested after at least one year of vision recovery.

FINDINGS

The normalized P1 amplitude over posterior electrodes allowed a successful classification of the CC from the DC individuals and typically sighted controls (area under ROC curve, AUC = 0.803 and 0.929 for the normalized P1 amplitude and the SVM-based biomarker, respectively). The validation for both biomarkers in experiment 2 again resulted in a high classification success (AUC = 0.800 and 0.883, respectively for the normalized P1 amplitude and the SVM-based biomarker). In the most conservative scenario involving classification of CC from DC individuals in a group of only cataract-reversal individuals, excluding typically sighted controls, the SVM-based biomarker was found to be superior to the mean P1 amplitude based biomarker (AUC = 0.852 compared to 0.757 for the mean P1 based biomarker in validation). Minimum specificity obtained was 80% across all biomarkers.

INTERPRETATION

A persistent reduction of the P1 wave provides a highly specific method for classifying cataract patients post-surgically as having suffered from bilateral congenital vs. bilateral developmental cataracts. We suggest that using the P1 based non-invasive electrophysiological biomarker will augment existing clinical classification criteria for individuals with a history of bilateral congenital cataracts, aiding clinical and basic research, recovery prognosis, and rehabilitation efforts.

FUNDING

German Research Foundation (DFG) and the European Research Council (ERC).

Mechanisms underlying simultaneous brightness contrast: Early and innate

In the phenomenon of simultaneous brightness contrast, two patches, one on a dark background and the other on a light one, appear to have different brightness despite being physically equi-luminant. Elucidating the phenomenon's underlying mechanisms is relevant for the larger question of how the visual system makes photometric judgments in images. Accounts over the past century have spanned low-, mid- and high-level visual processes, but a definitive resolution has not emerged. We present three studies that collectively demonstrate that the computations underlying this phenomenon are low-level, instantiated prior to binocular fusion, and available innately, without need for inferential learning via an individual's visual experience. In our first two studies, we find that strong brightness induction is obtained even when observers are unaware of any luminance differences in the neighborhoods of the probe patches. Results with dichoptic displays reveal that eye of origin, although not evident consciously, has a marked influence on the eventual brightness percept of the probe patches, thereby localizing brightness estimation to a site preceding binocular fusion. The third study uses conventional simultaneous brightness contrast displays, but an unusual group of participants: Congenitally blind children whom we were able to treat surgically. The results demonstrate an immediate susceptibility to the simultaneous brightness illusion after sight onset. Together, these data strongly constrain the search for mechanisms underlying a fundamental brightness phenomenon.

Potential downside of high initial visual acuity

Children who are treated for congenital cataracts later exhibit impairments in configural face analysis. This has been explained in terms of a critical period for the acquisition of normal face processing. Here, we consider a more parsimonious account according to which deficits in configural analysis result from the abnormally high initial retinal acuity that children treated for cataracts experience, relative to typical newborns. According to this proposal, the initial period of low retinal acuity characteristic of normal visual development induces extended spatial processing in the cortex that is important for configural face judgments. As a computational test of this hypothesis, we examined the effects of training with high-resolution or blurred images, and staged combinations, on the receptive fields and performance of a convolutional neural network. The results show that commencing training with blurred images creates receptive fields that integrate information across larger image areas and leads to improved performance and better generalization across a range of resolutions. These findings offer an explanation for the observed face recognition impairments after late treatment of congenital blindness, suggest an adaptive function for the acuity trajectory in normal development, and provide a scheme for improving the performance of computational face recognition systems.

Emergence of categorical face perception after extended early-onset blindness

It is unknown whether the ability to visually distinguish between faces and nonfaces is subject to a critical period during development. Would a congenitally blind child who gains sight several years after birth be able to acquire this skill? This question has remained unanswered because of the rarity of cases of late sight onset. We had the opportunity to work with five early-blind individuals who gained sight late in childhood after treatment for dense bilateral cataracts. We tested their ability to categorize patterns as faces, using natural images that spanned a spectrum of face semblance. The results show that newly sighted individuals are unable to distinguish between faces and nonfaces immediately after sight onset, but improve markedly in the following months. These results demonstrate preserved plasticity for acquiring face/nonface categorization ability even late in life, and set the stage for investigating the informational and neural basis of this skill acquisition.

The Sound of Vision Project: On the Feasibility of an Audio-Haptic Representation of the Environment, for the Visually Impaired

The Sound of Vision project involves developing a sensory substitution device that is aimed at creating and conveying a rich auditory representation of the surrounding environment to the visually impaired. However, the feasibility of such an approach is strongly constrained by neural flexibility, possibilities of sensory substitution and adaptation to changed sensory input. We review evidence for such flexibility from various perspectives. We discuss neuroplasticity of the adult brain with an emphasis on functional changes in the visually impaired compared to sighted people. We discuss effects of adaptation on brain activity, in particular short-term and long-term effects of repeated exposure to particular stimuli. We then discuss evidence for sensory substitution such as Sound of Vision involves, while finally discussing evidence for adaptation to changes in the auditory environment. We conclude that sensory substitution enterprises such as Sound of Vision are quite feasible in light of the available evidence, which is encouraging regarding such projects.

'Visual' parsing can be taught quickly without visual experience during critical periods

Cases of invasive sight-restoration in congenital blind adults demonstrated that acquiring visual abilities is extremely challenging, presumably because visual-experience during critical-periods is crucial for learning visual-unique concepts (e.g. size constancy). Visual rehabilitation can also be achieved using sensory-substitution-devices (SSDs) which convey visual information non-invasively through sounds. We tested whether one critical concept – visual parsing, which is highly-impaired in sight-restored patients – can be learned using SSD. To this end, congenitally blind adults participated in a unique, relatively short (~70 hours), SSD-‘vision’ training. Following this, participants successfully parsed 2D and 3D visual objects. Control individuals naïve to SSDs demonstrated that while some aspects of parsing with SSD are intuitive, the blind’s success could not be attributed to auditory processing alone. Furthermore, we had a unique opportunity to compare the SSD-users’ abilities to those reported for sight-restored patients who performed similar tasks visually, and who had months of eyesight. Intriguingly, the SSD-users outperformed the patients on most criteria tested. These suggest that with adequate training and technologies, key high-order visual features can be quickly acquired in adulthood, and lack of visual-experience during critical-periods can be somewhat compensated for. Practically, these highlight the potential of SSDs as standalone-aids or combined with invasive restoration approaches.

Immediate susceptibility to visual illusions after sight onset

The dominant accounts of many visual illusions are based on experience-driven development of sensitivity to certain visual cues. According to such accounts, learned associations between observed two-dimensional cues (say, converging lines) and the real three-dimensional structures they represent (a surface receding in depth) render us susceptible to misperceiving some images that are cleverly contrived to contain those two-dimensional cues. While this explanation appears reasonable, it lacks direct experimental validation. To contrast it with an account that dispenses with the need for visual experience, it is necessary to determine whether susceptibility to the illusion is present immediately after birth; however, eliciting reliable responses from newborns is fraught with operational difficulties, and studies with older infants are incapable of resolving this issue. Our work with children who gain sight after extended early-onset blindness, as part of Project Prakash, provides a potential way forward. We report here that the newly sighted children, ranging in age from 8 through 16 years, exhibit susceptibility to two well-known geometrical visual illusions, Ponzo [1] and Müller-Lyer [2], immediately after the onset of sight. This finding has implications not only for the likely explanations of these illusions, but more generally, for the nature-nurture argument as it relates to some key aspects of visual processing.

A lack of experience-dependent plasticity after more than a decade of recovered sight

In 2000, monocular vision was restored to M. M., who had been blind between the ages of 3 and 46 years. Tests carried out over 2 years following the surgery revealed impairments of 3-D form, object, and face processing and an absence of object- and face-selective blood-oxygen-level-dependent responses in ventral visual cortex. In the present research, we reexamined M. M. to test for experience-dependent recovery of visual function. Behaviorally, M. M. remains impaired in 3-D form, object, and face processing. Accordingly, we found little to no evidence of the category-selective organization within ventral visual cortex typically associated with face, body, scene, or object processing. We did observe remarkably normal object selectivity within lateral occipital cortex, consistent with M. M.'s previously reported shape-discrimination performance. Together, these findings provide little evidence for recovery of high-level visual function after more than a decade of visual experience in adulthood.

The blind brain: How (lack of) vision shapes the morphological and functional architecture of the human brain

Since the early days, how we represent the world around us has been a matter of philosophical speculation. Over the last few decades, modern neuroscience, and specifically the development of methodologies for the structural and the functional exploration of the brain have made it possible to investigate old questions with an innovative approach. In this brief review, we discuss the main findings from a series of brain anatomical and functional studies conducted in sighted and congenitally blind individuals by our’s and others' laboratories. Historically, research on the ‘blind brain’ has focused mainly on the cross-modal plastic changes that follow sensory deprivation. More recently, a novel line of research has been developed to determine to what extent visual experience is truly required to achieve a representation of the surrounding environment. Overall, the results of these studies indicate that most of the brain fine morphological and functional architecture is programmed to develop and function independently from any visual experience. Distinct cortical areas are able to process information in a supramodal fashion, that is, independently from the sensory modality that carries that information to the brain. These observations strongly support the hypothesis of a modality-independent, i.e. more abstract, cortical organization, and may contribute to explain how congenitally blind individuals may interact efficiently with an external world that they have never seen.