A framework to account for the effects of visual loss on human auditory abilities

Preliminary investigation of SEZUAL device for basic material identification and simple spatial navigation for blind and visually impaired people

PURPOSE

we present a preliminary set of experimental studies that demonstrates device-aided echolocation enabling in blind and visually impaired individuals. The proposed device emits a click-like sound into the surrounding space and returning sound is perceived by participants to infer the surrounding environment.

MATERIALS AND METHODS

two sets of experiments were set up to evaluate the echolocation abilities of nine blind participants. The first setup was designed to identify four material types based on the sound reflection properties of materials, such as glass, metal, wood, and ceramics. The second setup was navigation through a basic maze with the device.

RESULTS

experimental data demonstrate that the use of the proposed device enables active echolocation abilities in blind participants, particularly for material identification and spatial mobility.

CONCLUSION

the proposed device can potentially be used to rehabilitate disabled blind and visually impaired individuals in terms of spatial mobility and orientation.

Effects of type of emission and masking sound, and their spatial correspondence, on blind and sighted people's ability to echolocate

Ambient sound can mask acoustic signals. The current study addressed how echolocation in people is affected by masking sound, and the role played by type of sound and spatial (i.e. binaural) similarity. We also investigated the role played by blindness and long-term experience with echolocation, by testing echolocation experts, as well as blind and sighted people new to echolocation. Results were obtained in two echolocation tasks where participants listened to binaural recordings of echolocation and masking sounds, and either localized echoes in azimuth or discriminated echo audibility. Echolocation and masking sounds could be either clicks or broad band noise. An adaptive staircase method was used to adjust signal-to-noise ratios (SNRs) based on participants' responses. When target and masker had the same binaural cues (i.e. both were monoaural sounds), people performed better (i.e. had lower SNRs) when target and masker used different types of sound (e.g. clicks in noise-masker or noise in clicks-masker), as compared to when target and masker used the same type of sound (e.g. clicks in click-, or noise in noise-masker). A very different pattern of results was observed when masker and target differed in their binaural cues, in which case people always performed better when clicks were the masker, regardless of type of emission used. Further, direct comparison between conditions with and without binaural difference revealed binaural release from masking only when clicks were used as emissions and masker, but not otherwise (i.e. when noise was used as masker or emission). This suggests that echolocation with clicks or noise may differ in their sensitivity to binaural cues. We observed the same pattern of results for echolocation experts, and blind and sighted people new to echolocation, suggesting a limited role played by long-term experience or blindness. In addition to generating novel predictions for future work, the findings also inform instruction in echolocation for people who are blind or sighted.

Auditory Spatial Bisection of Blind and Normally Sighted Individuals in Free Field and Virtual Acoustics

Sound localization is an important ability in everyday life. This study investigates the influence of vision and presentation mode on auditory spatial bisection performance. Subjects were asked to identify the smaller perceived distance between three consecutive stimuli that were either presented via loudspeakers (free field) or via headphones after convolution with generic head-related impulse responses (binaural reproduction). Thirteen azimuthal sound incidence angles on a circular arc segment of ±24° at a radius of 3 m were included in three regions of space (front, rear, and laterally left). Twenty normally sighted (measured both sighted and blindfolded) and eight blind persons participated. Results showed no significant differences with respect to visual condition, but strong effects of sound direction and presentation mode. Psychometric functions were steepest in frontal space and indicated median spatial bisection thresholds of 11°-14°. Thresholds increased significantly in rear (11°-17°) and laterally left (20°-28°) space in free field. Individual pinna and torso cues, as available only in free field presentation, improved the performance of all participants compared to binaural reproduction. Especially in rear space, auditory spatial bisection thresholds were three to four times higher (i.e., poorer) using binaural reproduction than in free field. The results underline the importance of individual auditory spatial cues for spatial bisection, irrespective of access to vision, which indicates that vision may not be strictly necessary to calibrate allocentric spatial hearing.

6-hour Training in click-based echolocation changes practice in visual impairment professionals

Click-based echolocation can support mobility and orientation in people with vision impairments (VI) when used alongside other mobility methods. Only a small number of people with VI use click-based echolocation. Previous research about echolocation addresses the skill of echolocation per se to understand how echolocation works, and its brain basis. Our report is the first to address the question of professional practice for people with VI, i.e., a very different focus. VI professionals are well placed to affect how a person with VI might learn about, experience or use click-based echolocation. Thus, we here investigated if training in click-based echolocation for VI professionals might lead to a change in their professional practice. The training was delivered via 6-h workshops throughout the UK. It was free to attend, and people signed up via a publicly available website. We received follow-up feedback in the form of yes/no answers and free text comments. Yes/no answers showed that 98% of participants had changed their professional practice as a consequence of the training. Free text responses were analysed using content analysis, and we found that 32%, 11.7% and 46.6% of responses indicated a change in information processing, verbal influencing or instruction and practice, respectively. This attests to the potential of VI professionals to act as multipliers of training in click-based echolocation with the potential to improve the lives of people with VI. The training we evaluated here could feasibly be integrated into VI Rehabilitation or VI Habilitation training as implemented at higher education institutions (HEIs) or continuing professional development (CPD).

Early visual deprivation disrupts the mental representation of numbers in visually impaired children

Several shreds of evidence indicate that visual deprivation does not alter numerical competence neither in adults nor in children. However, studies reporting non-impaired numerical abilities in the visually impaired population present some limitations: (a) they mainly assessed the ability to process numbers (e.g. mathematical competence) rather than represent numbers (e.g. mental number line); (b) they principally focused on positive rather than negative number estimates; (c) they investigated numerical abilities in adult individuals except one focusing on children (Crollen et al. in Cognition 210:104586, 2021). Overall, this could limit a comprehensive explanation of the role exerted by vision on numerical processing when vision is compromised. Here we investigated how congenital visual deprivation affects the ability to represent positive and negative numbers in horizontal and sagittal planes in visually impaired children (thirteen children with low vision, eight children with complete blindness, age range 6-15 years old). We adapted the number-to-position paradigm adopted by Crollen et al. (Cognition 210:104586, 2021), asking children to indicate the spatial position of positive and negative numbers on a graduated rule positioned horizontally or sagittally in the frontal plane. Results suggest that long-term visual deprivation alters the ability to identify the spatial position of numbers independently of the spatial plane and the number polarity. Moreover, results indicate that relying on poor visual acuity is detrimental for low vision children when asked to localize both positive and negative numbers in space, suggesting that visual experience might have a differential role in numerical processing depending on number polarity. Such findings add knowledge related to the impact of visual experience on numerical processing. Since both positive and negative numbers are fundamental aspects of learning mathematical principles, the outcomes of the present study inform about the need to implement early rehabilitation strategies to prevent the risk of numerical difficulties in visually impaired children.

The pinna enhances angular discrimination in the frontal hemifield

Human sound localization in the horizontal dimension is thought to be dominated by binaural cues, particularly interaural time delays, because monaural localization in this dimension is relatively poor. Remaining ambiguities of front versus back and up versus down are distinguished by high-frequency spectral cues generated by the pinna. The experiments in this study show that this account is incomplete. Using binaural listening throughout, the pinna substantially enhanced horizontal discrimination in the frontal hemifield, making discrimination in front better than discrimination at the rear, particularly for directions away from the median plane. Eliminating acoustic effects of the pinna by acoustically bypassing them or low-pass filtering abolished the advantage at the front without affecting the rear. Acoustic measurements revealed a pinna-induced spectral prominence that shifts smoothly in frequency as sounds move from 0° to 90° azimuth. The improved performance is discussed in terms of the monaural and binaural changes induced by the pinna.

Partial visual loss disrupts the relationship between judged room size and sound source distance

Visual spatial information plays an important role in calibrating auditory space. Blindness results in deficits in a number of auditory abilities, which have been explained in terms of the hypothesis that visual information is needed to calibrate audition. When judging the size of a novel room when only auditory cues are available, normally sighted participants may use the location of the farthest sound source to infer the nearest possible distance of the far wall. However, for people with partial visual loss (distinct from blindness in that some vision is present), such a strategy may not be reliable if vision is needed to calibrate auditory cues for distance. In the current study, participants were presented with sounds at different distances (ranging from 1.2 to 13.8 m) in a simulated reverberant (T₆₀ = 700 ms) or anechoic room. Farthest distance judgments and room size judgments (volume and area) were obtained from blindfolded participants (18 normally sighted, 38 partially sighted) for speech, music, and noise stimuli. With sighted participants, the judged room volume and farthest sound source distance estimates were positively correlated (p < 0.05) for all conditions. Participants with visual losses showed no significant correlations for any of the conditions tested. A similar pattern of results was observed for the correlations between farthest distance and room floor area estimates. Results demonstrate that partial visual loss disrupts the relationship between judged room size and sound source distance that is shown by sighted participants.

Analysis and Validation of Cross-Modal Generative Adversarial Network for Sensory Substitution

Visual-auditory sensory substitution has demonstrated great potential to help visually impaired and blind groups to recognize objects and to perform basic navigational tasks. However, the high latency between visual information acquisition and auditory transduction may contribute to the lack of the successful adoption of such aid technologies in the blind community; thus far, substitution methods have remained only laboratory-scale research or pilot demonstrations. This high latency for data conversion leads to challenges in perceiving fast-moving objects or rapid environmental changes. To reduce this latency, prior analysis of auditory sensitivity is necessary. However, existing auditory sensitivity analyses are subjective because they were conducted using human behavioral analysis. Therefore, in this study, we propose a cross-modal generative adversarial network-based evaluation method to find an optimal auditory sensitivity to reduce transmission latency in visual-auditory sensory substitution, which is related to the perception of visual information. We further conducted a human-based assessment to evaluate the effectiveness of the proposed model-based analysis in human behavioral experiments. We conducted experiments with three participant groups, including sighted users (SU), congenitally blind (CB) and late-blind (LB) individuals. Experimental results from the proposed model showed that the temporal length of the auditory signal for sensory substitution could be reduced by 50%. This result indicates the possibility of improving the performance of the conventional vOICe method by up to two times. We confirmed that our experimental results are consistent with human assessment through behavioral experiments. Analyzing auditory sensitivity with deep learning models has the potential to improve the efficiency of sensory substitution.