Functional MRI of Sensory Substitution in the Blind

Analysis and Validation of Cross-Modal Generative Adversarial Network for Sensory Substitution

Visual-auditory sensory substitution has demonstrated great potential to help visually impaired and blind groups to recognize objects and to perform basic navigational tasks. However, the high latency between visual information acquisition and auditory transduction may contribute to the lack of the successful adoption of such aid technologies in the blind community; thus far, substitution methods have remained only laboratory-scale research or pilot demonstrations. This high latency for data conversion leads to challenges in perceiving fast-moving objects or rapid environmental changes. To reduce this latency, prior analysis of auditory sensitivity is necessary. However, existing auditory sensitivity analyses are subjective because they were conducted using human behavioral analysis. Therefore, in this study, we propose a cross-modal generative adversarial network-based evaluation method to find an optimal auditory sensitivity to reduce transmission latency in visual-auditory sensory substitution, which is related to the perception of visual information. We further conducted a human-based assessment to evaluate the effectiveness of the proposed model-based analysis in human behavioral experiments. We conducted experiments with three participant groups, including sighted users (SU), congenitally blind (CB) and late-blind (LB) individuals. Experimental results from the proposed model showed that the temporal length of the auditory signal for sensory substitution could be reduced by 50%. This result indicates the possibility of improving the performance of the conventional vOICe method by up to two times. We confirmed that our experimental results are consistent with human assessment through behavioral experiments. Analyzing auditory sensitivity with deep learning models has the potential to improve the efficiency of sensory substitution.

Abnormal Fractional Amplitude of Low-Frequency Fluctuation Changes in Patients with Monocular Blindness: A Functional Magnetic Resonance Imaging (MRI) Study

BACKGROUND We used fractional amplitude of low-frequency fluctuation (fALFF) technology to investigate spontaneous cerebral activity in patients with monocular blindness (MB) and in healthy controls (HCs). MATERIAL AND METHODS Thirty MB patient and 15 HCs were included in this study. All subjects were scanned by resting-state functional magnetic resonance imaging (rs-fMRI). The independent sample t test and chi-squared test were applied to analyze demographics of MB patients and HCs. The 2-sample t test and receiver operating characteristic (ROC) curves were applied to identify the difference in average fALFF values between MB patients and HCs. Pearson's correlation analysis was applied to explore the relationship between the average fALFF values of brain areas and clinical behavior in the MB group. RESULTS MB patients had lower fALFF values in the left anterior cingulate and higher fALFF values in the left precuneus and right and left inferior parietal lobes than in HCs. Moreover, the mean fALFF values of MB patients in the left anterior cingulate had negative correlations with the anxiety scale score (r=-0.825, P<0.001) and the depression scale score (r=-0.871, P<0.001). CONCLUSIONS Our study found that MB patients had abnormal spontaneous activities in the visual and vision-related regions. The finding of abnormal neuronal activity helps to reveal the underlying neuropathologic mechanisms of vision loss.