Haptic aesthetics in the blind: A behavioral and fMRI investigation

Neural correlates of thermal stimulation during active touch

Introduction

Thermal feedback technologies have been explored in human-computer interaction to provide secondary information and enhance the overall user experience. Unlike fast-response haptic modalities such as vibration and force feedback, the human brain's processes associated with thermal feedback are not fully understood.

Methods

In this study, we utilize electroencephalography (EEG) brain imaging to systematically examine the neural correlates associated with a wide range of thermal stimuli, including 9, 15, 32, and 42°C, during active touch at the fingertip. A custom experimental setup is developed to provide thermal stimulation at the desirable temperature levels. A total of 30 participants are recruited to experience the four levels of thermal stimulation by actively touching a thermal stimulation unit with the index finger while recording brain activities via EEG. Time-frequency analysis and power spectral density (PSD) of the EEG data are utilized to analyze the delta, theta, alpha, beta, and gamma frequency bands.

Results

The results show that the delta, theta, and alpha PSDs of 9 and 15°C stimuli are significantly higher than the PSDs of 32 and 42°C in the right frontal area during the early stage of the stimulation, from 282 ms up to 1,108 ms (One-way ANOVA test, Holm-Bonferroni correction, p < 0.05). No significant differences in PSDs are found between 9 and 15°C thermal stimuli or between 32 and 42°C thermal stimuli.

Discussion

The findings of this study inform the development of thermal feedback system in human-computer interaction.

Effect of Perceptual Training with Sound-Guided and Kinesthetic Feedback on Human 3D Sound Localization Capabilities

In this paper, we experimentally investigate how the 3D sound localization capabilities of the blind can improve through perceptual training. To this end, we develop a novel perceptual training method with sound-guided feedback and kinesthetic assistance to evaluate its effectiveness compared to conventional training methods. In perceptual training, we exclude visual perception by blindfolding the subjects to apply the proposed method to the visually impaired. Subjects used a specially designed pointing stick to generate a sound at the tip, indicating localization error and tip position. The proposed perceptual training aims to evaluate the training effect on 3D sound localization, including variations in azimuth, elevation, and distance. The six days of training based on six subjects resulted in the following outcomes: (1) In general, accuracy in full 3D sound localization can be improved based on training. (2) Training based on relative error feedback is more effective than absolute error feedback. (3) Subjects tend to underestimate distance when the sound source is near, less than 1000 mm, or larger than 15° to the left, and overestimate the elevation when the sound source is near or in the center, and within ±15° in azimuth estimations.

Do we enjoy what we sense and perceive? A dissociation between aesthetic appreciation and basic perception of environmental objects or events

This integrative review rearticulates the notion of human aesthetics by critically appraising the conventional definitions, offerring a new, more comprehensive definition, and identifying the fundamental components associated with it. It intends to advance holistic understanding of the notion by differentiating aesthetic perception from basic perceptual recognition, and by characterizing these concepts from the perspective of information processing in both visual and nonvisual modalities. To this end, we analyze the dissociative nature of information processing in the brain, introducing a novel local-global integrative model that differentiates aesthetic processing from basic perceptual processing. This model builds on the current state of the art in visual aesthetics as well as newer propositions about nonvisual aesthetics. This model comprises two analytic channels: aesthetics-only channel and perception-to-aesthetics channel. The aesthetics-only channel primarily involves restricted local processing for quality or richness (e.g., attractiveness, beauty/prettiness, elegance, sublimeness, catchiness, hedonic value) analysis, whereas the perception-to-aesthetics channel involves global/extended local processing for basic feature analysis, followed by restricted local processing for quality or richness analysis. We contend that aesthetic processing operates independently of basic perceptual processing, but not independently of cognitive processing. We further conjecture that there might be a common faculty, labeled as aesthetic cognition faculty, in the human brain for all sensory aesthetics albeit other parts of the brain can also be activated because of basic sensory processing prior to aesthetic processing, particularly during the operation of the second channel. This generalized model can account not only for simple and pure aesthetic experiences but for partial and complex aesthetic experiences as well.