Color Processing in Synesthesia: What Synesthesia Can and Cannot Tell Us About Mechanisms of Color Processing

Apparent physical brightness of graphemes is altered by their synaesthetic colour in grapheme-colour synaesthetes

Grapheme-colour synaesthesia is a condition in which the visual perception of letters or numbers induces a specific colour sensation. In this study, we demonstrated that the apparent physical brightness of graphemes is modulated by the synaesthetic colours elicited by them. Synaesthetes first selected a synaesthetic colour corresponding to each capital letter and digit. Then, we selected a grapheme stimulus with a bright synaesthetic colour and one with a dark colour for each synaesthete. Finally, synaesthetes and non-synaesthete controls participated in a brightness judgment task, in which each participant judged the real brightness of each of the two stimuli compared to a standard stimulus. Compared to non-synaesthetes, synaesthetes judged a grapheme with a bright synaesthetic colour to be brighter than one with a dark synaesthetic colour, suggesting that the synaesthetic colour experience of synaesthetes alters their brightness perception. Such alteration in real brightness perception was observed both in those who experienced synaesthetic colours in external space (projector-type synaesthetes) and in those who experienced such colours ‘in the mind’s eye’ (associator-type synaesthetes). These results support the view that early visual processing is modulated by feedback transmitted from the V4 colour area, the neural activation of which accompanies synaesthetic colour experience.

Multivariate pattern analysis of fMRI data for imaginary and real colours in grapheme-colour synaesthesia

Grapheme-colour synaesthesia is a subjective phenomenon related to perception and imagination, in which some people involuntarily but systematically associate specific, idiosyncratic colours to achromatic letters or digits. Its investigation is relevant to unravel the neural correlates of colour perception in isolation from low-level neural processing of spectral components, as well as the neural correlates of imagination by being able to reliably trigger imaginary colour experiences. However, functional MRI studies using univariate analyses failed to provide univocal evidence of the activation of the "colour network" by synaesthesia. Applying multivariate (multivoxel) pattern analysis (MVPA) on 20 synaesthetes and 20 control participants, we tested whether the neural processing of real colours (concentric rings) and synaesthetic colours (black graphemes) shared patterns of activations. Region of interest analyses in retinotopically and anatomically defined visual areas revealed neither evidence of shared circuits for real and synaesthetic colour processing, nor processing difference between synaesthetes and controls. We also found no correlation with individual experiences, characterised by measuring the strength of synaesthetic associations. The whole brain searchlight analysis led to similar results. We conclude that revealing the neural coding of the synaesthetic experience of colours is a hard task which requires the improvement of our current methodology: for example involving more individuals and achieving higher MR signal to noise ratio and spatial resolution. So far, we have not found any evidence of the involvement of the cortical colour network in the subjective experience of synaesthetic colours.

Colours + Numbers differs from colours of numbers: cognitive and visual illusions in grapheme-colour synaesthesia

This study investigates the bi-directionality of synaestesic experience by means of a flanked bisection paradigm in TT, a number-colour synaesthete. Previous studies have shown that bisection is shifted towards the larger digit flanker (e.g., Ranzini & Girelli, 2012). TT and controls performed line bisections with lines flanked by black digits (experiment 1), by TT's photism colours (experiment 2), and by congruently (experiment 3), or incongruently coloured digits (experiment 4). While the results of the control group mainly replicated previous findings, only the colour-digit congruence elicited in TT the larger-digit bias. TT's absence of effects in the other conditions was not due to reduced sensitivity to luminance effects (experiment 5), or to mathematical expertise (experiment 6). We suggest that grapheme-colour synaesthesia might be characterised by a rigid access to semantic representation when the inducer is task-irrelevant.

Gray Bananas and a Red Letter A - From Synesthetic Sensation to Memory Colors

Grapheme-color synesthesia is a condition in which objectively achromatic graphemes induce concurrent color experiences. While it was long thought that the colors emerge during perception, there is growing support for the view that colors are integral to synesthetes' cognitive representations of graphemes. In this work, we review evidence for two opposing theories positing either a perceptual or cognitive origin of concurrent colors: the cross-activation theory and the conceptual-mediation model. The review covers results on inducer and concurrent color processing as well as findings concerning the brain structure and grapheme-color mappings in synesthetes and trained mappings in nonsynesthetes. The results support different aspects of both theories. Finally, we discuss how research on memory colors could provide a new perspective in the debate about the level of processing at which the synesthetic colors occur.

Rare variants in axonogenesis genes connect three families with sound-color synesthesia

Synesthesia is a rare nonpathological phenomenon where stimulation of one sense automatically provokes a secondary perception in another. Hypothesized to result from differences in cortical wiring during development, synesthetes show atypical structural and functional neural connectivity, but the underlying molecular mechanisms are unknown. The trait also appears to be more common among people with autism spectrum disorder and savant abilities. Previous linkage studies searching for shared loci of large effect size across multiple families have had limited success. To address the critical lack of candidate genes, we applied whole-exome sequencing to three families with sound-color (auditory-visual) synesthesia affecting multiple relatives across three or more generations. We identified rare genetic variants that fully cosegregate with synesthesia in each family, uncovering 37 genes of interest. Consistent with reports indicating genetic heterogeneity, no variants were shared across families. Gene ontology analyses highlighted six genes-COL4A1, ITGA2, MYO10, ROBO3, SLC9A6, and SLIT2-associated with axonogenesis and expressed during early childhood when synesthetic associations are formed. These results are consistent with neuroimaging-based hypotheses about the role of hyperconnectivity in the etiology of synesthesia and offer a potential entry point into the neurobiology that organizes our sensory experiences.