Inside a synesthete's head: a functional connectivity analysis with grapheme-color synesthetes

A single case neuroimaging study of tickertape synesthesia

Reading acquisition is enabled by deep changes in the brain's visual system and language areas, and in the links subtending their collaboration. Disruption of those plastic processes commonly results in developmental dyslexia. However, atypical development of reading mechanisms may occasionally result in ticker-tape synesthesia (TTS), a condition described by Francis Galton in 1883 wherein individuals "see mentally in print every word that is uttered (…) as from a long imaginary strip of paper". While reading is the bottom-up translation of letters into speech, TTS may be viewed as its opposite, the top-down translation of speech into internally visualized letters. In a series of functional MRI experiments, we studied MK, a man with TTS. We showed that a set of left-hemispheric areas were more active in MK than in controls during the perception of normal than reversed speech, including frontoparietal areas involved in speech processing, and the Visual Word Form Area, an occipitotemporal region subtending orthography. Those areas were identical to those involved in reading, supporting the construal of TTS as upended reading. Using dynamic causal modeling, we further showed that, parallel to reading, TTS induced by spoken words and pseudowords relied on top-down flow of information along distinct lexical and phonological routes, involving the middle temporal and supramarginal gyri, respectively. Future studies of TTS should shed new light on the neurodevelopmental mechanisms of reading acquisition, their variability and their disorders.

Audiovisual Simultaneity Judgements in Synaesthesia

Synaesthesia is a multimodal phenomenon in which the activation of one sensory modality leads to an involuntary additional experience in another sensory modality. To date, normal multisensory processing has hardly been investigated in synaesthetes. In the present study we examine processes of audiovisual separation in synaesthesia by using a simultaneity judgement task. Subjects were asked to indicate whether an acoustic and a visual stimulus occurred simultaneously or not. Stimulus onset asynchronies (SOA) as well as the temporal order of the stimuli were systematically varied. Our results demonstrate that synaesthetes are better in separating auditory and visual events than control subjects, but only when vision leads.

A case of co-occuring synesthesia, autism, prodigious talent and strong structural brain connectivity

BACKGROUND

Synesthesia is a sensory phenomenon where certain domain-specific stimuli trigger additional sensations of e.g. color or texture. The condition occurs in about 4% of the general population, but is overrepresented in individuals with Autism Spectrum Disorder (ASD), where it might also be associated with the presence of prodigious talents.

CASE PRESENTATION

Here we describe the case of a young transsexual man with Asperger Syndrome, synesthesia and a prodigious talent for foreign language acquisition. In our case, not only letters, numbers, spoken words, music, noises, weekdays and months lead to highly consistent, vivid color sensations but also his own and others' emotions, geometric shapes, any mathematical symbol, and letters from an unfamiliar alphabet (Hebrew). These color associations seem to aid categorization, differentiation and storage of information and might thereby contribute to the young man's language acquisition ability. We investigated the young man's structural brain connectivity in comparison to adults with or without ASD, applying global fiber tracking to diffusion-weighted Magnetic Resonance Imaging (MRI) data. The case presented with increased connectivity, especially between regions involved in visual and emotion processing, memory, and higher order associative binding regions. An electroencephalography experiment investigating synesthetic color and shape sensations while listening to music showed a negligible occipital alpha suppression, indicating that these internally generated synesthetic sensations derive from a different brain mechanism than when processing external visual information.

CONCLUSIONS

Taken together, this case study endorses the notion of a link between synesthesia, prodigious talent and autism, adding to the currently still sparse literature in this field. It provides new insights into the possible manifestations of synesthesia in individuals with ASD and its potential contribution to prodigious talents in people with an otherwise unexceptional cognitive profile. Additionally, this case impressively illustrates how synesthesia can be a key element not only of sensory perception but also social and emotional processing and contributes to existing evidence of increased brain connectivity in association with synesthesia.

Echoes from the past: synaesthetic colour associations reflect childhood gender stereotypes

Grapheme-colour synaesthesia is a neurological phenomenon in which linguistic symbols evoke consistent colour sensations. Synaesthesia is believed to be influenced by both genetic and environmental factors, but how these factors interact to create specific associations in specific individuals is poorly understood. In this paper, we show that a grapheme-colour association in adult synaesthetes can be traced to a particular environmental effect at a particular moment in childhood. We propose a model in which specific grapheme-colour associations are 'locked in' during development in children predisposed to become synaesthetes, whereas grapheme-colour associations remain flexible in non-synaesthetes. We exploit Western gender-colour stereotypes to test our model: we found that young girls in general tend to associate their first initial with the colour pink. Consistent with our model, adult female synaesthetes are influenced by their childhood environment: they associate their first initial with pink. Adult female non-synaesthetes do not show this bias. Instead, in our study, non-synaesthetes tended to associate their first initial with their current favourite colour. The results thus support the 'locking in' model of synaesthesia, suggesting that synaesthetic associations can be used as a 'time capsule', revealing childhood influences on adult linguistic associations. Grapheme-colour synaesthesia may thus offer an extraordinary opportunity to study linguistic development. This article is part of a discussion meeting issue 'Bridging senses: novel insights from synaesthesia'.

Reduced Visual and Frontal Cortex Activation During Visual Working Memory in Grapheme-Color Synaesthetes Relative to Young and Older Adults

The sensory recruitment model envisages visual working memory (VWM) as an emergent property that is encoded and maintained in sensory (visual) regions. The model implies that enhanced sensory-perceptual functions, as in synaesthesia, entail a dedicated VWM-system, showing reduced visual cortex activity as a result of neural specificity. By contrast, sensory-perceptual decline, as in old age, is expected to show enhanced visual cortex activity as a result of neural broadening. To test this model, young grapheme-color synaesthetes, older adults and young controls engaged in a delayed pair-associative retrieval and a delayed matching-to-sample task, consisting of achromatic fractal stimuli that do not induce synaesthesia. While a previous analysis of this dataset (Pfeifer et al., 2016) has focused on cued retrieval and recognition of pair-associates (i.e., long-term memory), the current study focuses on visual working memory and considers, for the first time, the crucial delay period in which no visual stimuli are present, but working memory processes are engaged. Participants were trained to criterion and demonstrated comparable behavioral performance on VWM tasks. Whole-brain and region-of-interest-analyses revealed significantly lower activity in synaesthetes’ middle frontal gyrus and visual regions (cuneus, inferior temporal cortex), respectively, suggesting greater neural efficiency relative to young and older adults in both tasks. The results support the sensory recruitment model and can explain age and individual WM-differences based on neural specificity in visual cortex.

Assessing Lateral Interaction in the Synesthetic Visual Brain

In grapheme-color synesthesia, letters and numbers evoke abnormal colored perceptions. Although the underlying mechanisms are not known, it is largely thought that the synesthetic brain is characterized by atypical connectivity throughout various brain regions, including the visual areas. To study the putative impact of synesthesia on the visual brain, we assessed lateral interactions (i.e., local functional connectivity between neighboring neurons in the visual cortex) by recording steady-state visual evoked potentials (ssVEPs) over the occipital region in color-grapheme synesthetes (n = 6) and controls (n = 21) using the windmill/dartboard paradigm. Discrete Fourier Transform analysis was conducted to extract the fundamental frequency and the second harmonics of ssVEP responses from contrast-reversing stimuli presented at 4.27 Hz. Lateral interactions were assessed using two amplitude-based indices: Short-range and long-range lateral interactions. Results indicated that synesthetes had a statistically weaker signal coherence of the fundamental frequency component compared to the controls, but no group differences were observed on lateral interaction indices. However, a significant correlation was found between long-range lateral interactions and the type of synesthesia experience (projector versus associator). We conclude that the occipital activity related to lateral interactions in synesthetes does not substantially differ from that observed in controls. Further investigation is needed to understand the impact of synesthesia on visual processing, specifically in relation to subjective experiences of synesthete individuals.

Gray Bananas and a Red Letter A - From Synesthetic Sensation to Memory Colors

Grapheme-color synesthesia is a condition in which objectively achromatic graphemes induce concurrent color experiences. While it was long thought that the colors emerge during perception, there is growing support for the view that colors are integral to synesthetes' cognitive representations of graphemes. In this work, we review evidence for two opposing theories positing either a perceptual or cognitive origin of concurrent colors: the cross-activation theory and the conceptual-mediation model. The review covers results on inducer and concurrent color processing as well as findings concerning the brain structure and grapheme-color mappings in synesthetes and trained mappings in nonsynesthetes. The results support different aspects of both theories. Finally, we discuss how research on memory colors could provide a new perspective in the debate about the level of processing at which the synesthetic colors occur.

Top-down signal transmission and global hyperconnectivity in auditory-visual synesthesia: Evidence from a functional EEG resting-state study

Auditory-visual (AV) synesthesia is a rare phenomenon in which an auditory stimulus induces a "concurrent" color sensation. Current neurophysiological models of synesthesia mainly hypothesize "hyperconnected" and "hyperactivated" brains, but differ in the directionality of signal transmission. The two-stage model proposes bottom-up signal transmission from inducer- to concurrent- to higher-order brain areas, whereas the disinhibited feedback model postulates top-down signal transmission from inducer- to higher-order- to concurrent brain areas. To test the different models of synesthesia, we estimated local current density, directed and undirected connectivity patterns in the intracranial space during 2 min of resting-state (RS) EEG in 11 AV synesthetes and 11 nonsynesthetes. AV synesthetes demonstrated increased parietal theta, alpha, and lower beta current density compared to nonsynesthetes. Furthermore, AV synesthetes were characterized by increased top-down signal transmission from the superior parietal lobe to the left color processing area V4 in the upper beta frequency band. Analyses of undirected connectivity revealed a global, synesthesia-specific hyperconnectivity in the alpha frequency band. The involvement of the superior parietal lobe even during rest is a strong indicator for its key role in AV synesthesia. By demonstrating top-down signal transmission in AV synesthetes, we provide direct support for the disinhibited feedback model of synesthesia. Finally, we suggest that synesthesia is a consequence of global hyperconnectivity. Hum Brain Mapp 39:522-531, 2018. © 2017 Wiley Periodicals, Inc.

Color Processing in Synesthesia: What Synesthesia Can and Cannot Tell Us About Mechanisms of Color Processing

Synesthetic experiences of color have been traditionally conceptualized as a perceptual phenomenon. However, recent evidence suggests a role of higher order cognition in the formation of synesthetic experiences. Here, we discuss how synesthetic experiences of color differ from and influence veridical color processing, and how non-perceptual processes such as imagery and color memory might play a role in eliciting synesthetic color experience.

Synesthesia strengthens sound-symbolic cross-modal correspondences

Synesthesia is a phenomenon in which an experience in one domain is accompanied by an involuntary secondary experience in another, unrelated domain; in classical synesthesia, these associations are arbitrary and idiosyncratic. Cross-modal correspondences refer to universal associations between seemingly unrelated sensory features, e.g., auditory pitch and visual size. Some argue that these phenomena form a continuum, with classical synesthesia being an exaggeration of universal cross-modal correspondences, whereas others contend that the two are quite different, since cross-modal correspondences are non-arbitrary, non-idiosyncratic, and do not involve secondary experiences. Here, we used the implicit association test to compare synesthetes' and non-synesthetes' sensitivity to cross-modal correspondences. We tested the associations between auditory pitch and visual elevation, auditory pitch and visual size, and sound-symbolic correspondences between auditory pseudowords and visual shapes. Synesthetes were more sensitive than non-synesthetes to cross-modal correspondences involving sound-symbolic, but not low-level sensory, associations. We conclude that synesthesia heightens universally experienced cross-modal correspondences, but only when these involve sound symbolism. This is only partly consistent with the idea of a continuum between synesthesia and cross-modal correspondences, but accords with the idea that synesthesia is a high-level, post-perceptual phenomenon, with spillover of the abilities of synesthetes into domains outside their synesthesias. To our knowledge, this is the first demonstration that synesthetes, relative to non-synesthetes, experience stronger cross-modal correspondences outside their synesthetic domains.

The Merit of Synesthesia for Consciousness Research

Synesthesia is a phenomenon in which additional perceptual experiences are elicited by sensory stimuli or cognitive concepts. Synesthetes possess a unique type of phenomenal experiences not directly triggered by sensory stimulation. Therefore, for better understanding of consciousness it is relevant to identify the mental and physiological processes that subserve synesthetic experience. In the present work we suggest several reasons why synesthesia has merit for research on consciousness. We first review the research on the dynamic and rapidly growing field of the studies of synesthesia. We particularly draw attention to the role of semantics in synesthesia, which is important for establishing synesthetic associations in the brain. We then propose that the interplay between semantics and sensory input in synesthesia can be helpful for the study of the neural correlates of consciousness, especially when making use of ambiguous stimuli for inducing synesthesia. Finally, synesthesia-related alterations of brain networks and functional connectivity can be of merit for the study of consciousness.

A critical review of the neuroimaging literature on synesthesia

Synesthesia refers to additional sensations experienced by some people for specific stimulations, such as the systematic arbitrary association of colors to letters for the most studied type. Here, we review all the studies (based mostly on functional and structural magnetic resonance imaging) that have searched for the neural correlates of this subjective experience, as well as structural differences related to synesthesia. Most differences claimed for synesthetes are unsupported, due mainly to low statistical power, statistical errors, and methodological limitations. Our critical review therefore casts some doubts on whether any neural correlate of the synesthetic experience has been established yet. Rather than being a neurological condition (i.e., a structural or functional brain anomaly), synesthesia could be reconsidered as a special kind of childhood memory, whose signature in the brain may be out of reach with present brain imaging techniques.

Statistical inferences under the Null hypothesis: common mistakes and pitfalls in neuroimaging studies

Published studies using functional and structural MRI include many errors in the way data are analyzed and conclusions reported. This was observed when working on a comprehensive review of the neural bases of synesthesia, but these errors are probably endemic to neuroimaging studies. All studies reviewed had based their conclusions using Null Hypothesis Significance Tests (NHST). NHST have yet been criticized since their inception because they are more appropriate for taking decisions related to a Null hypothesis (like in manufacturing) than for making inferences about behavioral and neuronal processes. Here I focus on a few key problems of NHST related to brain imaging techniques, and explain why or when we should not rely on "significance" tests. I also observed that, often, the ill-posed logic of NHST was even not correctly applied, and describe what I identified as common mistakes or at least problematic practices in published papers, in light of what could be considered as the very basics of statistical inference. MRI statistics also involve much more complex issues than standard statistical inference. Analysis pipelines vary a lot between studies, even for those using the same software, and there is no consensus which pipeline is the best. I propose a synthetic view of the logic behind the possible methodological choices, and warn against the usage and interpretation of two statistical methods popular in brain imaging studies, the false discovery rate (FDR) procedure and permutation tests. I suggest that current models for the analysis of brain imaging data suffer from serious limitations and call for a revision taking into account the "new statistics" (confidence intervals) logic.

Associative memory advantage in grapheme-color synesthetes compared to older, but not young adults

People with grapheme-color synesthesia perceive enriched experiences of colors in response to graphemes (letters, digits). In this study, we examined whether these synesthetes show a generic associative memory advantage for stimuli that do not elicit a synesthetic color. We used a novel between group design (14 young synesthetes, 14 young, and 14 older adults) with a self-paced visual associative learning paradigm and subsequent retrieval (immediate and delayed). Non-synesthesia inducing, achromatic fractal pair-associates were manipulated in visual similarity (high and low) and corresponded to high and low memory load conditions. The main finding was a learning and retrieval advantage of synesthetes relative to older, but not to younger, adults. Furthermore, the significance testing was supported with effect size measures and power calculations. Differences between synesthetes and older adults were found during dissimilar pair (high memory load) learning and retrieval at immediate and delayed stages. Moreover, we found a medium size difference between synesthetes and young adults for similar pair (low memory load) learning. Differences between young and older adults were also observed during associative learning and retrieval, but were of medium effect size coupled with low power. The results show a subtle associative memory advantage in synesthetes for non-synesthesia inducing stimuli, which can be detected against older adults. They also indicate that perceptual mechanisms (enhanced in synesthesia, declining as part of the aging process) can translate into a generic associative memory advantage, and may contribute to associative deficits accompanying healthy aging.

The effects of psilocybin and MDMA on between-network resting state functional connectivity in healthy volunteers

Perturbing a system and observing the consequences is a classic scientific strategy for understanding a phenomenon. Psychedelic drugs perturb consciousness in a marked and novel way and thus are powerful tools for studying its mechanisms. In the present analysis, we measured changes in resting-state functional connectivity (RSFC) between a standard template of different independent components analysis (ICA)-derived resting state networks (RSNs) under the influence of two different psychoactive drugs, the stimulant/psychedelic hybrid, MDMA, and the classic psychedelic, psilocybin. Both were given in placebo-controlled designs and produced marked subjective effects, although reports of more profound changes in consciousness were given after psilocybin. Between-network RSFC was generally increased under psilocybin, implying that networks become less differentiated from each other in the psychedelic state. Decreased RSFC between visual and sensorimotor RSNs was also observed. MDMA had a notably less marked effect on between-network RSFC, implying that the extensive changes observed under psilocybin may be exclusive to classic psychedelic drugs and related to their especially profound effects on consciousness. The novel analytical approach applied here may be applied to other altered states of consciousness to improve our characterization of different conscious states and ultimately advance our understanding of the brain mechanisms underlying them.

Achromatic synesthesias - a functional magnetic resonance imaging study

Grapheme-color synesthetes experience consistent, automatic and idiosyncratic colors associated with specific letters and numbers. Frequently, these specific associations exhibit achromatic synesthetic qualities (e.g. white, black or gray). In this study, we have investigated for the first time the neural basis of achromatic synesthesias, their relationship to chromatic synesthesias and the achromatic congruency effect in order to understand not only synesthetic color but also other components of the synesthetic experience. To achieve this aim, functional magnetic resonance imaging experiments were performed in a group of associator grapheme-color synesthetes and matched controls who were stimulated with real chromatic and achromatic stimuli (Mondrians), and with letters and numbers that elicited different types of grapheme-color synesthesias (i.e. chromatic and achromatic inducers which elicited chromatic but also achromatic synesthesias, as well as congruent and incongruent ones). The information derived from the analysis of Mondrians and chromatic/achromatic synesthesias suggests that real and synesthetic colors/achromaticity do not fully share neural mechanisms. The whole-brain analysis of BOLD signals in response to the complete set of synesthetic inducers revealed that the functional peculiarities of the synesthetic brain are distributed, and reflect different components of the synesthetic experience: a perceptual component, an (attentional) feature binding component, and an emotional component. Additionally, the inclusion of achromatic experiences has provided new evidence in favor of the emotional binding theory, a line of interpretation which constitutes a bridge between grapheme-color synesthesia and other developmental modalities of the phenomenon.

The role of conceptual knowledge in understanding synaesthesia: Evaluating contemporary findings from a "hub-and-spokes" perspective

Synesthesia is a phenomenon in which stimulation in one sensory modality triggers involuntary experiences typically not associated with that stimulation. Inducing stimuli (inducers) and synesthetic experiences (concurrents) may occur within the same modality (e.g., seeing colors while reading achromatic text) or span across different modalities (e.g., tasting flavors while listening to music). Although there has been considerable progress over the last decade in understanding the cognitive and neural mechanisms of synesthesia, the focus of current neurocognitive models of synesthesia does not encompass many crucial psychophysical characteristics documented in behavioral research. Prominent theories of the neurophysiological basis of synesthesia construe it as a perceptual phenomenon and hence focus primarily on the modality-specific brain regions for perception. Many behavioral studies, however, suggest an essential role for conceptual-level information in synesthesia. For example, there is evidence that synesthetic experience arises subsequent to identification of an inducing stimulus, differs substantially from real perceptual events, can be akin to perceptual memory, and is susceptible to lexical/semantic contexts. These data suggest that neural mechanisms lying beyond the realm of the perceptual cortex (especially the visual system), such as regions subserving conceptual knowledge, may play pivotal roles in the neural architecture of synesthesia. Here we discuss the significance of non-perceptual mechanisms that call for a re-evaluation of the emphasis on synesthesia as a perceptual phenomenon. We also review recent studies which hint that some aspects of synesthesia resemble our general conceptual knowledge for object attributes, at both psychophysical and neural levels. We then present a conceptual-mediation model of synesthesia in which the inducer and concurrent are linked within a conceptual-level representation. This “inducer-to-concurrent” nexus is maintained within a supramodal “hub,” while the subjective (bodily) experience of its resultant concurrent (e.g., a color) may then require activation of “spokes” in the perception-related cortices. This hypothesized “hub-and-spoke” structure would engage a distributed network of cortical regions and may account for the full breadth of this intriguing phenomenon.

N1 enhancement in synesthesia during visual and audio-visual perception in semantic cross-modal conflict situations: an ERP study

Synesthesia entails a special kind of sensory perception, where stimulation in one sensory modality leads to an internally generated perceptual experience of another, not stimulated sensory modality. This phenomenon can be viewed as an abnormal multisensory integration process as here the synesthetic percept is aberrantly fused with the stimulated modality. Indeed, recent synesthesia research has focused on multimodal processing even outside of the specific synesthesia-inducing context and has revealed changed multimodal integration, thus suggesting perceptual alterations at a global level. Here, we focused on audio–visual processing in synesthesia using a semantic classification task in combination with visually or auditory–visually presented animated and in animated objects in an audio–visual congruent and incongruent manner. Fourteen subjects with auditory-visual and/or grapheme-color synesthesia and 14 control subjects participated in the experiment. During presentation of the stimuli, event-related potentials were recorded from 32 electrodes. The analysis of reaction times and error rates revealed no group differences with best performance for audio-visually congruent stimulation indicating the well-known multimodal facilitation effect. We found enhanced amplitude of the N1 component over occipital electrode sites for synesthetes compared to controls. The differences occurred irrespective of the experimental condition and therefore suggest a global influence on early sensory processing in synesthetes.

Is synesthesia more common in patients with Asperger syndrome?

There is increasing evidence from case reports that synesthesia is more common in individuals with autism spectrum conditions (ASC). Further, genes related to synesthesia have also been found to be linked to ASC and, similar to synaesthetes, individuals with ASC show altered brain connectivity and unusual brain activation during sensory processing. However, up to now a systematic investigation of whether synesthesia is more common in ASC patients is missing. The aim of the current pilot study was to test this hypothesis by investigating a group of patients diagnosed with Asperger Syndrome (AS) using questionnaires and standard consistency tests in order to classify them as grapheme-color synaesthetes. The results indicate that there are indeed many more grapheme-color synaesthetes among AS patients. This finding is discussed in relation to different theories regarding the development of synesthesia as well as altered sensory processing in autism.