Controlled semantic summation correlates with intrinsic connectivity between default mode and control networks

Semantic memory structure mediates the role of brain functional connectivity in creative writing

Associative theories of creativity posit that high-creativity individuals possess flexible semantic memory structures that allow broad access to varied information. However, the semantic memory structure characteristics and neural substrates of creative writing are unclear. Here, we explored the semantic network features and the predictive whole-brain functional connectivity associated with creative writing and generated mediation models. Participants completed two creative story continuation tasks. We found that keywords from written texts with superior creative writing performance encompassed more semantic categories and were highly interconnected and transferred efficiently. Connectome predictive modeling (CPM) was conducted with resting-state functional magnetic resonance imaging (fMRI) data to identify whole-brain functional connectivity patterns related to creative writing, dominated by default mode network (DMN). Semantic network features were found to mediate the relationship between brain functional connectivity and creative writing performance. These results highlight how semantic memory structure and the DMN-driven brain functional connectivity patterns support creative writing performance. Our findings extend prior research on the role of semantic memory structure and the DMN in creativity, expand upon previous research on semantic creativity, and provide insight into the cognitive and neural foundations of creative writing.

A double dissociation between semantic and spatial cognition in visual to default network pathways

Processing pathways between sensory and default mode network (DMN) regions support recognition, navigation, and memory but their organisation is not well understood. We show that functional subdivisions of visual cortex and DMN sit at opposing ends of parallel streams of information processing that support visually mediated semantic and spatial cognition, providing convergent evidence from univariate and multivariate task responses, intrinsic functional and structural connectivity. Participants learned virtual environments consisting of buildings populated with objects, drawn from either a single semantic category or multiple categories. Later, they made semantic and spatial context decisions about these objects and buildings during functional magnetic resonance imaging. A lateral ventral occipital to fronto-temporal DMN pathway was primarily engaged by semantic judgements, while a medial visual to medial temporal DMN pathway supported spatial context judgements. These pathways had distinctive locations in functional connectivity space: the semantic pathway was both further from unimodal systems and more balanced between visual and auditory-motor regions compared with the spatial pathway. When semantic and spatial context information could be integrated (in buildings containing objects from a single category), regions at the intersection of these pathways responded, suggesting that parallel processing streams interact at multiple levels of the cortical hierarchy to produce coherent memory-guided cognition.

Mapping patterns of thought onto brain activity during movie-watching

Movie-watching is a central aspect of our lives and an important paradigm for understanding the brain mechanisms behind cognition as it occurs in daily life. Contemporary views of ongoing thought argue that the ability to make sense of events in the 'here and now' depend on the neural processing of incoming sensory information by auditory and visual cortex, which are kept in check by systems in association cortex. However, we currently lack an understanding of how patterns of ongoing thoughts map onto the different brain systems when we watch a film, partly because methods of sampling experience disrupt the dynamics of brain activity and the experience of movie-watching. Our study established a novel method for mapping thought patterns onto the brain activity that occurs at different moments of a film, which does not disrupt the time course of brain activity or the movie-watching experience. We found moments when experience sampling highlighted engagement with multi-sensory features of the film or highlighted thoughts with episodic features, regions of sensory cortex were more active and subsequent memory for events in the movie was better-on the other hand, periods of intrusive distraction emerged when activity in regions of association cortex within the frontoparietal system was reduced. These results highlight the critical role sensory systems play in the multi-modal experience of movie-watching and provide evidence for the role of association cortex in reducing distraction when we watch films.

Neural correlates of audiovisual narrative speech perception in children and adults on the autism spectrum: A functional magnetic resonance imaging study

Autistic individuals show substantially reduced benefit from observing visual articulations during audiovisual speech perception, a multisensory integration deficit that is particularly relevant to social communication. This has mostly been studied using simple syllabic or word-level stimuli and it remains unclear how altered lower-level multisensory integration translates to the processing of more complex natural multisensory stimulus environments in autism. Here, functional neuroimaging was used to examine neural correlates of audiovisual gain (AV-gain) in 41 autistic individuals to those of 41 age-matched non-autistic controls when presented with a complex audiovisual narrative. Participants were presented with continuous narration of a story in auditory-alone, visual-alone, and both synchronous and asynchronous audiovisual speech conditions. We hypothesized that previously identified differences in audiovisual speech processing in autism would be characterized by activation differences in brain regions well known to be associated with audiovisual enhancement in neurotypicals. However, our results did not provide evidence for altered processing of auditory alone, visual alone, audiovisual conditions or AV- gain in regions associated with the respective task when comparing activation patterns between groups. Instead, we found that autistic individuals responded with higher activations in mostly frontal regions where the activation to the experimental conditions was below baseline (de-activations) in the control group. These frontal effects were observed in both unisensory and audiovisual conditions, suggesting that these altered activations were not specific to multisensory processing but reflective of more general mechanisms such as an altered disengagement of Default Mode Network processes during the observation of the language stimulus across conditions.

Ventral and dorsal aspects of the inferior frontal-occipital fasciculus support verbal semantic access and visually-guided behavioural control

The Inferior Frontal Occipital Fasciculus (IFOF) is a major anterior-to-posterior white matter pathway in the ventral human brain that connects parietal, temporal and occipital regions to frontal cortex. It has been implicated in a range of functions, including language, semantics, inhibition and the control of action. The recent research shows that the IFOF can be sub-divided into a ventral and dorsal branch, but the functional relevance of this distinction, as well as any potential hemispheric differences, are poorly understood. Using DTI tractography, we investigated the involvement of dorsal and ventral subdivisions of the IFOF in the left and right hemisphere in a response inhibition task (Go/No-Go), where the decision to respond or to withhold a prepotent response was made on the basis of semantic or non-semantic aspects of visual inputs. The task also varied the presentation modality (whether concepts were presented as written words or images). The results showed that the integrity of both dorsal and ventral IFOF in the left hemisphere were associated with participants' inhibition performance when the signal to stop was meaningful and presented in the verbal modality. This effect was absent in the right hemisphere. The integrity of dorsal IFOF was also associated with participants' inhibition efficiency in difficult perceptually guided decisions. This pattern of results indicates that left dorsal IFOF is implicated in the domain-general control of visually-guided behaviour, while the left ventral branch might interface with the semantic system to support the control of action when the inhibitory signal is based on meaning.

Time course of EEG power during creative problem-solving with insight or remote thinking

Problem-solving often requires creativity and is critical in everyday life. However, the neurocognitive mechanisms underlying creative problem-solving remain poorly understood. Two mechanisms have been highlighted: the formation of new connections among problem elements and insight solving, characterized by sudden realization of a solution. In this study, we investigated EEG activity during a modified version of the remote associates test, a classical insight problem task that requires finding a word connecting three unrelated words. This allowed us to explore the brain correlates associated with the semantic remoteness of connections (by varying the remoteness of the solution word across trials) and with insight solving (identified as a Eurêka moment reported by the participants). Semantic remoteness was associated with power increase in the alpha band (8-12 Hz) in a left parieto-temporal cluster, the beta band (13-30 Hz) in a right fronto-temporal cluster in the early phase of the task, and the theta band (3-7 Hz) in a bilateral frontal cluster just prior to participants' responses. Insight solving was associated with power increase preceding participants' responses in the alpha and gamma (31-60 Hz) bands in a left temporal cluster and the theta band in a frontal cluster. Source reconstructions revealed the brain regions associated with these clusters. Overall, our findings shed new light on some of the mechanisms involved in creative problem-solving.

Creativity in verbal associations is linked to semantic control

Although memory is known to play a key role in creativity, previous studies have not isolated the critical component processes and networks. We asked participants to generate links between words that ranged from strongly related to completely unrelated in long-term memory, delineating the neurocognitive processes that underpin more unusual versus stereotypical patterns of retrieval. More creative responses to strongly associated word-pairs were associated with greater engagement of episodic memory: in highly familiar situations, semantic, and episodic stores converge on the same information enabling participants to form a personal link between items. This pattern of retrieval was associated with greater engagement of core default mode network (DMN). In contrast, more creative responses to weakly associated word-pairs were associated with the controlled retrieval of less dominant semantic information and greater recruitment of the semantic control network, which overlaps with the dorsomedial subsystem of DMN. Although both controlled semantic and episodic patterns of retrieval are associated with activation within DMN, these processes show little overlap in activation. These findings demonstrate that controlled aspects of semantic cognition play an important role in verbal creativity.

An investigation of the cognitive and neural correlates of semantic memory search related to creative ability

Creative ideas likely result from searching and combining semantic memory knowledge, yet the mechanisms acting on memory to yield creative ideas remain unclear. Here, we identified the neurocognitive correlates of semantic search components related to creative abilities. We designed an associative fluency task based on polysemous words and distinguished two search components related to clustering and switching between the different meanings of the polysemous words. Clustering correlated with divergent thinking, while switching correlated with the ability to combine remote associates. Furthermore, switching correlated with semantic memory structure and executive abilities, and was predicted by connectivity between the default, control, and salience neural networks. In contrast, clustering relied on interactions between control, salience, and attentional neural networks. Our results suggest that switching captures interactions between memory structure and control processes guiding the search whereas clustering may capture attentional controlled processes for persistent search, and that alternations between exploratory search and focused attention support creativity.

Tasks activating the default mode network map multiple functional systems

Recent developments in network neuroscience suggest reconsidering what we thought we knew about the default mode network (DMN). Although this network has always been seen as unitary and associated with the resting state, a new deconstructive line of research is pointing out that the DMN could be divided into multiple subsystems supporting different functions. By now, it is well known that the DMN is not only deactivated by tasks, but also involved in affective, mnestic, and social paradigms, among others. Nonetheless, it is starting to become clear that the array of activities in which it is involved, might also be extended to more extrinsic functions. The present meta-analytic study is meant to push this boundary a bit further. The BrainMap database was searched for all experimental paradigms activating the DMN, and their activation likelihood estimation maps were then computed. An additional map of task-induced deactivations was also created. A multidimensional scaling indicated that such maps could be arranged along an anatomo-psychological gradient, which goes from midline core activations, associated with the most internal functions, to that of lateral cortices, involved in more external tasks. Further multivariate investigations suggested that such extrinsic mode is especially related to reward, semantic, and emotional functions. However, an important finding was that the various activation maps were often different from the canonical representation of the resting-state DMN, sometimes overlapping with it only in some peripheral nodes, and including external regions such as the insula. Altogether, our findings suggest that the intrinsic-extrinsic opposition may be better understood in the form of a continuous scale, rather than a dichotomy.

Brain connectivity-based prediction of real-life creativity is mediated by semantic memory structure

Associative theories of creativity argue that creative cognition involves the abilities to generate remote associations and make useful connections between unrelated concepts in one's semantic memory. Yet, whether and how real-life creative behavior relies on semantic memory structure and its neural substrates remains unclear. We acquired multi-echo functional magnetic resonance imaging data while participants underwent a semantic relatedness judgment task. These ratings were used to estimate their individual semantic memory networks, whose properties significantly predicted their real-life creativity. Using a connectome predictive modeling approach, we identified patterns of task-based functional connectivity that predicted creativity-related semantic memory network properties. Furthermore, these properties mediated the relationship between functional connectivity and real-life creativity. These results provide new insights into how brain connectivity patterns support real-life creative behavior via the structure of semantic memory. We also show how computational network science can be used to couple behavioral, cognitive, and neural levels of analysis.

OUP accepted manuscript

Working memory (WM) allows goal-relevant information to be encoded and maintained in mind, even when the contents of WM are incongruent with the immediate environment. While regions of heteromodal cortex are important for WM, the neural mechanisms that relate to individual differences in the encoding and maintenance of goal-relevant information remain unclear. Here, we used behavioral correlates of two large-scale heteromodal networks at rest, the default mode (DMN) and frontoparietal (FPN) networks, to understand their contributions to distinct features of WM. We assessed each individual’s ability to resist distracting information during the encoding and maintenance phases of a visuospatial WM task. Individuals with stronger connectivity of DMN with medial visual and retrosplenial cortex were less affected by encoding distraction. Conversely, weaker connectivity of both DMN and FPN with visual regions was associated with better WM performance when target information was no longer in the environment and distractors were presented in the maintenance phase. Our study suggests that stronger coupling between heteromodal cortex and visual–spatial regions supports WM encoding by reducing the influence of concurrently presented distractors, while weaker visual coupling is associated with better maintenance of goal-relevant information because it relates to the capacity to ignore task-irrelevant changes in the environment.

Intrinsic connectivity of left ventrolateral prefrontal cortex predicts individual differences in controlled semantic retrieval

Control processes allow us to constrain the retrieval of semantic information from long-term memory so that it is appropriate for the task or context. Control demands are influenced by the strength of the target information itself and by the circumstances in which it is retrieved, with more control needed when relatively weak aspects of knowledge are required and after the sustained retrieval of related concepts. To investigate the neurocognitive basis of individual differences in these aspects of semantic control, we used resting-state fMRI to characterise the intrinsic connectivity of left ventrolateral prefrontal cortex (VLPFC), implicated in controlled retrieval, and examined associations on a paced serial semantic task, in which participants were asked to detect category members amongst distractors. This task manipulated both the strength of target associations and the requirement to sustain retrieval within a narrow semantic category over time. We found that individuals with stronger connectivity between VLPFC and medial prefrontal cortex within the default mode network (DMN) showed better retrieval of strong associations (which are thought to be recalled more automatically). Stronger connectivity between the same VLPFC seed and another DMN region in medial parietal cortex was associated with larger declines in retrieval over the course of the category. In contrast, participants with stronger connectivity between VLPFC and cognitive control regions within the ventral attention network (VAN) had better controlled retrieval of weak associations and were better able to sustain their comprehension throughout the category. These effects overlapped in left insular cortex within the VAN, indicating that a common pattern of connectivity is associated with different aspects of controlled semantic retrieval induced by both the structure of long-term knowledge and the sustained retrieval of related information.

A tale of two gradients: differences between the left and right hemispheres predict semantic cognition

Decomposition of whole-brain functional connectivity patterns reveals a principal gradient that captures the separation of sensorimotor cortex from heteromodal regions in the default mode network (DMN). Functional homotopy is strongest in sensorimotor areas, and weakest in heteromodal cortices, suggesting there may be differences between the left and right hemispheres (LH/RH) in the principal gradient, especially towards its apex. This study characterised hemispheric differences in the position of large-scale cortical networks along the principal gradient, and their functional significance. We collected resting-state fMRI and semantic, working memory and non-verbal reasoning performance in 175 + healthy volunteers. We then extracted the principal gradient of connectivity for each participant, tested which networks showed significant hemispheric differences on the gradient, and regressed participants’ behavioural efficiency in tasks outside the scanner against interhemispheric gradient differences for each network. LH showed a higher overall principal gradient value, consistent with its role in heteromodal semantic cognition. One frontotemporal control subnetwork was linked to individual differences in semantic cognition: when it was nearer heteromodal DMN on the principal gradient in LH, participants showed more efficient semantic retrieval—and this network also showed a strong hemispheric difference in response to semantic demands but not working memory load in a separate study. In contrast, when a dorsal attention subnetwork was closer to the heteromodal end of the principal gradient in RH, participants showed better visual reasoning. Lateralization of function may reflect differences in connectivity between control and heteromodal regions in LH, and attention and visual regions in RH.

Network Analysis of Human Brain Connectivity Reveals Neural Fingerprints of a Compositionality Bias in Signaling Systems

Compositionality is a hallmark of human language and other symbolic systems: a finite set of meaningful elements can be systematically combined to convey an open-ended array of ideas. Compositionality is not uniformly distributed over expressions in a language or over individuals' communicative behavior: at both levels, variation is observed. Here, we investigate the neural bases of interindividual variability by probing the relationship between intrinsic characteristics of brain networks and compositional behavior. We first collected functional resting-state and diffusion magnetic resonance imaging data from a large participant sample (N = 51). Subsequently, participants took part in two signaling games. They were instructed to learn and reproduce an auditory symbolic system of signals (tone sequences) associated with affective meanings (human faces expressing emotions). Signal-meaning mappings were artificial and had to be learned via repeated signaling interactions. We identified a temporoparietal network in which connection length was related to the degree of compositionality introduced in a signaling system by each player. Graph-theoretic analysis of resting-state functional connectivity revealed that, within that network, compositional behavior was associated with integration measures in 2 semantic hubs: the left posterior cingulate cortex and the left angular gyrus. Our findings link individual variability in compositional biases to variation in the anatomy of semantic networks and in the functional topology of their constituent units.

A meta-analysis of functional magnetic resonance imaging studies of divergent thinking using activation likelihood estimation

There are conflicting findings regarding brain regions and networks underpinning creativity, with divergent thinking tasks commonly used to study this. A handful of meta-analyses have attempted to synthesise findings on neural mechanisms of divergent thinking. With the rapid proliferation of research and recent developments in fMRI meta-analysis approaches, it is timely to reassess the regions activated during divergent thinking creativity tasks. Of particular interest is examining the evidence regarding large-scale brain networks proposed to be key in divergent thinking and extending this work to consider the role of the semantic control network. Studies utilising fMRI with healthy participants completing divergent thinking tasks were systematically identified, with 20 studies meeting the criteria. Activation Likelihood Estimation was then used to integrate the neuroimaging results across studies. This revealed four clusters: the left inferior parietal lobe; the left inferior frontal and precentral gyrus; the superior and medial frontal gyrus and the right cerebellum. These regions are key in the semantic network, important for flexible retrieval of stored knowledge, highlighting the role of this network in divergent thinking.

Intrinsic connectivity of anterior temporal lobe relates to individual differences in semantic retrieval for landmarks

Contemporary neuroscientific accounts suggest that ventral anterior temporal lobe (ATL) acts as a bilateral heteromodal semantic hub, which is particularly critical for the specific-level knowledge needed to recognise unique entities, such as familiar landmarks and faces. There may also be graded functional differences between left and right ATL, relating to effects of modality (linguistic versus non-linguistic) and category (e.g., knowledge of people and places). Individual differences in intrinsic connectivity from left and right ATL might be associated with variation in semantic categorisation performance across these categories and modalities. We recorded resting-state fMRI in 74 individuals and, in a separate session, examined semantic categorisation. People with greater connectivity between left and right ATL were more efficient at categorising landmarks (e.g., Eiffel Tower), especially when these were presented visually. In addition, participants who showed stronger connectivity from right than left ATL to medial occipital cortex showed more efficient semantic categorisation of landmarks regardless of modality of presentation. These results can be interpreted in terms of graded differences in the patterns of connectivity across left and right ATL, which give rise to a bilateral yet partially segregated semantic 'hub'. More specifically, right ATL connectivity supports the efficient semantic categorisation of landmarks.