spreadr: An R package to simulate spreading activation in a network

Using network science to examine audio-visual speech perception with a multi-layer graph

To examine visual speech perception (i.e., lip-reading), we created a multi-layer network (the AV-net) that contained: (1) an auditory layer with nodes representing phonological word-forms and edges connecting words that were phonologically related, and (2) a visual layer with nodes representing the viseme representations of words and edges connecting viseme representations that differed by a single viseme (and additional edges to connect related nodes in the two layers). The results of several computer simulations (in which activation diffused across the network to simulate word identification) are reported and compared to the performance of human participants who identified the same words in a condition in which audio and visual information were both presented (Simulation 1), in an audio-only presentation condition (Simulation 2), and a visual-only presentation condition (Simulation 3). Another simulation (Simulation 4) examined the influence of phonological information on visual speech perception by comparing performance in the multi-layer AV-net to a single-layer network that contained only a visual layer with nodes representing the viseme representations of words and edges connecting viseme representations that differed by a single viseme. We also report the results of several analyses of the errors made by human participants in the visual-only presentation condition. The results of our analyses have implications for future research and training of lip-reading, and for the development of automatic lip-reading devices and software for individuals with certain developmental or acquired disorders or for listeners with normal hearing in noisy conditions.

Cognitive modelling of concepts in the mental lexicon with multilayer networks: Insights, advancements, and future challenges

The mental lexicon is a complex cognitive system representing information about the words/concepts that one knows. Over decades psychological experiments have shown that conceptual associations across multiple, interactive cognitive levels can greatly influence word acquisition, storage, and processing. How can semantic, phonological, syntactic, and other types of conceptual associations be mapped within a coherent mathematical framework to study how the mental lexicon works? Here we review cognitive multilayer networks as a promising quantitative and interpretative framework for investigating the mental lexicon. Cognitive multilayer networks can map multiple types of information at once, thus capturing how different layers of associations might co-exist within the mental lexicon and influence cognitive processing. This review starts with a gentle introduction to the structure and formalism of multilayer networks. We then discuss quantitative mechanisms of psychological phenomena that could not be observed in single-layer networks and were only unveiled by combining multiple layers of the lexicon: (i) multiplex viability highlights language kernels and facilitative effects of knowledge processing in healthy and clinical populations; (ii) multilayer community detection enables contextual meaning reconstruction depending on psycholinguistic features; (iii) layer analysis can mediate latent interactions of mediation, suppression, and facilitation for lexical access. By outlining novel quantitative perspectives where multilayer networks can shed light on cognitive knowledge representations, including in next-generation brain/mind models, we discuss key limitations and promising directions for cutting-edge future research.

Using Complex Networks in the Hearing Sciences

In this Point of View, we review a number of recent discoveries from the emerging, interdisciplinary field of Network Science , which uses graph theoretic techniques to understand complex systems. In the network science approach, nodes represent entities in a system, and connections are placed between nodes that are related to each other to form a web-like network . We discuss several studies that demonstrate how the micro-, meso-, and macro-level structure of a network of phonological word-forms influence spoken word recognition in listeners with normal hearing and in listeners with hearing loss. Given the discoveries made possible by this new approach and the influence of several complex network measures on spoken word recognition performance we argue that speech recognition measures-originally developed in the late 1940s and routinely used in clinical audiometry-should be revised to reflect our current understanding of spoken word recognition. We also discuss other ways in which the tools of network science can be used in Speech and Hearing Sciences and Audiology more broadly.

Accumulating evidence for myriad alternatives: Modeling the generation of free association

The associative manner by which thoughts follow one another has intrigued scholars for decades. The process by which an association is generated in response to a cue can be explained by classic models of semantic processing through distinct computational mechanisms. Distributed attractor networks implement rich-get-richer dynamics and assume that stronger associations can be reached with fewer steps. Conversely, spreading activation models assume that a cue distributes its activation, in parallel, to all associations at a constant rate. Despite these models' huge influence, their intractability together with the unconstrained nature of free association have restricted their few previous uses to qualitative predictions. To test these computational mechanisms quantitatively, we conceptualize free association as the product of internal evidence accumulation and generate predictions concerning the speed and strength of people's associations. To this end, we first develop a novel approach to mapping the personalized space of words from which an individual chooses an association to a given cue. We then use state-of-the-art evidence accumulation models to demonstrate the function of rich-get-richer dynamics on the one hand and of stochasticity in the rate of spreading activation on the other hand, in preventing an exceedingly slow resolution of the competition among myriad potential associations. Furthermore, whereas our results uniformly indicate that stronger associations require less evidence, only in combination with rich-get-richer dynamics does this explain why weak associations are slow yet prevalent. We discuss implications for models of semantic processing and evidence accumulation and offer recommendations for practical applications and individual-differences research. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Neural evidence of switch processes during semantic and phonetic foraging in human memory

Humans may retrieve words from memory by exploring and exploiting in "semantic space" similar to how nonhuman animals forage for resources in physical space. This has been studied using the verbal fluency test (VFT), in which participants generate words belonging to a semantic or phonetic category in a limited time. People produce bursts of related items during VFT, referred to as "clustering" and "switching." The strategic foraging model posits that cognitive search behavior is guided by a monitoring process which detects relevant declines in performance and then triggers the searcher to seek a new patch or cluster in memory after the current patch has been depleted. An alternative body of research proposes that this behavior can be explained by an undirected rather than strategic search process, such as random walks with or without random jumps to new parts of semantic space. This study contributes to this theoretical debate by testing for neural evidence of strategically timed switches during memory search. Thirty participants performed category and letter VFT during functional MRI. Responses were classified as cluster or switch events based on computational metrics of similarity and participant evaluations. Results showed greater hippocampal and posterior cerebellar activation during switching than clustering, even while controlling for interresponse times and linguistic distance. Furthermore, these regions exhibited ramping activity which increased during within-patch search leading up to switches. Findings support the strategic foraging model, clarifying how neural switch processes may guide memory search in a manner akin to foraging in patchy spatial environments.

The Resilience of the Phonological Network May Have Implications for Developmental and Acquired Disorders

A central tenet of network science states that the structure of the network influences processing. In this study of a phonological network of English words we asked: how does damage alter the network structure (Study 1)? How does the damaged structure influence lexical processing (Study 2)? How does the structure of the intact network "protect" processing with a less efficient algorithm (Study 3)? In Study 1, connections in the network were randomly removed to increasingly damage the network. Various measures showed the network remained well-connected (i.e., it is resilient to damage) until ~90% of the connections were removed. In Study 2, computer simulations examined the retrieval of a set of words. The performance of the model was positively correlated with naming accuracy by people with aphasia (PWA) on the Philadelphia Naming Test (PNT) across four types of aphasia. In Study 3, we demonstrated another way to model developmental or acquired disorders by manipulating how efficiently activation spread through the network. We found that the structure of the network "protects" word retrieval despite decreases in processing efficiency; words that are relatively easy to retrieve with efficient transmission of priming remain relatively easy to retrieve with less efficient transmission of priming. Cognitive network science and computer simulations may provide insight to a wide range of speech, language, hearing, and cognitive disorders.

Semantic Memory and Creativity: The Costs and Benefits of Semantic Memory Structure in Generating Original Ideas

Despite its theoretical importance, little is known about how semantic memory structure facilitates and constrains creative idea production. We examine whether the semantic richness of a concept has both benefits and costs to creative idea production. Specifically, we tested whether cue set-size-an index of semantic richness reflecting the average number of elements associated with a given concept-impacts the quantity (fluency) and quality (originality) of responses generated during the alternate uses task (AUT). Across four studies, we show that low-association, sparse, AUT cues benefit originality at the cost of fluency compared to high-association, rich, AUT cues. Furthermore, we found an interaction with individual differences in fluid intelligence in the low-association AUT cues, suggesting that constraints of sparse semantic knowledge can be overcome with top-down intervention. The findings indicate that semantic richness differentially impacts the quality and quantity of generated ideas, and that cognitive control processes can facilitate idea production when conceptual knowledge is limited.

What Do Cognitive Networks Do? Simulations of Spoken Word Recognition Using the Cognitive Network Science Approach

Cognitive network science is an emerging approach that uses the mathematical tools of network science to map the relationships among representations stored in memory to examine how that structure might influence processing. In the present study, we used computer simulations to compare the ability of a well-known model of spoken word recognition, TRACE, to the ability of a cognitive network model with a spreading activation-like process to account for the findings from several previously published behavioral studies of language processing. In all four simulations, the TRACE model failed to retrieve a sufficient number of words to assess if it could replicate the behavioral findings. The cognitive network model successfully replicated the behavioral findings in Simulations 1 and 2. However, in Simulation 3a, the cognitive network did not replicate the behavioral findings, perhaps because an additional mechanism was not implemented in the model. However, in Simulation 3b, when the decay parameter in spreadr was manipulated to model this mechanism the cognitive network model successfully replicated the behavioral findings. The results suggest that models of cognition need to take into account the multi-scale structure that exists among representations in memory, and how that structure can influence processing.

Exploring How Phonotactic Knowledge Can Be Represented in Cognitive Networks

In Linguistics and Psycholinguistics, phonotactics refers to the constraints on individual sounds in a given language that restrict how those sounds can be ordered to form words in that language. Previous empirical work in Psycholinguistics demonstrated that phonotactic knowledge influenced how quickly and accurately listeners retrieved words from that part of memory known as the mental lexicon. In the present study, we used three computer simulations to explore how three different cognitive network architectures could account for the previously observed effects of phonotactics on processing. The results of Simulation 1 showed that some—but not all—effects of phonotactics could be accounted for in a network where nodes represent words and edges connect words that are phonologically related to each other. In Simulation 2, a different network architecture was used to again account for some—but not all—effects of phonotactics and phonological neighborhood density. A bipartite network was used in Simulation 3 to account for many of the previously observed effects of phonotactic knowledge on spoken word recognition. The value of using computer simulations to explore different network architectures is discussed.

Unveiling the nature of interaction between semantics and phonology in lexical access based on multilayer networks

An essential aspect of human communication is the ability to access and retrieve information from ones’ ‘mental lexicon’. This lexical access activates phonological and semantic components of concepts, yet the question whether and how these two components relate to each other remains widely debated. We harness tools from network science to construct a large-scale linguistic multilayer network comprising of phonological and semantic layers. We find that the links in the two layers are highly similar to each other and that adding information from one layer to the other increases efficiency by decreasing the network overall distances, but specifically affecting shorter distances. Finally, we show how a multilayer architecture demonstrates the highest efficiency, and how this efficiency relates to weak semantic relations between cue words in the network. Thus, investigating the interaction between the layers and the unique benefit of a linguistic multilayer architecture allows us to quantify theoretical cognitive models of lexical access.

A Critical Review of Network-Based and Distributional Approaches to Semantic Memory Structure and Processes

Some of the earliest work on understanding how concepts are organized in memory used a network-based approach, where words or concepts are represented as nodes, and relationships between words are represented by links between nodes. Over the past two decades, advances in network science and graph theoretical methods have led to the development of computational semantic networks. This review provides a modern perspective on how computational semantic networks have proven to be useful tools to investigate the structure of semantic memory as well as search and retrieval processes within semantic memory, to ultimately model performance in a wide variety of cognitive tasks. Regarding representation, the review focuses on the distinctions and similarities between network-based (based on behavioral norms) approaches and more recent distributional (based on natural language corpora) semantic models, and the potential overlap between the two approaches. Capturing the type of relation between concepts appears to be particularly important in this modeling endeavor. Regarding processes, the review focuses on random walk models and the degree to which retrieval processes demand attention in pursuit of given task goals, which dovetails with the type of relation retrieved during tasks. Ultimately, this review provides a critical assessment of how the network perspective can be reconciled with distributional and machine-learning-based perspectives to meaning representation, and describes how cognitive network science provides a useful conceptual toolkit to probe both the structure and retrieval processes within semantic memory.

What Can Network Science Tell Us About Phonology and Language Processing?

Contemporary psycholinguistic models place significant emphasis on the cognitive processes involved in the acquisition, recognition, and production of language but neglect many issues related to the representation of language‐related information in the mental lexicon. In contrast, a central tenet of network science is that the structure of a network influences the processes that operate in that system, making process and representation inextricably connected. Here, we consider how the structure found across phonological networks of several languages from different language families may influence language processing as we age and experience diseases that affect cognition during the typical and atypical acquisition of new words, during typical perception and production of speech in adults, and during language change over time. We conclude that the network science approach may not only provide insights into specific language processes but also provide a way to connect the work from these domains, which are becoming increasingly balkanized.

Methodological Considerations for Incorporating Clinical Data Into a Network Model of Retrieval Failures

Difficulty retrieving information (e.g., words) from memory is prevalent in neurogenic communication disorders (e.g., aphasia and dementia). Theoretical modeling of retrieval failures often relies on clinical data, despite methodological limitations (e.g., locus of retrieval failure, heterogeneity of individuals, and progression of disorder/disease). Techniques from network science are naturally capable of handling these limitations. This paper reviews recent work using a multiplex lexical network to account for word retrieval failures and highlights how network science can address the limitations of clinical data. Critically, any model we employ could impact clinical practice and patient lives, harkening the need for theoretically well-informed network models.

Phonological but not semantic influences on the speech-to-song illusion

In the speech to song illusion, a spoken phrase begins to sound as if it is being sung after several repetitions. Castro et al. (2018) used Node Structure Theory (NST; MacKay, 1987), a model of speech perception and production, to explain how the illusion occurs. Two experiments further test the mechanisms found in NST-priming, activation, and satiation-as an account of the speech to song illusion. In Experiment 1, words varying in the phonological clustering coefficient influenced how quickly a lexical node could recover from satiation, thereby influencing the song-like ratings to lists of words that were high versus low in phonological clustering coefficient. In Experiment 2, we used equivalence testing (i.e., the TOST procedure) to demonstrate that once lexical nodes are satiated the higher level semantic information associated with the word cannot differentially influence song-like ratings to lists of words varying in emotional arousal. The results of these two experiments further support the NST account of the speech to song illusion.

Systemic States of Spreading Activation in Describing Associative Knowledge Networks II: Generalisations with Fractional Graph Laplacians and q-Adjacency Kernels

Associative knowledge networks are often explored by using the so-called spreading activation model to find their key items and their rankings. The spreading activation model is based on the idea of diffusion- or random walk -like spreading of activation in the network. Here, we propose a generalisation, which relaxes an assumption of simple Brownian-like random walk (or equally, ordinary diffusion process) and takes into account nonlocal jump processes, typical for superdiffusive processes, by using fractional graph Laplacian. In addition, the model allows a nonlinearity of the diffusion process. These generalizations provide a dynamic equation that is analogous to fractional porous medium diffusion equation in a continuum case. A solution of the generalized equation is obtained in the form of a recently proposed q-generalized matrix transformation, the so-called q-adjacency kernel, which can be adopted as a systemic state describing spreading activation. Based on the systemic state, a new centrality measure called activity centrality is introduced for ranking the importance of items (nodes) in spreading activation. To demonstrate the viability of analysis based on systemic states, we use empirical data from a recently reported case of a university students’ associative knowledge network about the history of science. It is shown that, while a choice of model does not alter rankings of the items with the highest rank, rankings of nodes with lower ranks depend essentially on the diffusion model.

Evidence for preferential attachment: Words that are more well connected in semantic networks are better at acquiring new links in paired-associate learning

Here, we view the mental lexicon as a semantic network where words are connected if they are semantically related. Steyvers and Tenenbaum (Cognitive Science, 29, 41–78, 2005) proposed that the growth of semantic networks follows preferential attachment, the observation that new nodes are more likely to connect to preexisting nodes that are more well connected (i.e., the rich get richer). If this is the case, well-connected known words should be better at acquiring new links than poorly connected words. We tested this prediction in three paired-associate learning (PAL) experiments in which participants memorized arbitrary cue–response word pairs. We manipulated the semantic connectivity of the cue words, indexed by the words’ free associative degree centrality. Experiment 1 is a reanalysis of the PAL data from Qiu and Johns (Psychonomic Bulletin & Review, 27, 114–121, 2020), in which young adults remembered 40 cue–response word pairs (e.g., nature–chain) and completed a cued recall task. Experiment 2 is a preregistered replication of Qiu and Johns. Experiment 3 addressed some limitations in Qiu and Johns’s design by using pseudowords as the response items (e.g., boot–arruity). The three experiments converged to show that cue words of higher degree centrality facilitated the recall/recognition of the response items, providing support for the notion that better-connected words have a greater ability to acquire new links (i.e., the rich do get richer). Importantly, while degree centrality consistently accounted for significant portions of variance in PAL accuracy, other psycholinguistic variables (e.g., concreteness, contextual diversity) did not, suggesting that degree centrality is a distinct variable that affects the ease of verbal associative learning.

Quantifying the Interplay of Semantics and Phonology During Failures of Word Retrieval by People With Aphasia Using a Multiplex Lexical Network

Investigating instances where lexical selection fails can lead to deeper insights into the cognitive machinery and architecture supporting successful word retrieval and speech production. In this paper, we used a multiplex lexical network approach that combines semantic and phonological similarities among words to model the structure of the mental lexicon. Network measures at different levels of analysis (degree, network distance, and closeness centrality) were used to investigate the influence of network structure on picture naming accuracy and errors by people with Anomic, Broca's, Conduction, and Wernicke's aphasia. Our results reveal that word retrieval is influenced by the multiplex lexical network structure in at least two ways-(a) the accuracy of production and error type on incorrect productions were influenced by the degree and closeness centrality of the target word, and (b) error type also varied in terms of network distance between the target word and produced error word. Taken together, the analyses demonstrate that network science techniques, particularly the use of the multiplex lexical network to simultaneously represent semantic and phonological relationships among words, reveal how the structure of the mental lexicon influences language processes beyond traditionally examined psycholinguistic variables. We propose a framework for how the multiplex lexical network approach allows for understanding the influence of mental lexicon structure on word retrieval processes, with an eye toward a better understanding of the nature of clinical impairments, like aphasia.

Contributions of modern network science to the cognitive sciences: revisiting research spirals of representation and process

Modelling the structure of cognitive systems is a central goal of the cognitive sciences-a goal that has greatly benefitted from the application of network science approaches. This paper provides an overview of how network science has been applied to the cognitive sciences, with a specific focus on the two research 'spirals' of cognitive sciences related to the representation and processes of the human mind. For each spiral, we first review classic papers in the psychological sciences that have drawn on graph-theoretic ideas or frameworks before the advent of modern network science approaches. We then discuss how current research in these areas has been shaped by modern network science, which provides the mathematical framework and methodological tools for psychologists to (i) represent cognitive network structure and (ii) investigate and model the psychological processes that occur in these cognitive networks. Finally, we briefly comment on the future of, and the challenges facing, cognitive network science.

Feature distinctiveness effects in language acquisition and lexical processing: Insights from megastudies

Semantic features are central to many influential theories of word meaning and semantic memory, but new methods of quantifying the information embedded in feature production norms are needed to advance our understanding of semantic processing and language acquisition. This paper capitalized on databases of semantic feature production norms and age-of-acquisition ratings, and megastudies including the English Lexicon Project and the Calgary Semantic Decision Project, to examine the influence of feature distinctiveness on language acquisition, visual lexical decision, and semantic decision. A feature network of English words was constructed such that edges in the network represented feature distance, or dissimilarity, between words (i.e., Jaccard and Manhattan distances of probability distributions of features elicited for each pair of words), enabling us to quantify the relative feature distinctiveness of individual words relative to other words in the network. Words with greater feature distinctiveness tended to be acquired earlier. Regression analyses of megastudy data revealed that Manhattan feature distinctiveness inhibited performance on the visual lexical decision task, facilitated semantic decision performance for concrete concepts, and inhibited semantic decision performance for abstract concepts. These results demonstrate the importance of considering the structural properties of words embedded in a semantic feature space in order to increase our understanding of semantic processing and language acquisition.

New Perspectives on the Aging Lexicon

The field of cognitive aging has seen considerable advances in describing the linguistic and semantic changes that happen during the adult life span to uncover the structure of the mental lexicon (i.e., the mental repository of lexical and conceptual representations). Nevertheless, there is still debate concerning the sources of these changes, including the role of environmental exposure and several cognitive mechanisms associated with learning, representation, and retrieval of information. We review the current status of research in this field and outline a framework that promises to assess the contribution of both ecological and psychological aspects to the aging lexicon.