The Glasgow Norms: Ratings of 5,500 words on nine scales

Contribution of orthography to vocabulary acquisition in a second language: Evidence of an early word-learning advantage in elementary-school children

Recent studies have shown that children benefit from orthography when learning new words. This orthographic facilitation can be explained by the fact that written language acts as an anchor device due to the transient nature of spoken language. There is also a close and reciprocal relationship between spoken and written language. Second-language word learning poses specific challenges in terms of orthography-phonology mappings that do not fully overlap with first-language mappings. The current study aimed to investigate whether orthographic information facilitates second-language word learning in developing readers, namely third and fifth graders. In a first experiment French children learned 16 German words, and in a second experiment they learned 24 German words. Word learning was assessed by picture designation, spoken word recognition, and orthographic choice. In both experiments, orthographic facilitation was found in both less and more advanced readers. The theoretical and practical implications of these findings are discussed.

Can large language models help augment English psycholinguistic datasets?

Research on language and cognition relies extensively on psycholinguistic datasets or "norms". These datasets contain judgments of lexical properties like concreteness and age of acquisition, and can be used to norm experimental stimuli, discover empirical relationships in the lexicon, and stress-test computational models. However, collecting human judgments at scale is both time-consuming and expensive. This issue of scale is compounded for multi-dimensional norms and those incorporating context. The current work asks whether large language models (LLMs) can be leveraged to augment the creation of large, psycholinguistic datasets in English. I use GPT-4 to collect multiple kinds of semantic judgments (e.g., word similarity, contextualized sensorimotor associations, iconicity) for English words and compare these judgments against the human "gold standard". For each dataset, I find that GPT-4's judgments are positively correlated with human judgments, in some cases rivaling or even exceeding the average inter-annotator agreement displayed by humans. I then identify several ways in which LLM-generated norms differ from human-generated norms systematically. I also perform several "substitution analyses", which demonstrate that replacing human-generated norms with LLM-generated norms in a statistical model does not change the sign of parameter estimates (though in select cases, there are significant changes to their magnitude). I conclude by discussing the considerations and limitations associated with LLM-generated norms in general, including concerns of data contamination, the choice of LLM, external validity, construct validity, and data quality. Additionally, all of GPT-4's judgments (over 30,000 in total) are made available online for further analysis.

Ethics-testing an eating disorder recovery memoir: a pre-publication experiment

BACKGROUND

Narratives (including memoirs and novels) about eating disorders (EDs) are typically published with the intention to benefit readers, but survey evidence suggests that reading such narratives with an active ED may more often be harmful than helpful. To reduce the probability of inadvertent harm and learn more about how narrative reading and EDs interact, a pre-publication study was designed to determine whether or not a recovery memoir should be published.

METHODS

64 participants with a self-reported ED read either the experimental text (The Hungry Anorexic [HA]) or a control text (Ten Zen Questions [TZ]) over a roughly two-week period. All participants completed the Eating Disorder Examination Questionnaire (EDE-Q) and the Anorexia Nervosa Stages of Change Questionnaire (ANSOCQ) one week before and two weeks after reading, and answered three recurring open-ended questions at regular timepoints during and after the reading. Computational analysis of the free-text responses assessed text/response similarity and response characteristics on emotional, sensory, and action-effector dimensions. Both rating-scale and free-text data were analysed using mixed ANOVAs to test for effects of time and condition, and the university ethics board was notified in advance of the quantitative threshold for harmful effects that would prohibit the ED memoir from being published.

RESULTS

On the two quantitative measures, there was an effect of time but not of condition: Significant improvement was found in both groups on the EDE-Q (with a medium-to-large effect size) and the ANSOCQ (with a very large effect size). In an ANCOVA analysis, no significant mediating effects were found for age, education, duration of professional support for the ED, or pre/post-reading BMI change. For the free-text responses, linguistic similarity measures indicated that HA responses most closely matched the text of HA, with the same being true for TZ. In a word-norm analysis, text condition significantly affected six emotional, sensory, and action-effector variables (interoception, olfaction, gustatory, mouth, torso, and hand/arm), mean scores for all of which were higher in HA responses than TZ responses. Close reading of readers' responses explored two potential mechanisms for the positive effects of time but not condition: engagement with the during-reading prompts as part of the experimental setup and engagement with the texts' dialogical form.

CONCLUSIONS

The ED memoir was found not to yield measurably harmful effects for readers with an ED, and will therefore be published. The finding that significant improvement on both quantitative measures was observed irrespective of text condition suggests that positive effects may be attributable to linguistic characteristics shared by the two texts or to elements of the reading and/or reflective processes scaffolded by both. The quantitative results and the free-text testimony have implications for our understanding of bibliotherapy, "triggering", and the practicalities of responsible publishing.

Neurocognitive mechanisms of emotional interference in native and foreign languages: evidence from proficient bilinguals

Currently available data show mixed results as to whether the processing of emotional information has the same characteristics in the native (L1) as in the second language (L2) of bilinguals. We conducted a functional magnetic resonance imaging (fMRI) experiment to shed light on the neurocognitive mechanisms underlying bilinguals' emotional processing in L1 and L2 during an emotional interference task (i.e., the Emotional Stroop Task - EST). Our sample comprised proficient Italian-English bilinguals who learned their L2 during childhood mainly in instructional rather than immersive contexts. In spite of no detectable behavioural effects, we found stronger brain activations for L1 versus L2 emotional words in sectors of the posteromedial cortex involved in attention modulation, episodic memory, and affective processing. While fMRI findings are consistent with the hypothesis of a stronger emotional resonance when processing words in a native language, our overall pattern of results points to the different sensitivity of behavioural and hemodynamic responses to emotional information in the two languages of bilingual speakers.

ANCW: Affective norms for 4030 Chinese words

Affective information contained in words is gaining increased attention among neurolinguists and psycholinguists around the world. This study established the Affective Norms for Chinese Words (ANCW) with valence, arousal, dominance, and concreteness ratings for 4030 words that were Chinese adaptations of the CET-4 (The National College English Test Band 4) official syllabus. Despite the existing Chinese affective norms such as the Chinese Affective Words System (CAWS), the ANCW provides much more and richer Chinese vocabulary. By using 7-point (ranging from 1 to 7) Likert scales in a paper-and-pencil procedure, we obtained ratings for all variables from 3717 Chinese undergraduates. The ANCW norms possessed good response reliability and were compatible with prior normative studies in Chinese. The pairwise correlation analysis revealed quadratic relations between valence and arousal, arousal and dominance, as well as valence and concreteness. Additionally, valence and dominance, as well as arousal and concreteness, presented a linear correlation, and concreteness and dominance were correlated. The ANCW provides reliable and standardized stimulus materials for further research involving emotional language processing.

The role of morphemic knowledge during novel word learning

This study used a novel word learning paradigm to investigate the role of morphology in the acquisition of complex words, when participants have no prior lexical knowledge of the embedded morphemic constituents. The influence of morphological family size on novel word learning was examined by comparing novel stems (torb) combined with large morphological families (e.g., torbnel, torbilm, torbla, torbiph) as opposed to small morphological families (e.g., torbilm, torbla). In two online experiments, participants learned complex novel words by associating words with pictures. Following training, participants performed a recognition and a spelling task where they were exposed to novel words that either did or did not contain a trained morpheme. As predicted, items consisting of a trained and an untrained constituent were harder to reject but easier to spell than those that did not contain any trained constituents. Moreover, novel words including trained constituents with large morphological families were harder to reject than those including constituents with small morphological families. The findings suggest that participants acquired novel morphemic constituents without prior knowledge of the constituents and point to the important facilitatory role of morphological family size in novel word learning.

Emotion processing in concrete and abstract words: evidence from eye fixations during reading

We replicated and extended the findings of Yao et al. [(2018). Differential emotional processing in concrete and abstract words. Journal of Experimental Psychology: Learning, Memory, and Cognition, 44(7), 1064-1074] regarding the interaction of emotionality, concreteness, and imageability in word processing by measuring eye fixation times on target words during normal reading. A 3 (Emotion: negative, neutral, positive) × 2 (Concreteness: abstract, concrete) design was used with 22 items per condition, with each set of six target words matched across conditions in terms of word length and frequency. Abstract (e.g. shocking, reserved, fabulous) and concrete (e.g. massacre, calendar, treasure) target words appeared (separately) within contextually neutral, plausible sentences. Sixty-three participants each read all 132 experimental sentences while their eye movements were recorded. Analyses using Gamma generalised linear mixed models revealed significant effects of both Emotion and Concreteness on all fixation measures, indicating faster processing for emotional and concrete words. Additionally, there was a significant Emotion × Concreteness interaction which, critically, was modulated by Imageability in early fixation time measures. Emotion effects were significantly larger in higher-imageability abstract words than in lower-imageability ones, but remained unaffected by imageability in concrete words. These findings support the multimodal induction hypothesis and highlight the intricate interplay of these factors in the immediate stages of word processing during fluent reading.

Memory enhancement for emotional words is attributed to both valence and arousal

We do not memorize items in our surroundings with equal priority. Previous literature has widely shown that emotional stimuli are better remembered than neutral stimuli. However, given emotional stimuli and neutral stimuli often differ in both valence and arousal dimensions, it remains unclear whether the enhancement effects can be attributed to valence, or just to arousal. Importantly, most prior studies relied on a relatively small number of stimuli and non-emotional factors such as word length, imageability and other confounds were hard to control. To address these challenges, we analyzed multiple large databases of recognition memory and free recall tasks from previous research by items with many lexical and semantic covariates included, examining the effects of valence or arousal when controlling for each other. Our results showed a U-shaped relationship between valence and memory performance for both recognition and free recall, and a linear relationship between arousal and memory performance for both tasks. These findings showed that the memory enhancement effects can be attributed to both valence and arousal. We demonstrated these effects with generalizability across many stimuli and controlled for non-emotional factors. Together, these findings disentangle the contribution of valence and arousal in emotional memory enhancement effects and provide insights for current major theories of emotional memory.

Large Language Models and the Wisdom of Small Crowds

Recent advances in Large Language Models (LLMs) have raised the question of replacing human subjects with LLM-generated data. While some believe that LLMs capture the "wisdom of the crowd"-due to their vast training data-empirical evidence for this hypothesis remains scarce. We present a novel methodological framework to test this: the "number needed to beat" (NNB), which measures how many humans are needed for a sample's quality to rival the quality achieved by GPT-4, a state-of-the-art LLM. In a series of pre-registered experiments, we collect novel human data and demonstrate the utility of this method for four psycholinguistic datasets for English. We find that NNB > 1 for each dataset, but also that NNB varies across tasks (and in some cases is quite small, e.g., 2). We also introduce two "centaur" methods for combining LLM and human data, which outperform both stand-alone LLMs and human samples. Finally, we analyze the trade-offs in data cost and quality for each approach. While clear limitations remain, we suggest that this framework could guide decision-making about whether and how to integrate LLM-generated data into the research pipeline.

Bigger is really better: Resolution of conflicting behavioural evidence for semantic size bias in a lexical decision task

Previous literature has indicated conflicting results regarding a response time bias favouring words indicating large real-world objects (RWO) over words indicating small RWO during a lexical decision task. This study aimed to replicate an original experiment and, expanding on it, disentangle possible alternatives for why this effect is sometimes observed and sometimes not. The same methods as the original study were followed, and the results were inconsistent with all previously published findings. Although no significant difference was observed for response time, the findings indicated a significant difference in accuracy and inverse efficiency scores such that "large" words were recognised significantly more accurately than "small" words. After examining several linguistic dimensions that may also contribute to response time, statistical models accounting for these dimensions yielded a significant and increased effect size for the response time size rating of words in our sample from the United States. Our findings indicate that there is a cognitive bias favouring words representing large RWO over small ones but suggest several additional linguistic factors need to be controlled for it to be detected consistently in response time.

Non-arbitrary mappings between size and sound of English words: Form typicality effects during lexical access and memory

A century of research has provided evidence of limited size sound symbolism in English, that is, certain vowels are non-arbitrarily associated with words denoting small versus large referents (e.g., /i/ as in teensy and /ɑ/ as in tall). In the present study, we investigated more extensive statistical regularities between surface form properties of English words and ratings of their semantic size, that is, form typicality, and its impact on language and memory processing. Our findings provide the first evidence of significant word form typicality for semantic size. In five empirical studies using behavioural megastudy data sets of performance on written and auditory lexical decision, reading aloud, semantic decision, and recognition memory tasks, we show that form typicality for size is a stronger and more consistent predictor of lexical access during word comprehension and production than semantic size, in addition to playing a significant role in verbal memory. The empirical results demonstrate that statistical information about non-arbitrary form-size mappings is accessed automatically during language and verbal memory processing, unlike semantic size that is largely dependent on task contexts that explicitly require participants to access size knowledge. We discuss how a priori knowledge about non-arbitrary form-meaning associations in the lexicon might be incorporated in models of language processing that implement Bayesian statistical inference.

Effects of emotional ambiguity and emotional intensity on true and false memory

Whereas the effects of emotional intensity (the perceived strength of an item's valence or arousal) have long been studied in true- and false-memory research, emotional ambiguity (the uncertainty that attaches to perceived emotional intensity) has only been studied recently. Available evidence suggests that emotional ambiguity has reliable effects on true memory that are distinct from those of emotional intensity. However, those findings are mostly restricted to recall, and the effects of emotional ambiguity on false memory remain unexplored. The current study addressed both limitations by measuring the effects of emotional ambiguity and emotional intensity on true and false recognition. In two experiments, we manipulated valence ambiguity and valence intensity (Experiment 1) and arousal ambiguity and arousal intensity (Experiment 2) of Deese/Roediger/McDermott lists. Multiple linear regression analyses were conducted for Experiment 1, Experiment 2, and the combined data of the experiments to separate the effects of emotional ambiguity and emotional intensity. Our results showed that both valence ambiguity and arousal ambiguity improved true recognition, and the effects of valence ambiguity remained robust even when controlling for valence intensity, arousal intensity, and arousal ambiguity. More importantly, for both valence and arousal, there was an interaction between ambiguity and intensity in false memory. Specifically, we found that valence ambiguity increased false recognition with positive valence, while arousal ambiguity amplified the effect of arousal intensity on false recognition. Our results are discussed in the context of the emotional ambiguity hypothesis and fuzzy-trace theory.

Stimulus specificity in combined action observation and motor imagery of typing

Combined action observation and motor imagery (AO + MI) can improve movement execution (ME) in healthy adults and certain patient populations. However, it is unclear how the specificity of the observation component during AO + MI influences ME. As generalised observation could result in more flexible AO + MI rehabilitation programmes, this study investigated whether observing typing of target words (specific condition) or non-matching words (general condition) during AO + MI would have different effects on keyboard typing in healthy young adults. In Experiment 1, 51 students imagined typing a target word while watching typing videos that were either specific to the target word or general. There were no differences in typing execution between AO + MI conditions, though participants typed more slowly after both AO + MI conditions compared with no observation or imagery. Experiment 2 repeated Experiment 1 in 20 students, but with a faster stimulus speed in the AO + MI conditions and increased cognitive difficulty in the control condition. The results showed that the slowed typing after AO + MI was likely due to a strong influence of task-switching between imagery and execution, as well as an automatic imitation effect. Both experiments demonstrate that general and specific AO + MI comparably affect ME. In addition, slower ME following both AO + MI and a challenging cognitive task provides support for the motor-cognitive model of MI.

It's All in the Interaction: Early Acquired Words Are Both Frequent and Highly Imageable

Prior studies have found that children are more likely to learn words that are frequent in the input and highly imageable. Many theories of word learning, however, predict that these variables should interact, particularly early in development: frequency of a form is of little use if you cannot infer its meaning, and a concrete word cannot be acquired if you never hear it. The present study explores this interaction, how it changes over time and its relationship to syntactic category effects in children acquiring American English. We analyzed 1461 monolingual English-speaking children aged 1;4-2;6 from the MB-CDI norming study (Fenson et al., 1994). Word frequency was estimated from the CHILDES database, and imageability was measured using adult ratings. There was a strong over-additive interaction between frequency and imageability, such that children were more likely to learn a word if it was both highly imageable and very frequent. This interaction was larger in younger children than in older children. There were reliable differences between syntactic categories independent of frequency and imageability, which did not interact with age. These findings are consistent with theories in which children's early words are acquired by mapping frequent word forms onto concrete, perceptually available referents, such that highly frequent items are only acquired if they are also imageable, and vice versa.

The neural basis of naturalistic semantic and social cognition

Decoding social environments and engaging meaningfully with other people are critical aspects of human cognition. Multiple cognitive systems, including social and semantic cognition, work alongside each other to support these processes. This study investigated shared processing between social and semantic systems using neuroimaging data collected during movie-viewing, which captures the multimodal environment in which social knowledge is exchanged. Semantic and social content from movie events (event-level) and movie transcripts (word-level) were used in parametric modulation analyses to test (1) the degree to which semantic and social information is processed within each respective network and (2) engagement of the same cross-network regions or the same domain-general hub located within the semantic network during semantic and social processing. Semantic word and event-level content engaged the same fronto-temporo-parietal network and a portion of the semantic hub in the anterior temporal lobe (ATL). Social word and event-level content engaged the supplementary motor area and right angular gyrus within the social network, but only social words engaged the domain-general semantic hub in left ATL. There was evidence of shared processing between the social and semantic systems in the dorsolateral portion of right ATL which was engaged by word and event-level semantic and social content. Overlap between the semantic and social word and event results was highly variable within and across participants, with the most consistent loci of overlap occurring in left inferior frontal, bilateral precentral and supramarginal gyri for social and semantic words and in bilateral superior temporal gyrus extending from ATL posteriorly into supramarginal gyri for social and semantic events. These results indicate a complex pattern of shared and distinct regions for social and semantic cognition during naturalistic processing. PROTOCOL REGISTRATION: The stage 1 protocol for this Registered Report was accepted in principle on October 11, 2022. The protocol, as accepted by the journal, can be found at: https://doi.org/10.17605/OSF.IO/ACWQY .

Cognitive modelling of concepts in the mental lexicon with multilayer networks: Insights, advancements, and future challenges

The mental lexicon is a complex cognitive system representing information about the words/concepts that one knows. Over decades psychological experiments have shown that conceptual associations across multiple, interactive cognitive levels can greatly influence word acquisition, storage, and processing. How can semantic, phonological, syntactic, and other types of conceptual associations be mapped within a coherent mathematical framework to study how the mental lexicon works? Here we review cognitive multilayer networks as a promising quantitative and interpretative framework for investigating the mental lexicon. Cognitive multilayer networks can map multiple types of information at once, thus capturing how different layers of associations might co-exist within the mental lexicon and influence cognitive processing. This review starts with a gentle introduction to the structure and formalism of multilayer networks. We then discuss quantitative mechanisms of psychological phenomena that could not be observed in single-layer networks and were only unveiled by combining multiple layers of the lexicon: (i) multiplex viability highlights language kernels and facilitative effects of knowledge processing in healthy and clinical populations; (ii) multilayer community detection enables contextual meaning reconstruction depending on psycholinguistic features; (iii) layer analysis can mediate latent interactions of mediation, suppression, and facilitation for lexical access. By outlining novel quantitative perspectives where multilayer networks can shed light on cognitive knowledge representations, including in next-generation brain/mind models, we discuss key limitations and promising directions for cutting-edge future research.

Gaze-speech coordination during social interaction in Parkinson's disease

BACKGROUND

Parkinson's disease (PD) can affect social interaction and communication as well as motor and cognitive processes. Speech is affected in PD, as is the control of voluntary eye movements which are thought to play an important role in 'turn taking' in conversation.

AIMS

This study aimed to measure eye movements during spoken conversation in PD to assess whether differences in patterns of eye gaze are linked to disrupted turn taking and impaired communication efficiency.

METHODS & PROCEDURE

Eleven participants with mild PD and 14 controls completed a two-player guessing game. During each 3 min game turn, one of the players had to guess the names of as many objects as possible based only on the other player's description. Eye movements were recorded simultaneously in both participants using mobile eye trackers along with speech onset and offset times.

OUTCOMES & RESULTS

When people with PD played the role of describer, the other player guessed fewer objects compared to when controls described objects. When guessing objects, people with PD performed just as well as controls. Analysis of eye fixations showed that people with PD made longer periods of fixation on the other player's face relative to controls and a lower number of such 'gaze on face' periods.

CONCLUSIONS & IMPLICATIONS

A combination of oculomotor, cognitive and speech abnormalities may disrupt communication in PD. Better public awareness of oculomotor, speech and other deficits in the condition could improve social connectedness in people with Parkinson's.

WHAT THIS PAPER ADDS

What is already known on this subject? Parkinson's disease is known to affect the control of voluntary eye movements. Direction of eye gaze is important in spoken conversation as a cue to turn-taking, but no studies have examined whether eye movements are different during communication in people with Parkinson's. What this paper adds to existing knowledge? People with Parkinson's showed longer periods of eye fixation during conversations compared to controls. Delays and overlaps between speech turns were also affected in patients. What are the clinical implications of this work? Better knowledge of the effect of the disease on eye gaze control amongst clinicians may help improve communication and social connectedness for patients in the future.

Patterns of performance on the animal fluency task in logopenic variant of primary progressive aphasia: A reflection of phonological and semantic skills

PURPOSE

This study aimed to characterize the quantitative (total number of correct words generated) and qualitative (psycholinguistic properties of correct words generated) performance patterns on the animal fluency task in individuals with the logopenic variant of primary progressive aphasia and to investigate the influence of phonological and semantic abilities to these patterns.

METHODS

Fifteen participants with lvPPA and twenty neurotypical adults completed the animal fluency task and an assessment battery to characterize their phonological and semantic abilities. We recorded the total number of correct words produced and their psycholinguistic properties. Group differences were analyzed using independent samples t-tests and analysis of covariance. Stepwise and multiple linear regression analyses were implemented to investigate the contribution of psycholinguistic properties on word generation as well as the role of phonological and semantic abilities on performance. We also investigated the mediating role of phonological and semantic abilities on the relationship between relevant psycholinguistic properties and word generation output.

RESULTS

Compared to neurotypical controls, participants with lvPPA produced fewer correct responses and more words with lower age of acquisition. The total number of correct words generated was predicted by the age of word acquisition, such that individuals who generated more responses, produced words acquired later in life. Phonology and semantics influenced the number of correct words generated and their frequency, age of acquisition, and semantic neighborhood density. Familiarity and arousal were driven by semantic abilities. Phonological abilities partially mediated the relationship between age of acquisition and word generation output.

CONCLUSIONS

This study provides valuable insights into the performance patterns of the animal fluency task in lvPPA. Individuals with lvPPA with more intact phonological and semantic abilities generated greater number of words with more complex psycholinguistic properties. Our findings contribute to the understanding of language processes underlying word retrieval in lvPPA.

Using artificial intelligence to explore sound symbolic expressions of gender in American English

This study investigates the extent to which gender can be inferred from the phonemes that make up given names and words in American English. Two extreme gradient boosted algorithms were constructed to classify words according to gender, one using a list of the most common given names (N∼1,000) in North America and the other using the Glasgow Norms (N∼5,500), a corpus consisting of nouns, verbs, adjectives, and adverbs which have each been assigned a psycholinguistic score of how they are associated with male or female behaviour. Both models report significant findings, but the model constructed using given names achieves a greater accuracy despite being trained on a smaller dataset suggesting that gender is expressed more robustly in given names than in other word classes. Feature importance was examined to determine which features were contributing to the decision-making process. Feature importance scores revealed a general pattern across both models, but also show that not all word classes express gender the same way. Finally, the models were reconstructed and tested on the opposite dataset to determine whether they were useful in classifying opposite samples. The results showed that the models were not as accurate when classifying opposite samples, suggesting that they are more suited to classifying words of the same class.

Neurocognitive correlates of semantic memory navigation in Parkinson's disease

Cognitive studies on Parkinson's disease (PD) reveal abnormal semantic processing. Most research, however, fails to indicate which conceptual properties are most affected and capture patients' neurocognitive profiles. Here, we asked persons with PD, healthy controls, and individuals with behavioral variant frontotemporal dementia (bvFTD, as a disease control group) to read concepts (e.g., 'sun') and list their features (e.g., hot). Responses were analyzed in terms of ten word properties (including concreteness, imageability, and semantic variability), used for group-level comparisons, subject-level classification, and brain-behavior correlations. PD (but not bvFTD) patients produced more concrete and imageable words than controls, both patterns being associated with overall cognitive status. PD and bvFTD patients showed reduced semantic variability, an anomaly which predicted semantic inhibition outcomes. Word-property patterns robustly classified PD (but not bvFTD) patients and correlated with disease-specific hypoconnectivity along the sensorimotor and salience networks. Fine-grained semantic assessments, then, can reveal distinct neurocognitive signatures of PD.

Semantic gender: Norms for 24,000 Dutch words and its role in word meaning

Semantic gender norms are presented for 24,037 Dutch words. Eighty participants rated 6017 words each on a five-point Likert scale ranging from feminine to masculine. Each word was rated by ten male and ten female participants. The collected norms show high reliability and correlate well with similar norms in English. We show that semantic gender is distinct from other lexical dimensions such as valence, arousal, dominance, concreteness, and age of acquisition. Semantic gender is not the same as the grammatical gender of words, either. The collected norms can be predicted accurately using a semantic space based on word association data. A dimension explaining a good amount of variance is present in this space, indicating that semantic gender is an important component of the human meaning system.

The Flickr frequency norms: What 17 years of images tagged online tell us about lexical processing

Word frequency is one of the best predictors of language processing. Typically, word frequency norms are entirely based on natural-language text data, thus representing what the literature typically refers to as purely linguistic experience. This study presents Flickr frequency norms as a novel word frequency measure from a domain-specific corpus inherently tied to extra-linguistic information: words used as image tags on social media. To obtain Flickr frequency measures, we exploited the photo-sharing platform Flickr Image (containing billions of photos) and extracted the number of uploaded images tagged with each of the words considered in the lexicon. Here, we systematically examine the peculiarities of Flickr frequency norms and show that Flickr frequency is a hybrid metrics, lying at the intersection between language and visual experience and with specific biases induced by being based on image-focused social media. Moreover, regression analyses indicate that Flickr frequency captures additional information beyond what is already encoded in existing norms of linguistic, sensorimotor, and affective experience. Therefore, these new norms capture aspects of language usage that are missing from traditional frequency measures: a portion of language usage capturing the interplay between language and vision, which - this study demonstrates - has its own impact on word processing. The Flickr frequency norms are openly available on the Open Science Framework (https://osf.io/2zfs3/).

Noun imageability and the processing of sensory-based information

The aim of this study was to test whether the availability of internal imagery elicited by words is related to ratings of word imageability. Participants are presented with target words and, after a delay allowing for processing of the word, answer questions regarding the size or weight of the word referents. Target words differ with respect to imageability. Results show faster responses to questions for high imageability words than for low imageability words. The type of question (size/weight) modulates reaction times suggesting a dominance of the visual domain over the physical-experience domain in concept representation. Results hold across two different languages (Czech/German). These findings provide further insights into the representations underlying word meaning and the role of word imageability in language acquisition and processing.

Neural patterns differentiate traumatic from sad autobiographical memories in PTSD

For people with post-traumatic stress disorder (PTSD), recall of traumatic memories often displays as intrusions that differ profoundly from processing of 'regular' negative memories. These mnemonic features fueled theories speculating a unique cognitive state linked with traumatic memories. Yet, to date, little empirical evidence supports this view. Here we examined neural activity of patients with PTSD who were listening to narratives depicting their own memories. An intersubject representational similarity analysis of cross-subject semantic content and neural patterns revealed a differentiation in hippocampal representation by narrative type: semantically similar, sad autobiographical memories elicited similar neural representations across participants. By contrast, within the same individuals, semantically similar trauma memories were not represented similarly. Furthermore, we were able to decode memory type from hippocampal multivoxel patterns. Finally, individual symptom severity modulated semantic representation of the traumatic narratives in the posterior cingulate cortex. Taken together, these findings suggest that traumatic memories are an alternative cognitive entity that deviates from memory per se.

Subjective age of acquisition norms for 1604 English words by Spanish L2 speakers of English and their relationship with lexico-semantic, affective, sociolinguistic and proficiency variables

Psycholinguistic studies have shown that there are many variables implicated in language comprehension and production. At the lexical level, subjective age of acquisition (AoA), the estimate of the age at which a word is acquired, is key for stimuli selection in psycholinguistic studies. AoA databases in English are often used when testing a variety of phenomena in second language (L2) speakers of English. However, these have limitations, as the norms are not provided by the target population (L2 speakers of English) but by native English speakers. In this study, we asked native Spanish L2 speakers of English to provide subjective AoA ratings for 1604 English words, and investigated whether factors related to 14 lexico-semantic and affective variables, both in Spanish and English, and to the speakers' profile (i.e., sociolinguistic variables and L2 proficiency), were related to the L2 AoA ratings. We used boosted regression trees, an advanced form of regression analysis based on machine learning and boosting algorithms, to analyse the data. Our results showed that the model accounted for a relevant proportion of deviance (58.56%), with the English AoA provided by native English speakers being the strongest predictor for L2 AoA. Additionally, L2 AoA correlated with L2 reaction times. Our database is a useful tool for the research community running psycholinguistic studies in L2 speakers of English. It adds knowledge about which factors-linked to the characteristics of both the linguistic stimuli and the speakers-affect L2 subjective AoA. The database and the data can be downloaded from: https://osf.io/gr8xd/?view_only=73b01dccbedb4d7897c8d104d3d68c46 .

The recognition effects of attribute ambiguity

When examining memory effects of semantic attributes, it is common practice to manipulate normed mean (M) ratings of the attributes (i.e., attribute intensity) in learning materials. Meanwhile, the standard deviations (SDs) of attribute ratings (i.e., attribute ambiguity) are usually treated as indexes of measurement error. However, some recent research found that recall accuracy varied as a function of both the intensity and ambiguity of semantic attributes such as valence, categorization, concreteness, and meaningfulness. These findings challenged the traditional interpretation of attribute rating SDs as noise indexes. In the current study, we examined the recognition effects of ambiguity, intensity, and Ambiguity × Intensity interactions for 21 attributes using mega study data for over 5,000 words. Our results showed that attribute ambiguity had reliable recognition effects beyond those of attribute intensity, and that it sometimes explained more unique variance in recognition than attribute intensity. Thus, we concluded that attribute ambiguity is a distinct psychological dimension of semantic attributes, which is processed separately from attribute intensity during encoding. Two theoretical hypotheses had been proposed for the memory effects of attribute ambiguity. We discuss the implications of our findings for the two theoretical hypotheses about how attribute ambiguity influences episodic memory.

Studying Individual Differences in Language Comprehension: The Challenges of Item-Level Variability and Well-Matched Control Conditions

Translating experimental tasks that were designed to investigate differences between conditions at the group-level into valid and reliable instruments to measure individual differences in cognitive skills is challenging (Hedge et al., 2018; Rouder et al., 2019; Rouder & Haaf, 2019). For psycholinguists, the additional complexities associated with selecting or constructing language stimuli, and the need for appropriate well-matched baseline conditions make this endeavour particularly complex. In a typical experiment, a process-of-interest (e.g. ambiguity resolution) is targeted by contrasting performance in an experimental condition with performance in a well-matched control condition. In many cases, careful between-condition matching precludes the same participant from encountering all stimulus items. Unfortunately, solutions that work for group-level research (e.g. constructing counterbalanced experiment versions) are inappropriate for individual-differences designs. As a case study, we report an ambiguity resolution experiment that illustrates the steps that researchers can take to address this issue and assess whether their measurement instrument is both valid and reliable. On the basis of our findings, we caution against the widespread approach of using datasets from group-level studies to also answer important questions about individual differences.

SCOPE: The South Carolina psycholinguistic metabase

The number of databases that provide various measurements of lexical properties for psycholinguistic research has increased rapidly in recent years. The proliferation of lexical variables, and the multitude of associated databases, makes the choice, comparison, and standardization of these variables in psycholinguistic research increasingly difficult. Here, we introduce The South Carolina Psycholinguistic Metabase (SCOPE), which is a metabase (or a meta-database) containing an extensive, curated collection of psycholinguistic variable values from major databases. The metabase currently contains 245 lexical variables, organized into seven major categories: General (e.g., frequency), Orthographic (e.g., bigram frequency), Phonological (e.g., phonological uniqueness point), Orth-Phon (e.g., consistency), Semantic (e.g., concreteness), Morphological (e.g., number of morphemes), and Response variables (e.g., lexical decision latency). We hope that SCOPE will become a valuable resource for researchers in psycholinguistics and affiliated disciplines such as cognitive neuroscience of language, computational linguistics, and communication disorders. The availability and ease of use of the metabase with comprehensive set of variables can facilitate the understanding of the unique contribution of each of the variables to word processing, and that of interactions between variables, as well as new insights and development of improved models and theories of word processing. It can also help standardize practice in psycholinguistics. We demonstrate use of the metabase by measuring relationships between variables in multiple ways and testing their individual contribution towards a number of dependent measures, in the most comprehensive analysis of this kind to date. The metabase is freely available at go.sc.edu/scope.

Memory effects of semantic attributes: A method of controlling attribute contamination

Rating norms for semantic attributes (e.g., concreteness, familiarity, valence) are widely used to study the content that people process as they encode meaningful material. Intensity ratings of individual attributes have been manipulated in numerous experiments with a range of memory paradigms, but those manipulations are contaminated by substantial correlations with the intensity ratings of other attributes. A method of controlling such contamination is needed, which requires a determination of how many distinct attributes there are among the large collection of attributes for which published norms are available. Identification of overlapping words in multiple rating projects yielded a data base containing normed values for each word's perceived intensity (M rating) and ambiguity (rating SD) on 20 different attributes. Principal component analyses then revealed that the intensity space was spanned by just three latent semantic attributes, and the ambiguity space was spanned by five. Psychologically, the big three intensity factors (emotional valence, size, age) were highly interpretable, as were the big five ambiguity factors (discrete emotion, emotional valence, age, meaningfulness, and verbatim memory). We provide a data base of intensity and ambiguity factor scores that can be used to conduct uncontaminated studies of the memory effects of the intensity and ambiguity of latent semantic attributes.

Speakers of different languages remember visual scenes differently

Language can have a powerful effect on how people experience events. Here, we examine how the languages people speak guide attention and influence what they remember from a visual scene. When hearing a word, listeners activate other similar-sounding words before settling on the correct target. We tested whether this linguistic coactivation during a visual search task changes memory for objects. Bilinguals and monolinguals remembered English competitor words that overlapped phonologically with a spoken English target better than control objects without name overlap. High Spanish proficiency also enhanced memory for Spanish competitors that overlapped across languages. We conclude that linguistic diversity partly accounts for differences in higher cognitive functions such as memory, with multilinguals providing a fertile ground for studying the interaction between language and cognition.

Rating norms should be calculated from cumulative link mixed effects models

Studies which provide norms of Likert ratings typically report per-item summary statistics. Traditionally, these summary statistics comprise the mean and the standard deviation (SD) of the ratings, and the number of observations. Such summary statistics can preserve the rank order of items, but provide distorted estimates of the relative distances between items because of the ordinal nature of Likert ratings. Inter-item relations in such ordinal scales can be more appropriately modelled by cumulative link mixed effects models (CLMMs). In a series of simulations, and with a reanalysis of an existing rating norms dataset, we show that CLMMs can be used to more accurately norm items, and can provide summary statistics analogous to the traditionally reported means and SDs, but which are disentangled from participants' response biases. CLMMs can be applied to solve important statistical issues that exist for more traditional analyses of rating norms.

Familiarity ratings for 24,325 simplified Chinese words

The present work collected familiarity norms for 20,275 two-character, 1231 three-character, and 2819 four-character simplified Chinese words from 1300 native speakers of Mandarin Chinese. The familiarity of each word was rated on a 7-point scale by at least 21 participants. The results supported the reliability and validity of the present familiarity ratings, which is the first large familiarity database for Chinese in the field. These familiarity norms can be downloaded from the supplemental materials. Furthermore, the contribution of familiarity to Chinese lexical processing was investigated using the present familiarity ratings and previous data (lexical features and visual lexical decision), mainly from two major Chinese lexicon projects, MELD-SCH and CLP. Regression analysis suggests that familiarity explained a substantial percentage of the variance in lexical processing of both simplified and traditional Chinese words, over and above the effects of word frequency and other lexical features, including age of acquisition (AoA). Further analysis identified a significantly greater familiarity effect for lower-frequency words than that for higher-frequency words. Together, among the first, our findings support the important contribution of familiarity with Chinese words to lexical processing, especially for low-frequency words.

The Role of Semantic Associations as a Metacognitive Cue in Creative Idea Generation

Is my idea creative? This question directs investing in companies and choosing a research agenda. Following previous research, we focus on the originality of ideas and consider their association with self-assessments of idea generators regarding their own originality. We operationalize the originality score as the frequency (%) of each idea within a sample of participants and originality judgment as the self-assessment of this frequency. Initial evidence suggests that originality scores and originality judgments are produced by separate processes. As a result, originality judgments are prone to biases. So far, heuristic cues that lead to such biases are hardly known. We used methods from computational linguistics to examine the semantic distance as a potential heuristic cue underlying originality judgments. We examined the extent to which the semantic distance would contribute additional explanatory value in predicting originality scores and originality judgments, above and beyond cues known from previous research. In Experiment 1, we re-analyzed previous data that compared originality scores and originality judgments after adding the semantic distance of the generated ideas from the stimuli. We found that the semantic distance contributed to the gap between originality scores and originality judgments. In Experiment 2, we manipulated the examples given in task instructions to prime participants with two levels of idea originality and two levels of semantic distance. We replicated Experiment 1 in finding the semantic distance as a biasing factor for originality judgments. In addition, we found differences among the conditions in the extent of the bias. This study highlights the semantic distance as an unacknowledged metacognitive cue and demonstrates its biasing power for originality judgments.

Quantifying social semantics: An inclusive definition of socialness and ratings for 8388 English words

It has been proposed that social experience plays an important role in the grounding of concepts, and socialness has been proffered as a fundamental organisational principle underpinning semantic representation in the human brain. However, the empirical support for these hypotheses is limited by inconsistencies in the way socialness has been defined and measured. To further advance theory, the field must establish a clearer working definition, and research efforts could be facilitated by the availability of an extensive set of socialness ratings for individual concepts. Therefore, in the current work, we employed a novel and inclusive definition to test the extent to which socialness is reliably perceived as a broad construct, and we report socialness norms for over 8000 English words, including nouns, verbs, and adjectives. Our inclusive socialness measure shows good reliability and validity, and our analyses suggest that the socialness ratings capture aspects of word meaning which are distinct to those measured by other pertinent semantic constructs, including concreteness and emotional valence. Finally, in a series of regression analyses, we show for the first time that the socialness of a word's meaning explains unique variance in participant performance on lexical tasks. Our dataset of socialness norms has considerable item overlap with those used in both other lexical/semantic norms and in available behavioural mega-studies. They can help target testable predictions about brain and behaviour derived from multiple representation theories and neurobiological accounts of social semantics.

Is a boat bigger than a ship? Null results in the investigation of vowel sound symbolism on size judgements in real language

Sound symbolism is the phenomenon by which certain kinds of phonemes are associated with perceptual and/or semantic properties. In this article, we explored size sound symbolism (i.e., the mil/mal effect) in which high-front vowels (e.g., /i/) show an association with smallness, while low-back vowels (e.g., /ɑ/) show an association with largeness. This has previously been demonstrated with nonwords, but its impact on the processing of real language is unknown. We investigated this using a size judgement task, in which participants classified words for small or large objects, containing a small- or large-associated vowel, based on their size. Words were presented auditorily in Experiment 1 and visually in Experiment 2. We did not observe an effect of vowel congruence (i.e., between object size and the size association of its vowel) in either of the experiments. This suggests that there are limits to the impact of sound symbolism on the processing of real language.

How does attribute ambiguity improve memory?

The memory effects of semantic attributes (e.g., concreteness, familiarity, valence) have long been studied by manipulating their average perceived intensities, as quantified in word rating norms. The semantic ambiguity hypothesis specifies that the uncertainty as well as the intensity of semantic attributes is processed when words are encoded. Testing that hypothesis requires a normed measure of ambiguity, so that ambiguity and intensity can be manipulated independently. The standard deviation (SD) of intensity ratings has been used for that purpose, which has produced three characteristic ambiguity effects. Owing to the recency of such research, fundamental questions remain about the validity of this method of measuring ambiguity and about its process-level effects on memory. In a validity experiment, we found that the rating SDs of six semantic attributes (arousal, concreteness, familiarity, meaningfulness, negative valence, positive valence) passed tests of concurrent and predictive validity. In three memory experiments, we found that manipulating rating SDs had a specific effect on retrieval: It influenced subjects' ability to use reconstructive retrieval to recall words. That pattern was predicted by the current theoretical explanation of how ambiguity benefits memory.

The role of category ambiguity in normal and impaired lexical processing: can you paint without the paint?

Introduction

Many words are categorially ambiguous and can be used as a verb (to paint) or as a noun (the paint) due to the presence of unpronounced morphology or "zero morphology". On this account, the verb "paint" is derived from the noun "paint" through the addition of a silent category-changing morpheme. Past studies have uncovered the syntactic and semantic properties of these categorially ambiguous words, but no research has been conducted on how people process them during normal or impaired lexical processing. Are these two different uses of "paint" processed in the same way? Does this morphosyntactic structure have an effect on online sentence processing?

Methods

This study presents two experiments that investigate the effect of morphosyntactic complexity in categorially ambiguous words presented in isolation (experiment 1) and in a sentential context (experiment 2). The first experiment tested the ability to process categorially unambiguous and ambiguous nouns and verbs in 30 healthy older adults and 12 individuals with aphasia, using a forced choice phrasal-completion task, in which individuals choose whether the or to is most compatible with target words.

Results

Healthy controls and individuals with fluent aphasia all showed: (1) a bias toward the base category in selection rates for the and to, where the was selected more frequently for words identified to be base nouns, and to was selected more frequently for base verbs, and (2) longer reaction times for ambiguous (over unambiguous) words. However, individuals with non-fluent agrammatic aphasia showed a base-category effect only for nouns, with chance performance for verbs. The second experiment, using an eye-tracking while reading paradigm with 56 young healthy adults, showed a reading time slowdown for derived forms (to paint) compared to their base-category counterparts (the paint) in sentence contexts.

Discussion

These findings suggest that categorially ambiguous words likely share a common root, and are related by zero-derivation, and that impaired access to the base-category (i.e., verbs like to visit) precludes associated morphological processes and therefore the retrieval of the derived-category (i.e., nouns like the visit) in non-fluent agrammatic aphasia. This study provides insights into the theory of zero morphology, and the principles that need to be accounted for in models of the lexicon.

The Effects of Symbol Format and Psycholinguistic Features on Receptive Syntax Outcomes of Children Without Disability

PURPOSE

The graphic symbol is the foundation of augmentative and alternative communication (AAC) for many preliterate individuals; however, research has focused primarily on static graphic symbol sequences despite mainstream commercial technologies such as animation. The goal of this study was to compare static and animated symbol sequences across receptive communication outcome measures and psycholinguistic features (e.g., word frequency).

METHOD

A counterbalanced, 2 × 2 × 2 mixed design was used to investigate the effects of symbol format (animated and static), first condition (animated or static), and first experimental task (identification or labeling) on identification accuracy and labeling accuracy of graphic symbol sequences (five symbols) in 24 children with typical development ages 7 and 8 years old. Additionally, three 2 × 2 repeated-measures analyses of variance were conducted using symbol format (animated and static) and (a) word frequency (low, high), (b) imageability (low, high), and (c) concreteness (low, high).

RESULTS

In addition to superior identification and labeling accuracy of animated sequences, a significant interaction between symbol format and the first condition was observed for both experimental tasks. When the animation format was the first condition, then the children's performance improved in the subsequent static condition. Finally, word frequency, imageability, and concreteness ratings for all verbs and prepositions had significant effects on labeling accuracy of verbs and prepositions. Significant interactions between symbol format and psycholinguistic features were also found. For example, highly imageable, animated verbs were labeled with greater accuracy when compared with all other variables.

CONCLUSIONS

Animation technology appears to alleviate some of the burden associated with word- and sentence-level outcomes in children with typical development. Moreover, animation appears to reduce the effects of psycholinguistic features such as word frequency and imageability by increasing the transparency of the symbol. Given the increase in research in this area, speech-language pathologists may consider adopting animated graphic symbols on a case-by-case basis as a tool to augment the learning of word classes in which movement is integral to comprehension.

Learning about the meanings of ambiguous words: evidence from a word-meaning priming paradigm with short narratives

Fluent language comprehension requires people to rapidly activate and integrate context-appropriate word meanings. This process is challenging for meanings of ambiguous words that are comparatively lower in frequency (e.g., the "bird" meaning of "crane"). Priming experiments have shown that recent experience makes such subordinate (less frequent) word meanings more readily available at the next encounter. These experiments used lists of unconnected sentences in which each ambiguity was disambiguated locally by neighbouring words. In natural language, however, disambiguation may occur via more distant contextual cues, embedded in longer, connected communicative contexts. In the present experiment, participants (N = 51) listened to 3-sentence narratives that ended in an ambiguous prime. Cues to disambiguation were relatively distant from the prime; the first sentence of each narrative established a situational context congruent with the subordinate meaning of the prime, but the remainder of the narrative did not provide disambiguating information. Following a short delay, primed subordinate meanings were more readily available (compared with an unprimed control), as assessed by responses in a word association task related to the primed meaning. This work confirms that listeners reliably disambiguate spoken ambiguous words on the basis of cues from wider narrative contexts, and that they retain information about the outcome of these disambiguation processes to inform subsequent encounters of the same word form.

IDEST: International Database of Emotional Short Texts

We introduce a database (IDEST) of 250 short stories rated for valence, arousal, and comprehensibility in two languages. The texts, with a narrative structure telling a story in the first person and controlled for length, were originally written in six different languages (Finnish, French, German, Portuguese, Spanish, and Turkish), and rated for arousal, valence, and comprehensibility in the original language. The stories were translated into English, and the same ratings for the English translations were collected via an internet survey tool (N = 573). In addition to the rating data, we also report readability indexes for the original and English texts. The texts have been categorized into different story types based on their emotional arc. The texts score high on comprehensibility and represent a wide range of emotional valence and arousal levels. The comparative analysis of the ratings of the original texts and English translations showed that valence ratings were very similar across languages, whereas correlations between the two pairs of language versions for arousal and comprehensibility were modest. Comprehensibility ratings correlated with only some of the readability indexes. The database is published in osf.io/9tga3, and it is freely available for academic research.

Mnemicity versus temporality: Distinguishing between components of episodic representations

Human beings regularly "mentally travel" to past and future times in memory and imagination. In theory, whether an event is remembered or imagined (its "mnemicity") underspecifies whether it is oriented toward the past or the future (its "temporality"). However, it remains unclear to what extent the temporal orientation of such episodic simulations is cognitively represented separately from their status as memory or imagination. To address this question, we investigated to what extent episodic simulations are distinguishable in recall by virtue of both temporal orientation and mnemicity. In three experiments (N = 360), participants were asked to generate and later recall events differing along the lines of temporal orientation (past/future) and mnemicity (remembered/imagined). Across all of our experiments, we found that mnemicity and temporality each contributed to participants' ability to discriminate different types of event simulations in recall. However, participants were also consistently more likely to confuse in recall event simulations that shared the same temporal orientation rather than the same mnemicity. These results show that the temporal orientation of episodic simulations can be cognitively represented separately from their mnemicity and have implications for debates about the structure of episodic representations as well as the role of temporality in this structure. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

The Multilingual Picture Database

The growing interdisciplinary research field of psycholinguistics is in constant need of new and up-to-date tools which will allow researchers to answer complex questions, but also expand on languages other than English, which dominates the field. One type of such tools are picture datasets which provide naming norms for everyday objects. However, existing databases tend to be small in terms of the number of items they include, and have also been normed in a limited number of languages, despite the recent boom in multilingualism research. In this paper we present the Multilingual Picture (Multipic) database, containing naming norms and familiarity scores for 500 coloured pictures, in thirty-two languages or language varieties from around the world. The data was validated with standard methods that have been used for existing picture datasets. This is the first dataset to provide naming norms, and translation equivalents, for such a variety of languages; as such, it will be of particular value to psycholinguists and other interested researchers. The dataset has been made freely available.

Auditory Verb Generation Performance Patterns Dissociate Variants of Primary Progressive Aphasia

Primary progressive aphasia (PPA) is a clinical syndrome in which patients progressively lose speech and language abilities. Three variants are recognized: logopenic (lvPPA), associated with phonology and/or short-term verbal memory deficits accompanied by left temporo-parietal atrophy; semantic (svPPA), associated with semantic deficits and anterior temporal lobe (ATL) atrophy; non-fluent (nfvPPA) associated with grammar and/or speech-motor deficits and inferior frontal gyrus (IFG) atrophy. Here, we set out to investigate whether the three variants of PPA can be dissociated based on error patterns in a single language task. We recruited 21 lvPPA, 28 svPPA, and 24 nfvPPA patients, together with 31 healthy controls, and analyzed their performance on an auditory noun-to-verb generation task, which requires auditory analysis of the input, access to and selection of relevant lexical and semantic knowledge, as well as preparation and execution of speech. Task accuracy differed across the three variants and controls, with lvPPA and nfvPPA having the lowest and highest accuracy, respectively. Critically, machine learning analysis of the different error types yielded above-chance classification of patients into their corresponding group. An analysis of the error types revealed clear variant-specific effects: lvPPA patients produced the highest percentage of "not-a-verb" responses and the highest number of semantically related nouns (production of baseball instead of throw to noun ball); in contrast, svPPA patients produced the highest percentage of "unrelated verb" responses and the highest number of light verbs (production of take instead of throw to noun ball). Taken together, our findings indicate that error patterns in an auditory verb generation task are associated with the breakdown of different neurocognitive mechanisms across PPA variants. Specifically, they corroborate the link between temporo-parietal regions with lexical processing, as well as ATL with semantic processes. These findings illustrate how the analysis of pattern of responses can help PPA phenotyping and heighten diagnostic sensitivity, while providing insights on the neural correlates of different components of language.

Bilinear pooling in video-QA: empirical challenges and motivational drift from neurological parallels

Bilinear pooling (BLP) refers to a family of operations recently developed for fusing features from different modalities predominantly for visual question answering (VQA) models. Successive BLP techniques have yielded higher performance with lower computational expense, yet at the same time they have drifted further from the original motivational justification of bilinear models, instead becoming empirically motivated by task performance. Furthermore, despite significant success in text-image fusion in VQA, BLP has not yet gained such notoriety in video question answering (video-QA). Though BLP methods have continued to perform well on video tasks when fusing vision and non-textual features, BLP has recently been overshadowed by other vision and textual feature fusion techniques in video-QA. We aim to add a new perspective to the empirical and motivational drift in BLP. We take a step back and discuss the motivational origins of BLP, highlighting the often-overlooked parallels to neurological theories (Dual Coding Theory and The Two-Stream Model of Vision). We seek to carefully and experimentally ascertain the empirical strengths and limitations of BLP as a multimodal text-vision fusion technique in video-QA using two models (TVQA baseline and heterogeneous-memory-enchanced 'HME' model) and four datasets (TVQA, TGif-QA, MSVD-QA, and EgoVQA). We examine the impact of both simply replacing feature concatenation in the existing models with BLP, and a modified version of the TVQA baseline to accommodate BLP that we name the 'dual-stream' model. We find that our relatively simple integration of BLP does not increase, and mostly harms, performance on these video-QA benchmarks. Using our insights on recent work in BLP for video-QA results and recently proposed theoretical multimodal fusion taxonomies, we offer insight into why BLP-driven performance gain for video-QA benchmarks may be more difficult to achieve than in earlier VQA models. We share our perspective on, and suggest solutions for, the key issues we identify with BLP techniques for multimodal fusion in video-QA. We look beyond the empirical justification of BLP techniques and propose both alternatives and improvements to multimodal fusion by drawing neurological inspiration from Dual Coding Theory and the Two-Stream Model of Vision. We qualitatively highlight the potential for neurological inspirations in video-QA by identifying the relative abundance of psycholinguistically 'concrete' words in the vocabularies for each of the text components (e.g., questions and answers) of the four video-QA datasets we experiment with.

Motivated semantic control: Exploring the effects of extrinsic reward and self-reference on semantic retrieval in semantic aphasia

Recent insights show that increased motivation can benefit executive control, but this effect has not been explored in relation to semantic cognition. Patients with deficits of controlled semantic retrieval in the context of semantic aphasia (SA) after stroke may benefit from this approach since 'semantic control' is considered an executive process. Deficits in this domain are partially distinct from the domain-general deficits of cognitive control. We assessed the effect of both extrinsic and intrinsic motivation in healthy controls and SA patients. Experiment 1 manipulated extrinsic reward using high or low levels of points for correct responses during a semantic association task. Experiment 2 manipulated the intrinsic value of items using self-reference, allocating pictures of items to the participant ('self') or researcher ('other') in a shopping game before participants retrieved their semantic associations. These experiments revealed that patients, but not controls, showed better performance when given an extrinsic reward, consistent with the view that increased external motivation may help ameliorate patients' semantic control deficits. However, while self-reference was associated with better episodic memory, there was no effect on semantic retrieval. We conclude that semantic control deficits can be reduced when extrinsic rewards are anticipated; this enhanced motivational state is expected to support proactive control, for example, through the maintenance of task representations. It may be possible to harness this modulatory impact of reward to combat the control demands of semantic tasks in SA patients.

Multisensory Concept Learning Framework Based on Spiking Neural Networks

Concept learning highly depends on multisensory integration. In this study, we propose a multisensory concept learning framework based on brain-inspired spiking neural networks to create integrated vectors relying on the concept's perceptual strength of auditory, gustatory, haptic, olfactory, and visual. With different assumptions, two paradigms: Independent Merge (IM) and Associate Merge (AM) are designed in the framework. For testing, we employed eight distinct neural models and three multisensory representation datasets. The experiments show that integrated vectors are closer to human beings than the non-integrated ones. Furthermore, we systematically analyze the similarities and differences between IM and AM paradigms and validate the generality of our framework.

Statistical Analysis of Multisensory and Text-Derived Representations on Concept Learning

When learning concepts, cognitive psychology research has revealed that there are two types of concept representations in the human brain: language-derived codes and sensory-derived codes. For the objective of human-like artificial intelligence, we expect to provide multisensory and text-derived representations for concepts in AI systems. Psychologists and computer scientists have published lots of datasets for the two kinds of representations, but as far as we know, no systematic work exits to analyze them together. We do a statistical study on them in this work. We want to know if multisensory vectors and text-derived vectors reflect conceptual understanding and if they are complementary in terms of cognition. Four experiments are presented in this work, all focused on multisensory representations labeled by psychologists and text-derived representations generated by computer scientists for concept learning, and the results demonstrate that (1) for the same concept, both forms of representations can properly reflect the concept, but (2) the representational similarity analysis findings reveal that the two types of representations are significantly different, (3) as the concreteness of the concept grows larger, the multisensory representation of the concept becomes closer to human beings than the text-derived representation, and (4) we verified that combining the two improves the concept representation.