1
|
Sidhu DM, Wingate TG, Bourdage JS, Pexman PM. Would you hire Liam over Kirk? Name sound symbolism and hiring. Acta Psychol (Amst) 2025; 256:104978. [PMID: 40245669 DOI: 10.1016/j.actpsy.2025.104978] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2024] [Revised: 02/14/2025] [Accepted: 04/01/2025] [Indexed: 04/19/2025] Open
Abstract
Sound symbolism is the phenomenon by which certain language sounds evoke particular associations. Previous work has demonstrated that names evoke personality associations based on the sounds they contain, with names containing sonorant consonants evoking different associations than those containing voiceless stops. Here we examined whether these associations would impact a mock hiring task. We created job ads that described an ideal candidate as being high in one of the six factors of the HEXACO framework of personality. Participants were given a pair of candidates, one whose name contained sonorants (e.g., "Molly") and one whose name contained voiceless stops (e.g., "Katie"). Whether job ads contained three personality adjectives (Experiment 1), a single adjective (Experiment 2), or a single adjective and a picture (Experiment 3) participants were more likely to choose the candidate with the sonorant name for certain personality factors. In Experiment 4 participants saw videotaped mock interviews of candidates presented with a sonorant or voiceless stop name. Names were less influential in the presence of audiovisual information than perceived name fit. These results demonstrate the impact of name sound symbolism in a more material scenario. They also help establish boundary conditions and moderators for name sound symbolism.
Collapse
|
2
|
Meng Y, Wan Y, Kit C. Sound symbolism is not "marginal" in Chinese: Evidence from diachronic rhyme books. PLoS One 2025; 20:e0322044. [PMID: 40367103 PMCID: PMC12077721 DOI: 10.1371/journal.pone.0322044] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2024] [Accepted: 03/15/2025] [Indexed: 05/16/2025] Open
Abstract
Contrary to the widespread notion that linguistic signs are arbitrary, researchers have consistently demonstrated the existence of sound symbolism in language, providing evidence for non-arbitrariness in sound-meaning associations. However, much evidence of this kind is based on a limited subset of vocabulary and falls short of systematically demonstrating the pervasive nature of sound symbolism and, especially, its central, rather than marginal, role in language. Furthermore, a historical perspective is lacking to determine whether sound symbolism is merely a feature of archaic languages or has remained a significant element throughout the evolution of languages. This research pioneers a diachronic analysis of sound symbolism in Chinese using historical rhyme books to trace its presence on the vocabulary scale. Employing natural language processing techniques along with statistical methods, it investigates whether phonologically related Chinese characters, as documented in rhyme books, also demonstrate semantic congruence, which would suggest that the phonological aspects of characters are inherently meaningful and hence indicate a systematic, rather than random or purely arbitrary relationship between sounds and meanings. Statistically significant results from our analysis of all four analyzed rhyme books confirm the robustness of sound symbolism over a large span of the Chinese language continuum, and a granular analysis of a representative one of them further reveals that sound symbolism is manifest across various levels of phonological organization, including initials, finals, etc. This study initiates an innovative combination of traditional materials with novel techniques to enrich and expand existing knowledge about sound symbolism, providing both methodological advancement and empirical insights.
Collapse
Affiliation(s)
- Yingying Meng
- Department of Linguistics and Translation, City University of Hong Kong, Kowloon, Hong Kong SAR, China
| | - Yuwei Wan
- Department of Linguistics and Translation, City University of Hong Kong, Kowloon, Hong Kong SAR, China
| | - Chunyu Kit
- Department of Linguistics and Translation, City University of Hong Kong, Kowloon, Hong Kong SAR, China
| |
Collapse
|
3
|
Sidhu DM, Peetz J. Sounds of the future and past. Br J Psychol 2025; 116:316-335. [PMID: 39652400 PMCID: PMC11984344 DOI: 10.1111/bjop.12753] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2024] [Accepted: 11/19/2024] [Indexed: 04/11/2025]
Abstract
We report evidence of sound symbolism for the abstract concept of time across seven experiments (total N = 825). Participants associated the future and past with distinct phonemes (Experiment 1). In particular, using nearly 8000 pseudowords, we found associations between the future and high front vowels and voiced fricatives/affricatives, and between the past and /θ/ and voiced stops (Experiment 2). This association was present not only among English speakers but also by speakers of a closely related language (German) and those of a more distantly related language (Hungarian; Experiment 3). This time-sound symbolism does not appear to be due to embodied articulation (Experiment 4). In sum, these studies identify a robust time sound symbolism effect, along with tests of underlying mechanisms.
Collapse
|
4
|
Ćwiek A, Kreiman J, Fuchs S. Introduction to the Special Issue on Iconicity and Sound Symbolism. THE JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA 2025; 157:3806-3813. [PMID: 40387397 DOI: 10.1121/10.0036662] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/24/2025] [Accepted: 04/25/2025] [Indexed: 05/20/2025]
Abstract
This Special Issue explores iconicity and sound symbolism, areas once considered peripheral to linguistics but now recognized as fundamental to language. The collection presents ten papers that advocate for viewing iconicity, not as a binary trait but as a gradient property, emerging from relationships between form and meaning. The contributions examine various dimensions of iconicity and sound symbolism, including the underlying mechanisms of iconic associations (both acoustic and articulatory), cross-modal relationships across sensory domains, cross-linguistic patterns, social and emotional dimensions, and a developmental perspective that challenges assumptions about the role of iconicity in language acquisition. Moving beyond phonemic approaches, these studies emphasize the importance of continuous acoustic and articulatory parameters in understanding iconic relationships. Collectively, they demonstrate how iconicity bridges physical and conceptual domains and is shaped by biological, cultural, and contextual factors.
Collapse
Affiliation(s)
| | - Jody Kreiman
- Departments of Head and Neck Surgery and Linguistics, University of California Los Angeles, Los Angeles, California 90095-1543, USA
| | - Susanne Fuchs
- Leibniz-Centre General Linguistics, Berlin, 10719, Germany
| |
Collapse
|
5
|
Kilpatrick A, Bundgaard-Nielsen RL. Exploring the dynamics of Shannon's information and iconicity in language processing and lexeme evolution. PLoS One 2025; 20:e0321294. [PMID: 40300008 PMCID: PMC12040248 DOI: 10.1371/journal.pone.0321294] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2024] [Accepted: 03/04/2025] [Indexed: 05/01/2025] Open
Abstract
This two-part meta-study explores the relationship of Shannon's information and iconicity in American English, with a focus on their implications for cognitive processing and the evolution of lexemes. Part one explores the expression of information in iconic words by calculating phonemic bigram surprisal using a very large corpus of spoken American English and cross referencing it with iconicity ratings. Iconic words-those with a form/meaning resemblance-are known to be processed with a cognitive advantage, so they are included in our tests as a benchmark. Within the framework of the Iconic Treadmill Hypothesis, we posit that as iconic words evolve towards arbitrariness, bigram sequences become more predictable, offsetting some the cognitive costs associated with processing arbitrary words. In part 2, we extend Cognitive Load Theory and the Lossy Context Surprisal Model-both sentence level language processing models-to test our predictions at the bigram level using the results of a battery of existing psycholinguistic experiments. In line with these models that explain the psycholinguistic consequences of hearing improbable words in sentences, our results show that words made up of improbable phonemes are processed with cognitive disadvantage, but that extra processing effort enhances their retention in long term memory. Overall, our findings speak to the cognitive limitations of language processing and how these limitations influence lexeme evolution.
Collapse
|
6
|
Anselme R, Pellegrino F, Dediu D. Not just the alveolar trill, but all "r-like" sounds are associated with roughness across languages, pointing to a more general link between sound and touch. Sci Rep 2025; 15:12930. [PMID: 40234493 PMCID: PMC12000421 DOI: 10.1038/s41598-025-94850-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2024] [Accepted: 03/14/2025] [Indexed: 04/17/2025] Open
Affiliation(s)
- Rémi Anselme
- Laboratoire Dynamique du Langage, UMR 5596, Université Lyon2-CNRS, Lyon, France
| | - François Pellegrino
- Laboratoire Dynamique du Langage, UMR 5596, Université Lyon2-CNRS, Lyon, France
| | - Dan Dediu
- Department of Catalan Philology and General Linguistics, University of Barcelona, Barcelona, Spain.
- University of Barcelona Institute for Complex Systems (UBICS), Barcelona, Spain.
- Catalan Institute for Research and Advanced Studies (ICREA), Barcelona, Spain.
| |
Collapse
|
7
|
Winter B. The size and shape of sound: The role of articulation and acoustics in iconicity and crossmodal correspondencesa). THE JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA 2025; 157:2636-2656. [PMID: 40202363 DOI: 10.1121/10.0036362] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/25/2024] [Accepted: 03/14/2025] [Indexed: 04/10/2025]
Abstract
Onomatopoeias like hiss and peep are iconic because their forms resemble their meanings. Iconicity can also involve forms and meanings in different modalities, such as when people match the nonce words bouba and kiki to round and angular objects, and mil and mal to small and large ones, also known as "sound symbolism." This paper focuses on what specific analogies motivate such correspondences in spoken language: do people associate shapes and size with how phonemes sound (auditory), or how they are produced (articulatory)? Based on a synthesis of empirical evidence probing the cognitive mechanisms underlying different types of sound symbolism, this paper argues that analogies based on acoustics alone are often sufficient, rendering extant articulatory explanations for many iconic phenomena superfluous. This paper further suggests that different types of crossmodal iconicity in spoken language can fruitfully be understood as an extension of onomatopoeia: when speakers iconically depict such perceptual characteristics as size and shape, they mimic the acoustics that are correlated with these characteristics in the natural world.
Collapse
Affiliation(s)
- Bodo Winter
- Department of Linguistics and Communication, University of Birmingham, Birmingham B15 2TT, United Kingdom
| |
Collapse
|
8
|
Ramachandra V, Sugimoto K, Ziskind K, Verma A, Ahmad I, Godoy M, Watanabe K. The influence of iconicity and autistic traits on novel word learning: a cross-cultural investigation. ROYAL SOCIETY OPEN SCIENCE 2025; 12:242161. [PMID: 40144288 PMCID: PMC11937926 DOI: 10.1098/rsos.242161] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/11/2024] [Revised: 02/24/2025] [Accepted: 02/26/2025] [Indexed: 03/28/2025]
Abstract
The effects of iconicity and autistic traits on novel word learning were investigated through an online experiment involving 1481 healthy adult participants aged between 18 and 40 years from four countries: Brazil (N = 261), India (N = 416), Japan (N = 493) and the USA (N = 311). Participants completed a bouba-kiki-based word learning task, viewing novel images paired with either iconic names (congruent condition) or arbitrary names (incongruent condition). Word recognition was assessed using a three-alternative forced-choice procedure, and autistic traits were measured with the autism spectrum quotient (AQ). Results showed a significant benefit of iconicity across all countries, with better performance in the congruent condition. While a linear mixed model revealed no significant effect of AQ on bouba-kiki scores overall, a country-specific analysis found a weak but significant positive correlation between AQ scores and bouba-kiki performance in Japanese participants. This country-specific finding should be interpreted cautiously and warrants further exploration. Overall, the findings demonstrate the robustness and universality of the bouba-kiki effect on word learning across both Western and Eastern cultures. However, the relationship between autistic traits and iconicity was not consistent across all countries and may depend on cultural factors. Further research is needed to explore this in more detail.
Collapse
Affiliation(s)
| | - Kairi Sugimoto
- Faculty of Science and Engineering, Waseda University, Shinjuku-ku, Tokyo, Japan
| | - Kelly Ziskind
- Clinical Fellow in Speech-Language Pathology, Theracare, Hackensack, NJ, USA
| | - Ark Verma
- Department of Cognitive Science, Indian Institute of Technology Kanpur, Kanpur, Uttar Pradesh, India
| | - Irfan Ahmad
- Department of Cognitive Science, Indian Institute of Technology Kanpur, Kanpur, Uttar Pradesh, India
| | - Mahayana Godoy
- Center for the Humanities, Languages and Arts, Federal University of Rio Grande do Norte, Natal, Brazil
| | - Katsumi Watanabe
- Faculty of Science and Engineering, Waseda University, Shinjuku-ku, Tokyo, Japan
| |
Collapse
|
9
|
Imai M, Kita S, Akita K, Saji N, Ohba M, Namatame M. Does sound symbolism need sound?: The role of articulatory movement in detecting iconicity between sound and meaninga). THE JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA 2025; 157:137-148. [PMID: 39791996 DOI: 10.1121/10.0034832] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/27/2024] [Accepted: 12/06/2024] [Indexed: 01/12/2025]
Abstract
Ever since de Saussure [Course in General Lingustics (Columbia University Press, 1916)], theorists of language have assumed that the relation between form and meaning of words is arbitrary. However, recently, a body of empirical research has established that language is embodied and contains iconicity. Sound symbolism, an intrinsic link language users perceive between word sound and properties of referents, is a representative example of iconicity in language and has offered profound insights into theories of language pertaining to language processing, language acquisition, and evolution. However, on what basis people detect iconicity between sound and meaning has not yet been made clear. One way to address this question is to ask whether one needs to be able to hear sound to detect sound symbolism. Here, it is shown that (1) deaf-and-Hard-of-Hearing (DHH) participants, even those with profound hearing loss, could judge the sound symbolic match between shapes and words at the same level of accuracy as hearing participants do; and (2) restriction of articulatory movements negatively affects DHH individuals' judgments. The results provided support for the articulatory theory of sound symbolism and lead to a possibility that linguistic symbols may have emerged through iconic mappings across different sensory modality-in particular, oral gesture and sensory experience of the world in the case of speech.
Collapse
Affiliation(s)
- Mutsumi Imai
- Faculty of Environment and Information Studies, Keio University, Fujisawa, Kanagawa 252-0882, Japan
| | - Sotaro Kita
- Department of Psychology, University of Warwick, Warwick, Coventry CV4 7AL, United Kingdom
| | - Kimi Akita
- Department of English Linguistics, Nagoya University, Nagoya, Aichi 464-8601, Japan
| | - Noburo Saji
- Faculty of Human Sciences, Waseda University, Tokorozawa, Saitama 359-1192, Japan
| | - Masato Ohba
- Graduate School of Media and Governance, Keio University, Fujisawa, Kanagawa 252-0882, Japan
| | - Miki Namatame
- Department of Apparel and Space Design, Kyoto Women's University, Kyoto, Kyoto 605-8501, Japan
| |
Collapse
|
10
|
Barker H, Bozic M. Forms, Mechanisms, and Roles of Iconicity in Spoken Language: A Review. Psychol Rep 2024:332941241310119. [PMID: 39705711 DOI: 10.1177/00332941241310119] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2024]
Abstract
Historically, debates over relationships between spoken lexical form and meaning have been dominated by views of arbitrariness. However more recent research revealed a different perspective, in which non-arbitrary mappings play an important role in the makeup of a lexicon. It is now clear that phoneme-sound symbolism - along with other types of form-to-meaning mappings - contributes to non-arbitrariness (iconicity) of spoken words, which is present in many forms and degrees in different languages. Attempts have been made to provide a mechanistic explanation of the phenomenon, and these theories largely centre around cross-modal correspondences. We build on these views to explore iconicity within the evolutionary context and the neurobiological framework for human language processing. We argue that the multimodal bihemsipheric communicative system, to which iconicity is integral, has important phylogenetic and ontogenetic advantages, facilitating language learning, comprehension, and processing. Despite its numerous advantages however, iconicity must compete with arbitrariness, forcing language systems to balance the competing needs of perceptual grounding of the linguistic form and ensuring an effective signal. We conclude that, on balance, iconicity should be viewed as integral to language, and not merely a marginal phenomenon.
Collapse
Affiliation(s)
- Harry Barker
- Department of Psychology, University of Cambridge, Cambridge, UK
| | - Mirjana Bozic
- Department of Psychology, University of Cambridge, Cambridge, UK
| |
Collapse
|
11
|
Mooshammer C, Bobeck D, Hornecker H, Meinhardt K, Olina O, Walch MC, Xia Q. Does Orkish Sound Evil? Perception of Fantasy Languages and Their Phonetic and Phonological Characteristics. LANGUAGE AND SPEECH 2024; 67:961-1000. [PMID: 38018568 PMCID: PMC11583514 DOI: 10.1177/00238309231202944] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/30/2023]
Abstract
Constructed languages, frequently invented to support world-building in fantasy and science fiction genres, are often intended to sound similar to the characteristics of the people who speak them. The aims of this study are (1) to investigate whether some fictional languages, such as Orkish whose speakers are portrayed as villainous, are rated more negatively by listeners than, for example, the Elvish languages, even when they are all produced without emotional involvement in the voice; and (2) to investigate whether the rating results can be related to the sound structure of the languages under investigation. An online rating experiment with three 7-point semantic differential scales was conducted, in which three sentences from each of 12 fictional languages (Neo-Orkish, Quenya, Sindarin, Khuzdul, Adûnaic, Klingon, Vulcan, Atlantean, Dothraki, Na'vi, Kesh, ʕuiʕuid) were rated, spoken by a female and a male speaker. The results from 129 participants indicate that Klingon and Dothraki do indeed sound more unpleasant, evil, and aggressive than the Elvish languages Sindarin and Quenya. Furthermore, this difference in rating is predicted by certain characteristics of the sound structure, such as the percentage of non-German sounds and the percentage of voicing. The implications of these results are discussed in relation to theories of language attitude.
Collapse
Affiliation(s)
- Christine Mooshammer
- Institut für deutsche Sprache und Linguistik, Humboldt-Universität zu Berlin, Germany
| | - Dominique Bobeck
- Institut für deutsche Sprache und Linguistik, Humboldt-Universität zu Berlin, Germany
| | - Henrik Hornecker
- Institut für deutsche Sprache und Linguistik, Humboldt-Universität zu Berlin, Germany
| | - Kierán Meinhardt
- Institut für deutsche Sprache und Linguistik, Humboldt-Universität zu Berlin, Germany
| | - Olga Olina
- Institut für deutsche Sprache und Linguistik, Humboldt-Universität zu Berlin, Germany
| | - Marie Christin Walch
- Institut für deutsche Sprache und Linguistik, Humboldt-Universität zu Berlin, Germany
| | - Qiang Xia
- Institut für deutsche Sprache und Linguistik, Humboldt-Universität zu Berlin, Germany
| |
Collapse
|
12
|
Contreras Kallens P, Christiansen MH. Distributional Semantics: Meaning Through Culture and Interaction. Top Cogn Sci 2024. [PMID: 39587986 DOI: 10.1111/tops.12771] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2024] [Revised: 10/24/2024] [Accepted: 10/28/2024] [Indexed: 11/27/2024]
Abstract
Mastering how to convey meanings using language is perhaps the main challenge facing any language learner. However, satisfactory accounts of how this is achieved, and even of what it is for a linguistic item to have meaning, are hard to come by. Nick Chater was one of the pioneers involved in the early development of one of the most successful methodologies within the cognitive science of language for discovering meaning: distributional semantics. In this article, we review this approach and discuss its successes and shortcomings in capturing semantic phenomena. In particular, we discuss what we dub the "distributional paradox:" how can models that do not implement essential dimensions of human semantic processing, such as sensorimotor grounding, capture so many meaning-related phenomena? We conclude by providing a preliminary answer, arguing that distributional models capture the statistical scaffolding of human language acquisition that allows for communication, which, in line with Nick Chater's more recent ideas, has been shaped by the features of human cognition on the timescale of cultural evolution.
Collapse
Affiliation(s)
| | - Morten H Christiansen
- Department of Psychology, Cornell University
- School of Communication and Culture, Aarhus University
| |
Collapse
|
13
|
Ćwiek A, Anselme R, Dediu D, Fuchs S, Kawahara S, Oh GE, Paul J, Perlman M, Petrone C, Reiter S, Ridouane R, Zeller J, Winter B. The alveolar trill is perceived as jagged/rough by speakers of different languagesa). THE JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA 2024; 156:3468-3479. [PMID: 39565142 DOI: 10.1121/10.0034416] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/11/2024] [Accepted: 10/26/2024] [Indexed: 11/21/2024]
Abstract
Typological research shows that across languages, trilled [r] sounds are more common in adjectives describing rough as opposed to smooth surfaces. In this study, this lexical research is built on with an experiment with speakers of 28 different languages from 12 different families. Participants were presented with images of a jagged and a straight line and imagined running their finger along each. They were then played an alveolar trill [r] and an alveolar approximant [l] and matched each sound to one of the lines. Participants showed a strong tendency to match [r] with the jagged line and [l] with the straight line, even more consistently than in a comparable cross-cultural investigation of the bouba/kiki effect. The pattern is strongest for matching [r] to the jagged line, but also very strong for matching [l] to the straight line. While this effect was found with speakers of languages with different phonetic realizations of the rhotic sound, it was weaker when trilled [r] was the primary variant. This suggests that when a sound is used phonologically to make systemic meaning contrasts, its iconic potential may become more limited. These findings extend our understanding of iconic crossmodal correspondences, highlighting deep-rooted connections between auditory perception and touch/vision.
Collapse
Affiliation(s)
| | - Rémi Anselme
- Laboratoire Dynamique Du Langage UMR 5596, Université Lumière Lyon 2, Lyon, 69363, France
| | - Dan Dediu
- Department of Catalan Philology and General Linguistics, University of Barcelona, Barcelona, 08007, Spain
- Universitat de Barcelona Institute of Complex Systems (UBICS), Barcelona, 08038, Spain
- Catalan Institute for Research and Advanced Studies (ICREA), Barcelona, 08010, Spain
| | - Susanne Fuchs
- Leibniz-Centre General Linguistics, Berlin, 10719, Germany
- IMéRA Institute for Advanced Studies of Aix-Marseille University, Marseille, 13004, France
| | - Shigeto Kawahara
- The Institute of Cultural and Linguistic Studies, Keio University, Mita Minatoku, Tokyo, 108-8345, Japan
| | - Grace E Oh
- Department of English Language and Literature, Konkuk University, Seoul 05029, South Korea
| | - Jing Paul
- Asian Studies Program, Agnes Scott College, Decatur, Georgia 30030, USA
| | - Marcus Perlman
- Department of Linguistics and Communication, University of Birmingham, Birmingham, B15 2TT, United Kingdom
| | - Caterina Petrone
- Aix-Marseille Université, CNRS, Laboratoire Parole et Langage, 13100 Aix-en-Provence, France
| | - Sabine Reiter
- Departamento de Polonês, Alemão e Letras Clássicas, Universidade Federal do Paraná, 80060-150 Curitiba, Brazil
| | - Rachid Ridouane
- Laboratoire de Phonétique et Phonologie, UMR 7018, CNRS, Université Sorbonne Nouvelle, 75005 Paris, France
| | - Jochen Zeller
- School of Arts, Linguistics Discipline, University of KwaZulu-Natal, Durban 4041, South Africa
| | - Bodo Winter
- Department of Linguistics and Communication, University of Birmingham, Birmingham, B15 2TT, United Kingdom
| |
Collapse
|
14
|
Calhoun S, Warren P, Mills J, Agnew J. Socialising the Frequency Code: Effects of gender and age on iconic associations of pitcha). THE JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA 2024; 156:3183-3203. [PMID: 39535238 DOI: 10.1121/10.0034354] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/16/2024] [Accepted: 10/14/2024] [Indexed: 11/16/2024]
Abstract
Burgeoning research has shown the pervasiveness of sound symbolism, a type of iconicity, in language. However, little work looks at how individual experiences and beliefs affect sound symbolic associations. We investigate pitch associations under the Frequency Code, which links high vs low pitch to small vs large body size and female vs male gender (via sexual dimorphism), long claimed to underlie "universal" meanings like submissiveness vs dominance. While such associations appear widespread, the Frequency Code assumes ideological links, e.g., between dominance and masculinity, which differ between individuals and cultures. In Implicit Association Task experiments with English-speaking listeners, we show high pitch is implicitly associated with small size and female gender, and low with large and male, following the Frequency Code. Crucially, though, the strength of these associations varies by social factors. Associations are stronger for male voices and listeners, particularly older men, as ideologies related to the Frequency Code (linking large size, strength, and dominance) tend to be stronger for men. The association of pitch with gender is stronger than with body size, reflecting stronger gender-based stereotypes. This work shows that social experience shapes and reinforces iconic associations, with important implications for how iconic meanings develop and are processed.
Collapse
Affiliation(s)
- Sasha Calhoun
- School of Linguistics and Applied Language Studies, Te Herenga Waka-Victoria University of Wellington (THW-VUW), Wellington, 6140, New Zealand
| | - Paul Warren
- School of Linguistics and Applied Language Studies, Te Herenga Waka-Victoria University of Wellington (THW-VUW), Wellington, 6140, New Zealand
| | - Joy Mills
- School of Linguistics and Applied Language Studies, Te Herenga Waka-Victoria University of Wellington (THW-VUW), Wellington, 6140, New Zealand
| | - Jemima Agnew
- School of Linguistics and Applied Language Studies, Te Herenga Waka-Victoria University of Wellington (THW-VUW), Wellington, 6140, New Zealand
| |
Collapse
|
15
|
Maimon A, Wald IY, Snir A, Ben Oz M, Amedi A. Perceiving depth beyond sight: Evaluating intrinsic and learned cues via a proof of concept sensory substitution method in the visually impaired and sighted. PLoS One 2024; 19:e0310033. [PMID: 39321152 PMCID: PMC11423994 DOI: 10.1371/journal.pone.0310033] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2024] [Accepted: 08/23/2024] [Indexed: 09/27/2024] Open
Abstract
This study explores spatial perception of depth by employing a novel proof of concept sensory substitution algorithm. The algorithm taps into existing cognitive scaffolds such as language and cross modal correspondences by naming objects in the scene while representing their elevation and depth by manipulation of the auditory properties for each axis. While the representation of verticality utilized a previously tested correspondence with pitch, the representation of depth employed an ecologically inspired manipulation, based on the loss of gain and filtration of higher frequency sounds over distance. The study, involving 40 participants, seven of which were blind (5) or visually impaired (2), investigates the intrinsicness of an ecologically inspired mapping of auditory cues for depth by comparing it to an interchanged condition where the mappings of the two axes are swapped. All participants successfully learned to use the algorithm following a very brief period of training, with the blind and visually impaired participants showing similar levels of success for learning to use the algorithm as did their sighted counterparts. A significant difference was found at baseline between the two conditions, indicating the intuitiveness of the original ecologically inspired mapping. Despite this, participants were able to achieve similar success rates following the training in both conditions. The findings indicate that both intrinsic and learned cues come into play with respect to depth perception. Moreover, they suggest that by employing perceptual learning, novel sensory mappings can be trained in adulthood. Regarding the blind and visually impaired, the results also support the convergence view, which claims that with training, their spatial abilities can converge with those of the sighted. Finally, we discuss how the algorithm can open new avenues for accessibility technologies, virtual reality, and other practical applications.
Collapse
Affiliation(s)
- Amber Maimon
- Baruch Ivcher Institute for Brain, Cognition, and Technology, Reichman University, Herzliya, Israel
- Computational Psychiatry and Neurotechnology Lab, Ben Gurion University, Be'er Sheva, Israel
| | - Iddo Yehoshua Wald
- Baruch Ivcher Institute for Brain, Cognition, and Technology, Reichman University, Herzliya, Israel
- Digital Media Lab, University of Bremen, Bremen, Germany
| | - Adi Snir
- Baruch Ivcher Institute for Brain, Cognition, and Technology, Reichman University, Herzliya, Israel
| | - Meshi Ben Oz
- Baruch Ivcher Institute for Brain, Cognition, and Technology, Reichman University, Herzliya, Israel
| | - Amir Amedi
- Baruch Ivcher Institute for Brain, Cognition, and Technology, Reichman University, Herzliya, Israel
| |
Collapse
|
16
|
Fink L, Fiehn H, Wald-Fuhrmann M. The role of audiovisual congruence in aesthetic appreciation of contemporary music and visual art. Sci Rep 2024; 14:20923. [PMID: 39251764 PMCID: PMC11384752 DOI: 10.1038/s41598-024-71399-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2023] [Accepted: 08/27/2024] [Indexed: 09/11/2024] Open
Abstract
Does congruence between auditory and visual modalities affect aesthetic experience? While cross-modal correspondences between vision and hearing are well-documented, previous studies show conflicting results regarding whether audiovisual correspondence affects subjective aesthetic experience. Here, in collaboration with the Kentler International Drawing Space (NYC, USA), we depart from previous research by using music specifically composed to pair with visual art in the professionally-curated Music as Image and Metaphor exhibition. Our pre-registered online experiment consisted of 4 conditions: Audio, Visual, Audio-Visual-Intended (artist-intended pairing of art/music), and Audio-Visual-Random (random shuffling). Participants (N = 201) were presented with 16 pieces and could click to proceed to the next piece whenever they liked. We used time spent as an implicit index of aesthetic interest. Additionally, after each piece, participants were asked about their subjective experience (e.g., feeling moved). We found that participants spent significantly more time with Audio, followed by Audiovisual, followed by Visual pieces; however, they felt most moved in the Audiovisual (bi-modal) conditions. Ratings of audiovisual correspondence were significantly higher for the Audiovisual-Intended compared to Audiovisual-Random condition; interestingly, though, there were no significant differences between intended and random conditions on any other subjective rating scale, or for time spent. Collectively, these results call into question the relationship between cross-modal correspondence and aesthetic appreciation. Additionally, the results complicate the use of time spent as an implicit measure of aesthetic experience.
Collapse
Affiliation(s)
- Lauren Fink
- Department of Music, Max Planck Institute for Empirical Aesthetics, Frankfurt Am Main, HE, Germany.
- Max Planck-NYU Center for Language, Music, & Emotion, Frankfurt Am Main, HE, Germany.
- Department of Psychology, Neuroscience & Behaviour, McMaster University, Hamilton, ON, Canada.
| | - Hannah Fiehn
- Department of Music, Max Planck Institute for Empirical Aesthetics, Frankfurt Am Main, HE, Germany
- Institute of Psychology, Goethe University, Frankfurt Am Main, HE, Germany
| | - Melanie Wald-Fuhrmann
- Department of Music, Max Planck Institute for Empirical Aesthetics, Frankfurt Am Main, HE, Germany
- Max Planck-NYU Center for Language, Music, & Emotion, Frankfurt Am Main, HE, Germany
| |
Collapse
|
17
|
Di Stefano N, Ansani A, Schiavio A, Spence C. Prokofiev was (almost) right: A cross-cultural investigation of auditory-conceptual associations in Peter and the Wolf. Psychon Bull Rev 2024; 31:1735-1744. [PMID: 38267741 PMCID: PMC11358347 DOI: 10.3758/s13423-023-02435-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/10/2023] [Indexed: 01/26/2024]
Abstract
Over recent decades, studies investigating cross-modal correspondences have documented the existence of a wide range of consistent cross-modal associations between simple auditory and visual stimuli or dimensions (e.g., pitch-lightness). Far fewer studies have investigated the association between complex and realistic auditory stimuli and visually presented concepts (e.g., musical excerpts-animals). Surprisingly, however, there is little evidence concerning the extent to which these associations are shared across cultures. To address this gap in the literature, two experiments using a set of stimuli based on Prokofiev's symphonic fairy tale Peter and the Wolf are reported. In Experiment 1, 293 participants from several countries and with very different language backgrounds rated the association between the musical excerpts, images and words representing the story's characters (namely, bird, duck, wolf, cat, and grandfather). The results revealed that participants tended to consistently associate the wolf and the bird with the corresponding musical excerpt, while the stimuli of other characters were not consistently matched across participants. Remarkably, neither the participants' cultural background, nor their musical expertise affected the ratings. In Experiment 2, 104 participants were invited to rate each stimulus on eight emotional features. The results revealed that the emotional profiles associated with the music and with the concept of the wolf and the bird were perceived as more consistent between observers than the emotional profiles associated with the music and the concept of the duck, the cat, and the grandpa. Taken together, these findings therefore suggest that certain auditory-conceptual associations are perceived consistently across cultures and may be mediated by emotional associations.
Collapse
Affiliation(s)
- Nicola Di Stefano
- National Research Council, Institute of Cognitive Sciences and Technologies, Rome, Italy.
| | - Alessandro Ansani
- Centre of Excellence in Music, Mind, Body and Brain, Department of Music, Art and Culture Studies, Jyväskylä, Finland
| | - Andrea Schiavio
- University of York, School of Arts and Creative Technologies, York, UK
| | | |
Collapse
|
18
|
Aussems S, Devey Smith L, Kita S. Do 14-17-month-old infants use iconic speech and gesture cues to interpret word meanings?a). THE JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA 2024; 156:638-654. [PMID: 39051718 DOI: 10.1121/10.0027916] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/31/2024] [Accepted: 06/25/2024] [Indexed: 07/27/2024]
Abstract
This experimental study investigated whether infants use iconicity in speech and gesture cues to interpret word meanings. Specifically, we tested infants' sensitivity to size sound symbolism and iconic gesture cues and asked whether combining these cues in a multimodal fashion would enhance infants' sensitivity in a superadditive manner. Thirty-six 14-17-month-old infants participated in a preferential looking task in which they heard a spoken nonword (e.g., "zudzud") while observing a small and large object (e.g., a small and large square). All infants were presented with an iconic cue for object size (small or large) (1) in the pitch of the spoken non-word (high vs low), (2) in gesture (small or large), or (3) congruently in pitch and gesture (e.g., a high pitch and small gesture indicating a small square). Infants did not show a preference for congruently sized objects in any iconic cue condition. Bayes factor analyses showed moderate to strong support for the null hypotheses. In conclusion, 14-17-month-old infants did not use iconic pitch cues, iconic gesture cues, or iconic multimodal cues (pitch and gesture) to associate speech sounds with their referents. These findings challenge theories that emphasize the role of iconicity in early language development.
Collapse
Affiliation(s)
- Suzanne Aussems
- Department of Psychology, University of Warwick, Coventry CV4 7AL, United Kingdom
| | - Lottie Devey Smith
- School of Education, University of Exeter, Exeter EX1 2LU, United Kingdom
| | - Sotaro Kita
- Department of Psychology, University of Warwick, Coventry CV4 7AL, United Kingdom
| |
Collapse
|
19
|
Schmidtke D, Conrad M. The role of valence and arousal for phonological iconicity in the lexicon of German: a cross-validation study using pseudoword ratings. Cogn Emot 2024:1-22. [PMID: 38773881 DOI: 10.1080/02699931.2024.2353775] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2023] [Accepted: 05/05/2024] [Indexed: 05/24/2024]
Abstract
The notion of sound symbolism receives increasing interest in psycholinguistics. Recent research - including empirical effects of affective phonological iconicity on language processing (Adelman et al., 2018; Conrad et al., 2022) - suggested language codes affective meaning at a basic phonological level using specific phonemes as sublexical markers of emotion. Here, in a series of 8 rating-experiments, we investigate the sensitivity of language users to assumed affectively-iconic systematic distribution patterns of phonemes across the German vocabulary:After computing sublexical-affective-values (SAV) concerning valence and arousal for the entire German phoneme inventory according to occurrences of syllabic onsets, nuclei and codas in a large-scale affective normative lexical database, we constructed pseudoword material differing in SAV to test for subjective affective impressions.Results support affective iconicity as affective ratings mirrored sound-to-meaning correspondences in the lexical database. Varying SAV of otherwise semantically meaningless pseudowords altered affective impressions: Higher arousal was consistently assigned to pseudowords made of syllabic constituents more often used in high-arousal words - contrasted by less straightforward effects of valence SAV. Further disentangling specific differential effects of the two highly-related affective dimensions valence and arousal, our data clearly suggest arousal, rather than valence, as the relevant dimension driving affective iconicity effects.
Collapse
Affiliation(s)
| | - Markus Conrad
- Psychology, Universidad de La Laguna, San Cristóbal de La Laguna, Spain
| |
Collapse
|
20
|
Cao S, Kelly J, Nyugen C, Chow HM, Leonardo B, Sabov A, Ciaramitaro VM. Prior visual experience increases children's use of effective haptic exploration strategies in audio-tactile sound-shape correspondences. J Exp Child Psychol 2024; 241:105856. [PMID: 38306737 DOI: 10.1016/j.jecp.2023.105856] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2023] [Revised: 12/21/2023] [Accepted: 12/23/2023] [Indexed: 02/04/2024]
Abstract
Sound-shape correspondence refers to the preferential mapping of information across the senses, such as associating a nonsense word like bouba with rounded abstract shapes and kiki with spiky abstract shapes. Here we focused on audio-tactile (AT) sound-shape correspondences between nonsense words and abstract shapes that are felt but not seen. Despite previous research indicating a role for visual experience in establishing AT associations, it remains unclear how visual experience facilitates AT correspondences. Here we investigated one hypothesis: seeing the abstract shapes improve haptic exploration by (a) increasing effective haptic strategies and/or (b) decreasing ineffective haptic strategies. We analyzed five haptic strategies in video-recordings of 6- to 8-year-old children obtained in a previous study. We found the dominant strategy used to explore shapes differed based on visual experience. Effective strategies, which provide information about shape, were dominant in participants with prior visual experience, whereas ineffective strategies, which do not provide information about shape, were dominant in participants without prior visual experience. With prior visual experience, poking-an effective and efficient strategy-was dominant, whereas without prior visual experience, uncategorizable and ineffective strategies were dominant. These findings suggest that prior visual experience of abstract shapes in 6- to 8-year-olds can increase the effectiveness and efficiency of haptic exploration, potentially explaining why prior visual experience can increase the strength of AT sound-shape correspondences.
Collapse
Affiliation(s)
- Shibo Cao
- Department of Psychology, University of Massachusetts Boston, Boston, MA 02125, USA
| | - Julia Kelly
- Department of Psychology, University of Massachusetts Boston, Boston, MA 02125, USA
| | - Cuong Nyugen
- Department of Psychology, University of Massachusetts Boston, Boston, MA 02125, USA
| | - Hiu Mei Chow
- Department of Psychology, University of Massachusetts Boston, Boston, MA 02125, USA; Department of Psychology, St. Thomas University, Fredericton, New Brunswick E3B 5G3, Canada
| | - Brianna Leonardo
- Department of Psychology, University of Massachusetts Boston, Boston, MA 02125, USA
| | - Aleksandra Sabov
- Department of Psychology, University of Massachusetts Boston, Boston, MA 02125, USA
| | - Vivian M Ciaramitaro
- Department of Psychology, University of Massachusetts Boston, Boston, MA 02125, USA.
| |
Collapse
|
21
|
Calvillo-Torres R, Haro J, Ferré P, Poch C, Hinojosa JA. Sound symbolic associations in Spanish emotional words: affective dimensions and discrete emotions. Cogn Emot 2024:1-17. [PMID: 38660751 DOI: 10.1080/02699931.2024.2345377] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2023] [Accepted: 04/16/2024] [Indexed: 04/26/2024]
Abstract
Sound symbolism refers to non-arbitrary associations between word forms and meaning, such as those observed for some properties of sounds and size or shape. Recent evidence suggests that these connections extend to emotional concepts. Here we investigated two types of non-arbitrary relationships. Study 1 examined whether iconicity scores (i.e. resemblance-based mapping between aspects of a word's form and its meaning) for words can be predicted from ratings in the affective dimensions of valence and arousal and/or the discrete emotions of happiness, anger, fear, disgust and sadness. Words denoting negative concepts were more likely to have more iconic word forms. Study 2 explored whether statistical regularities in single phonemes (i.e. systematicity) predicted ratings in affective dimensions and/or discrete emotions. Voiceless (/p/, /t/) and voiced plosives (/b/, /d/, /g/) were related to high arousing words, whereas high arousing negative words tended to include fricatives (/s/, /z/). Hissing consonants were also more likely to occur in words denoting all negative discrete emotions. Additionally, words conveying certain discrete emotions included specific phonemes. Overall, our data suggest that emotional features might explain variations in iconicity and provide new insight about phonemic patterns showing sound symbolic associations with the affective properties of words.
Collapse
Affiliation(s)
- Rocío Calvillo-Torres
- Departamento de Psicología Experimental, Procesos Cognitivos y Logopedia, Universidad Complutense de Madrid, Madrid, Spain
| | - Juan Haro
- Departament de Psicologia and CRAMC, Universitat Rovira i Virgili, Tarragona, Spain
| | - Pilar Ferré
- Departament de Psicologia and CRAMC, Universitat Rovira i Virgili, Tarragona, Spain
| | - Claudia Poch
- Centro de Investigación Nebrija en Cognición (CINC), Universidad Nebrija, Madrid, Spain
- Departamento de Educación, Universidad de Nebrija, Madrid, Spain
| | - José A Hinojosa
- Departamento de Psicología Experimental, Procesos Cognitivos y Logopedia, Universidad Complutense de Madrid, Madrid, Spain
- Centro de Investigación Nebrija en Cognición (CINC), Universidad Nebrija, Madrid, Spain
- Instituto Pluridisciplinar, Universidad Complutense de Madrid, Madrid, Spain
| |
Collapse
|
22
|
Bulusu V, Lazar L. Crossmodal associations between naturally occurring tactile and sound textures. Perception 2024; 53:219-239. [PMID: 38304994 DOI: 10.1177/03010066231224557] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/03/2024]
Abstract
This study investigates the crossmodal associations between naturally occurring sound textures and tactile textures. Previous research has demonstrated the association between low-level sensory features of sound and touch, as well as higher-level, cognitively mediated associations involving language, emotions, and metaphors. However, stimuli like textures, which are found in both modalities have received less attention. In this study, we conducted two experiments: a free association task and a two alternate forced choice task using everyday tactile textures and sound textures selected from natural sound categories. The results revealed consistent crossmodal associations reported by participants between the textures of the two modalities. They tended to associate more sound textures (e.g., wood shavings and sandpaper) with tactile surfaces that were rated as harder, rougher, and intermediate on the sticky-slippery scale. While some participants based the auditory-tactile association on sensory features, others made the associations based on semantic relationships, co-occurrence in nature, and emotional mediation. Interestingly, the statistical features of the sound textures (mean, variance, kurtosis, power, autocorrelation, and correlation) did not show significant correlations with the crossmodal associations, indicating a higher-level association. This study provides insights into auditory-tactile associations by highlighting the role of sensory and emotional (or cognitive) factors in prompting these associations.
Collapse
Affiliation(s)
| | - Leslee Lazar
- Indian Institute of Technology Gandhinagar, India
| |
Collapse
|
23
|
Akita K, McLean B, Park J, Thompson AL. Iconicity mediates semantic networks of sound symbolisma). THE JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA 2024; 155:2687-2697. [PMID: 38639927 DOI: 10.1121/10.0025763] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/11/2024] [Accepted: 03/28/2024] [Indexed: 04/20/2024]
Abstract
One speech sound can be associated with multiple meanings through iconicity, indexicality, and/or systematicity. It was not until recently that this "pluripotentiality" of sound symbolism attracted serious attention, and it remains uninvestigated how pluripotentiality may arise. In the current study, Japanese, Korean, Mandarin, and English speakers rated unfamiliar jewel names on three semantic scales: size, brightness, and hardness. The results showed language-specific and cross-linguistically shared pluripotential sound symbolism. Japanese speakers associated voiced stops with large and dark jewels, whereas Mandarin speakers associated [i] with small and bright jewels. Japanese, Mandarin, and English speakers also associated lip rounding with darkness and softness. These sound-symbolic meanings are unlikely to be obtained through metaphorical or metonymical extension, nor are they reported to colexify. Notably, in a purely semantic network without the mediation of lip rounding, softness can instead be associated with brightness, as illustrated by synesthetic metaphors such as yawaraka-na hizashi /jawaɾakanaçizaɕi/ "a gentle (lit. soft) sunshine" in Japanese. These findings suggest that the semantic networks of sound symbolism may not coincide with those of metaphor or metonymy. The current study summarizes the findings in the form of (phono)semantic maps to facilitate cross-linguistic comparisons of pluripotential sound symbolism.
Collapse
Affiliation(s)
- Kimi Akita
- Department of English Linguistics, Nagoya University, Furo-cho, Chikusa-ku, Nagoya, Aichi 464 8601, Japan
| | - Bonnie McLean
- Department of Linguistics and Philology, Uppsala University, 751 26 Uppsala, Sweden
| | - Jiyeon Park
- Namseoul Institute for International Education, Namseoul University, 31020 91, Daehak-ro, Seonghwan-eup, Seobuk-gu, Cheonan, Chungcheongnam-do, South Korea
| | | |
Collapse
|
24
|
Kilpatrick A, Ćwiek A. Using artificial intelligence to explore sound symbolic expressions of gender in American English. PeerJ Comput Sci 2024; 10:e1811. [PMID: 38283586 PMCID: PMC10821993 DOI: 10.7717/peerj-cs.1811] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2023] [Accepted: 12/18/2023] [Indexed: 01/30/2024]
Abstract
This study investigates the extent to which gender can be inferred from the phonemes that make up given names and words in American English. Two extreme gradient boosted algorithms were constructed to classify words according to gender, one using a list of the most common given names (N∼1,000) in North America and the other using the Glasgow Norms (N∼5,500), a corpus consisting of nouns, verbs, adjectives, and adverbs which have each been assigned a psycholinguistic score of how they are associated with male or female behaviour. Both models report significant findings, but the model constructed using given names achieves a greater accuracy despite being trained on a smaller dataset suggesting that gender is expressed more robustly in given names than in other word classes. Feature importance was examined to determine which features were contributing to the decision-making process. Feature importance scores revealed a general pattern across both models, but also show that not all word classes express gender the same way. Finally, the models were reconstructed and tested on the opposite dataset to determine whether they were useful in classifying opposite samples. The results showed that the models were not as accurate when classifying opposite samples, suggesting that they are more suited to classifying words of the same class.
Collapse
Affiliation(s)
- Alexander Kilpatrick
- International Communication, Nagoya University of Commerce and Business, Nagoya, Aichi, Japan
| | | |
Collapse
|
25
|
Nalbantoğlu H, Hazır BM, Dövencioğlu DN. Selectively manipulating softness perception of materials through sound symbolism. Front Psychol 2024; 14:1323873. [PMID: 38259577 PMCID: PMC10801190 DOI: 10.3389/fpsyg.2023.1323873] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2023] [Accepted: 11/30/2023] [Indexed: 01/24/2024] Open
Abstract
Cross-modal interactions between auditory and haptic perception manifest themselves in language, such as sound symbolic words: crunch, splash, and creak. Several studies have shown strong associations between sound symbolic words, shapes (e.g., Bouba/Kiki effect), and materials. Here, we identified these material associations in Turkish sound symbolic words and then tested for their effect on softness perception. First, we used a rating task in a semantic differentiation method to extract the perceived softness dimensions from words and materials. We then tested whether Turkish onomatopoeic words can be used to manipulate the perceived softness of everyday materials such as honey, silk, or sand across different dimensions of softness. In the first preliminary study, we used 40 material videos and 29 adjectives in a rating task with a semantic differentiation method to extract the main softness dimensions. A principal component analysis revealed seven softness components, including Deformability, Viscosity, Surface Softness, and Granularity, in line with the literature. The second preliminary study used 27 onomatopoeic words and 21 adjectives in the same rating task. Again, the findings aligned with the literature, revealing dimensions such as Viscosity, Granularity, and Surface Softness. However, no factors related to Deformability were found due to the absence of sound symbolic words in this category. Next, we paired the onomatopoeic words and material videos based on their associations with each softness dimension. We conducted a new rating task, synchronously presenting material videos and spoken onomatopoeic words. We hypothesized that congruent word-video pairs would produce significantly higher ratings for dimension-related adjectives, while incongruent word-video pairs would decrease these ratings, and the ratings of unrelated adjectives would remain the same. Our results revealed that onomatopoeic words selectively alter the perceived material qualities, providing evidence and insight into the cross-modality of perceived softness.
Collapse
|
26
|
Erben Johansson N. Prominence effects in vocal iconicity: Implications for lexical access and language changea). THE JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA 2024; 155:8-17. [PMID: 38169522 DOI: 10.1121/10.0024240] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/15/2023] [Accepted: 12/13/2023] [Indexed: 01/05/2024]
Abstract
This paper explores how three cognitive and perceptual cues, vocal iconicity, resemblance-based mappings between form and meaning, and segment position and lexical stress, interact to affect word formation and language processing. The study combines an analysis of the word-internal positions that iconic segments occur in based on data from 245 language families with an experimental study in which participants representing more than 30 languages rated iconic and non-iconic pseudowords. The pseudowords were designed to systematically vary segment and stress placement across syllables. The results for study 1 indicate that segments used iconically appear approximately 0.26 segment positions closer toward the beginning of words compared to non-iconic segments. In study 2, it was found that iconic segments occurring in stressed syllables and non-iconic segments occurring in the second syllable were rated as significantly more fitting. These findings suggest that the interplay between vocal iconicity and prominence effects increases the predictive function of iconic segments by foregrounding sounds, which intrinsically carry semantic information. Consequently, these results contribute to the understanding of the widespread occurrence of vocal iconicity in human languages.
Collapse
|
27
|
Brandt AK. Calls of the wild: Exploring the evolutionary roots of consonance and dissonance: Comment on "Consonance and dissonance perception: A critical review of historical sources, multidisciplinary findings, and main hypotheses" by N. Di Stefano, P. Vuust and E. Brattico. Phys Life Rev 2023; 47:68-70. [PMID: 37734283 DOI: 10.1016/j.plrev.2023.09.005] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2023] [Accepted: 09/07/2023] [Indexed: 09/23/2023]
Affiliation(s)
- Anthony K Brandt
- The Shepherd School of Music, Rice University, United States of America.
| |
Collapse
|
28
|
Sidhu DM, Athanasopoulou A, Archer SL, Czarnecki N, Curtin S, Pexman PM. The maluma/takete effect is late: No longitudinal evidence for shape sound symbolism in the first year. PLoS One 2023; 18:e0287831. [PMID: 37943758 PMCID: PMC10635456 DOI: 10.1371/journal.pone.0287831] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2022] [Accepted: 06/14/2023] [Indexed: 11/12/2023] Open
Abstract
The maluma/takete effect refers to an association between certain language sounds (e.g., /m/ and /o/) and round shapes, and other language sounds (e.g., /t/ and /i/) and spiky shapes. This is an example of sound symbolism and stands in opposition to arbitrariness of language. It is still unknown when sensitivity to sound symbolism emerges. In the present series of studies, we first confirmed that the classic maluma/takete effect would be observed in adults using our novel 3-D object stimuli (Experiments 1a and 1b). We then conducted the first longitudinal test of the maluma/takete effect, testing infants at 4-, 8- and 12-months of age (Experiment 2). Sensitivity to sound symbolism was measured with a looking time preference task, in which infants were shown images of a round and a spiky 3-D object while hearing either a round- or spiky-sounding nonword. We did not detect a significant difference in looking time based on nonword type. We also collected a series of individual difference measures including measures of vocabulary, movement ability and babbling. Analyses of these measures revealed that 12-month olds who babbled more showed a greater sensitivity to sound symbolism. Finally, in Experiment 3, we had parents take home round or spiky 3-D printed objects, to present to 7- to 8-month-old infants paired with either congruent or incongruent nonwords. This language experience had no effect on subsequent measures of sound symbolism sensitivity. Taken together these studies demonstrate that sound symbolism is elusive in the first year, and shed light on the mechanisms that may contribute to its eventual emergence.
Collapse
Affiliation(s)
- David M. Sidhu
- Department of Psychology, Carleton University, Ottawa, Canada
| | - Angeliki Athanasopoulou
- School of Languages, Linguistics, Literatures, and Cultures, University of Calgary, Calgary, Canada
| | | | | | - Suzanne Curtin
- Department of Child and Youth Studies, Brock University, St. Catharines, Canada
| | - Penny M. Pexman
- Department of Psychology, University of Calgary, Calgary, Canada
| |
Collapse
|
29
|
Pelkey J. Embodiment and language. WILEY INTERDISCIPLINARY REVIEWS. COGNITIVE SCIENCE 2023; 14:e1649. [PMID: 37186163 DOI: 10.1002/wcs.1649] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/25/2022] [Revised: 02/26/2023] [Accepted: 03/21/2023] [Indexed: 05/17/2023]
Abstract
The findings of cognitive linguistics demonstrate the thoroughly embodied grounding of linguistic constructions and linguistic meaning ranging from abstract thought to interactive communication. A historical survey and updated summary of work in this area illustrates the many layers of bodily meaning that we rely on when thinking and communicating as human beings. Key distinctions, definitions, and clarifications, plus an overview of key works on embodied cognition in cognitive linguistics provide necessary context for understanding specific aspects of linguistic embodiment, including schemas and iconicity, mapping and metaphor, categories and projections, embodied grammar and abstract thought, intersubjectivity, and textual meaning. Realigning philosophical presuppositions with the findings of cognitive linguistics has important consequences: Body and mind can be reunited in lived experience. Both imaginative thought and rational thought can be understood as reliant on the same movement and memory structures. Even the most habituated form-content relationships in language can be understood as growing out of vital networks of real-world experiential relations, from the personal to the interpersonal. And instead of being understood as the narrow purview of semantics and pragmatics, the study of meaning can be embraced as the purpose and function of linguistics. These consequences have potential for revolutionizing scientific inquiry and theory building across a wide array of disciplines. This article is categorized under: Linguistics > Cognitive Linguistics Psychology > Language Philosophy > Foundations of Cognitive Science.
Collapse
Affiliation(s)
- Jamin Pelkey
- Department of Languages, Literatures & Cultures, Toronto Metropolitan University, Toronto, Ontario, Canada
| |
Collapse
|
30
|
Sidhu DM, Vigliocco G. I don't see what you're saying: The maluma/takete effect does not depend on the visual appearance of phonemes as they are articulated. Psychon Bull Rev 2023; 30:1521-1529. [PMID: 36520277 PMCID: PMC10482773 DOI: 10.3758/s13423-022-02224-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/16/2022] [Indexed: 12/23/2022]
Abstract
In contrast to the principle of arbitrariness, recent work has shown that language can iconically depict referents being talked about. One such example is the maluma/takete effect: an association between certain phonemes (e.g., those in maluma) and round shapes, and other phonemes (e.g., those in takete and spiky shapes). An open question has been whether this association is crossmodal (arising from phonemes' sound or kinesthetics) or unimodal (arising from phonemes' visual appearance). In the latter case, individuals may associate a person's rounded lips as they pronounce the /u/ in maluma with round shapes. We examined this hypothesis by having participants pair nonwords with shapes in either an audio-only condition (they only heard nonwords) or an audiovisual condition (they both heard nonwords and saw them articulated). We found no evidence that seeing nonwords articulated enhanced the maluma/takete effect. In fact, there was evidence that it decreased it in some cases. This was confirmed with a Bayesian analysis. These results eliminate a plausible explanation for the maluma/takete effect, as an instance of visual matching. We discuss the alternate possibility that it involves crossmodal associations.
Collapse
Affiliation(s)
- David M. Sidhu
- Department of Psychology, University College London, London, UK
- Department of Psychology, Carleton University, Ottawa, Ontario Canada
| | | |
Collapse
|
31
|
Piller S, Senna I, Ernst MO. Visual experience shapes the Bouba-Kiki effect and the size-weight illusion upon sight restoration from congenital blindness. Sci Rep 2023; 13:11435. [PMID: 37454205 PMCID: PMC10349879 DOI: 10.1038/s41598-023-38486-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2023] [Accepted: 07/09/2023] [Indexed: 07/18/2023] Open
Abstract
The Bouba-Kiki effect is the systematic mapping between round/spiky shapes and speech sounds ("Bouba"/"Kiki"). In the size-weight illusion, participants judge the smaller of two equally-weighted objects as being heavier. Here we investigated the contribution of visual experience to the development of these phenomena. We compared three groups: early blind individuals (no visual experience), individuals treated for congenital cataracts years after birth (late visual experience), and typically sighted controls (visual experience from birth). We found that, in cataract-treated participants (tested visually/visuo-haptically), both phenomena are absent shortly after sight onset, just like in blind individuals (tested haptically). However, they emerge within months following surgery, becoming statistically indistinguishable from the sighted controls. This suggests a pivotal role of visual experience and refutes the existence of an early sensitive period: A short period of experience, even when gained only years after birth, is sufficient for participants to visually pick-up regularities in the environment, contributing to the development of these phenomena.
Collapse
Affiliation(s)
- Sophia Piller
- Applied Cognitive Psychology, Faculty for Computer Science, Engineering, and Psychology, Ulm University, Ulm, Germany.
- Transfer Center for Neuroscience and Education (ZNL), Ulm University, Ulm, Germany.
| | - Irene Senna
- Applied Cognitive Psychology, Faculty for Computer Science, Engineering, and Psychology, Ulm University, Ulm, Germany
- Department of Psychology, Liverpool Hope University, Liverpool, UK
| | - Marc O Ernst
- Applied Cognitive Psychology, Faculty for Computer Science, Engineering, and Psychology, Ulm University, Ulm, Germany
| |
Collapse
|
32
|
King DA, Kamien RD. What promotes smectic order: Applying mean-field theory to the ends. Phys Rev E 2023; 107:064702. [PMID: 37464685 DOI: 10.1103/physreve.107.064702] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2022] [Accepted: 06/05/2023] [Indexed: 07/20/2023]
Abstract
Not every particle that forms a nematic liquid crystal makes a smectic. The particle tip is critical for this behavior. Ellipsoids do not make a smectic, but spherocylinders do. Similarly, only those N-CB alkylcyanobiphenyls with sufficiently long (N≥8 carbons) alkane tails form smectics. We understand the role of the particle tip in the smectic transition by means of a simple two-dimensional model. We model spherocylinders by "boubas" with rounded tips, and ellipsoids by "kikis" with pointed tips. The N-CB molecules are modeled by a small body with a polymer tail. We find that rounded tips and longer polymer tails lead to a smectic at lower densities by making the space between layers less accessible, destabilizing the nematic.
Collapse
Affiliation(s)
- David A King
- Department of Physics and Astronomy, University of Pennsylvania, 209 South 33rd Street, Philadelphia, Pennsylvania 19104, USA
| | - Randall D Kamien
- Department of Physics and Astronomy, University of Pennsylvania, 209 South 33rd Street, Philadelphia, Pennsylvania 19104, USA
| |
Collapse
|
33
|
Topolinski S, Boecker L, Löffler CS, Gusmão B, Ingendahl M. On the emergence of the in-out effect across trials: two items do the trick. PSYCHOLOGICAL RESEARCH 2023; 87:1180-1192. [PMID: 35867154 PMCID: PMC10192141 DOI: 10.1007/s00426-022-01715-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2022] [Accepted: 07/07/2022] [Indexed: 11/28/2022]
Abstract
Individuals prefer letter strings whose consonantal articulation spots move from the front of the mouth to the back (e.g., BAKA, inward) over those with a reversed consonant order (e.g., KABA, outward), the so-called in-out effect. The present research explores whether individuals hold an internal standard or scheme of consonant order that triggers this effect. If this were the case, the in-out effect should already occur in one-trial between-subjects designs. If not, the in-out effect should emerge over the course of trials in within-subjects designs. In Experiments 1a-e (1b-e preregistered; total N = 2973; German, English, and Portuguese samples) employing a one-trial between-subjects design, no in-out effect was found. In Experiment 2 (N = 253), employing within-subjects designs with either 1, 5, 10, 30, or 50 trials per consonant order category (inward vs. outward), the in-out effect was absent in the first trial, but already surfaced for the first 2 trials, reached significance within the first 10 trials and a solid plateau within the first 20 trials. Of the four theoretical explanations, the present evidence favors the fluency/frequency and letter-position accounts and is at odds with the eating-related embodiment and easy-first accounts.
Collapse
Affiliation(s)
- Sascha Topolinski
- Department of Psychology, University of Cologne, Richard-Strauss-Straße 2, 50931, Cologne, Germany.
| | - Lea Boecker
- Department of Economic Psychology, Social Psychology and Experimental Methods, University of Lüneburg, Lüneburg, Germany
| | - Charlotte S Löffler
- Department of Psychology, University of Cologne, Richard-Strauss-Straße 2, 50931, Cologne, Germany
| | - Beatriz Gusmão
- Department of Psychology, University of Cologne, Richard-Strauss-Straße 2, 50931, Cologne, Germany
| | - Moritz Ingendahl
- Department of Psychology, University of Mannheim, Mannheim, Germany
| |
Collapse
|
34
|
Guedes D, Vaz Garrido M, Lamy E, Pereira Cavalheiro B, Prada M. Crossmodal interactions between audition and taste: A systematic review and narrative synthesis. Food Qual Prefer 2023. [DOI: 10.1016/j.foodqual.2023.104856] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/30/2023]
|
35
|
Kilpatrick AJ, Ćwiek A, Kawahara S. Random forests, sound symbolism and Pokémon evolution. PLoS One 2023; 18:e0279350. [PMID: 36598905 PMCID: PMC9812336 DOI: 10.1371/journal.pone.0279350] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2022] [Accepted: 12/06/2022] [Indexed: 01/05/2023] Open
Abstract
This study constructs machine learning algorithms that are trained to classify samples using sound symbolism, and then it reports on an experiment designed to measure their understanding against human participants. Random forests are trained using the names of Pokémon, which are fictional video game characters, and their evolutionary status. Pokémon undergo evolution when certain in-game conditions are met. Evolution changes the appearance, abilities, and names of Pokémon. In the first experiment, we train three random forests using the sounds that make up the names of Japanese, Chinese, and Korean Pokémon to classify Pokémon into pre-evolution and post-evolution categories. We then train a fourth random forest using the results of an elicitation experiment whereby Japanese participants named previously unseen Pokémon. In Experiment 2, we reproduce those random forests with name length as a feature and compare the performance of the random forests against humans in a classification experiment whereby Japanese participants classified the names elicited in Experiment 1 into pre-and post-evolution categories. Experiment 2 reveals an issue pertaining to overfitting in Experiment 1 which we resolve using a novel cross-validation method. The results show that the random forests are efficient learners of systematic sound-meaning correspondence patterns and can classify samples with greater accuracy than the human participants.
Collapse
Affiliation(s)
| | - Aleksandra Ćwiek
- Department Leibniz-Zentrum Allgemeine Sprachwissenschaft, Berlin, Germany
| | - Shigeto Kawahara
- Institute of Cultural and Linguistic Studies, Keio University, Tokyo, Japan
| |
Collapse
|
36
|
Kilpatrick A, Ćwiek A, Lewis E, Kawahara S. A cross-linguistic, sound symbolic relationship between labial consonants, voiced plosives, and Pokémon friendship. Front Psychol 2023; 14:1113143. [PMID: 36910799 PMCID: PMC10000297 DOI: 10.3389/fpsyg.2023.1113143] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2022] [Accepted: 02/07/2023] [Indexed: 03/14/2023] Open
Abstract
Introduction This paper presents a cross-linguistic study of sound symbolism, analysing a six-language corpus of all Pokémon names available as of January 2022. It tests the effects of labial consonants and voiced plosives on a Pokémon attribute known as friendship. Friendship is a mechanic in the core series of Pokémon video games that arguably reflects how friendly each Pokémon is. Method Poisson regression is used to examine the relationship between the friendship mechanic and the number of times /p/, /b/, /d/, /m/, /g/, and /w/ occur in the names of English, Japanese, Korean, Chinese, German, and French Pokémon. Results Bilabial plosives, /p/ and /b/, typically represent high friendship values in Pokémon names while /m/, /d/, and /g/ typically represent low friendship values. No association is found for /w/ in any language. Discussion Many of the previously known cases of cross-linguistic sound symbolic patterns can be explained by the relationship between how sounds in words are articulated and the physical qualities of the referents. This study, however, builds upon the underexplored relationship between sound symbolism and abstract qualities.
Collapse
|
37
|
Blasi DE, Henrich J, Adamou E, Kemmerer D, Majid A. Over-reliance on English hinders cognitive science. Trends Cogn Sci 2022; 26:1153-1170. [PMID: 36253221 DOI: 10.1016/j.tics.2022.09.015] [Citation(s) in RCA: 79] [Impact Index Per Article: 26.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2022] [Revised: 09/19/2022] [Accepted: 09/22/2022] [Indexed: 11/05/2022]
Abstract
English is the dominant language in the study of human cognition and behavior: the individuals studied by cognitive scientists, as well as most of the scientists themselves, are frequently English speakers. However, English differs from other languages in ways that have consequences for the whole of the cognitive sciences, reaching far beyond the study of language itself. Here, we review an emerging body of evidence that highlights how the particular characteristics of English and the linguistic habits of English speakers bias the field by both warping research programs (e.g., overemphasizing features and mechanisms present in English over others) and overgeneralizing observations from English speakers' behaviors, brains, and cognition to our entire species. We propose mitigating strategies that could help avoid some of these pitfalls.
Collapse
Affiliation(s)
- Damián E Blasi
- Department of Human Evolutionary Biology, Harvard University, 11 Divinity Street, 02138 Cambridge, MA, USA; Department of Linguistic and Cultural Evolution, Max Planck Institute for Evolutionary Anthropology, Deutscher Pl. 6, 04103 Leipzig, Germany; Human Relations Area Files, 755 Prospect Street, New Haven, CT 06511-1225, USA.
| | - Joseph Henrich
- Department of Human Evolutionary Biology, Harvard University, 11 Divinity Street, 02138 Cambridge, MA, USA
| | - Evangelia Adamou
- Languages and Cultures of Oral Tradition lab, National Center for Scientific Research (CNRS), 7 Rue Guy Môquet, 94801 Villejuif, France
| | - David Kemmerer
- Department of Speech, Language, and Hearing Sciences, Purdue University, 715 Clinic Drive, West Lafayette, IN 47907, USA; Department of Psychological Sciences, Purdue University, 703 3rd Street, West Lafayette, IN 47907, USA
| | - Asifa Majid
- Department of Experimental Psychology, University of Oxford, Woodstock Road, Oxford OX2 6GG, UK.
| |
Collapse
|
38
|
Resolving the bouba-kiki effect enigma by rooting iconic sound symbolism in physical properties of round and spiky objects. Sci Rep 2022; 12:19172. [PMID: 36357511 PMCID: PMC9649795 DOI: 10.1038/s41598-022-23623-w] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2022] [Accepted: 11/02/2022] [Indexed: 11/11/2022] Open
Abstract
The "bouba-kiki effect", where "bouba" is perceived round and "kiki" spiky, remains a puzzling enigma. We solve it by combining mathematical findings largely unknown in the field, with computational models and novel experimental evidence. We reveal that this effect relies on two acoustic cues: spectral balance and temporal continuity. We demonstrate that it is not speech-specific but rather rooted in physical properties of objects, creating audiovisual regularities in the environment. Round items are mathematically bound to produce, when hitting or rolling on a surface, lower-frequency spectra and more continuous sounds than same-size spiky objects. Finally, we show that adults are sensitive to such regularities. Hence, intuitive physics impacts language perception and possibly language acquisition and evolution too.
Collapse
|
39
|
Conrad M, Ullrich S, Schmidtke D, Kotz SA. ERPs reveal an iconic relation between sublexical phonology and affective meaning. Cognition 2022; 226:105182. [PMID: 35689874 DOI: 10.1016/j.cognition.2022.105182] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2021] [Revised: 05/15/2022] [Accepted: 05/25/2022] [Indexed: 11/03/2022]
Abstract
Classical linguistic theory assumes that formal aspects, like sound, are not internally related to the meaning of words. However, recent research suggests language might code affective meaning such as threat and alert sublexically. Positing affective phonological iconicity as a systematic organization principle of the German lexicon, we calculated sublexical affective values for sub-syllabic phonological word segments from a large-scale affective lexical German database by averaging valence and arousal ratings of all words any phonological segment appears in. We tested word stimuli with either consistent or inconsistent mappings between lexical affective meaning and sublexical affective values (negative-valence/high-arousal vs. neutral-valence/low-arousal) in an EEG visual-lexical-decision task. A mismatch between sublexical and lexical affective values elicited an increased N400 response. These results reveal that systematic affective phonological iconicity - extracted from the lexicon - impacts the extraction of lexical word meaning during reading.
Collapse
Affiliation(s)
- M Conrad
- Department of Cognitive Psychology, Universidad de La Laguna, Spain; Instituto Universitario de Neurociencia (IUNE), Universidad de La Laguna, Spain.
| | | | | | - S A Kotz
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany; Maastricht University, Maastricht, the Netherlands
| |
Collapse
|
40
|
de Varda AG, Strapparava C. A Cross-Modal and Cross-lingual Study of Iconicity in Language: Insights From Deep Learning. Cogn Sci 2022; 46:e13147. [PMID: 35665953 PMCID: PMC9285447 DOI: 10.1111/cogs.13147] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2021] [Revised: 04/27/2022] [Accepted: 04/28/2022] [Indexed: 11/30/2022]
Abstract
The present paper addresses the study of non-arbitrariness in language within a deep learning framework. We present a set of experiments aimed at assessing the pervasiveness of different forms of non-arbitrary phonological patterns across a set of typologically distant languages. Different sequence-processing neural networks are trained in a set of languages to associate the phonetic vectorization of a set of words to their sensory (Experiment 1), semantic (Experiment 2), and word-class representations (Experiment 3). The models are then tested, without further training, in a set of novel instances in a language belonging to a different language family, and their performance is compared with a randomized baseline. We show that the three cross-domain mappings can be successfully transferred across languages and language families, suggesting that the phonological structure of the lexicon is pervaded with language-invariant cues about the words' meaning and their syntactic classes.
Collapse
|