Neurocognitive poetics: methods and models for investigating the neuronal and cognitive-affective bases of literature reception

Dance and the Embodied Social Cognition of Mating: Carlos Saura's Tango in the Perspective of the Tie-Up Theory

This paper analyzes Carlos Saura's film Tango through the theoretical lens of the Tie-Up Theory to explore how fictional narratives can serve as laboratories for investigating the embodied social cognition of romantic relationships. The study shows how dance, particularly tango, functions both as subject matter and cognitive metaphor in representing the complex dynamics of couple formation and maintenance. The film's meta-representational structure, combining the creation of a dance performance with the exploration of actual relationships, reveals how cultural forms serve as cognitive scaffolds for understanding complex social dynamics. The study contributes to our understanding of how artistic representation can reveal typically implicit aspects of relationship cognition by demonstrating the value of integrating multidisciplinary perspectives of cognitive theory, psychology of mating, and cultural theory.

Predicting subjective ratings of affect and comprehensibility with text features: a reader response study of narrative poetry

Literary reading is an interactive process between a reader and a text that depends on a balance between cognitive effort and emotional rewards. By studying both the crucial features of the text and of the subjective reader reception, a better understanding of this interactive process can be reached. In the present study, subjects (N=31) read and rated a work of narrative fiction that was written in a poetic style, thereby offering the readers two pathways to cognitive rewards: Aesthetic appreciation and narrative immersion. Using purely text-based quantitative descriptors, we were able to independently and accurately predict the subjective ratings in the dimensions comprehensibility, valence, arousal, and liking across roughly 140 pages of naturalistic text. The specific text features that were most important in predicting each rating dimension are discussed in detail. In addition, the implications of the findings are discussed more generally in the context of existing models of literary processing and future research avenues for empirical literary studies.

The role of the target language culture on Arabic learners' fondness for Arabic poetry

As an important carrier of culture, poetry plays a significant role in deepening language learners' understanding of the target language culture as well as enhancing their language skills; however, the effect of the target language culture on language learners' enjoyment of poetry remains unclear. The study served as an attempt to shed light on the point of whether the target language culture has different effects on high- and low-level Chinese Arabic learners' fondness for Arabic poetry with the use of pictures related to Arabic culture and those not related to Arabic culture. In the current study, 40 Arabic learners (20 high-level and 20 low-level) scored the Arabic poem line based on their fondness for it after viewing two kinds of picture with electroencephalogram (EEG) recording. Frontal alpha asymmetry index as a correlate of approach and avoidance related motivation measured by EEG power in the alpha band (8-13 Hz) was calculated for examining whether the behavioral results of Arabic learners' fondness for poetry are in line with the results of changes in the related EEG components. Behavioral results illustrated that low-level subjects showed significantly less liking for Arabic poetry after viewing pictures related to Arabic culture compared to those not related to Arabic culture. The high-level subjects did not show a significant difference in the level of liking for Arabic poetry between the two cases. FAA results demonstrated that low-level subjects presented a significant avoidance-related responses to Arabic poetry after viewing pictures related to Arabic culture in comparison to viewing pictures not related to Arabic culture; while the FAA values did not differ significantly between the two cases in high-level subjects, which is in line with behavioral results. The findings of this research can benefit teachers in motivating students to learn poetry in foreign language curriculum and also contribute to the literature on the effect of target language culture on language learners' enjoyment of poetry.

Smile Back at Me, But Only Once: Social Norms of Appropriate Nonverbal Intensity and Reciprocity Apply to Emoji Use

In computer-mediated communication, small graphical icons (emojis) can be used to compensate for the lack of nonverbal cues such as facial expressions or hand gestures. Accordingly, literature suggests that the use of emojis may also be subject to social norms—similar to nonverbal behavior in face-to-face interactions. However, actual empirical investigations into this assumption remain lacking. To remedy this research gap, I explored whether traditional norms of appropriate emotional intensity and reciprocity also apply to emoji usage. A first online experiment (N = 188) revealed that excessive emoji use in a first-contact scenario leads to diminished interpersonal outcomes, corresponding to the drawbacks of overly intense nonverbal displays in natural interactions. Proceeding to a different communicative stage, Experiment 2 (N = 242) explored nonverbal reciprocity with acquainted interaction partners. Inviting participants to reply to fictitious text messages (at varying levels of interpersonal intimacy), it was observed that stimulus messages containing more emojis also evoke stronger emoji use in return—indicating that principles of nonverbal attunement are in full effect during text-based online interactions.

'Looking before and after': Can simple eye tracking patterns distinguish poetic from prosaic texts?

Introduction

The study of 'serious' literature has recently developed into an emerging field called neurocognitive poetics that applies cognitive neuroscientific techniques to examine how we understand and appreciate poetry. The current research used eye-tracking techniques on a small sample of young adults to see if and how the reading of short pieces of poetry differed from the reading of matched prosaic texts.

Methods

With 'proof of concept' intentions reflecting arguments first proposed by 19th Century literary figures, there was a particular focus on the differences between the reading of poetry and prose in terms number and frequency of fixations and regressive eye movements back and forth within the texts in this two-by-two experimental design (poetry vs. prose x need vs. no need for final line reappraisal).

Results

It was found that poetic pieces compared to prosaic pieces were associated with more and longer fixations and more regressive eye movements throughout the text. The need to reappraise meaning at the prompt of a final line was only significantly associated with more regressive eye movements. Comparisons examining the 4 text conditions (poetic reappraisal, poetic non-reappraisal, prosaic reappraisal, and prosaic non-reappraisal) showed that the poetic reappraisal condition was characterised by significantly more regressive eye movements as well as longer fixations compared to the prosaic non-reappraisal condition. No significant correlations were found between self-reported literary familiarity and eye tracking patterns.

Discussion

Despite limitations, this proof-of-concept study provides insights into reading patterns that can help to define objectively the nature of poetic material as requiring slower reading particularly characterised by more and longer fixations and eye movements backwards through the texts compared to the faster, more linear reading of prose. Future research using these, and other psychophysiological metrics can begin to unpack the putative cognitive benefits of reading literary material.

MA-EM: A neurocognitive model for understanding mixed and ambiguous emotions and morality

Understanding emotions and moral intentions of other people is integral to being human. Humanities scholars have long recognized the complex and ambiguous nature of emotions and morality. People are rarely 'just' happy, or sad. Neither are they 'just' good or bad people. Despite this, most knowledge about the psychological and neural basis of emotions and moral understanding comes from experiments investigating unidimensional and non-ambiguous emotions and morality. The goal of this paper is twofold. First I want to point out why mixed and ambiguous emotions and morality are a promising research topic for cognitive neuroscientists. Observing or experiencing mixed or ambiguous emotions and morality tends to have a strong impact on humans. This impact is clearly visible in narratives and fiction, and I will argue that narratives make an excellent stimulus to study the effects of emotional and moral ambiguity. Second, I will sketch a model to help guide research in this promising corner of human cognition.

Different routes to liking: how readers arrive at narrative evaluations

When two people read the same story, they might both end up liking it very much. However, this does not necessarily mean that their reasons for liking it were identical. We therefore ask what factors contribute to “liking” a story, and—most importantly—how people vary in this respect. We found that readers like stories because they find them interesting, amusing, suspenseful and/or beautiful. However, the degree to which these components of appreciation were related to how much readers liked stories differed between individuals. Interestingly, the individual slopes of the relationships between many of the components and liking were (positively or negatively) correlated. This indicated, for instance, that individuals displaying a relatively strong relationship between interest and liking, generally display a relatively weak relationship between sadness and liking. The individual differences in the strengths of the relationships between the components and liking were not related to individual differences in expertize, a characteristic strongly associated with aesthetic appreciation of visual art. Our work illustrates that it is important to take into consideration the fact that individuals differ in how they arrive at their evaluation of literary stories, and that it is possible to quantify these differences in empirical experiments. Our work suggests that future research should be careful about “overfitting” theories of aesthetic appreciation to an “idealized reader,” but rather take into consideration variations across individuals in the reason for liking a particular story.

IDEST: International Database of Emotional Short Texts

We introduce a database (IDEST) of 250 short stories rated for valence, arousal, and comprehensibility in two languages. The texts, with a narrative structure telling a story in the first person and controlled for length, were originally written in six different languages (Finnish, French, German, Portuguese, Spanish, and Turkish), and rated for arousal, valence, and comprehensibility in the original language. The stories were translated into English, and the same ratings for the English translations were collected via an internet survey tool (N = 573). In addition to the rating data, we also report readability indexes for the original and English texts. The texts have been categorized into different story types based on their emotional arc. The texts score high on comprehensibility and represent a wide range of emotional valence and arousal levels. The comparative analysis of the ratings of the original texts and English translations showed that valence ratings were very similar across languages, whereas correlations between the two pairs of language versions for arousal and comprehensibility were modest. Comprehensibility ratings correlated with only some of the readability indexes. The database is published in osf.io/9tga3, and it is freely available for academic research.

User-centered categorization of mood in fiction

Purpose

Readers articulate mood in deeply subjective ways, yet the underlying structure of users' understanding of the media they consume has important implications for retrieval and access. User articulations might at first seem too idiosyncratic, but organizing them meaningfully has considerable potential to provide a better searching experience for all involved. The current study develops mood categories inductively for fiction organization and retrieval in information systems.

Design/methodology/approach

The authors developed and distributed an open-ended survey to 76 fiction readers to understand their preferences with regard to the affective elements in fiction. From the fiction reader responses, the research team identified 161 mood terms and used them for further categorization.

Findings

The inductive approach resulted in 30 categories, including angry, cozy, dark and nostalgic. Results include three overlapping mood families: Emotion, Tone/Narrative, and Atmosphere/Setting, which in turn relate to structures that connect reader-generated data with conceptual frameworks in previous studies.

Originality/value

The inherent complexity of “mood” should not dissuade researchers from carefully investigating users' preferences in this regard. Adding to the existing efforts of classifying moods conducted by experts, the current study presents mood terms provided by actual end-users when describing different moods in fiction. This study offers a useful roadmap for creating taxonomies for retrieval and description, as well as structures derived from user-provided terms that ultimately have the potential to improve user experience.

More Information, Greater Appreciation: The Correlation between Background Information and Aesthetic Judgment of Tourist Crafts

More information is often correlated with greater appreciation. Drawing on the model of aesthetic appreciation and aesthetic judgment in art psychology, this study aims to investigate changes in tourists' aesthetic judgments of tourist crafts when provided with different background information. Blue calico, an art form created through white pulp dyeing and printing, is an intangible cultural heritage of China. The photographs used in this study illustrate typical examples of blue calicos that are commonly sold in tourist gift shops in Wuzhen, China. Data from a sample of 133 participants (49 women and 84 men) was analyzed using Two-Way Repeated Measures ANOVA. We examined to what extent respondents varied their assessments of the calicos based on author manipulation of background factors, such as commentaries by the artist or details about the production process. We found that tourists' impressions of the aesthetics of blue calicos were predicted by background factors, especially those of tourists who were less interested in high arts. Specifically, blue calicos reported to tourists with names that conveyed an auspicious meaning predicted tourists' assessments of the calicos as more aesthetically pleasing. Explanations of the production process also predicted an increased appreciation of calico aesthetics. Conversely, artists' commentaries were not significantly correlated with an increased aesthetic merit of calicos. Understanding what may affect tourists' assessment of art could help those in the tourism industry market souvenirs to drive sales and enhance tourists' understanding and appreciation of intangible cultural heritage.

Points of View and Readers' Immersion in Translation: A Neurocognitive Interpretation of Poetic Translatability

There have been few attempts at applying cultural neuroscience and psychology to the discussion of poetic translatability. This study employs cultural neuroscience and psychology methodologies and forms of evidence to explore the neurocognitive mechanisms by which cross-cultural variations in perspectives during the translation process influence poetic reception in the target culture. The English translation of Chinese poetry is often tasked with the supplement of perspectives and accompanied by cross-cultural variations of immersion. These changes have been substantially discussed from literary and poetic perspectives but remain understudied in terms of their neurocognitive and psychological implications. Through textual analysis of first-person points of view, this study attempts to apply neuroscience to the interpretation of the impact of differences in cross-cultural perspectives in poetry translation. Our findings suggest that a general tendency toward the supplement of first-person perspectives could boost the immersive experience by activating mirror neurons and the temporal parietal junction. These neuroscientific mechanisms underlying the observable cultural phenomenon offer implications for the translation of Chinese poetry in a way that generates brain responses and neurotransmitters similar to the source text. This study demonstrates how research in neuroscience can illuminate findings in cross-cultural communication.

Reading Russian poetry: An expert-novice study

Studying the role of expertise in poetry reading, we hypothesized that poets' expert knowledge comprises genre-appropriate reading- and comprehension strategies that are re-flected in distinct patterns of reading behavior. We recorded eye movements while two groups of native speakers (n=10 each) read selected Russian poetry: an expert group of professional poets who read poetry daily, and a control group of novices who read poetry less than once a month. We conducted mixed-effects re-gression analyses to test for effects of group on first-fixation durations, first-pass gaze du-rations, and total reading times per word while controlling for lexical- and text variables. First-fixation durations exclusively reflected lexical features, and total reading times re-flected both lexical- and text variables; only first-pass gaze durations were additionally mod-ulated by readers' level of expertise. Whereas gaze durations of novice readers became faster as they progressed through the poems, and differed between line-final words and non-final ones, poets retained a steady pace of first-pass reading throughout the poems and within verse lines. Additionally, poets' gaze durations were less sensitive to word length. We conclude that readers' level of expertise modulates the way they read poetry. Our find-ings support theories of literary comprehension that assume distinct processing modes which emerge from prior experience with literary texts.

Reading digital- versus print-easy texts: a study with university students who prefer digital sources

The transition from on-paper to on-screen reading seems to make it necessary to raise some considerations, as a greater attentional effort has been claimed for print texts than digital ones. Not surprisingly, most university students prefer this digital medium. This research aims to examine reading times by contextualizing this phenomenon into two processes: namely, word recognition and reading comprehension task on paper and on screen. Thus, two different tasks—counterbalanced into digital and print mediums—were carried out per each participant with a preference for a digital medium: a reading comprehension task (RCT) and a lexical decision task (LDT) after reading a specific story. Participants were slower reading print texts and no statistically significant differences were found in RCT accuracy. This result suggests that the task required more cognitive resources under the print medium for those with a worse comprehension performance in reading, and a more conservative pattern in digital RCT for those with a better performance.

How poetry evokes emotions

Poetry evokes emotions. It does so, according to the theory we present, from three sorts of simulation. They each can prompt emotions, which are communications both within the brain and among people. First, models of a poem's semantic contents can evoke emotions as do models that occur in depictions of all kinds, from novels to perceptions. Second, mimetic simulations of prosodic cues, such as meter, rhythm, and rhyme, yield particular emotional states. Third, people's simulations of themselves enable them to know that they are engaged with a poem, and an aesthetic emotion can occur as a result. The three simulations predict certain sorts of emotion, e.g., prosodic cues can evoke basic emotions of happiness, sadness, anger, and anxiety. Empirical evidence corroborates the theory, which we relate to other accounts of poetic emotions.

Reading about minds: The social-cognitive potential of narratives

It is often argued that narratives improve social cognition, either by appealing to social-cognitive abilities as we engage with the story world and its characters, or by conveying social knowledge. Empirical studies have found support for both a correlational and a causal link between exposure to (literary, fictional) narratives and social cognition. However, a series of failed replications has cast doubt on the robustness of these claims. Here, we review the existing empirical literature and identify open questions and challenges. An important conclusion of the review is that previous research has given too little consideration to the diversity of narratives, readers, and social-cognitive processes involved in the social-cognitive potential of narratives. We therefore establish a research agenda, proposing that future research should focus on (1) the specific text characteristics that drive the social-cognitive potential of narratives, (2) the individual differences between readers with respect to their sensitivity to this potential, and (3) the various aspects of social cognition that are potentially affected by reading narratives. Our recommendations can guide the design of future studies that will help us understand how, for whom, and in what respect exposure to narratives can advantage social cognition.

Computational Models of Readers' Apperceptive Mass

Recent progress in machine-learning-based distributed semantic models (DSMs) offers new ways to simulate the apperceptive mass (AM; Kintsch, 1980) of reader groups or individual readers and to predict their performance in reading-related tasks. The AM integrates the mental lexicon with world knowledge, as for example, acquired via reading books. Following pioneering work by Denhière and Lemaire (2004), here, we computed DSMs based on a representative corpus of German children and youth literature (Jacobs et al., 2020) as null models of the part of the AM that represents distributional semantic input, for readers of different reading ages (grades 1–2, 3–4, and 5–6). After a series of DSM quality tests, we evaluated the performance of these models quantitatively in various tasks to simulate the different reader groups' hypothetical semantic and syntactic skills. In a final study, we compared the models' performance with that of human adult and children readers in two rating tasks. Overall, the results show that with increasing reading age performance in practically all tasks becomes better. The approach taken in these studies reveals the limits of DSMs for simulating human AM and their potential for applications in scientific studies of literature, research in education, or developmental science.

Aesthetic appraisals of literary style and emotional intensity in narrative engagement are neurally dissociable

Humans are deeply affected by stories, yet it is unclear how. In this study, we explored two aspects of aesthetic experiences during narrative engagement - literariness and narrative fluctuations in appraised emotional intensity. Independent ratings of literariness and emotional intensity of two literary stories were used to predict blood-oxygen-level-dependent signal changes in 52 listeners from an existing fMRI dataset. Literariness was associated with increased activation in brain areas linked to semantic integration (left angular gyrus, supramarginal gyrus, and precuneus), and decreased activation in bilateral middle temporal cortices, associated with semantic representations and word memory. Emotional intensity correlated with decreased activation in a bilateral frontoparietal network that is often associated with controlled attention. Our results confirm a neural dissociation in processing literary form and emotional content in stories and generate new questions about the function of and interaction between attention, social cognition, and semantic systems during literary engagement and aesthetic experiences.

Micropoetry Meets Neurocognitive Poetics: Influence of Associations on the Reception of Poetry

Reading and understanding poetic texts is often described as an interactive process influenced by the words and phrases building the poems and all associations and images induced by them in the readers mind. Iser, for example, described the understanding process as the closing of a good Gestalt promoted by mental images. Here, we investigate the effect that semantic cohesion, that is the internal connection of a list words, has on understanding and appreciation of poetic texts. To do this, word lists are presented as modern micropoems to the participants and the (ease of) extraction of underlying concepts as well as the affective and aesthetic responses are implicitly and explicitly measured. We found that a unifying concept is found more easily and unifying concepts vary significantly less between participants when the words composing a micropoem are semantically related. Moreover these items are liked better and are understood more easily. Our study shows evidence for the assumed relationship between building spontaneous associations, forming mental imagery, and understanding and appreciation of poetic texts. In addition, we introduced a new method well-suited to manipulate backgrounding features independently of foregrounding features which allows to disentangle the effects of both on poetry reception.

"I'm getting too old for this stuff": The conceptual structure of tattoo aesthetics

While body modifications have increasingly gained acceptance and popularity, how different subpopulations aesthetically appreciate tattoos remains unclear. The present study aimed to investigate the conceptual structure underlying tattoo aesthetics, focusing on the effects of internalized social norms and expertise. Using a timed free-listing task, three groups (≤49 years, ≥50 years, and experts) comprising 497 participants were asked to write down adjectives that could describe tattoo aesthetics. Statistical analyses of frequency, cognitive salience indices, co-occurrence dimensions, semantic dimensions, similarity measures, and valences were applied and, to directly compare the three groups, a generalized Procrustes analysis was applied. The variance and complexity with which individuals verbally expressed their perceived aesthetic appeal of tattoos were highlighted. However, the results do not reveal a unified concept of beauty, nor do they present a clear bipolar dimension of beautiful/ugly for two of the three groups. Nevertheless, the concept of beauty was found to be prominent in tattoo aesthetics, and aesthetic and descriptive-evaluative dimensions were identified, with terms such as beautiful, ugly, multicolored, and interesting being the most notable adjectives, although not with the highest valence. Possible factors explaining the intracultural differences between the three groups are also discussed.

The Effects of Emotional Design on Multimedia Learning and Appreciation of Chinese Poetry

Painting, music, literature, and other art forms embody the essence of human wisdom and induce esthetic experience, among which poetry is inherently creative, because it contains a wealth of symbols, imageries, insights, and so forth. The appreciation and learning of Chinese poetry is an important part of the curriculum in secondary schools. However, studies have mainly focused on textual characters of poetry, with little literature focusing on esthetic appreciation and in-depth learning of poetry. In this vein, we ask whether emotional designs will promote the appreciation and learning of Chinese poetry. To answer this question, we explored the influence of the combination of external emotion induction (positive and neutral movie clips) and internal colorful design (chromatic and achromatic) on esthetic preference and learning of poetry. One hundred and sixty-six participants (14–15 years old) were randomly assigned to one of four conditions created by two factors (external emotion induction and internal colorful design). The results showed that the combination of external emotion induction and internal colorful design promoted positive emotions, retention, and transfer performances of learners. Furthermore, perceived difficulty of learners decreased significantly when external emotional induction and internal colorful design were both positive. Consequently, these findings indicated that emotional designs in multimedia facilitated the learning performance of middle school students in Chinese poetry, and supported the cognitive-affective theory of learning with media. This research was a preliminary exploration of emotional design in humanities.

Presence, flow, and narrative absorption: an interdisciplinary theoretical exploration with a new spatiotemporal integrated model based on predictive processing

Presence, flow, narrative absorption, immersion, transportation, and similar subjective phenomena are studied in many different disciplines, mostly in relation to mediated experiences (books, film, VR, games). Moreover, since real, virtual, or fictional agents are often involved, concepts like identification and state empathy are often linked to engaging media use. Based on a scoping review that identified similarities in the wording of various questionnaire items conceived to measure different phenomena, we categorize items into the most relevant psychological aspects and use this categorization to propose an interdisciplinary systematization. Then, based on a framework of embodied predictive processing, we present a new cognitive model of presence-related phenomena for mediated and non-mediated experiences, integrating spatial and temporal aspects and also considering the role of fiction and media design. Key processes described within the model are: selective attention, enactment of intentions, and interoception. We claim that presence is the state of perceived successful agency of an embodied mind able to correctly enact its predictions. The difference between real-life and simulated experiences ("book problem," "paradox of fiction") lays in the different precision weighting of exteroceptive and interoceptive signals.

Naturalistic Stimuli in Affective Neuroimaging: A Review

Naturalistic stimuli such as movies, music, and spoken and written stories elicit strong emotions and allow brain imaging of emotions in close-to-real-life conditions. Emotions are multi-component phenomena: relevant stimuli lead to automatic changes in multiple functional components including perception, physiology, behavior, and conscious experiences. Brain activity during naturalistic stimuli reflects all these changes, suggesting that parsing emotion-related processing during such complex stimulation is not a straightforward task. Here, I review affective neuroimaging studies that have employed naturalistic stimuli to study emotional processing, focusing especially on experienced emotions. I argue that to investigate emotions with naturalistic stimuli, we need to define and extract emotion features from both the stimulus and the observer.

Neuroimaging of valence decisions in children and adults

To date, the neural underpinnings of affective components in language processing in children remain largely unknown. To fill this gap, the present study examined behavioural and neural correlates of children and adults performing the same auditory valence decision task with an event-related fMRI paradigm. Based on previous findings in adults, activations in anterior and posterior cingulate cortex, orbitofrontal cortex and left inferior frontal gyrus were expected for both positive and negative valence categories. Recent behavioural findings on valence decisions showed similar ratings and reaction time patterns in children and adults. This finding was successfully replicated in the present study. On a neural level, our analysis of affective language processing showed activations in regions associated with both semantic (superior and middle temporal and frontal) and affective (anterior and posterior cingulate, orbitofrontal and inferior frontal, insula and amygdala) processing. Neural activations in children and adults were systematically different in explicit affective word processing. In particular, adults showed a more distributed semantic network activation while children recruited additional subcortical structures.

Fractality and Variability in Canonical and Non-Canonical English Fiction and in Non-Fictional Texts

This study investigates global properties of three categories of English text: canonical fiction, non-canonical fiction, and non-fictional texts. The central hypothesis of the study is that there are systematic differences with respect to structural design features between canonical and non-canonical fiction, and between fictional and non-fictional texts. To investigate these differences, we compiled a corpus containing texts of the three categories of interest, the Jena Corpus of Expository and Fictional Prose (JEFP Corpus). Two aspects of global structure are investigated, variability and self-similar (fractal) patterns, which reflect long-range correlations along texts. We use four types of basic observations, (i) the frequency of POS-tags per sentence, (ii) sentence length, (iii) lexical diversity, and (iv) the distribution of topic probabilities in segments of texts. These basic observations are grouped into two more general categories, (a) the lower-level properties (i) and (ii), which are observed at the level of the sentence (reflecting linguistic decoding), and (b) the higher-level properties (iii) and (iv), which are observed at the textual level (reflecting comprehension/integration). The observations for each property are transformed into series, which are analyzed in terms of variance and subjected to Multi-Fractal Detrended Fluctuation Analysis (MFDFA), giving rise to three statistics: (i) the degree of fractality ( H ), (ii) the degree of multifractality ( D ), i.e., the width of the fractal spectrum, and (iii) the degree of asymmetry ( A ) of the fractal spectrum. The statistics thus obtained are compared individually across text categories and jointly fed into a classification model (Support Vector Machine). Our results show that there are in fact differences between the three text categories of interest. In general, lower-level text properties are better discriminators than higher-level text properties. Canonical fictional texts differ from non-canonical ones primarily in terms of variability in lower-level text properties. Fractality seems to be a universal feature of text, slightly more pronounced in non-fictional than in fictional texts. On the basis of our results obtained on the basis of corpus data we point out some avenues for future research leading toward a more comprehensive analysis of textual aesthetics, e.g., using experimental methodologies.

NeuroDante: Poetry Mentally Engages More Experts but Moves More Non-Experts, and for Both the Cerebral Approach Tendency Goes Hand in Hand with the Cerebral Effort

Neuroaesthetics, the science studying the biological underpinnings of aesthetic experience, recently extended its area of investigation to literary art; this was the humus where neurocognitive poetics blossomed. Divina Commedia represents one of the most important, famous and studied poems worldwide. Poetry stimuli are characterized by elements (meter and rhyme) promoting the processing fluency, a core aspect of neuroaesthetics theories. In addition, given the evidence of different neurophysiological reactions between experts and non-experts in response to artistic stimuli, the aim of the present study was to investigate, in poetry, a different neurophysiological cognitive and emotional reaction between Literature (L) and Non-Literature (NL) students. A further aim was to investigate whether neurophysiological underpinnings would support explanation of behavioral data. Investigation methods employed: self-report assessments (recognition, appreciation, content recall) and neurophysiological indexes (approach/withdrawal (AW), cerebral effort (CE) and galvanic skin response (GSR)). The main behavioral results, according to fluency theories in aesthetics, suggested in the NL but not in the L group that the appreciation/liking went hand by hand with the self-declared recognition and with the content recall. The main neurophysiological results were: (i) higher galvanic skin response in NL, whilst higher CE values in L; (ii) a positive correlation between AW and CE indexes in both groups. The present results extended previous evidence relative to figurative art also to auditory poetry stimuli, suggesting an emotional attenuation “expertise-specific” showed by experts, but increased cognitive processing in response to the stimuli.

Neural correlates of affective contributions to lexical decisions in children and adults

The goal of the present study was to investigate whether 6-9-year old children and adults show similar neural responses to affective words. An event-related neuroimaging paradigm was used in which both age cohorts performed the same auditory lexical decision task (LDT). The results show similarities in (auditory) lexico-semantic network activation as well as in areas associated with affective information. In both age cohorts' activations were stronger for positive than for negative words, thus exhibiting a positivity superiority effect. Children showed less activation in areas associated with affective information in response to all three valence categories than adults. Our results are discussed in the light of computational models of word recognition, and previous findings of affective contributions to LDT in adults.

Sentiment Analysis of Children and Youth Literature: Is There a Pollyanna Effect?

If the words of natural human language possess a universal positivity bias, as assumed by Boucher and Osgood’s (1969) famous Pollyanna hypothesis and computationally confirmed for large text corpora in several languages (Dodds et al., 2015), then children and youth literature (CYL) should also show a Pollyanna effect. Here we tested this prediction applying an unsupervised vector space model-based sentiment analysis tool called SentiArt (Jacobs, 2019) to two CYL corpora, one in English (372 books) and one in German (500 books). Pitching our analysis at the sentence level, and assessing semantic as well as lexico-grammatical information, both corpora show the Pollyanna effect and thus add further evidence to the universality hypothesis. The results of our multivariate sentiment analyses provide interesting testable predictions for future scientific studies of literature.

The Influence of Mental Imagery Instructions and Personality Characteristics on Reading Experiences

It is well established that readers form mental images when reading a narrative. However, the consequences of mental imagery (i.e. the influence of mental imagery on the way people experience stories) are still unclear. Here we manipulated the amount of mental imagery that participants engaged in while reading short literary stories in two experiments. Participants received pre-reading instructions aimed at encouraging or discouraging mental imagery. After reading, participants answered questions about their reading experiences. We also measured individual trait differences that are relevant for literary reading experiences. The results from the first experiment suggests an important role of mental imagery in determining reading experiences. However, the results from the second experiment show that mental imagery is only a weak predictor of reading experiences compared to individual (trait) differences in how imaginative participants were. Moreover, the influence of mental imagery instructions did not extend to reading experiences unrelated to mental imagery. The implications of these results for the relationship between mental imagery and reading experiences are discussed.

Fluctuation in Pupil Size and Spontaneous Blinks Reflect Story Transportation

Thirty-nine participants listened to 28 neutral and horror excerpts of Stephen King short stories while constantly tracking their emotional arousal. Pupil size was measured with an Eyelink 1000+, and participants rated valence and transportation after each story. In addition to computing mean pupil size across 1-sec intervals, we extracted blink count and used detrended fluctuation analysis (DFA) to obtain the scaling exponents of long-range temporal correlations (LRTCs) in pupil size time-series. Pupil size was expected to be sensitive also to emotional arousal, whereas blink count and LRTC's were expected to reflect cognitive engagement. The results showed that self-reported arousal increased, pupil size was overall greater, and the decreasing slope of pupil size was flatter for horror than for neutral stories. Horror stories induced higher transportation than neutral stories. High transportation was associated with a steeper increase in self-reported arousal across time, stronger LRTCs in pupil size fluctuations, and lower blink count. These results indicate that pupil size reflects emotional arousal induced by the text content, while LRTCs and blink count are sensitive to cognitive engagement associated with transportation, irrespective of the text type. The study demonstrates the utility of pupillometric measures and blink count to study literature reception.

From Abstract Symbols to Emotional (In-)Sights: An Eye Tracking Study on the Effects of Emotional Vignettes and Pictures

Reading is known to be a highly complex, emotion-inducing process, usually involving connected and cohesive sequences of sentences and paragraphs. However, most empirical results, especially from studies using eye tracking, are either restricted to simple linguistic materials (e.g., isolated words, single sentences) or disregard valence-driven effects. The present study addressed the need for ecologically valid stimuli by examining the emotion potential of and reading behavior in emotional vignettes, often used in applied psychological contexts and discourse comprehension. To allow for a cross-domain comparison in the area of emotion induction, negatively and positively valenced vignettes were constructed based on pre-selected emotional pictures from the Nencki Affective Picture System (NAPS; Marchewka et al., 2014). We collected ratings of perceived valence and arousal for both material groups and recorded eye movements of 42 participants during reading and picture viewing. Linear mixed-effects models were performed to analyze effects of valence (i.e., valence category, valence rating) and stimulus domain (i.e., textual, pictorial) on ratings of perceived valence and arousal, eye movements in reading, and eye movements in picture viewing. Results supported the success of our experimental manipulation: emotionally positive stimuli (i.e., vignettes, pictures) were perceived more positively and less arousing than emotionally negative ones. The cross-domain comparison indicated that vignettes are able to induce stronger valence effects than their pictorial counterparts, no differences between vignettes and pictures regarding effects on perceived arousal were found. Analyses of eye movements in reading replicated results from experiments using isolated words and sentences: perceived positive text valence attracted shorter reading times than perceived negative valence at both the supralexical and lexical level. In line with previous findings, no emotion effects on eye movements in picture viewing were found. This is the first eye tracking study reporting superior valence effects for vignettes compared to pictures and valence-specific effects on eye movements in reading at the supralexical level.

Following in Jakobson and Lévi-Strauss' footsteps: A neurocognitive poetics investigation of eye movements during the reading of Baudelaire's 'Les Chats'

Following Jakobson and Levi-Strauss [1] famous analysis of Baudelaire's poem 'Les Chats' ('The Cats'), in the present study we investigated the reading of French poetry from a Neurocognitive Poetics perspective. Our study is exploratory and a first attempt in French, most previous work having been done in either German or English (e.g. [2] [3] [4] [5] [6]). We varied the presentation mode of the poem Les Chats (verse vs. prose form) and measured the eye movements of our readers to test the hypothesis of an interaction between presentation mode and reading behavior. We specifically focussed on rhyme scheme effects on standard eye movement parameters. Our results replicate those from previous English poetry studies in that there is a specific pattern in poetry reading with longer gaze durations and more rereading in the verse than in the prose format. Moreover, presentation mode also matters for making salient the rhyme scheme. This first study generates interesting hypotheses for further research applying quantitative narrative analysis to French poetry and developing the Neurocognitive Poetics Model of literary reading [NCPM; 2] into a cross-linguistic model of poetry reading.

Eye movements and mental imagery during reading of literary texts with different narrative styles

Based on Kuzmičová's [1] phenomenological typology of narrative styles, we studied the specific contributions of mental imagery to literary reading experience and to reading behavior by combining questionnaires with eye-tracking methodology. Specifically, we focused on the two main categories in Kuzmičová's [1] typology, i.e., texts dominated by an "enactive" style, and texts dominated by a "descriptive" style. "Enactive" style texts render characters interacting with their environment, and "descriptive" style texts render environments dissociated from human action. The quantitative analyses of word category distributions of two dominantly enactive and two dominantly descriptive texts indicated significant differences especially in the number of verbs, with more verbs in enactment compared to descriptive texts. In a second study, participants read two texts (one theoretically cueing descriptive imagery, the other cueing enactment imagery) while their eye movements were recorded. After reading, participants completed questionnaires assessing aspects of the reading experience generally, as well as their text-elicited mental imagery specifically. Results show that readers experienced more difficulties conjuring up mental images during reading descriptive style texts and that longer fixation duration on words were associated with enactive style text. We propose that enactive style involves more imagery processes which can be reflected in eye movement behavior.

What Is the Difference? Rereading Shakespeare's Sonnets -An Eye Tracking Study

Texts are often reread in everyday life, but most studies of rereading have been based on expository texts, not on literary ones such as poems, though literary texts may be reread more often than others. To correct this bias, the present study is based on two of Shakespeare's sonnets. Eye movements were recorded, as participants read a sonnet then read it again after a few minutes. After each reading, comprehension and appreciation were measured with the help of a questionnaire. In general, compared to the first reading, rereading improved the fluency of reading (shorter total reading times, shorter regression times, and lower fixation probability) and the depth of comprehension. Contrary to the other rereading studies using literary texts, no increase in appreciation was apparent. Moreover, results from a predictive modeling analysis showed that readers' eye movements were determined by the same critical psycholinguistic features throughout the two sessions. Apparently, even in the case of poetry, the eye movement control in reading is determined mainly by surface features of the text, unaffected by repetition.

Reading English-language haiku: An eye-movement study of the 'cut effect'

The current study, set within the larger enterprise of Neuro-Cognitive Poetics, was designed to examine how readers deal with the ‘cut’ – a more or less sharp semantic-conceptual break – in normative, three-line English-language haiku poems (ELH). Readers were presented with three-line haiku that consisted of two (seemingly) disparate parts, a (two-line) ‘phrase’ image and a one-line ‘fragment’ image, in order to determine how they process the conceptual gap between these images when constructing the poem’s meaning – as reflected in their patterns of reading eye movements. In addition to replicating the basic ‘cut effect’, i.e., the extended fixation dwell time on the fragment line relative to the other lines, the present study examined (a) how this effect is influenced by whether the cut is purely implicit or explicitly marked by punctuation, and (b) whether the effect pattern could be delineated against a control condition of ‘uncut’, one-image haiku. For ‘cut’ vs. ‘uncut’ haiku, the results revealed the distribution of fixations across the poems to be modulated by the position of the cut (after line 1 vs. after line 2), the presence vs. absence of a cut marker, and the semanticconceptual distance between the two images (context–action vs. juxtaposition haiku). These formal-structural and conceptual-semantic properties were associated with systematic changes in how individual poem lines were scanned at first reading and then (selectively) re-sampled in second- and third-pass reading to construct and check global meaning. No such effects were found for one-image (control) haiku. We attribute this pattern to the operation of different meaning resolution processes during the comprehension of two-image haiku, which are invoked by both form- and meaning-related features of the poems.

Computing the Affective-Aesthetic Potential of Literary Texts

In this paper, we compute the affective-aesthetic potential (AAP) of literary texts by using a simple sentiment analysis tool called SentiArt. In contrast to other established tools, SentiArt is based on publicly available vector space models (VSMs) and requires no emotional dictionary, thus making it applicable in any language for which VSMs have been made available (>150 so far) and avoiding issues of low coverage. In a first study, the AAP values of all words of a widely used lexical databank for German were computed and the VSM’s ability in representing concrete and more abstract semantic concepts was demonstrated. In a second study, SentiArt was used to predict ~2800 human word valence ratings and shown to have a high predictive accuracy (R2 > 0.5, p < 0.0001). A third study tested the validity of SentiArt in predicting emotional states over (narrative) time using human liking ratings from reading a story. Again, the predictive accuracy was highly significant: R2adj = 0.46, p < 0.0001, establishing the SentiArt tool as a promising candidate for lexical sentiment analyses at both the micro- and macrolevels, i.e., short and long literary materials. Possibilities and limitations of lexical VSM-based sentiment analyses of diverse complex literary texts are discussed in the light of these results.

Is less readable liked better? The case of font readability in poetry appreciation

Previous research shows conflicting findings for the effect of font readability on comprehension and memory for language. It has been found that—perhaps counterintuitively–a hard to read font can be beneficial for language comprehension, especially for difficult language. Here we test how font readability influences the subjective experience of poetry reading. In three experiments we tested the influence of poem difficulty and font readability on the subjective experience of poems. We specifically predicted that font readability would have opposite effects on the subjective experience of easy versus difficult poems. Participants read poems which could be more or less difficult in terms of conceptual or structural aspects, and which were presented in a font that was either easy or more difficult to read. Participants read existing poems and subsequently rated their subjective experience (measured through four dependent variables: overall liking, perceived flow of the poem, perceived topic clarity, and perceived structure). In line with previous literature we observed a Poem Difficulty x Font Readability interaction effect for subjective measures of poetry reading. We found that participants rated easy poems as nicer when presented in an easy to read font, as compared to when presented in a hard to read font. Despite the presence of the interaction effect, we did not observe the predicted opposite effect for more difficult poems. We conclude that font readability can influence reading of easy and more difficult poems differentially, with strongest effects for easy poems.

Differential brain mechanisms during reading human vs. machine translated fiction and news texts

Few neuroimaigng studies on reading comprehension have been conducted under natural reading settings. In this study, we showed texts presented in a natural way during functional MRI (fMRI) measurements to reveal brain areas sensitive to reading comprehension. Specifically, this paradigm independently manipulated two holistic features of article style: text genre and translation style, a qualitative index of how typical word choices and arrangements are made in daily use of the language. Specifically, articles from The New York Times (news) and Reader’s Digest (fiction) translated from English to Mandarin Chinese either by human experts or machine (Google Translate) were used to investigate the correlation of brain activity across participants during article reading. We found that bi-hemispheric visual cortex, precuneus, and occipito-parietal junction show significantly correlated hemodynamics across participants regardless of translation style and article genre. Compared to machine translation, reading human expert translation elicited more reliable fMRI signals across participants at precuneus, potentially because narrative representations and contents can be coherently presented over tens of seconds. We also found significantly stronger inter-subject correlated fMRI signals at temporal poles and fusiform gyri in fiction reading than in news reading. This may be attributed to more stable empathy processing across participants in fiction reading. The degree of stability of brain responses across subjects at extra-linguistic areas was found correlated with subjective rating on the text fluency. The functional connectivity between these areas was modulated by text genre and translation style. Taken together, our imaging results suggested stable and selective neural substrates associated with comprehending holistic features of written narratives.

Affective iconic words benefit from additional sound-meaning integration in the left amygdala

Recent studies have shown that a similarity between sound and meaning of a word (i.e., iconicity) can help more readily access the meaning of that word, but the neural mechanisms underlying this beneficial role of iconicity in semantic processing remain largely unknown. In an fMRI study, we focused on the affective domain and examined whether affective iconic words (e.g., high arousal in both sound and meaning) activate additional brain regions that integrate emotional information from different domains (i.e., sound and meaning). In line with our hypothesis, affective iconic words, compared to their non‐iconic counterparts, elicited additional BOLD responses in the left amygdala known for its role in multimodal representation of emotions. Functional connectivity analyses revealed that the observed amygdalar activity was modulated by an interaction of iconic condition and activations in two hubs representative for processing sound (left superior temporal gyrus) and meaning (left inferior frontal gyrus) of words. These results provide a neural explanation for the facilitative role of iconicity in language processing and indicate that language users are sensitive to the interaction between sound and meaning aspect of words, suggesting the existence of iconicity as a general property of human language.

The SLS-Berlin: Validation of a German Computer-Based Screening Test to Measure Reading Proficiency in Early and Late Adulthood

Reading proficiency, i.e., successfully integrating early word-based information and utilizing this information in later processes of sentence and text comprehension, and its assessment is subject to extensive research. However, screening tests for German adults across the life span are basically non-existent. Therefore, the present article introduces a standardized computerized sentence-based screening measure for German adult readers to assess reading proficiency including norm data from 2,148 participants covering an age range from 16 to 88 years. The test was developed in accordance with the children's version of the Salzburger LeseScreening (SLS, Wimmer and Mayringer, 2014). The SLS-Berlin has a high reliability and can easily be implemented in any research setting using German language. We present a detailed description of the test and report the distribution of SLS-Berlin scores for the norm sample as well as for two subsamples of younger (below 60 years) and older adults (60 and older). For all three samples, we conducted regression analyses to investigate the relationship between sentence characteristics and SLS-Berlin scores. In a second validation study, SLS-Berlin scores were compared with two (pseudo)word reading tests, a test measuring attention and processing speed and eye-movements recorded during expository text reading. Our results confirm the SLS-Berlin's sensitivity to capture early word decoding and later text related comprehension processes. The test distinguished very well between skilled and less skilled readers and also within less skilled readers and is therefore a powerful and efficient screening test for German adults to assess interindividual levels of reading proficiency.

Poetic Science: Bidirectional Reflection in Science and Medicine

The arts are making their mark in science, technology, engineering, arts, and mathematics/medicine (STEAM). Integrating creative expression-poetry and other visual and performing arts-can help clinicians, scientists, and others use familiar social constructs to embody science and medicine, in what may be termed poetic science. Poetic science imbues bidirectional reflections of science and medicine on the clinician or scientist or other inquisitor, creatively engaging the learner's brain cells as mirrors. This ultimately leads to a subjective perspective on the understanding or the proposition of underlying principles. Such an approach is encouraged here with poignant examples that can be accessed publicly online and used widely by readers, teachers, learners, clinicians, scientists, students, and others.

Sentiment Analysis for Words and Fiction Characters From the Perspective of Computational (Neuro-)Poetics

Two computational studies provide different sentiment analyses for text segments (e.g., "fearful" passages) and figures (e.g., "Voldemort") from the Harry Potter books (Rowling, 1997, 1998, 1999, 2000, 2003, 2005, 2007) based on a novel simple tool called SentiArt. The tool uses vector space models together with theory-guided, empirically validated label lists to compute the valence of each word in a text by locating its position in a 2d emotion potential space spanned by the words of the vector space model. After testing the tool's accuracy with empirical data from a neurocognitive poetics study, it was applied to compute emotional figure and personality profiles (inspired by the so-called "big five" personality theory) for main characters from the book series. The results of comparative analyses using different machine-learning classifiers (e.g., AdaBoost, Neural Net) show that SentiArt performs very well in predicting the emotion potential of text passages. It also produces plausible predictions regarding the emotional and personality profile of fiction characters which are correctly identified on the basis of eight character features, and it achieves a good cross-validation accuracy in classifying 100 figures into "good" vs. "bad" ones. The results are discussed with regard to potential applications of SentiArt in digital literary, applied reading and neurocognitive poetics studies such as the quantification of the hybrid hero potential of figures.