Scrutinizing the basis of originality in divergent thinking tests: On the measurement precision of response propensity estimates

AuDrA: An automated drawing assessment platform for evaluating creativity

The visual modality is central to both reception and expression of human creativity. Creativity assessment paradigms, such as structured drawing tasks Barbot (2018), seek to characterize this key modality of creative ideation. However, visual creativity assessment paradigms often rely on cohorts of expert or naïve raters to gauge the level of creativity of the outputs. This comes at the cost of substantial human investment in both time and labor. To address these issues, recent work has leveraged the power of machine learning techniques to automatically extract creativity scores in the verbal domain (e.g., SemDis; Beaty & Johnson 2021). Yet, a comparably well-vetted solution for the assessment of visual creativity is missing. Here, we introduce AuDrA - an Automated Drawing Assessment platform to extract visual creativity scores from simple drawing productions. Using a collection of line drawings and human creativity ratings, we trained AuDrA and tested its generalizability to untrained drawing sets, raters, and tasks. Across four datasets, nearly 60 raters, and over 13,000 drawings, we found AuDrA scores to be highly correlated with human creativity ratings for new drawings on the same drawing task (r = .65 to .81; mean = .76). Importantly, correlations between AuDrA scores and human raters surpassed those between drawings' elaboration (i.e., ink on the page) and human creativity raters, suggesting that AuDrA is sensitive to features of drawings beyond simple degree of complexity. We discuss future directions, limitations, and link the trained AuDrA model and a tutorial ( https://osf.io/kqn9v/ ) to enable researchers to efficiently assess new drawings.

Automatic assessment of divergent thinking in Chinese language with TransDis: A transformer-based language model approach

Language models have been increasingly popular for automatic creativity assessment, generating semantic distances to objectively measure the quality of creative ideas. However, there is currently a lack of an automatic assessment system for evaluating creative ideas in the Chinese language. To address this gap, we developed TransDis, a scoring system using transformer-based language models, capable of providing valid originality (novelty) and flexibility (variety) scores for Alternative Uses Task (AUT) responses in Chinese. Study 1 demonstrated that the latent model-rated originality factor, comprised of three transformer-based models, strongly predicted human originality ratings, and the model-rated flexibility strongly correlated with human flexibility ratings as well. Criterion validity analyses indicated that model-rated originality and flexibility positively correlated to other creativity measures, demonstrating similar validity to human ratings. Study 2 and 3 showed that TransDis effectively distinguished participants instructed to provide creative vs. common uses (Study 2) and participants instructed to generate ideas in a flexible vs. persistent way (Study 3). Our findings suggest that TransDis can be a reliable and low-cost tool for measuring idea originality and flexibility in Chinese language, potentially paving the way for automatic creativity assessment in other languages. We offer an open platform to compute originality and flexibility for AUT responses in Chinese and over 50 other languages ( https://osf.io/59jv2/ ).

Evaluating the effects of episodic and semantic memory induction procedures on divergent thinking in younger and older adults

Evidence suggesting that episodic specificity induction improves divergent thinking performance in younger and older adults has been taken as indicative of the role of declarative memory processes in creativity. A series of studies were carried out to verify the specificity of such findings by investigating the effects of several novel episodic and semantic memory induction procedures on a widely employed measure of divergent creative thinking (the Alternate Uses Task), in comparison to a control induction and a no-induction baseline in both younger and older adults. There was no clear evidence for a specific role played by the induction of episodic or semantic memory processes in facilitating creative thinking across the three experiments, and the effects of the induction procedures (episodic, semantic and control) on divergent thinking were not comparable across age groups. On the other hand, higher levels of creativity were generally associated with older adults (60-80 years). In Experiments 2 and 3, older adults generated a greater number of responses (fluency), more unique responses (average originality, peak originality, creativity ratings) and more varied responses (flexibility) than younger adults (18-30 years). The findings are discussed in relation to the specificity of declarative memory operations and their impact on creative thinking, especially within the context of healthy ageing.

The Role of Semantic Associations as a Metacognitive Cue in Creative Idea Generation

Is my idea creative? This question directs investing in companies and choosing a research agenda. Following previous research, we focus on the originality of ideas and consider their association with self-assessments of idea generators regarding their own originality. We operationalize the originality score as the frequency (%) of each idea within a sample of participants and originality judgment as the self-assessment of this frequency. Initial evidence suggests that originality scores and originality judgments are produced by separate processes. As a result, originality judgments are prone to biases. So far, heuristic cues that lead to such biases are hardly known. We used methods from computational linguistics to examine the semantic distance as a potential heuristic cue underlying originality judgments. We examined the extent to which the semantic distance would contribute additional explanatory value in predicting originality scores and originality judgments, above and beyond cues known from previous research. In Experiment 1, we re-analyzed previous data that compared originality scores and originality judgments after adding the semantic distance of the generated ideas from the stimuli. We found that the semantic distance contributed to the gap between originality scores and originality judgments. In Experiment 2, we manipulated the examples given in task instructions to prime participants with two levels of idea originality and two levels of semantic distance. We replicated Experiment 1 in finding the semantic distance as a biasing factor for originality judgments. In addition, we found differences among the conditions in the extent of the bias. This study highlights the semantic distance as an unacknowledged metacognitive cue and demonstrates its biasing power for originality judgments.

Dopamine supports idea originality: the role of spontaneous eye blink rate on divergent thinking

The neurotransmitter dopamine plays a crucial role in human creative behaviour. Specifically, striatal dopamine seems to be associated with specific dimensions of divergent thinking performance, especially with categorical diversity (flexibility) of ideas. In experimental contexts, spontaneous Eye Blink Rate (sEBR) has been used as a proxy for striatal dopamine, and an inverted U-shape relationship between sEBR and flexibility has been demonstrated, such that a medium sEBR level predicts highest flexibility levels. The present study aimed at carrying out further investigations about the relationship between sEBR and idea generation through divergent thinking, specifically focusing on the relationship between idea originality and dopamine level, since originality is a key element for creativity. We asked 80 participants, whose sEBR at rest was measured, to perform an Alternative Uses Task (AUT) to measure their divergent thinking performance. Results revealed that the relationship between sEBR and originality, as measured through subjective ratings of external raters, followed an inverted U-shape function with medium sEBR being associated with highest originality scores. Moreover, and most importantly, we demonstrated that sEBR predicted originality through the mediation of flexibility. Our results provide further insights on the possible role of dopamine on divergent thinking performance, demonstrating that an adequate dopamine level may facilitate the generation of original ideas through the exploration of diverse conceptual categories (higher flexibility).

Creativity in verbal associations is linked to semantic control

Although memory is known to play a key role in creativity, previous studies have not isolated the critical component processes and networks. We asked participants to generate links between words that ranged from strongly related to completely unrelated in long-term memory, delineating the neurocognitive processes that underpin more unusual versus stereotypical patterns of retrieval. More creative responses to strongly associated word-pairs were associated with greater engagement of episodic memory: in highly familiar situations, semantic, and episodic stores converge on the same information enabling participants to form a personal link between items. This pattern of retrieval was associated with greater engagement of core default mode network (DMN). In contrast, more creative responses to weakly associated word-pairs were associated with the controlled retrieval of less dominant semantic information and greater recruitment of the semantic control network, which overlaps with the dorsomedial subsystem of DMN. Although both controlled semantic and episodic patterns of retrieval are associated with activation within DMN, these processes show little overlap in activation. These findings demonstrate that controlled aspects of semantic cognition play an important role in verbal creativity.

Evaluating the predictive validity of four divergent thinking tasks for the originality of design product ideation

What factors predict the originality of domain-specific idea generation? Replicating and extending an earlier study using a Design Product Ideation task in an introductory university design course, the present research, grounded in the componential theory of creativity, assessed the relative contributions to originality of design ideation from five factors: divergent thinking, personality traits, general cognitive ability, prior creative experience, and task-specific challenge/interest. The Design Product Ideation task asked participants, at two different timepoints, to propose ideas for products to improve either the experience of urban gardening or of outdoor picnics. Four divergent thinking tasks were used, including the predominantly conceptually-based Alternative Uses Task, a newly developed perceptually-based Figural Interpretation Quest, and two modified verbal tasks from the Torrance Tests of Creative Thinking (Torrance Suppose and Torrance Product). Regression analyses revealed that, at both timepoints, originality on the Design Product Ideation tasks was predicted by multiple divergent thinking, personality, and task-based factors. Originality of responses to the Figural Interpretation Quest was a significant predictor at both timepoints, and continued to add incremental value after controlling for the other divergent thinking measures. Collectively, these findings indicate that the four divergent thinking tasks, though related, do not measure identical constructs, and that many individual difference components, both trait-based (e.g., openness to experience) and more specifically task-based (e.g., perceived challenge of the task), shape creative performance. Methodologically, and from a practical standpoint, these findings underscore the value of incorporating both conceptual and perceptual measures of divergent thinking as contributors to originality in domain-specific idea generation.

Intra-Individual Variability in Creativity

Abstract. Individual differences perspectives have dominated the scientific study of creativity since the 1950’s. These perspectives, however, mainly emphasize group-level variations or inter-individual differences, with limited interest in individual-level variations. Yet, (1) group-level findings are often used to make inferences at the person-level, which might not apply consistently across individuals, and (2) a focus on intra-individual variations could supplement knowledge based on inter-individual differences and accurately inform creativity as a dynamic and multifaceted psychological construct. Indeed, when observed at the individual level, creativity can vary from moment to moment, task to task, and even item to item, which is not well reflected in the current understanding of creativity. After introducing the historical context for the study of individual differences in creativity, this article presents and illustrates three fundamental and distinct aspects of intra-individual variability as they apply to creativity, namely (in)consistency (or processing fluctuation), dispersion, and intraindividual change. While doing so, recent developments in apparatus and methods to assess creativity as a more dynamic phenomenon are presented. The article concludes by discussing the promise of accounting for intra-individual variability in creative performance and potential and the new knowledge it may elicit for both creativity research and practice.

Automating creativity assessment with SemDis: An open platform for computing semantic distance

Creativity research requires assessing the quality of ideas and products. In practice, conducting creativity research often involves asking several human raters to judge participants' responses to creativity tasks, such as judging the novelty of ideas from the alternate uses task (AUT). Although such subjective scoring methods have proved useful, they have two inherent limitations-labor cost (raters typically code thousands of responses) and subjectivity (raters vary on their perceptions and preferences)-raising classic psychometric threats to reliability and validity. We sought to address the limitations of subjective scoring by capitalizing on recent developments in automated scoring of verbal creativity via semantic distance, a computational method that uses natural language processing to quantify the semantic relatedness of texts. In five studies, we compare the top performing semantic models (e.g., GloVe, continuous bag of words) previously shown to have the highest correspondence to human relatedness judgements. We assessed these semantic models in relation to human creativity ratings from a canonical verbal creativity task (AUT; Studies 1-3) and novelty/creativity ratings from two word association tasks (Studies 4-5). We find that a latent semantic distance factor-comprised of the common variance from five semantic models-reliably and strongly predicts human creativity and novelty ratings across a range of creativity tasks. We also replicate an established experimental effect in the creativity literature (i.e., the serial order effect) and show that semantic distance correlates with other creativity measures, demonstrating convergent validity. We provide an open platform to efficiently compute semantic distance, including tutorials and documentation ( https://osf.io/gz4fc/ ).

An Experimental Approach to Investigate the Involvement of Cognitive Load in Divergent Thinking

Up to now, support for the idea that a controlled component exists in creative thought has mainly been supported by correlational studies; to further shed light on this issue, we employed an experimental approach. We used four alternate uses tasks that differed in instruction type ("be fluent" vs. "be creative") and concurrent secondary workload (load vs. no load). A total of 51 participants (39 female) went through all tasks and generated ideas for a total of 16 different objects; their responses were scored in terms of fluency (number of responses generated), creative quality, and flexibility. We did find, as expected, that the be-creative instruction resulted in fewer and more creative ideas, as well as more flexible idea sets, but neither of the expected interaction effects became significant. Specifically, fluency was not affected more strongly by secondary workload in the be-fluent instruction condition than in the be-creative instruction condition. Further, the performance drop evoked by the secondary workload was not stronger in the be-creative instruction condition compared to the be-fluent instruction condition when creative quality or flexibility were examined as dependent variable. Altogether, our results do not confirm that be-creative instructions involve more cognitive load than be-fluent instructions. Nevertheless, the analysis of the serial order effect and additional correlational examinations revealed some promising results. Methodological limitations which may have influenced the results are discussed in light of the inherent suspense between internal and external validity (i.e., most likely the applied self-paced dual-task approach increased external validity, but undermined internal validity) and potentially guide future research.

The Influence of Situational Cues on Children's Creativity in an Alternative Uses Task and the Moderating Effect of Selective Attention

Taking a perception-action perspective, we investigated how the presence of different real objects in children's immediate situation affected their creativity and whether this effect was moderated by their selective attention. Seventy children between ages 9 and 12 years old participated. Verbal responses on a visual Alternative Uses Task with a low stimulus and high stimulus condition were coded on fluency, flexibility, and originality. Selective attention was measured with a visual search task. Results showed that fluency was not affected by stimulus condition and was unrelated to selective attention. Flexibility was positively associated with selective attention. Originality, net of fluency and flexibility, showed a main effect of stimulus condition in an unexpected direction, as children gave more original responses in the low stimulus condition compared to the high stimulus condition. A significant moderation effect revealed that children with better selective attention skills benefitted from a low stimulus environment, whereas children with weaker selective attention performed better in a high stimulus environment. The findings demonstrate differential effects of the immediate situation and selective attention, and support the hypothesis that creativity is impacted by immediate situation and selective attention, yet in unexpected ways.