Why rate when you could compare? Using the "EloChoice" package to assess pairwise comparisons of perceived physical strength

Assessing novelty, feasibility and value of creative ideas with an unsupervised approach using GPT-4

Creativity is defined by three key factors: novelty, feasibility and value. While many creativity tests focus primarily on novelty, they often neglect feasibility and value, thereby limiting their reflection of real-world creativity. In this study, we employ GPT-4, a large language model, to assess these three dimensions in a Japanese-language Alternative Uses Test (AUT). Using a crowdsourced evaluation method, we acquire ground truth data for 30 question items and test various GPT prompt designs. Our findings show that asking for multiple responses in a single prompt, using an 'explain first, rate later' design, is both cost-effective and accurate (r = .62, .59 and .33 for novelty, feasibility and value, respectively). Moreover, our method offers comparable accuracy to existing methods in assessing novelty, without the need for training data. We also evaluate additional models such as GPT-4 Turbo, GPT-4 Omni and Claude 3.5 Sonnet. Comparable performance across these models demonstrates the universal applicability of our prompt design. Our results contribute a straightforward platform for instant AUT evaluation and provide valuable ground truth data for future methodological research.

Rating and ranking preparedness characteristics important for veterinary workplace clinical training: a novel application of pairwise comparisons and the Elo algorithm

Quantitatively eliciting perspectives about a large number of similar entities (such as a list of competences) is a challenge for researchers in health professions education (HPE). Traditional survey methods may include using Likert items. However, a Likert item approach that generates absolute ratings of the entities may suffer from the "ceiling effect," as ratings cluster at one end of the scale. This impacts on researchers' ability to detect differences in ratings between the entities themselves and between respondent groups. This paper describes the use of pairwise comparison (this or that?) questions and a novel application of the Elo algorithm to generate relative ratings and rankings of a large number of entities, on a unidimensional scale. A study assessing the relative importance of 91 student "preparedness characteristics" for veterinary workplace clinical training (WCT) is presented as an example of this method in action. The Elo algorithm uses pairwise comparison responses to generate an importance rating for each preparedness characteristic on a scale from zero to one. This is continuous data with measurement variability which, by definition, spans an entire spectrum and is not susceptible to the ceiling effect. The output should allow for the detection of differences in perspectives between groups of survey respondents (such as students and workplace supervisors) which Likert ratings may be insensitive to. Additional advantages of the pairwise comparisons are their low susceptibility to systematic bias and measurement error, they can be quicker and arguably more engaging to complete than Likert items, and they should carry a low cognitive load for respondents. Methods for evaluating the validity and reliability of this survey design are also described. This paper presents a method that holds great potential for a diverse range of applications in HPE research. In the pursuit quantifying perspectives on survey items which are measured on a relative basis and a unidimensional scale (e.g., importance, priority, probability), this method is likely to be a valuable option.

The aesthetic value of reef fishes is globally mismatched to their conservation priorities

Reef fishes are closely connected to many human populations, yet their contributions to society are mostly considered through their economic and ecological values. Cultural and intrinsic values of reef fishes to the public can be critical drivers of conservation investment and success, but remain challenging to quantify. Aesthetic value represents one of the most immediate and direct means by which human societies engage with biodiversity, and can be evaluated from species to ecosystems. Here, we provide the aesthetic value of 2,417 ray-finned reef fish species by combining intensive evaluation of photographs of fishes by humans with predicted values from machine learning. We identified important biases in species’ aesthetic value relating to evolutionary history, ecological traits, and International Union for Conservation of Nature (IUCN) threat status. The most beautiful fishes are tightly packed into small parts of both the phylogenetic tree and the ecological trait space. In contrast, the less attractive fishes are the most ecologically and evolutionary distinct species and those recognized as threatened. Our study highlights likely important mismatches between potential public support for conservation and the species most in need of this support. It also provides a pathway for scaling-up our understanding of what are both an important nonmaterial facet of biodiversity and a key component of nature’s contribution to people, which could help better anticipate consequences of species loss and assist in developing appropriate communication strategies.

The most beautiful reef fish are tightly packed into small regions of both the phylogenetic tree and the ecological trait space of the world’s reef fish fauna and are less threatened than unattractive fish. This study highlights likely important mismatches between potential public support for conservation and the species most in need of this support.

The Effect of Odor Valence on Facial Attractiveness Judgment: A Preliminary Experiment

The role of social odors on human social interactions, including face evaluation, has been widely indicated. However, for nonsocial odors, there has not been a consistent conclusion. Therefore, this study aimed to verify the effect of suprathreshold nonsocial odors on facial attractiveness judgment when the visual input is ambiguous. We designed a 3 (odor valence: neutral, pleasant, and unpleasant) × 7 (continuous levels of morphed fuzziness of attractiveness: 37.5% to 62.5%) within-subject experiment. A total of 30 participants (18 females) completed the whole experiment simultaneously for three consecutive days. The results showed that faces presented with pleasant and neutral odors were judged as significantly more attractive than those with unpleasant odors. The intervention effect of odor valence on facial attractiveness differed by fuzzy attractiveness levels. Results also suggested that male faces were perceived as more attractive than female faces no matter the odor conditions. The results of this study provide evidence to support the cross-modal emotion integration effect of olfaction and vision. Follow-up studies need to be conducted to reveal the underlying mechanism of odor valence on visual fact attractive judgment.

Examining vocal attractiveness through articulatory working space

Robust gender differences exist in the acoustic correlates of clearly articulated speech, with females, on average, producing speech that is acoustically and phonetically more distinct than that of males. This study investigates the relationship between several acoustic correlates of clear speech and subjective ratings of vocal attractiveness. Talkers were recorded producing vowels in /bVd/ context and sentences containing the four corner vowels. Multiple measures of working vowel space were computed from continuously sampled formant trajectories and were combined with measures of speech timing known to co-vary with clear articulation. Partial least squares regression (PLS-R) modeling was used to predict ratings of vocal attractiveness for male and female talkers based on the acoustic measures. PLS components that loaded on size and shape measures of working vowel space-including the quadrilateral vowel space area, convex hull area, and bivariate spread of formants-along with measures of speech timing were highly successful at predicting attractiveness in female talkers producing /bVd/ words. These findings are consistent with a number of hypotheses regarding human attractiveness judgments, including the role of sexual dimorphism in mate selection, the significance of traits signalling underlying health, and perceptual fluency accounts of preferences.

Species diversity and composition drive the aesthetic value of coral reef fish assemblages

Cultural and recreational values of biodiversity are considered as important dimensions of nature's contribution to people. Among these values, the aesthetics can be of major importance as the appreciation of beauty is one of the simplest forms of human emotional response. Using an online survey, we disentangled the effects of different facets of biodiversity on aesthetic preferences of coral reef fish assemblages that are among the most emblematic assemblages on Earth. While we found a positive saturating effect of species' richness on human preference, we found a net negative effect of species abundance, no effect of species functional diversity and contrasting effects of species composition depending on species' attractiveness. Our results suggest that the biodiversity-human interest relationship is more complex than has been previously stated. By integrating several scales of organization, our study is a step forward in better evaluating the aesthetic value of biodiversity.

Best-worst scaling improves measurement of first impressions

A common goal in psychological research is the measurement of subjective impressions, such as first impressions of faces. These impressions are commonly measured using Likert ratings. Although these ratings are simple to administer, they are associated with response issues that can limit reliability. Here we examine best-worst scaling (BWS), a forced-choice method, as a potential alternative to Likert ratings for measuring participants' facial first impressions. We find that at the group level, BWS scores correlated almost perfectly with Likert scores, indicating that the two methods measure the same impressions. However, at the individual participant level BWS outperforms Likert ratings, both in terms of ability to predict preferences in a third task, and in terms of test-retest reliability. These benefits highlight the power of BWS, particularly for use in individual differences research.

An assessment of touchscreens for testing primate food preferences and valuations

Typically, animals' food preferences are tested manually, which can be both time-consuming and vulnerable to experimenter biases. Given the utility of ascertaining animals' food preferences for research and husbandry protocols, developing a quick, reliable, and flexible paradigm would be valuable for expediting many research protocols. Therefore, we evaluated the efficacy of using a touchscreen interface to test nonhuman primates' food preferences and valuations, adapting previously validated manual methods. We tested a nonhuman primate subject with four foods (carrot, cucumber, grape, and turnip). Preference testing followed a pairwise forced choice protocol with pairs of food images presented on a touchscreen: The subject was rewarded with whichever food was selected. All six possible pairwise combinations were presented, with 90 trials per pairing. Second, we measured how hard the subject was willing to work to obtain each of the four foods, allowing us to generate demand curves. For this phase, a single image of a food item was presented on the touchscreen that the subject had to select in order to receive the food, and the number of selections required increased following a quarter-log scale, with ten trials per cost level (1, 2, 3, 6, 10, and 18). These methods allowed us to ascertain the subject's relative preferences and valuations of the four foods. The success of this touchscreen protocol for testing the subject's food preferences, from both a practical and a theoretical standpoint, suggests that the protocol should be further validated with other foods with this subject, with other subjects, and with other test items.