One-shot generalization in humans revealed through a drawing task

Limited Impact of Object Attributes on Event-related Potentials During an Implicit Word Reading Task

BACKGROUND

Previous research in cognitive science has focused on the encoding and activation of sensory-based object knowledge in the brain during language comprehension, including aspects such as appearance, movement, and taste.

OBJECTIVE

To investigate how different object-related attributes affect event-related potentials (ERPs), specifically the N400 component, during word processing in an implicit task setting.

METHOD

We embedded a set of 420 critical nouns within a list of 2,745 total words and asked 240 participants to read each one, but to respond only to words denoting colors. We categorized each noun by attributes such as familiarity, smell, pain, taste, sound, graspability, and motion. We focused primarily on changes in the N400 component, indicative of semantic processing, across nouns with different attributes.

RESULTS

The least familiar stimuli elicited the strongest N400 response, indicating significant ERP variability across familiarity levels with more positive amplitudes for highly familiar stimuli. Among the attributes examined, only the attribute of smell demonstrated a notable, though isolated, increase in N400 amplitude. Other attributes, including pain, taste, sound, graspability, and visual motion showed no significant differences in N400 responses, suggesting a minimal influence on semantic processing in this context.

CONCLUSION

These results suggest that the specific sensory attributes of objects have limited influence on the N400 component of ERPs in implicit reading tasks, highlighting the complexity of semantic networks in cognitive processing. The subtlety of ERP modulations driven by object-related attributes points to the need for further exploration into how these attributes interact within semantic networks during cognitive tasks.

Human shape perception spontaneously discovers the biological origin of novel, but natural, stimuli

Humans excel at categorizing objects by shape. This facility involves identifying shape features that objects have in common with other members of their class and relies-at least in part-on semantic/cognitive constructs. For example, plants sprout branches, fish grow fins, shoes are moulded to our feet. Can humans parse shapes according to the processes that give shapes their key characteristics, even when such processes are hidden? To answer this, we investigated how humans perceive the shape of cells from the olfactory system of Xenopus laevis tadpoles. These objects are novel to most humans yet occur in nature and cluster into classes following their underlying biological function. We reconstructed three-dimensional (3D) cell models through 3D microscopy and photogrammetry, then conducted psychophysical experiments. Human participants performed two tasks: they arranged 3D-printed cell models by similarity and rated them along eight visual dimensions. Participants were highly consistent in their arrangements and ratings and spontaneously grouped stimuli to reflect the cell classes, unwittingly revealing the underlying processes shaping these forms. Our findings thus demonstrate that human perceptual organization mechanisms spontaneously parse the biological systematicities of never-before-seen, natural shapes. Integrating such human perceptual strategies into automated systems may enhance morphology-based analysis in biology and medicine.

Core dimensions of human material perception

Visually categorizing and comparing materials is crucial for everyday behavior, but what organizational principles underlie our mental representation of materials? Here, we used a large-scale data-driven approach to uncover core latent dimensions of material representations from behavior. First, we created an image dataset of 200 systematically sampled materials and 600 photographs (STUFF dataset, https://osf.io/myutc/). Using these images, we next collected 1.87 million triplet similarity judgments and used a computational model to derive a set of sparse, positive dimensions underlying these judgments. The resulting multidimensional embedding space predicted independent material similarity judgments and the similarity matrix of all images close to the human intersubject consistency. We found that representations of individual images were captured by a combination of 36 material dimensions that were highly reproducible and interpretable, comprising perceptual (e.g., grainy, blue) as well as conceptual (e.g., mineral, viscous) dimensions. These results provide the foundation for a comprehensive understanding of how humans make sense of materials.

Neural representation of action symbols in primate frontal cortex

At the core of intelligence is proficiency in solving new problems, including those that differ dramatically from problems seen before. Problem-solving, in turn, depends on goal-directed generation of novel thoughts and behaviors1, which has been proposed to rely on internal representations of discrete units, or symbols, and processes that can recombine them into a large set of possible composite representations1-11. Although this view has been influential in formulating cognitive-level explanations of behavior, definitive evidence for a neuronal substrate of symbols has remained elusive. Here, we identify a neural population encoding action symbols-internal, recombinable representations of discrete units of motor behavior-localized to a specific area of frontal cortex. In macaque monkeys performing a drawing-like task designed to assess recombination of learned action symbols into novel sequences, we found behavioral evidence for three critical features that indicate actions have an underlying symbolic representation: (i) invariance over low-level motor parameters; (ii) categorical structure, reflecting discrete classes of action; and (iii) recombination into novel sequences. In simultaneous neural recordings across motor, premotor, and prefrontal cortex, we found that planning-related population activity in ventral premotor cortex encodes actions in a manner that, like behavior, reflects motor invariance, categorical structure, and recombination, three properties indicating a symbolic representation. Activity in no other recorded area exhibited this combination of properties. These findings reveal a neural representation of action symbols localized to PMv, and therefore identify a putative neural substrate for symbolic cognitive operations.

Memory-Dependent Computation and Learning in Spiking Neural Networks Through Hebbian Plasticity

Spiking neural networks (SNNs) are the basis for many energy-efficient neuromorphic hardware systems. While there has been substantial progress in SNN research, artificial SNNs still lack many capabilities of their biological counterparts. In biological neural systems, memory is a key component that enables the retention of information over a huge range of temporal scales, ranging from hundreds of milliseconds up to years. While Hebbian plasticity is believed to play a pivotal role in biological memory, it has so far been analyzed mostly in the context of pattern completion and unsupervised learning in artificial and SNNs. Here, we propose that Hebbian plasticity is fundamental for computations in biological and artificial spiking neural systems. We introduce a novel memory-augmented SNN architecture that is enriched by Hebbian synaptic plasticity. We show that Hebbian enrichment renders SNNs surprisingly versatile in terms of their computational as well as learning capabilities. It improves their abilities for out-of-distribution generalization, one-shot learning, cross-modal generative association, language processing, and reward-based learning. This suggests that powerful cognitive neuromorphic systems can be built based on this principle.

Inferring shape transformations in a drawing task

Many objects and materials in our environment are subject to transformations that alter their shape. For example, branches bend in the wind, ice melts, and paper crumples. Still, we recognize objects and materials across these changes, suggesting we can distinguish an object's original features from those caused by the transformations ("shape scission"). Yet, if we truly understand transformations, we should not only be able to identify their signatures but also actively apply the transformations to new objects (i.e., through imagination or mental simulation). Here, we investigated this ability using a drawing task. On a tablet computer, participants viewed a sample contour and its transformed version, and were asked to apply the same transformation to a test contour by drawing what the transformed test shape should look like. Thus, they had to (i) infer the transformation from the shape differences, (ii) envisage its application to the test shape, and (iii) draw the result. Our findings show that drawings were more similar to the ground truth transformed test shape than to the original test shape-demonstrating the inference and reproduction of transformations from observation. However, this was only observed for relatively simple shapes. The ability was also modulated by transformation type and magnitude but not by the similarity between sample and test shapes. Together, our findings suggest that we can distinguish between representations of original object shapes and their transformations, and can use visual imagery to mentally apply nonrigid transformations to observed objects, showing how we not only perceive but also 'understand' shape.

Jackdaws form categorical prototypes based on experience with category exemplars

Categorization represents one cognitive ability fundamental to animal behavior. Grouping of elements based on perceptual or semantic features helps to reduce processing resources and facilitates appropriate behavior. Corvids master complex categorization, yet the detailed categorization learning strategies are less well understood. We trained two jackdaws on a delayed match to category paradigm using a novel, artificial stimulus type, RUBubbles. Both birds learned to differentiate between two session-unique categories following two distinct learning protocols. Categories were either introduced via central category prototypes (low variability approach) or using a subset of diverse category exemplars from which diagnostic features had to be identified (high variability approach). In both versions, the stimulus similarity relative to a central category prototype explained categorization performance best. Jackdaws consistently used a central prototype to judge category membership, regardless of whether this prototype was used to introduce distinct categories or had to be inferred from multiple exemplars. Reliance on a category prototype occurred already after experiencing only a few trials with different category exemplars. High stimulus set variability prolonged initial learning but showed no consistent beneficial effect on later generalization performance. High numbers of stimuli, their perceptual similarity, and coherent category structure resulted in a prototype-based strategy, reflecting the most adaptive, efficient, and parsimonious way to represent RUBubble categories. Thus, our birds represent a valuable comparative animal model that permits further study of category representations throughout learning in different regions of a brain producing highly cognitive behavior.

How does the primate brain combine generative and discriminative computations in vision?

Vision is widely understood as an inference problem. However, two contrasting conceptions of the inference process have each been influential in research on biological vision as well as the engineering of machine vision. The first emphasizes bottom-up signal flow, describing vision as a largely feedforward, discriminative inference process that filters and transforms the visual information to remove irrelevant variation and represent behaviorally relevant information in a format suitable for downstream functions of cognition and behavioral control. In this conception, vision is driven by the sensory data, and perception is direct because the processing proceeds from the data to the latent variables of interest. The notion of "inference" in this conception is that of the engineering literature on neural networks, where feedforward convolutional neural networks processing images are said to perform inference. The alternative conception is that of vision as an inference process in Helmholtz's sense, where the sensory evidence is evaluated in the context of a generative model of the causal processes that give rise to it. In this conception, vision inverts a generative model through an interrogation of the sensory evidence in a process often thought to involve top-down predictions of sensory data to evaluate the likelihood of alternative hypotheses. The authors include scientists rooted in roughly equal numbers in each of the conceptions and motivated to overcome what might be a false dichotomy between them and engage the other perspective in the realm of theory and experiment. The primate brain employs an unknown algorithm that may combine the advantages of both conceptions. We explain and clarify the terminology, review the key empirical evidence, and propose an empirical research program that transcends the dichotomy and sets the stage for revealing the mysterious hybrid algorithm of primate vision.

Drawing as a versatile cognitive tool

Drawing is a cognitive tool that makes the invisible contents of mental life visible. Humans use this tool to produce a remarkable variety of pictures, from realistic portraits to schematic diagrams. Despite this variety and the prevalence of drawn images, the psychological mechanisms that enable drawings to be so versatile have yet to be fully explored. In this Review, we synthesize contemporary work in multiple areas of psychology, computer science and neuroscience that examines the cognitive processes involved in drawing production and comprehension. This body of findings suggests that the balance of contributions from perception, memory and social inference during drawing production varies depending on the situation, resulting in some drawings that are more realistic and other drawings that are more abstract. We also consider the use of drawings as a research tool for investigating various aspects of cognition, as well as the role that drawing has in facilitating learning and communication. Taken together, information about how drawings are used in different contexts illuminates the central role of visually grounded abstractions in human thought and behaviour.