A pool of pairs of related objects (POPORO) for investigating visual semantic integration: behavioral and electrophysiological validation

The upside of cumulative conceptual interference on exemplar-level mnemonic discrimination

Although long-term visual memory (LTVM) has a remarkable capacity, the fidelity of its episodic representations can be influenced by at least two intertwined interference mechanisms during the encoding of objects belonging to the same category: the capacity to hold similar episodic traces (e.g., different birds) and the conceptual similarity of the encoded traces (e.g., a sparrow shares more features with a robin than with a penguin). The precision of episodic traces can be tested by having participants discriminate lures (unseen objects) from targets (seen objects) representing different exemplars of the same concept (e.g., two visually similar penguins), which generates interference at retrieval that can be solved if efficient pattern separation happened during encoding. The present study examines the impact of within-category encoding interference on the fidelity of mnemonic object representations, by manipulating an index of cumulative conceptual interference that represents the concurrent impact of capacity and similarity. The precision of mnemonic discrimination was further assessed by measuring the impact of visual similarity between targets and lures in a recognition task. Our results show a significant decrement in the correct identification of targets for increasing interference. Correct rejections of lures were also negatively impacted by cumulative interference as well as by the visual similarity with the target. Most interestingly though, mnemonic discrimination for targets presented with a visually similar lure was more difficult when objects were encoded under lower, not higher, interference. These findings counter a simply additive impact of interference on the fidelity of object representations providing a finer-grained, multi-factorial, understanding of interference in LTVM.

ObScene database: Semantic congruency norms for 898 pairs of object-scene pictures

Research on the interaction between object and scene processing has a long history in the fields of perception and visual memory. Most databases have established norms for pictures where the object is embedded in the scene. In this study, we provide a diverse and controlled stimulus set comprising real-world pictures of 375 objects (e.g., suitcase), 245 scenes (e.g., airport), and 898 object-scene pairs (e.g., suitcase-airport), with object and scene presented separately. Our goal was twofold. First, to create a database of object and scene pictures, normed for the same variables to have comparable measures for both types of pictures. Second, to acquire normative data for the semantic relationships between objects and scenes presented separately, which offers more flexibility in the use of the pictures and allows disentangling the processing of the object and its context (the scene). Along three experiments, participants evaluated each object or scene picture on name agreement, familiarity, and visual complexity, and rated object-scene pairs on semantic congruency. A total of 125 septuplets of one scene and six objects (three congruent, three incongruent), and 120 triplets of one object and two scenes (in congruent and incongruent pairings) were built. In future studies, these objects and scenes can be used separately or combined, while controlling for their key features. Additionally, as object-scene pairs received semantic congruency ratings along the entire scale, researchers may select among a wide range of congruency values. ObScene is a comprehensive and ecologically valid database, useful for psychology and neuroscience studies of visual object and scene processing.

Identifying content-invariant neural signatures of perceptual vividness

Some conscious experiences are more vivid than others. Although perceptual vividness is a key component of human consciousness, how variation in this magnitude property is registered by the human brain is unknown. A striking feature of neural codes for magnitude in other psychological domains, such as number or reward, is that the magnitude property is represented independently of its sensory features. To test whether perceptual vividness also covaries with neural codes that are invariant to sensory content, we reanalyzed existing magnetoencephalography and functional MRI data from two distinct studies which quantified perceptual vividness via subjective ratings of awareness and visibility. Using representational similarity and decoding analyses, we find evidence for content-invariant neural signatures of perceptual vividness distributed across visual, parietal, and frontal cortices. Our findings indicate that the neural correlates of subjective vividness may share similar properties to magnitude codes in other cognitive domains.

Context effects on object recognition in real-world environments: A study protocol

Background: The environments that we live in impact on our ability to recognise objects, with recognition being facilitated when objects appear in expected locations (congruent) compared to unexpected locations (incongruent). However, these findings are based on experiments where the object is isolated from its environment. Moreover, it is not clear which components of the recognition process are impacted by the environment. In this experiment, we seek to examine the impact real world environments have on object recognition. Specifically, we will use mobile electroencephalography (mEEG) and augmented reality (AR) to investigate how the visual and semantic processing aspects of object recognition are changed by the environment. Methods: We will use AR to place congruent and incongruent virtual objects around indoor and outdoor environments. During the experiment a total of 34 participants will walk around the environments and find these objects while we record their eye movements and neural signals. We will perform two primary analyses. First, we will analyse the event-related potential (ERP) data using paired samples t-tests in the N300/400 time windows in an attempt to replicate congruency effects on the N300/400. Second, we will use representational similarity analysis (RSA) and computational models of vision and semantics to determine how visual and semantic processes are changed by congruency. Conclusions: Based on previous literature, we hypothesise that scene-object congruence would facilitate object recognition. For ERPs, we predict a congruency effect in the N300/N400, and for RSA we predict that higher level visual and semantic information will be represented earlier for congruent scenes than incongruent scenes. By collecting mEEG data while participants are exploring a real-world environment, we will be able to determine the impact of a natural context on object recognition, and the different processing stages of object recognition.

Instant Effects of Semantic Information on Visual Perception

Does our perception of an object change once we discover what function it serves? We showed human participants (n = 48, 31 females and 17 males) pictures of unfamiliar objects either together with keywords matching their function, leading to semantically informed perception, or together with nonmatching keywords, resulting in uninformed perception. We measured event-related potentials to investigate at which stages in the visual processing hierarchy these two types of object perception differed from one another. We found that semantically informed compared with uninformed perception was associated with larger amplitudes in the N170 component (150-200 ms), reduced amplitudes in the N400 component (400-700 ms), and a late decrease in alpha/beta band power. When the same objects were presented once more without any information, the N400 and event-related power effects persisted, and we also observed enlarged amplitudes in the P1 component (100-150 ms) in response to objects for which semantically informed perception had taken place. Consistent with previous work, this suggests that obtaining semantic information about previously unfamiliar objects alters aspects of their lower-level visual perception (P1 component), higher-level visual perception (N170 component), and semantic processing (N400 component, event-related power). Our study is the first to show that such effects occur instantly after semantic information has been provided for the first time, without requiring extensive learning.SIGNIFICANCE STATEMENT There has been a long-standing debate about whether or not higher-level cognitive capacities, such as semantic knowledge, can influence lower-level perceptual processing in a top-down fashion. Here we could show, for the first time, that information about the function of previously unfamiliar objects immediately influences cortical processing within less than 200 ms. Of note, this influence does not require training or experience with the objects and related semantic information. Therefore, our study is the first to show effects of cognition on perception while ruling out the possibility that prior knowledge merely acts by preactivating or altering stored visual representations. Instead, this knowledge seems to alter perception online, thus providing a compelling case against the impenetrability of perception by cognition.

The effects of search-irrelevant working memory content on visual search

Previous experiments investigating visual search have shown that distractors that are semantically related to a search target can capture attention and slow the search process. In two experiments, we examine if distractors exactly matching, or semantically related to, search-irrelevant information held in working memory (WM) can also influence visual search while ruling out potential effects of color similarity. Participants first viewed and memorized an image of an everyday object, then they determined if a target item was present or absent in a two-object search array. On exact-match trials, the memorized object appeared as a distractor; on semantic-match trials, an object semantically related to the memorized object appeared as a distractor. Both exact-match and semantic-match distractors slowed search when the target was present in the search array. Our findings extend previous findings by demonstrating WM-driven attentional guidance by complex objects rather than simple features. The results also suggest that visual search can be influenced by distractors sharing only semantic features with a search-irrelevant, but active, WM representation.

The role of working memory loads on immediate and long-term sentence recall

It is well-established that both phonological and semantic knowledge influence verbal working memory. However, the focus has primarily been on understanding phonological effects despite evidence of semantic influences. Articulatory suppression is a well-established task for preventing phonological processing. Methods to prevent semantic processing have rarely been used in the past, highlighting a need for developing a semantic interference task. We, therefore, conceptualised two novel tasks - an animacy categorisation and semantic relatedness judgement task. This study explored the impact of phonological (articulatory suppression) and semantic loads (animacy categorisation and semantic relatedness judgement) on immediate and delayed sentence recall. Additionally, sentence concreteness (concrete vs. abstract sentences) indexed semantic knowledge in verbal working memory. Across two studies, immediate recall revealed that articulatory suppression (preventing phonological processing) increased the size of the concreteness effect, while the novel semantic tasks (preventing semantic processing) reduced it suggesting that our semantic tasks were indeed imposing a semantic load. Further, relative long-term performance showed that more new words were remembered in articulatory suppression, whereas recall was disproportionately impaired in the semantic relatedness task. Our experimental paradigm offers phonological and semantic suppression tasks that can be used in parallel to investigate the interactions between working memory and language.

Multisensory synchrony of contextual boundaries affects temporal order memory, but not encoding or recognition

We memorize our daily life experiences, which are often multisensory in nature, by segmenting them into distinct event models, in accordance with perceived contextual or situational changes. However, very little is known about how multisensory boundaries affect segmentation, as most studies have focused on unisensory (visual or audio) segmentation. In three experiments, we investigated the effect of multisensory boundaries on segmentation in memory and perception. In Experiment 1, participants encoded lists of pictures while audio and visual contexts changed synchronously or asynchronously. After each list, we tested recognition and temporal associative memory for pictures that were encoded in the same audio-visual context or that crossed a synchronous or an asynchronous multisensory change. We found no effect of multisensory synchrony for recognition memory: synchronous and asynchronous changes similarly impaired recognition for pictures encoded at those changes, compared to pictures encoded further away from those changes. Multisensory synchrony did affect temporal associative memory, which was worse for pictures encoded at synchronous than at asynchronous changes. Follow up experiments showed that this effect was not due to the higher dimensionality of multisensory over unisensory contexts (Experiment 2), nor that it was due to the temporal unpredictability of contextual changes inherent to Experiment 1 (Experiment 3). We argue that participants formed situational expectations through multisensory synchronicity, such that synchronous multisensory changes deviated more strongly from those expectations than asynchronous changes. We discuss our findings in light of supportive and conflicting findings of uni- and multi-sensory segmentation.

Predictive language comprehension in Parkinson's disease

Verb and action knowledge deficits are reported in persons with Parkinson's disease (PD), even in the absence of dementia or mild cognitive impairment. However, the impact of these deficits on combinatorial semantic processing is less well understood. Following on previous verb and action knowledge findings, we tested the hypothesis that PD impairs the ability to integrate event-based thematic fit information during online sentence processing. Specifically, we anticipated persons with PD with age-typical cognitive abilities would perform more poorly than healthy controls during a visual world paradigm task requiring participants to predict a target object constrained by the thematic fit of the agent-verb combination. Twenty-four PD and 24 healthy age-matched participants completed comprehensive neuropsychological assessments. We recorded participants' eye movements as they heard predictive sentences (The fisherman rocks the boat) alongside target, agent-related, verb-related, and unrelated images. We tested effects of group (PD/control) on gaze using growth curve models. There were no significant differences between PD and control participants, suggesting that PD participants successfully and rapidly use combinatory thematic fit information to predict upcoming language. Baseline sentences with no predictive information (e.g., Look at the drum) confirmed that groups showed equivalent sentence processing and eye movement patterns. Additionally, we conducted an exploratory analysis contrasting PD and controls' performance on low-motion-content versus high-motion-content verbs. This analysis revealed fewer predictive fixations in high-motion sentences only for healthy older adults. PD participants may adapt to their disease by relying on spared, non-action-simulation-based language processing mechanisms, although this conclusion is speculative, as the analyses of high- vs. low-motion items was highly limited by the study design. These findings provide novel evidence that individuals with PD match healthy adults in their ability to use verb meaning to predict upcoming nouns despite previous findings of verb semantic impairment in PD across a variety of tasks.

Forgetting Alcohol: A Double-Blind, Randomized Controlled Trial Investigating Memory Inhibition Training in Young Binge Drinkers

Background

Binge Drinking (BD) has been associated with altered inhibitory control and augmented alcohol-cue reactivity. Memory inhibition (MI), the ability to voluntarily suppress unwanted thoughts/memories, may lead to forgetting of memories in several psychiatric conditions. However, despite its potential clinical implications, no study to date has explored the MI abilities in populations with substance misuse, such as binge drinkers (BDs).

Method

This study—registered in the NIH Clinical Trials Database (ClinicalTrials.gov identifier: NCT05237414)—aims firstly to examine the behavioral and electroencephalographic (EEG) correlates of MI among college BDs. For this purpose, 45 BDs and 45 age-matched non/low-drinkers (50% female) will be assessed by EEG while performing the Think/No-Think Alcohol task, a paradigm that evaluates alcohol-related MI. Additionally, this work aims to evaluate an alcohol-specific MI intervention protocol using cognitive training (CT) and transcranial direct current stimulation (tDCS) while its effects on behavioral and EEG outcomes are assessed. BDs will be randomly assigned to one MI training group: combined [CT and verum tDCS applied over the right dorsolateral prefrontal cortex (DLPFC)], cognitive (CT and sham tDCS), or control (sham CT and sham tDCS). Training will occur in three consecutive days, in three sessions. MI will be re-assessed in BDs through a post-training EEG assessment. Alcohol use and craving will be measured at the first EEG assessment, and both 10-days and 3-months post-training. In addition, behavioral and EEG data will be collected during the performance of an alcohol cue reactivity (ACR) task, which evaluates attentional bias toward alcoholic stimuli, before, and after the MI training sessions.

Discussion

This study protocol will provide the first behavioral and neurofunctional MI assessment in BDs. Along with poor MI abilities, BDs are expected to show alterations in event-related potentials and functional connectivity patterns associated with MI. Results should also demonstrate the effectiveness of the protocol, with BDs exhibiting an improved capacity to suppress alcohol-related memories after both combined and cognitive training, along with a reduction in alcohol use and craving in the short/medium-term. Collectively, these findings might have major implications for the understanding and treatment of alcohol misuse.

Clinical Trial Registration

[www.ClinicalTrials.gov], identifier [NCT05237414].

Cue overlap supports preretrieval selection in episodic memory: ERP evidence

People often want to recall events of a particular kind, but this selective remembering is not always possible. We contrasted two candidate mechanisms: the overlap between retrieval cues and stored memory traces, and the ease of recollection. In two preregistered experiments (Ns = 28), we used event-related potentials (ERPs) to quantify selection occurring before retrieval and the goal states — retrieval orientations — thought to achieve this selection. Participants viewed object pictures or heard object names, and one of these sources was designated as targets in each memory test. We manipulated cue overlap by probing memory with visual names (Experiment 1) or line drawings (Experiment 2). Results revealed that regardless of which source was targeted, the left parietal ERP effect indexing recollection was selective when test cues overlapped more with the targeted than non-targeted information, despite consistently better memory for pictures. ERPs for unstudied items also were more positive-going when cue overlap was high, suggesting that engagement of retrieval orientations reflected availability of external cues matching the targeted source. The data support the view that selection can act before recollection if there is sufficient overlap between retrieval cues and targeted versus competing memory traces.

Context effects on object recognition in real-world environments: A study protocol

Background: The environments that we live in impact on our ability to recognise objects, with recognition being facilitated when objects appear in expected locations (congruent) compared to unexpected locations (incongruent). However, these findings are based on experiments where the object is isolated from its environment. Moreover, it is not clear which components of the recognition process are impacted by the environment. In this experiment, we seek to examine the impact real world environments have on object recognition. Specifically, we will use mobile electroencephalography (mEEG) and augmented reality (AR) to investigate how the visual and semantic processing aspects of object recognition are changed by the environment. Methods: We will use AR to place congruent and incongruent virtual objects around indoor and outdoor environments. During the experiment a total of 34 participants will walk around the environments and find these objects while we record their eye movements and neural signals. We will perform two primary analyses. First, we will analyse the event-related potential (ERP) data using paired samples t-tests in the N300/400 time windows in an attempt to replicate congruency effects on the N300/400. Second, we will use representational similarity analysis (RSA) and computational models of vision and semantics to determine how visual and semantic processes are changed by congruency. Conclusions: Based on previous literature, we hypothesise that scene-object congruence would facilitate object recognition. For ERPs, we predict a congruency effect in the N300/N400, and for RSA we predict that higher level visual and semantic information will be represented earlier for congruent scenes than incongruent scenes. By collecting mEEG data while participants are exploring a real-world environment, we will be able to determine the impact of a natural context on object recognition, and the different processing stages of object recognition.

Time changes: Timing contexts support event segmentation in associative memory

We tend to mentally segment a series of events according to perceptual contextual changes, such that items from a shared context are more strongly associated in memory than items from different contexts. It is also known that timing context provides a scaffold to structure experiences in memory, but its role in event segmentation has not been investigated. We adapted a previous paradigm, which was used to investigate event segmentation using visual contexts, to study the effects of changes in timing contexts on event segmentation in associative memory. In two experiments, we presented lists of 36 items in which the interstimulus intervals (ISIs) changed after a series of six items ranging between 0.5 and 4 s in 0.5 s steps. After each list, participants judged which one of two test items were shown first (temporal order judgment) for items that were either drawn from the same context (within an ISI) or from consecutive contexts (across ISIs). Further, participants judged from memory whether the ISI associated to an item lasted longer than a standard interval (2.25 s) that was not previously shown (temporal source memory). Experiment 2 further included a time-item encoding task. Results revealed an effect of timing context changes in temporal order judgments, with faster responses (Experiment 1) or higher accuracy (Experiment 2) when items were drawn from the same context, as opposed to items drawn from across contexts. Further, in both experiments, we found that participants were well able to provide temporal source memory judgments based on recalled durations. Finally, replicated across experiments, we found subjective duration bias, as estimated by psychometric curve fitting parameters of the recalled durations, correlated negatively with within-context temporal order judgments. These findings show that changes in timing context support event segmentation in associative memory.

No Evidence for Neural Overlap between Unconsciously Processed and Imagined Stimuli

Visual representations can be generated via feedforward or feedback processes. The extent to which these processes result in overlapping representations remains unclear. Previous work has shown that imagined stimuli elicit similar representations as perceived stimuli throughout the visual cortex. However, while representations during imagery are indeed only caused by feedback processing, neural processing during perception is an interplay of both feedforward and feedback processing. This means that any representational overlap could be because of overlap in feedback processes. In the current study, we aimed to investigate this issue by characterizing the overlap between feedforward- and feedback-initiated category representations during imagined stimuli, conscious perception, and unconscious processing using fMRI in humans of either sex. While all three conditions elicited stimulus representations in left lateral occipital cortex (LOC), significant similarities were observed only between imagery and conscious perception in this area. Furthermore, connectivity analyses revealed stronger connectivity between frontal areas and left LOC during conscious perception and in imagery compared with unconscious processing. Together, these findings can be explained by the idea that long-range feedback modifies visual representations, thereby reducing representational overlap between purely feedforward- and feedback-initiated stimulus representations measured by fMRI. Neural representations influenced by feedback, either stimulus driven (perception) or purely internally driven (imagery), are, however, relatively similar.

How to do Better N400 Studies: Reproducibility, Consistency and Adherence to Research Standards in the Existing Literature

Given the complexity of ERP recording and processing pipeline, the resulting variability of methodological options, and the potential for these decisions to influence study outcomes, it is important to understand how ERP studies are conducted in practice and to what extent researchers are transparent about their data collection and analysis procedures. The review gives an overview of methodology reporting in a sample of 132 ERP papers, published between January 1980 – June 2018 in journals included in two large databases: Web of Science and PubMed. Because ERP methodology partly depends on the study design, we focused on a well-established component (the N400) in the most commonly assessed population (healthy neurotypical adults), in one of its most common modalities (visual images). The review provides insights into 73 properties of study design, data pre-processing, measurement, statistics, visualization of results, and references to supplemental information across studies within the same subfield. For each of the examined methodological decisions, the degree of consistency, clarity of reporting and deviations from the guidelines for best practice were examined. Overall, the results show that each study had a unique approach to ERP data recording, processing and analysis, and that at least some details were missing from all papers. In the review, we highlight the most common reporting omissions and deviations from established recommendations, as well as areas in which there was the least consistency. Additionally, we provide guidance for a priori selection of the N400 measurement window and electrode locations based on the results of previous studies.

Neural Signatures of Learning Novel Object-Scene Associations

Objects are perceived within rich visual contexts, and statistical associations may be exploited to facilitate their rapid recognition. Recent work using natural scene-object associations suggests that scenes can prime the visual form of associated objects, but it remains unknown whether this relies on an extended learning process. We asked participants to learn categorically structured associations between novel objects and scenes in a paired associate memory task while ERPs were recorded. In the test phase, scenes were first presented (2500 msec), followed by objects that matched or mismatched the scene; degree of contextual mismatch was manipulated along visual and categorical dimensions. Matching objects elicited a reduced N300 response, suggesting visuostructural priming based on recently formed associations. Amplitude of an extended positivity (onset ∼200 msec) was sensitive to visual distance between the presented object and the contextually associated target object, most likely indexing visual template matching. Results suggest recent associative memories may be rapidly recruited to facilitate object recognition in a top-down fashion, with clinical implications for populations with impairments in hippocampal-dependent memory and executive function.

A perceptual bias for man-made objects in humans

Ambiguous images are widely recognized as a valuable tool for probing human perception. Perceptual biases that arise when people make judgements about ambiguous images reveal their expectations about the environment. While perceptual biases in early visual processing have been well established, their existence in higher-level vision has been explored only for faces, which may be processed differently from other objects. Here we developed a new, highly versatile method of creating ambiguous hybrid images comprising two component objects belonging to distinct categories. We used these hybrids to measure perceptual biases in object classification and found that images of man-made (manufactured) objects dominated those of naturally occurring (non-man-made) ones in hybrids. This dominance generalized to a broad range of object categories, persisted when the horizontal and vertical elements that dominate man-made objects were removed and increased with the real-world size of the manufactured object. Our findings show for the first time that people have perceptual biases to see man-made objects and suggest that extended exposure to manufactured environments in our urban-living participants has changed the way that they see the world.

Electrophysiological correlates of masked repetition and conceptual priming for visual objects

BACKGROUND

Previous studies have investigated the time course of visual object processing using event-related potential (ERP) and the masked repetition priming paradigm. However, it is unclear how the ERP correlates associated with masked repetition priming differentiate from masked conceptual priming of visual objects.

METHOD

The present study used semantically related picture pairs of visual objects to compare the ERPs associated with masked repetition and conceptual priming of visual objects.

RESULTS

The results revealed that masked repetition priming was associated with N/P190 and N400 effects, whereas masked conceptual priming was only associated with N400 effect. Moreover, the topography of repetition N/P190 effect was different from repetition and conceptual N400 effects, whereas the topography of repetition N400 effect was similar to conceptual N400 effect.

CONCLUSIONS

These results indicated that masked repetition and conceptual priming were associated with spatiotemporally different ERP effects and that the N400 of visual objects was sensitive to automatic semantic spreading.

Extrafoveal attentional capture by object semantics

There is ongoing debate on whether object meaning can be processed outside foveal vision, making semantics available for attentional guidance. Much of the debate has centred on whether objects that do not fit within an overall scene draw attention, in complex displays that are often difficult to control. Here, we revisited the question by reanalysing data from three experiments that used displays consisting of standalone objects from a carefully controlled stimulus set. Observers searched for a target object, as per auditory instruction. On the critical trials, the displays contained no target but objects that were semantically related to the target, visually related, or unrelated. Analyses using (generalized) linear mixed-effects models showed that, although visually related objects attracted most attention, semantically related objects were also fixated earlier in time than unrelated objects. Moreover, semantic matches affected the very first saccade in the display. The amplitudes of saccades that first entered semantically related objects were larger than 5° on average, confirming that object semantics is available outside foveal vision. Finally, there was no semantic capture of attention for the same objects when observers did not actively look for the target, confirming that it was not stimulus-driven. We discuss the implications for existing models of visual cognition.

Food-Pics_Extended-An Image Database for Experimental Research on Eating and Appetite: Additional Images, Normative Ratings and an Updated Review

Our current environment is characterized by the omnipresence of food cues. The taste and smell of real foods—but also graphical depictions of appetizing foods—can guide our eating behavior, for example, by eliciting food craving and anticipatory cephalic phase responses. To facilitate research into this so-called cue reactivity, several groups have compiled standardized food image sets. Yet, selecting the best subset of images for a specific research question can be difficult as images and image sets vary along several dimensions. In the present report, we review the strengths and weaknesses of popular food image sets to guide researchers during stimulus selection. Furthermore, we present a recent extension of our previously published database food-pics, which comprises an additional 328 food images from different countries to increase cross-cultural applicability. This food-pics_extended stimulus database, thus, encompasses and replaces food-pics. Normative data from a predominantly German-speaking sample are again presented as well as updated calculations of image characteristics.

Not all perceptual difficulties lower memory predictions: Testing the perceptual fluency hypothesis with rotated and inverted object images

Studies typically show that perceptual difficulties at the time of encoding lower memory predictions. One potential exception to this is the inverted-word manipulation, in which participants produce equivalent memory predictions for upright and inverted words, despite higher free-recall performance for the inverted words (Sungkhasettee, Friedman, & Castel in Psychonomic Bulletin & Review, 18, 973-978, 2011). In the present set of experiments, we aimed to investigate the contributions of online perceptual difficulties versus a priori beliefs through two disfluency manipulations conceptually similar to the inverted-word manipulation: inversion and canonicity. The inversion manipulation involved presentation of upright and inverted object images, whereas the canonicity manipulation involved presentation of objects to participants from frequent (canonical) or infrequent (noncanonical) viewing perspectives. Memory predictions were made either on an item-by-item basis or aggregately. In all studies, the perceptual identification latencies for inverted and noncanonical items were slower than those for upright and canonical items, respectively. In experiments conducted with item-by-item memory predictions, predictions were not significantly different from each other across encoding conditions. In contrast, in experiments using aggregate memory predictions, fluent items produced higher memory predictions than did disfluent items. These results show that in certain cases, participants may not consider online objective perceptual difficulties. Moreover, item-by-item and aggregate memory predictions produce different patterns, evidence of a dissociation between the two types of predictions. The results are discussed in light of theories that rely on objective perceptual fluency differences across encoding conditions versus theories that rely on participants' a priori beliefs about fluency.

Impaired perceptual integration and memory for unitized representations are associated with perirhinal cortex atrophy in Alzheimer's disease

Unitization, the capacity to encode associations as one integrated entity, can enhance associative memory in populations with an associative memory deficit by promoting familiarity-based associative recognition. Patients with Alzheimer's disease (AD) are typically impaired in associative memory compared with healthy controls but do not benefit from unitization strategies. Using fragmented pictures of objects, this study aimed at assessing which of the cognitive processes that compose unitization is actually affected in AD: the retrieval of unitized representations itself, or some earlier stages of processing, such as the integration process at a perceptual or conceptual stage of representation. We also intended to relate patients' object unitization capacity to the integrity of their perirhinal cortex (PrC), as the PrC is thought to underlie unitization and is also one of the first affected regions in AD. We evaluated perceptual integration capacity and subsequent memory for those items that have supposedly been unitized in 23 mild AD patients and 20 controls. We systematically manipulated the level of perceptual integration during encoding by presenting object pictures that were either left intact, separated into 2 fragments, or separated into 4 fragments. Subjects were instructed to unitize the fragments into a single representation. Success of integration was assessed by a question requiring the identification of the object. Participants also underwent a structural magnetic resonance imaging examination, and measures of PrC, posterior cingulate cortex volume and thickness, and hippocampal volume, were extracted. The results showed that patients' perceptual integration performance decreased with the increased fragmentation level and that their memory for unitized representations was impaired whatever the demands in terms of perceptual integration at encoding. Both perceptual integration and memory for unitized representations were related to the integrity of the PrC, and memory for unitized representations was also related to the volume of the hippocampus. We argue that, globally, this supports representational theories of memory that hold that the role of the PrC is not only perceptual nor mnemonic but instead underlies complex object representation.

The nature and emotional valence of a prime influences the processing of emotional faces in adults and children

A large body of research has investigated both the emotional elaboration of facial stimuli in adults and the development of children’s recognition of emotional expressions. Yet, it is still not clear whether children’s ability to recognize an emotional face may be modulated by prior exposure to a different face, and whether an emotional expression may exert an effect on the processing of subsequently encountered facial emotional expressions. We tested in three experiments the recognition of happy and angry target faces preceded by neutral faces or objects (Experiment 1) and happy or angry faces (Experiment 2A and Experiment 2B) using an affective priming task in adults and 7- and 5-year-old children. Results showed a standard prime effect for neutral faces (Experiment 1) for all participants, and for happy faces in children (Experiment 2A) and adults (Experiment 2B). Otherwise, angry faces elicited negative priming effects in all participants (Experiment 2A). Overall, our findings showed that both prior exposure to a face per se and the emotional valence of the prime face have an impact on subsequent processing of facial emotional information. Implications for emotional processing are discussed.

Phonological and semantic priming in American Sign Language: N300 and N400 effects

This study investigated the electrophysiological signatures of phonological and semantic priming in American Sign Language (ASL). Deaf signers made semantic relatedness judgments to pairs of ASL signs separated by a 1300 ms prime-target SOA. Phonologically related sign pairs shared two of three phonological parameters (handshape, location, and movement). Target signs preceded by phonologically related and semantically related prime signs elicited smaller negativities within the N300 and N400 windows than those preceded by unrelated primes. N300 effects, typically reported in studies of picture processing, are interpreted to reflect the mapping from the visual features of the signs to more abstract linguistic representations. N400 effects, consistent with rhyme priming effects in the spoken language literature, are taken to index lexico-semantic processes that appear to be largely modality independent. Together, these results highlight both the unique visual-manual nature of sign languages and the linguistic processing characteristics they share with spoken languages.

Scene grammar shapes the way we interact with objects, strengthens memories, and speeds search

Predictions of environmental rules (here referred to as "scene grammar") can come in different forms: seeing a toilet in a living room would violate semantic predictions, while finding a toilet brush next to the toothpaste would violate syntactic predictions. The existence of such predictions has usually been investigated by showing observers images containing such grammatical violations. Conversely, the generative process of creating an environment according to one's scene grammar and its effects on behavior and memory has received little attention. In a virtual reality paradigm, we either instructed participants to arrange objects according to their scene grammar or against it. Subsequently, participants' memory for the arrangements was probed using a surprise recall (Exp1), or repeated search (Exp2) task. As a result, participants' construction behavior showed strategic use of larger, static objects to anchor the location of smaller objects which are generally the goals of everyday actions. Further analysis of this scene construction data revealed possible commonalities between the rules governing word usage in language and object usage in naturalistic environments. Taken together, we revealed some of the building blocks of scene grammar necessary for efficient behavior, which differentially influence how we interact with objects and what we remember about scenes.

Does a Flatter General Gradient of Visual Attention Explain Peripheral Advantages and Central Deficits in Deaf Adults?

Individuals deaf from early age often outperform hearing individuals in the visual periphery on attention-dependent dorsal stream tasks (e.g., spatial localization or movement detection), but sometimes show central visual attention deficits, usually on ventral stream object identification tasks. It has been proposed that early deafness adaptively redirects attentional resources from central to peripheral vision to monitor extrapersonal space in the absence of auditory cues, producing a more evenly distributed attention gradient across visual space. However, little direct evidence exists that peripheral advantages are functionally tied to central deficits, rather than determined by independent mechanisms, and previous studies using several attention tasks typically report peripheral advantages or central deficits, not both. To test the general altered attentional gradient proposal, we employed a novel divided attention paradigm that measured target localization performance along a gradient from parafoveal to peripheral locations, independent of concurrent central object identification performance in prelingually deaf and hearing groups who differed in access to auditory input. Deaf participants without cochlear implants (No-CI), with cochlear implants (CI), and hearing participants identified vehicles presented centrally, and concurrently reported the location of parafoveal (1.4°) and peripheral (13.3°) targets among distractors. No-CI participants but not CI participants showed a central identification accuracy deficit. However, all groups displayed equivalent target localization accuracy at peripheral and parafoveal locations and nearly parallel parafoveal-peripheral gradients. Furthermore, the No-CI group's central identification deficit remained after statistically controlling peripheral performance; conversely, the parafoveal and peripheral group performance equivalencies remained after controlling central identification accuracy. These results suggest that, in the absence of auditory input, reduced central attentional capacity is not necessarily associated with enhanced peripheral attentional capacity or with flattening of a general attention gradient. Our findings converge with earlier studies suggesting that a general graded trade-off of attentional resources across the visual field does not adequately explain the complex task-dependent spatial distribution of deaf-hearing performance differences reported in the literature. Rather, growing evidence suggests that the spatial distribution of attention-mediated performance in deaf people is determined by sophisticated cross-modal plasticity mechanisms that recruit specific sensory and polymodal cortex to achieve specific compensatory processing goals.

Associated Information Increases Subjective Perception of Duration

Our sense of time is prone to various biases. For instance, one factor that can dilate an event's perceived duration is the violation of predictions; when a series of repeated stimuli is interrupted by an unpredictable oddball. On the other hand, when the probability of a repetition itself is manipulated, predictable conditions can also increase estimated duration. This suggests that manipulations of expectations have different or even opposing effects on time perception. In previous studies, expectations were generated because stimuli were repeated or because the likelihood of a sequence or a repetition was varied. In the natural environment, however, expectations are often built via associative processes, for example, the context of a kitchen promotes the expectation of plates, appliances, and other associated objects. Here, we manipulated such association-based expectations by using oddballs that were either contextually associated or nonassociated with the standard items. We find that duration was more strongly overestimated for contextually associated oddballs. We reason that top-down attention is biased toward associated information, and thereby dilates subjective duration for associated oddballs. Based on this finding, we propose an interplay between top-down attention and predictive processing in the perception of time.

Semantic Relations between Visual Objects Can Be Unconsciously Processed but Not Reported under Change Blindness

Change blindness—the failure to detect changes in visual scenes—has often been interpreted as a result of impoverished visual information encoding or as a failure to compare the prechange and postchange scene. In the present electroencephalography study, we investigated whether semantic features of prechange and postchange information are processed unconsciously, even when observers are unaware that a change has occurred. We presented scenes composed of natural objects in which one object changed from one presentation to the next. Object changes were either semantically related (e.g., rail car changed to rail) or unrelated (e.g., rail car changed to sausage). Observers were first asked to detect whether any change had occurred and then to judge the semantic relation of the two objects involved in the change. We found a semantic mismatch ERP effect, that is, a more negative-going ERP for semantically unrelated compared to related changes, originating from a cortical network including the left middle temporal gyrus and occipital cortex and resembling the N400 effect, albeit at longer latencies. Importantly, this semantic mismatch effect persisted even when observers were unaware of the change and the semantic relationship of prechange and postchange object. This finding implies that change blindness does not preclude the encoding of the prechange and postchange objects' identities and possibly even the comparison of their semantic content. Thus, change blindness cannot be interpreted as resulting from impoverished or volatile visual representations or as a failure to process the prechange and postchange object. Instead, change detection appears to be limited at a later, postperceptual stage.

OB3D, a new set of 3D objects available for research: a web-based study

Studying object recognition is central to fundamental and clinical research on cognitive functions but suffers from the limitations of the available sets that cannot always be modified and adapted to meet the specific goals of each study. We here present a new set of 3D scans of real objects available on-line as ASCII files, OB3D. These files are lists of dots, each defined by a triplet of spatial coordinates and their normal that allow simple and highly versatile transformations and adaptations. We performed a web-based experiment to evaluate the minimal number of dots required for the denomination and categorization of these objects, thus providing a reference threshold. We further analyze several other variables derived from this data set, such as the correlations with object complexity. This new stimulus set, which was found to activate the Lower Occipital Complex (LOC) in another study, may be of interest for studies of cognitive functions in healthy participants and patients with cognitive impairments, including visual perception, language, memory, etc.

Food-pics: an image database for experimental research on eating and appetite

Our current environment is characterized by the omnipresence of food cues. The sight and smell of real foods, but also graphically depictions of appetizing foods, can guide our eating behavior, for example, by eliciting food craving and influencing food choice. The relevance of visual food cues on human information processing has been demonstrated by a growing body of studies employing food images across the disciplines of psychology, medicine, and neuroscience. However, currently used food image sets vary considerably across laboratories and image characteristics (contrast, brightness, etc.) and food composition (calories, macronutrients, etc.) are often unspecified. These factors might have contributed to some of the inconsistencies of this research. To remedy this, we developed food-pics, a picture database comprising 568 food images and 315 non-food images along with detailed meta-data. A total of N = 1988 individuals with large variance in age and weight from German speaking countries and North America provided normative ratings of valence, arousal, palatability, desire to eat, recognizability and visual complexity. Furthermore, data on macronutrients (g), energy density (kcal), and physical image characteristics (color composition, contrast, brightness, size, complexity) are provided. The food-pics image database is freely available under the creative commons license with the hope that the set will facilitate standardization and comparability across studies and advance experimental research on the determinants of eating behavior.