Beyond correlation: do color features influence attention in rainforest?

Visual Design Cues Impacting Food Choice: A Review and Future Research Agenda

This review aims to tackle the challenge of understanding how visual design cues can affect behavioural outcomes in a food context. The review answers two key questions: (1) What are the effects of the most important visual design cues on behavioural outcomes and how can they be explained? (2) What are the research gaps in this area? We start from a comprehensive taxonomy of visual design cues delineating the most important visual design cues. Next, we evaluate the extant research based on a structured, narrative literature review on visual design cues in the food domain. We differentiate between object processed and spatially processed visual design cues in food choice contexts and show how they affect behavioural outcomes through a range of psychological processes (attention, affective-, cognitive- and motivational reactions, food perceptions and attitudes). We end with recommendations which take into account the current food store context, the state-of-art in measuring psychological processes and behavioural outcomes and the specific food-, person- and context-related moderators. This review offers guidance for research to untangle the complexity of the effect of visual design cues in a food choice context.

A Historically Based Review of Empirical Work on Color and Psychological Functioning: Content, Methods, and Recommendations for Future Research

Empirical work on color and psychological functioning has a long history, dating back to the 19th century. This early research focused on five different areas: Arousal, physical strength, preference, time perception, and attention. In the present paper, I overview the relations observed in this early research, and detail methodological weaknesses therein. I then trace subsequent 20th and 21st century developments in these research areas, in terms of both content and methods. Finally, I extend the review to cover the full breadth of research in this domain of inquiry, and provide guidelines for interpreting existing work and conducting future work. Thus, this historically based review tells us much about research on color and psychological functioning, including where it started, where it has been, where it is, and where it can go.

Membrane-plate transition in leaves as an influence on dietary selectivity and tooth form

Primates need accurate sensory signals about food quality to forage efficiently. Current evidence suggests that they target leaf foods based on color at long-range, reinforcing this with post-ingestive sensations relating to leaf toughness evoked during chewing. Selection against tough leaves effectively selects against high fiber content, which in turn gives a greater opportunity of acquiring protein. Here we consider a novel intermediate mechanical factor that could aid a folivore: leaves may transform mechanically from membranes (sheets that cannot maintain their shape under gravitational loads and thus 'flop') early on in development into plates (that can maintain their shape) as they mature. This transformation can be detected visually. Mechanical tests on two species of leaf eaten by southern muriqui monkeys (Brachyteles arachnoides) in Southern Atlantic Forest, Brazil, support a membrane-to-plate shift in turgid leaves during their development. A measure of this mechanical transition, termed lambda (λ), was found to correlate with both leaf color and toughness, thus supporting a potential role in leaf selection. Muriquis appear to select membranous leaves, but they also eat leaves that are plate-like. We attribute this to the degree of cresting of their molar teeth. A dietary choice restricted to membranous leaves might typify the type of 'fallback' leaf that even frugivorous primates will target because membranes of low toughness are relatively easily chewed. This may be relevant to the diets of hominins because these lack the bladed postcanine teeth seen in mammals with a specialized folivorous diet. We suggest that mammals with such dental adaptations can consume tougher leaf 'plates' than others.

Visual Search in the Real World: Color Vision Deficiency Affects Peripheral Guidance, but Leaves Foveal Verification Largely Unaffected

BACKGROUND

People with color vision deficiencies report numerous limitations in daily life, restricting, for example, their access to some professions. However, they use basic color terms systematically and in a similar manner as people with normal color vision. We hypothesize that a possible explanation for this discrepancy between color perception and behavioral consequences might be found in the gaze behavior of people with color vision deficiency.

METHODS

A group of participants with color vision deficiencies and a control group performed several search tasks in a naturalistic setting on a lawn. All participants wore a mobile eye-tracking-driven camera with a high foveal image resolution (EyeSeeCam). Search performance as well as fixations of objects of different colors were examined.

RESULTS

Search performance was similar in both groups in a color-unrelated search task as well as in a search for yellow targets. While searching for red targets, participants with color vision deficiencies exhibited a strongly degraded performance. This was closely matched by the number of fixations on red objects shown by the two groups. Importantly, once they fixated a target, participants with color vision deficiencies exhibited only few identification errors.

CONCLUSIONS

In contrast to controls, participants with color vision deficiencies are not able to enhance their search for red targets on a (green) lawn by an efficient guiding mechanism. The data indicate that the impaired guiding is the main influence on search performance, while foveal identification (verification) is largely unaffected by the color vision deficiency.

Effects of salience are both short- and long-lived

A salient object can attract attention irrespective of its relevance to current goals. However, this bottom up effect tends to be short-lived (e.g. <150 ms) and it is generally assumed that top down processes such as goals or task instructions operating in later time windows override the effect of salience operating in early time windows. While the majority of studies on visual search and scene viewing comply with the assumptions of top down and bottom up processes operating in different time windows and that the former overrides the latter, we point to some possible anomalies in decision research. To explore these anomalies and thereby test the two key assumptions, we manipulate the salience and valence of one information cue in a decision task. Our analyses reveal that in decision tasks top down and bottom up processes do not operate in different time windows as predicted, nor does the former process necessarily override the latter. Instead, we find that the maximum effect of salience on the likelihood of making a saccade to the target cue is delayed until about 20 saccades after stimulus onset and that the effects of salience and valence are additive rather than multiplicative. Further, we find that in the positive and neutral valence conditions, salience continues to exert pressure on saccadic latency, i.e. the interval between saccades to the target with high salience targets being fixated faster than low salience targets. Our findings challenge the assumption that top down and bottom up processes operate in different time windows and the assumption that top down processes necessarily override bottom up processes.

Sex differences in multisensory speech processing in both typically developing children and those on the autism spectrum

BACKGROUND

Previous work has revealed sizeable deficits in the abilities of children with an autism spectrum disorder (ASD) to integrate auditory and visual speech signals, with clear implications for social communication in this population. There is a strong male preponderance in ASD, with approximately four affected males for every female. The presence of sex differences in ASD symptoms suggests a sexual dimorphism in the ASD phenotype, and raises the question of whether this dimorphism extends to ASD traits in the neurotypical population. Here, we investigated possible sexual dimorphism in multisensory speech integration in both ASD and neurotypical individuals.

METHODS

We assessed whether males and females differed in their ability to benefit from visual speech when target words were presented under varying levels of signal-to-noise, in samples of neurotypical children and adults, and in children diagnosed with an ASD.

RESULTS

In typically developing (TD) children and children with ASD, females (n = 47 and n = 15, respectively) were significantly superior in their ability to recognize words under audiovisual listening conditions compared to males (n = 55 and n = 58, respectively). This sex difference was absent in our sample of neurotypical adults (n = 28 females; n = 28 males).

CONCLUSIONS

We propose that the development of audiovisual integration is delayed in male relative to female children, a delay that is also observed in ASD. In neurotypicals, these sex differences disappear in early adulthood when females approach their performance maximum and males "catch up." Our findings underline the importance of considering sex differences in the search for autism endophenotypes and strongly encourage increased efforts to study the underrepresented population of females within ASD.

Effects of contextual information and stimulus ambiguity on overt visual sampling behavior

The sampling of our visual environment through saccadic eye movements is an essential function of the brain, allowing us to overcome the limits of peripheral vision. Understanding which parts of a scene attract overt visual attention is subject to intense research, and considerable progress has been made in unraveling the underlying cortical mechanisms. In contrast to spatial aspects, however, relatively little is understood about temporal aspects of overt visual sampling. At every fixation, the oculomotor system faces the decision whether to keep exploring different aspects of an object or scene or whether to remain fixated to allow for in-depth cortical processing - a situation that can be understood in terms of an exploration-exploitation dilemma. To improve our understanding of the factors involved in these decisions, we here investigate how the level of visual information, experimentally manipulated by scene context and stimulus ambiguity, changes the sampling behavior preceding the recognition of centrally presented ambiguous and disambiguated objects. Behaviorally, we find that context, although only presented until the first voluntary saccade, biases the perceptual outcome and significantly reduces reaction times. Importantly, we find that increased information about an object significantly alters its visual exploration, as evident through increased fixation durations and reduced saccade amplitudes. These results demonstrate that the initial sampling of an object, preceding its recognition, is subject to change based on the amount of information available in the system: increased evidence for its identity biases the exploration-exploitation strategy towards in-depth analyses.

Differential binding of colors to objects in memory: red and yellow stick better than blue and green

Both evolutionary considerations and recent research suggest that the color red serves as a signal indicating an object’s importance. However, until now, there is no evidence that this signaling function of red is also reflected in human memory. To examine the effect of red on memory, we conducted four experiments in which we presented objects colored in four different colors (red, green, blue, and yellow) and measured later memory for the presence of an object and for the color of an object. Across experiments, we varied the type of objects (words vs. pictures), task complexity (single objects vs. multiple objects in visual scenes), and intentionality of encoding (intentional vs. incidental learning). Memory for the presence of an object was not influenced by color. However, in all four experiments, memory for the color of an object depended on color type and was particularly high for red and yellow-colored objects and particularly low for green-colored objects, indicating that the binding of colors into object memory representations varies as a function of color type. Analyzing the observers’ confidence in their color memories revealed that color not only influenced objective memory performance but also subjective confidence. Subjective confidence judgments differentiated well between correct and incorrect color memories for red-colored objects, but poorly for green-colored objects. Our findings reveal a previously unknown color effect which may be of considerable interest for both basic color research and applied settings like eyewitness testimony in which memory for color features is relevant. Furthermore, our results indicate that feature binding in memory is not a uniform process by which any attended feature is automatically bound into unitary memory representations. Rather, memory binding seems to vary across different subtypes of features, a finding that supports recent research showing that object features are stored in memory rather independently from each other.

Influence of local scene color on fixation position in visual search

Where observers concentrate their gaze during visual search depends on several factors. The aim here was to determine how much of the variance in observers' fixations in natural scenes can be explained by local scene color and how that variance is related to viewing bias. Fixation data were taken from an experiment in which observers searched images of 20 natural rural and urban scenes for a small target. The proportion R2 of the variance explained in a regression on local color properties (lightness and the red-green and yellow-blue chromatic components) ranged from 1% to 85%, depending mainly on how well those properties were consistent with observers' viewing bias. When viewing bias was included in the regression, values of R2 increased, ranging from 62% to 96%. By comparison, local lightness and local lightness contrast, edge density, and entropy each explained less variance than local color properties. Local scene color may have a much stronger influence on gaze position than is generally recognized, capturing significant aspects of scene structure on target search behavior.

Visual search in natural scenes explained by local color properties

Success in visually searching for a small object or target in a natural scene depends on many factors, including the spatial structure of the scene and the pattern of observers' eye movements. The aim of this study was to determine to what extent local color properties of natural scenes can account for target-detection performance. A computer-controlled high-resolution color monitor was used to present images of natural scenes containing a small, randomly located, shaded gray sphere, which served as the target. Observers' gaze position was simultaneously monitored with an infrared video eye-tracker. About 60% of the adjusted variance in observers' detection performance was accounted for by local color properties, namely, lightness and the red-green and blue-yellow components of chroma. A similar level of variance was accounted for by observers' fixations. These results suggest that local color can be as influential as gaze position in determining observers' search performance in natural scenes.