New Approaches to 3D Vision

New approaches to 3D vision are enabling new advances in artificial intelligence and autonomous vehicles, a better understanding of how animals navigate the 3D world, and new insights into human perception in virtual and augmented reality. Whilst traditional approaches to 3D vision in computer vision (SLAM: simultaneous localization and mapping), animal navigation (cognitive maps), and human vision (optimal cue integration) start from the assumption that the aim of 3D vision is to provide an accurate 3D model of the world, the new approaches to 3D vision explored in this issue challenge this assumption. Instead, they investigate the possibility that computer vision, animal navigation, and human vision can rely on partial or distorted models or no model at all. This issue also highlights the implications for artificial intelligence, autonomous vehicles, human perception in virtual and augmented reality, and the treatment of visual disorders, all of which are explored by individual articles. This article is part of a discussion meeting issue 'New approaches to 3D vision'.

Robust Lexically Mediated Compensation for Coarticulation: Christmash Time Is Here Again

A long-standing question in cognitive science is how high-level knowledge is integrated with sensory input. For example, listeners can leverage lexical knowledge to interpret an ambiguous speech sound, but do such effects reflect direct top-down influences on perception or merely postperceptual biases? A critical test case in the domain of spoken word recognition is lexically mediated compensation for coarticulation (LCfC). Previous LCfC studies have shown that a lexically restored context phoneme (e.g., /s/ in Christma#) can alter the perceived place of articulation of a subsequent target phoneme (e.g., the initial phoneme of a stimulus from a tapes-capes continuum), consistent with the influence of an unambiguous context phoneme in the same position. Because this phoneme-to-phoneme compensation for coarticulation is considered sublexical, scientists agree that evidence for LCfC would constitute strong support for top-down interaction. However, results from previous LCfC studies have been inconsistent, and positive effects have often been small. Here, we conducted extensive piloting of stimuli prior to testing for LCfC. Specifically, we ensured that context items elicited robust phoneme restoration (e.g., that the final phoneme of Christma# was reliably identified as /s/) and that unambiguous context-final segments (e.g., a clear /s/ at the end of Christmas) drove reliable compensation for coarticulation for a subsequent target phoneme. We observed robust LCfC in a well-powered, preregistered experiment with these pretested items (N = 40) as well as in a direct replication study (N = 40). These results provide strong evidence in favor of computational models of spoken word recognition that include top-down feedback.

Close or far? Affect explains conflicting findings on motivated distance perception to rewards

Research on motivated perception has yielded conflicting findings: Whereas Balcetis and Dunning (2010) showed that people approaching (vs. avoiding) rewarding objects (e.g. food) see them as closer, Krpan and Schnall (2014a) found the opposite. Furthermore, whereas Balcetis (2016) suggested that people who perceive rewarding objects as closer (vs. farther) should subsequently consume more, Krpan and Schnall (2017) showed that they actually ate less. We introduce affect as the missing link to explain these conflicting findings. Two experiments showed that approach and avoidance can either involve, or lack, an affective experience, which in turn determines how they influence perception, and how perception is related to behavior. Consistent with Krpan and Schnall (2017), non-affective approach (vs. avoidance) motivation made candies look farther; seeing candies as farther in turn predicted increased consumption (Experiment 1). In contrast, consistent with Balcetis and Dunning (2010), affective approach (vs. avoidance) motivation made these stimuli look closer; seeing candies as closer was associated with more being eaten (Experiment 2). Our findings therefore reconcile previous inconsistencies on motivated perception, and suggest that people's view of their surroundings is more dynamic than previously assumed.

A dual systems account of visual perception: Predicting candy consumption from distance estimates

A substantial amount of evidence shows that visual perception is influenced by forces that control human actions, ranging from motivation to physiological potential. However, studies have not yet provided convincing evidence that perception itself is directly involved in everyday behaviors such as eating. We suggest that this issue can be resolved by employing the dual systems account of human behavior. We tested the link between perceived distance to candies and their consumption for participants who were tired or depleted (impulsive system), versus those who were not (reflective system). Perception predicted eating only when participants were tired (Experiment 1) or depleted (Experiments 2 and 3). In contrast, a rational determinant of behavior-eating restraint towards candies-predicted eating for non-depleted individuals (Experiment 2). Finally, Experiment 3 established that perceived distance was correlated with participants' self-reported motivation to consume candies. Overall, these findings suggest that the dynamics between perception and behavior depend on the interplay of the two behavioral systems.