Phase-dependent asymmetry of pattern masking in natural images explained by intrinsic position uncertainty

A number of recent studies have been directed at measuring and modeling detection of targets at specific locations in natural backgrounds, a key subtask of visual search in natural environments. A useful approach is to bin natural background patches into joint histograms with bins along specific background dimensions. By measuring psychometric functions in a sparse subset of these bins, it is possible to estimate how the included dimensions jointly affect detectability over the whole space of natural backgrounds. In previous studies, we found that threshold is proportional to the product of the background luminance, contrast, and similarity; a result predicted by a simple template-matching observer with divisive normalization along each of the dimensions. The measure of similarity was the cosine similarity of the amplitude spectra of the target and background (SA)-a phase-invariant measure. Here, we investigated the effect of the cosine similarity of the target and background images (SI|A)-a phase-dependent measure. We found that threshold decreases monotonically with SI|A in agreement with a recent study (Rideaux et al., 2022). In contrast, the template-matching observer predicts threshold to be a U-shaped function of SI|A reaching a minimum when the target and background are orthogonal (SI|A = 0). Surprisingly, when the template-matching observer includes a small amount of intrinsic position uncertainty (measured in a separate experiment) the pattern of thresholds is explained.

Vision screening and vocational aptitude: A factor analysis approach

For a good vision screening battery to quickly and accurately reflect the status of the human visual system it should be relevant, reliable, and streamlined. Because the early visual system has limited functional architecture, many simple measurements of the visual system may in fact be measuring the shared computations and parallel processes of other visual functions, making much of the measurement process redundant. This can make a screening battery repetitious and therefore inefficient. The purpose of this research is to investigate these redundancies in a large occupational screening dataset using factor analysis. 192 subjects participated in the Operational Based Vision Assessment (OBVA) Laboratory Automated Vision Testing (AVT) procedure. The AVT includes digital tests for visual acuity, luminance and cone contrast sensitivity, motion coherence, stereopsis, and binocular motor function. Psychometric thresholds and fusional ranges were collected from each subject and a factor analysis was utilized to investigate independent latent variables in the dataset. A promax rotation revealed 5 factors that explained 74% of the total variance: (1) medium and high spatial frequency vision, (2) stereoacuity and horizontal fusional range, (3) cone contrast sensitivity, (4) motion perception, and (5) low spatial frequency vision. Practically, these results suggest that the screening battery can be reduced to 5 independent measurements that capture much of the variance in the dataset. Furthermore, the factors predicted operational and vocational aptitude better than any single variable. More interestingly, these relationships also reiterate known computational processes within the human visual system, such as the parallel processing of low and high spatial frequency content.

Scene saliencies in egocentric vision and their creation by parents and infants

Across the lifespan, humans are biased to look first at what is easy to see, with a handful of well-documented visual saliences shaping our attention (e.g., Itti & Koch, 2001). These attentional biases may emerge from the contexts in which moment-tomoment attention occurs, where perceivers and their social partners actively shape bottom-up saliences, moving their bodies and objects to make targets of interest more salient. The goal of the present study was to determine the bottom-up saliences present in infant egocentric images and to provide evidence on the role that infants and their mature social partners play in highlighting targets of interest via these saliences. We examined 968 unique scenes in which an object had purposefully been placed in the infant's egocentric view, drawn from videos created by one-year-old infants wearing a head camera during toy-play with a parent. To understand which saliences mattered in these scenes, we conducted a visual search task, asking participants (n = 156) to find objects in the egocentric images. To connect this to the behaviors of perceivers, we then characterized the saliences of objects placed by infants or parents compared to objects that were otherwise present in the scenes. Our results show that body-centric properties, such as increases in the centering and visual size of the object, as well as decreases in the number of competing objects immediately surrounding it, both predicted faster search time and distinguished placed and unplaced objects. The present results suggest that the bottom-up saliences that can be readily controlled by perceivers and their social partners may most strongly impact our attention. This finding has implications for the functional role of saliences in human vision, their origin, the social structure of perceptual environments, and how the relation between bottom-up and top-down control of attention in these environments may support infant learning.

The relationship between reflex eye realignment and the percept of single vision in young children

Effective binocular vision is dependent on both motor and perceptual function. Young children undergo development of both components while interacting with their dynamic three-dimensional environment. When this development fails, eye misalignment and double vision may result. We compared the range of image disparities over which young children display reflex motor realignment of their eyes with the range over which they report a single versus double percept. In response to step changes in the disparity of a 2.2° wide stimulus, 5-year-olds generated an adult-like reflex vergence velocity tuning function peaking at 2° of disparity, with a mean latency of 210 ms. On average, they reported double vision for stimulus disparities of 3° and larger, compared to 1° in adult reports. Three-year-olds also generated reflex vergence tuning functions peaking at approximately 2° of disparity, but their percepts could not be assessed. These data suggest that, by age 5, reflex eye realignment responses and percepts driven by these brief stimuli are tightly coordinated in space and time to permit robust binocular function around the point of fixation. Importantly, the plastic neural processes maintaining this tight coordination during growth control the stability of visual information driving learning during childhood.

Local reliability weighting explains identification of partially masked objects in natural images

A fundamental natural visual task is the identification of specific target objects in the environments that surround us. It has long been known that some properties of the background have strong effects on target visibility. The most well-known properties are the luminance, contrast, and similarity of the background to the target. In previous studies, we found that these properties have highly lawful effects on detection in natural backgrounds. However, there is another important factor affecting detection in natural backgrounds that has received little or no attention in the masking literature, which has been concerned with detection in simpler backgrounds. Namely, in natural backgrounds the properties of the background often vary under the target, and hence some parts of the target are masked more than others. We began studying this factor, which we call the "partial masking factor," by measuring detection thresholds in backgrounds of contrast-modulated white noise that was constructed so that the standard template-matching (TM) observer performs equally well whether or not the noise contrast modulates in the target region. If noise contrast is uniform in the target region, then this TM observer is the Bayesian optimal observer. However, when the noise contrast modulates then the Bayesian optimal observer weights the template at each pixel location by the estimated reliability at that location. We find that human performance for modulated noise backgrounds is predicted by this reliability-weighted TM (RTM) observer. More surprisingly, we find that human performance for natural backgrounds is also predicted by the RTM observer.

The gaze stability of 4- to 10-week-old human infants

The relationship between gaze stability, retinal image quality, and visual perception is complex. Gaze instability related to pathology in adults can cause a reduction in visual acuity (e.g., Chung, LaFrance, & Bedell, 2011). Conversely, poor retinal image quality and spatial vision may be a contributing factor to gaze instability (e.g., Ukwade & Bedell, 1993). Though much is known about the immaturities in spatial vision of human infants, little is currently understood about their gaze stability. To characterize the gaze stability of young infants, adult participants and 4- to 10-week-old infants were shown a dynamic random-noise stimulus for 30-s intervals while their eye positions were recorded binocularly. After removing adultlike saccades, we used 5-s epochs of stable intersaccade gaze to estimate bivariate contour ellipse area and standard deviations of vergence. The geometric means (with standard deviations) for infants' bivariate contour ellipse area were left eye = -0.697 ± 0.534 log(°2), right eye = -0.471 ± 0.367 log(°2). For binocular vergence stability, the infant geometric means (with standard deviations) were horizontal = -1.057 ± 0.743 log(°), vertical = -1.257 ± 0.573 log(°). These values were all not significantly different from those of the adult comparison sample, suggesting that gaze instability is not a significant limiting factor in retinal image quality and spatial vision during early postnatal development.

Human infants can generate vergence responses to retinal disparity by 5 to 10 weeks of age

Vergence is defined as a binocular eye movement during which the two eyes move in opposite directions to align to a target in depth. In adults, fine vergence control is driven primarily by interocular retinal image disparity. Although infants have not typically been shown to respond to disparity until 3 to 5 months postpartum, they have been shown to align their eyes from hours after birth. It remains unclear what drives these responses in young infants. In this experiment, 5- to 10-week-old human infants were presented with a dynamic random noise stimulus oscillating in disparity at 0.1 Hz over an amplitude of 2° for 30 s. Fourier transforms of the horizontal eye movements revealed significant disparity-driven responses at the frequency of the stimulus in over half of the tested infants. Because the stimulus updated dynamically, this experiment precluded the possibility of independent monocular fixations to a sustained target. These data demonstrate cortical binocular function in humans by five weeks, the youngest age tested here, which is as much as two months younger than previously believed.

Sensitivity of vergence responses of 5- to 10-week-old human infants

Infants have been shown to make vergence eye movements by 1 month of age to stimulation with prisms or targets moving in depth. However, little is currently understood about the threshold sensitivity of the maturing visual system to such stimulation. In this study, 5- to 10-week-old human infants and adults viewed a target moving in depth as a triangle wave of three amplitudes (1.0, 0.5, and 0.25 meter angles). Their horizontal eye position and the refractive state of both eyes were measured simultaneously. The vergence responses of the infants and adults varied at the same frequency as the stimulus at the three tested modulation amplitudes. For a typical infant of this age, the smallest amplitude is equivalent to an interocular change of approximately 2° of retinal disparity, from nearest to farthest points. The infants' accommodation responses only modulated reliably to the largest stimulus, while adults responded to all three amplitudes. Although the accommodative system appears relatively insensitive, the sensitivity of the vergence responses suggests that subtle cues are available to drive vergence in the second month after birth.