A new format of perceptual learning based on evidence abstraction from multiple stimuli

Comparing conventional and action video game training in visual perceptual learning

Action video game (AVG) playing has been found to transfer to a variety of laboratory tasks in visual cognition. More recently, it has even been found to transfer to low-level visual "psychophysics tasks. This is unexpected since such low-level tasks have traditionally been found to be largely "immune" to transfer from another task, or even from the same task but a different stimulus attribute, e.g., motion direction. In this study, we set out to directly quantify transfer efficiency from AVG training to motion discrimination. Participants (n = 65) trained for 20 h on either a first-person active shooting video game, or a motion direction discrimination task with random dots. They were tested before, midway, and after training with the same motion task and an orientation discrimination task that had been shown to receive transfer from AVG training, but not from motion training. A subsequent control group (n = 18) was recruited to rule out any test-retest effect, by taking the same tests with the same time intervals, but without training. We found that improvement in motion discrimination performance was comparable between the AVG training and control groups, and less than the motion discrimination training group. We could not replicate the AVG transfer to orientation discrimination, but this was likely due to the fact that our participants were practically at chance for this task at all test points. Our study found no evidence, in either accuracy or reaction time, that AVG training transferred to motion discrimination. Overall, our results suggest that AVG training transferred little to lower-level visual skills, refining understanding of the mechanisms by which AVGs may affect vision. Protocol registration The accepted stage 1 protocol for this study can be found on the Open Science Framework at https://osf.io/zdv9c/?view_only=5b3b0c161dad448d9d1d8b14ce91ab11 . The stage 1 protocol for this Registered Report was accepted in principle on 01/12/22. The protocol, as accepted by the journal, can be found at: https://doi.org/10.17605/OSF.IO/ZDV9C.

Transfer of visual perceptual learning over a task-irrelevant feature through feature-invariant representations: Behavioral experiments and model simulations

A large body of literature has examined specificity and transfer of perceptual learning, suggesting a complex picture. Here, we distinguish between transfer over variations in a "task-relevant" feature (e.g., transfer of a learned orientation task to a different reference orientation) and transfer over a "task-irrelevant" feature (e.g., transfer of a learned orientation task to a different retinal location or different spatial frequency), and we focus on the mechanism for the latter. Experimentally, we assessed whether learning a judgment of one feature (such as orientation) using one value of an irrelevant feature (e.g., spatial frequency) transfers to another value of the irrelevant feature. Experiment 1 examined whether learning in eight-alternative orientation identification with one or multiple spatial frequencies transfers to stimuli at five different spatial frequencies. Experiment 2 paralleled Experiment 1, examining whether learning in eight-alternative spatial-frequency identification at one or multiple orientations transfers to stimuli with five different orientations. Training the orientation task with a single spatial frequency transferred widely to all other spatial frequencies, with a tendency to specificity when training with the highest spatial frequency. Training the spatial frequency task fully transferred across all orientations. Computationally, we extended the identification integrated reweighting theory (I-IRT) to account for the transfer data (Dosher, Liu, & Lu, 2023; Liu, Dosher, & Lu, 2023). Just as location-invariant representations in the original IRT explain transfer over retinal locations, incorporating feature-invariant representations effectively accounted for the observed transfer. Taken together, we suggest that feature-invariant representations can account for transfer of learning over a "task-irrelevant" feature.

Feature variability determines specificity and transfer in multiorientation feature detection learning

Historically, in many perceptual learning experiments, only a single stimulus is practiced, and learning is often specific to the trained feature. Our prior work has demonstrated that multi-stimulus learning (e.g., training-plus-exposure procedure) has the potential to achieve generalization. Here, we investigated two important characteristics of multi-stimulus learning, namely, roving and feature variability, and their impacts on multi-stimulus learning and generalization. We adopted a feature detection task in which an oddly oriented target bar differed by 16° from the background bars. The stimulus onset asynchrony threshold between the target and the mask was measured with a staircase procedure. Observers were trained with four target orientation search stimuli, either with a 5° deviation (30°-35°-40°-45°) or with a 45° deviation (30°-75°-120°-165°), and the four reference stimuli were presented in a roving manner. The transfer of learning to the swapped target-background orientations was evaluated after training. We found that multi-stimulus training with a 5° deviation resulted in significant learning improvement, but learning failed to transfer to the swapped target-background orientations. In contrast, training with a 45° deviation slowed learning but produced a significant generalization to swapped orientations. Furthermore, a modified training-plus-exposure procedure, in which observers were trained with four orientation search stimuli with a 5° deviation and simultaneously passively exposed to orientations with high feature variability (45° deviation), led to significant orientation learning generalization. Learning transfer also occurred when the four orientation search stimuli with a 5° deviation were presented in separate blocks. These results help us to specify the condition under which multistimuli learning produces generalization, which holds potential for real-world applications of perceptual learning, such as vision rehabilitation and expert training.

Informational feedback accelerates learning in multi-alternative perceptual judgements of orientation

Experience or training can substantially improve perceptual performance through perceptual learning, and the extent and rate of these improvements may be affected by feedback. In this paper, we first developed a neural network model based on the integrated reweighting theory (Dosher et al., 2013) to account for perceptual learning and performance in n-alternative identification tasks and the dependence of learning on different forms of feedback. We then report an experiment comparing the effectiveness of response feedback (RF) versus accuracy feedback (AF) or no feedback (NF) (full versus partial versus no supervision) in learning a challenging eight-alternative visual orientation identification (8AFC) task. Although learning sometimes occurred in the absence of feedback (NF), RF had a clear advantage above AF or NF in this task. Using hybrid supervision learning rules, a new n-alternative identification integrated reweighting theory (I-IRT) explained both the differences in learning curves given different feedback and the dynamic changes in identification confusion data. This study shows that training with more informational feedback (RF) is more effective, though not necessary, in these challenging n-alternative tasks, a result that has implications for developing training paradigms in realistic tasks.

A new perceptual training strategy to improve vision impaired by central vision loss

Patients with central vision loss depend on peripheral vision for everyday functions. A preferred retinal locus (PRL) on the intact retina is commonly trained as a new "fovea" to help. However, reprogramming the fovea-centered oculomotor control is difficult, so saccades often bring the defunct fovea to block the target. Aligning PRL with distant targets also requires multiple saccades and sometimes head movements. To overcome these problems, we attempted to train normal-sighted observers to form a preferred retinal annulus (PRA) around a simulated scotoma, so that they could rely on the same fovea-centered oculomotor system and make short saccades to align PRA with the target. Observers with an invisible simulated central scotoma (5° radius) practiced making saccades to see a tumbling-E target at 10° eccentricity. The otherwise blurred E target became clear when saccades brought a scotoma-abutting clear window (2° radius) to it. The location of the clear window was either fixed for PRL training, or changing among 12 locations for PRA training. Various cues aided the saccades through training. Practice quickly established a PRL or PRA. Comparing to PRL-trained observers whose first saccade persistently blocked the target with scotoma, PRA-trained observers produced more accurate first saccade. The benefits of more accurate PRA-based saccades also outweighed the costs of slower latency. PRA training may provide an efficient strategy to cope with central vision loss, especially for aging patients who have major difficulties adapting to a PRL.