1
|
Patel KY, Wilcox LM, Maloney LT, Ehinger KA, Patel JY, Wiedenmann E, Murray RF. Lightness constancy in reality, in virtual reality, and on flat-panel displays. Behav Res Methods 2024:10.3758/s13428-024-02352-0. [PMID: 38443726 DOI: 10.3758/s13428-024-02352-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/30/2024] [Indexed: 03/07/2024]
Abstract
Virtual reality (VR) displays are being used in an increasingly wide range of applications. However, previous work shows that viewers often perceive scene properties very differently in real and virtual environments and so realistic perception of virtual stimuli should always be a carefully tested conclusion, not an assumption. One important property for realistic scene perception is surface color. To evaluate how well virtual platforms support realistic perception of achromatic surface color, we assessed lightness constancy in a physical apparatus with real lights and surfaces, in a commercial VR headset, and on a traditional flat-panel display. We found that lightness constancy was good in all three environments, though significantly better in the real environment than on the flat-panel display. We also found that variability across observers was significantly greater in VR and on the flat-panel display than in the physical environment. We conclude that these discrepancies should be taken into account in applications where realistic perception is critical but also that in many cases VR can be used as a flexible alternative to flat-panel displays and a reasonable proxy for real environments.
Collapse
Affiliation(s)
- Khushbu Y Patel
- Department of Psychology and Centre for Vision Research, York University, Toronto, Canada.
| | - Laurie M Wilcox
- Department of Psychology and Centre for Vision Research, York University, Toronto, Canada
| | | | - Krista A Ehinger
- School of Computing and Information Systems, University of Melbourne, Melbourne, Australia
| | - Jaykishan Y Patel
- Department of Psychology and Centre for Vision Research, York University, Toronto, Canada
| | - Emma Wiedenmann
- Department of Psychology and Centre for Vision Research, York University, Toronto, Canada
- Department of Psychology, Carl Von Ossietzky Universität Oldenburg, Oldenburg, Germany
| | - Richard F Murray
- Department of Psychology and Centre for Vision Research, York University, Toronto, Canada
| |
Collapse
|
2
|
Yildiz GY, Skarbez R, Sperandio I, Chen SJ, Mulder IJ, Chouinard PA. Linear perspective cues have a greater effect on the perceptual rescaling of distant stimuli than textures in the virtual environment. Atten Percept Psychophys 2024; 86:653-665. [PMID: 38182938 DOI: 10.3758/s13414-023-02834-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/14/2023] [Indexed: 01/07/2024]
Abstract
The presence of pictorial depth cues in virtual environments is important for minimising distortions driven by unnatural viewing conditions (e.g., vergence-accommodation conflict). Our aim was to determine how different pictorial depth cues affect size constancy in virtual environments under binocular and monocular viewing conditions. We systematically removed linear perspective cues and textures of a hallway in a virtual environment. The experiment was performed using the method of constant stimuli. The task required participants to compare the size of 'far' (10 m) and 'near' (5 m) circles displayed inside a virtual environment with one or both or none of the pictorial depth cues. Participants performed the experiment under binocular and monocular viewing conditions while wearing a virtual reality headset. ANOVA revealed that size constancy was greater for both the far and the near circles in the virtual environment with pictorial depth cues compared to the one without cues. However, the effect of linear perspective cues was stronger than textures, especially for the far circle. We found no difference between the binocular and monocular viewing conditions across the different virtual environments. We conclude that linear perspective cues exert a stronger effect than textures on the perceptual rescaling of far stimuli placed in the virtual environment, and that this effect does not vary between binocular and monocular viewing conditions.
Collapse
Affiliation(s)
- Gizem Y Yildiz
- Department of Psychology, Counselling, and Therapy, La Trobe University, George Singer Building, Room 460, 75 Kingsbury Drive, Bundoora, Victoria, 3086, Australia
- Institute of Neuroscience and Medicine (INM-3), Forschungszentrum Jülich GmbH, Jülich, Germany
| | - Richard Skarbez
- Department of Computer Science and Information Technology, La Trobe University, Melbourne, VIC, Australia
| | - Irene Sperandio
- Department of Psychology and Cognitive Science, University of Trento, Rovereto, TN, Italy
| | - Sandra J Chen
- Department of Psychology, Counselling, and Therapy, La Trobe University, George Singer Building, Room 460, 75 Kingsbury Drive, Bundoora, Victoria, 3086, Australia
| | - Indiana J Mulder
- Department of Psychology, Counselling, and Therapy, La Trobe University, George Singer Building, Room 460, 75 Kingsbury Drive, Bundoora, Victoria, 3086, Australia
| | - Philippe A Chouinard
- Department of Psychology, Counselling, and Therapy, La Trobe University, George Singer Building, Room 460, 75 Kingsbury Drive, Bundoora, Victoria, 3086, Australia.
| |
Collapse
|
3
|
Yoo SA, Lee S, Joo SJ. Monocular cues are superior to binocular cues for size perception when they are in conflict in virtual reality. Cortex 2023; 166:80-90. [PMID: 37343313 DOI: 10.1016/j.cortex.2023.05.010] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2022] [Revised: 03/16/2023] [Accepted: 05/22/2023] [Indexed: 06/23/2023]
Abstract
Three-dimensional (3D) depth information is important to estimate object sizes. The visual system extracts 3D depth information using both binocular cues and monocular cues. However, how these different depth signals interact with each other to compute the object size in 3D space is unclear. Here, we aim to study the relative contribution of monocular and binocular depth information to size perception in a modified Ponzo context by manipulating their relations in a virtual reality environment. Specifically, we compared the amount of the size illusion in the following two conditions, in which monocular cues and binocular disparity in the Ponzo context can indicate the same depth sign (congruent) or opposite depth sign (incongruent). Our results show an increase in the amount of the Ponzo illusion in the congruent condition. In contrast, in the incongruent condition, we find that the two cues indicating the opposite depth signs do not cancel out the Ponzo illusion, suggesting that the effects of the two cues are not equal. Rather, binocular disparity information seems to be suppressed and the size judgment is mainly dependent on the monocular depth information when the two cues are in conflict. Our results suggest that monocular and binocular depth signals are fused for size perception only when they both indicate the same depth sign and top-down 3D depth information based on monocular cues contributes more to size perception than binocular disparity when they are in conflict in virtual reality.
Collapse
Affiliation(s)
- Sang-Ah Yoo
- Department of Psychology, Pusan National University, Busan, Republic of Korea
| | - Suhyun Lee
- Department of Psychology, Pusan National University, Busan, Republic of Korea
| | - Sung Jun Joo
- Department of Psychology, Pusan National University, Busan, Republic of Korea.
| |
Collapse
|
4
|
Mangalam M, Yarossi M, Furmanek MP, Krakauer JW, Tunik E. Investigating and acquiring motor expertise using virtual reality. J Neurophysiol 2023; 129:1482-1491. [PMID: 37194954 PMCID: PMC10281781 DOI: 10.1152/jn.00088.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2023] [Revised: 04/25/2023] [Accepted: 05/11/2023] [Indexed: 05/18/2023] Open
Abstract
After just months of simulated training, on January 19, 2019 a 23-year-old E-sports pro-gamer, Enzo Bonito, took to the racetrack and beat Lucas di Grassi, a Formula E and ex-Formula 1 driver with decades of real-world racing experience. This event raised the possibility that practicing in virtual reality can be surprisingly effective for acquiring motor expertise in real-world tasks. Here, we evaluate the potential of virtual reality to serve as a space for training to expert levels in highly complex real-world tasks in time windows much shorter than those required in the real world and at much lower financial cost without the hazards of the real world. We also discuss how VR can also serve as an experimental platform for exploring the science of expertise more generally.
Collapse
Affiliation(s)
- Madhur Mangalam
- Department of Physical Therapy, Movement, and Rehabilitation Science, Northeastern University, Boston, Massachusetts, United States
- Division of Biomechanics and Research Development, Department of Biomechanics, University of Nebraska at Omaha, Omaha, Nebraska, United States
- Center for Research in Human Movement Variability, University of Nebraska at Omaha, Omaha, Nebraska, United States
| | - Mathew Yarossi
- Department of Physical Therapy, Movement, and Rehabilitation Science, Northeastern University, Boston, Massachusetts, United States
- Department of Electrical and Computer Engineering, Northeastern University, Boston, Massachusetts, United States
| | - Mariusz P Furmanek
- Department of Physical Therapy, Movement, and Rehabilitation Science, Northeastern University, Boston, Massachusetts, United States
- Institute of Sport Sciences, The Jerzy Kukuczka Academy of Physical Education in Katowice, Katowice, Poland
- Physical Therapy Department, University of Rhode Island, Kingston, Rhode Island, United States
| | - John W Krakauer
- Department of Neurology, The Johns Hopkins University School of Medicine, Baltimore, Maryland, United States
- Department of Neuroscience, The Johns Hopkins University School of Medicine, Baltimore, Maryland, United States
- Department of Physical Medicine and Rehabilitation, The Johns Hopkins University School of Medicine, Baltimore, Maryland, United States
- The Santa Fe Institute, Santa Fe, New Mexico, United States
| | - Eugene Tunik
- Department of Physical Therapy, Movement, and Rehabilitation Science, Northeastern University, Boston, Massachusetts, United States
- Department of Electrical and Computer Engineering, Northeastern University, Boston, Massachusetts, United States
| |
Collapse
|