Multisensory Assessment of Acoustic Comfort Aboard Metros: a Virtual Reality Study

Modeling the Impact of Head-Body Rotations on Audio-Visual Spatial Perception for Virtual Reality Applications

Humans perceive the world by integrating multimodal sensory feedback, including visual and auditory stimuli, which holds true in virtual reality (VR) environments. Proper synchronization of these stimuli is crucial for perceiving a coherent and immersive VR experience. In this work, we focus on the interplay between audio and vision during localization tasks involving natural head-body rotations. We explore the impact of audio-visual offsets and rotation velocities on users' directional localization acuity for various viewing modes. Using psychometric functions, we model perceptual disparities between visual and auditory cues and determine offset detection thresholds. Our findings reveal that target localization accuracy is affected by perceptual audio-visual disparities during head-body rotations, but remains consistent in the absence of stimuli-head relative motion. We then showcase the effectiveness of our approach in predicting and enhancing users' localization accuracy within realistic VR gaming applications. To provide additional support for our findings, we implement a natural VR game wherein we apply a compensatory audio-visual offset derived from our measured psychometric functions. As a result, we demonstrate a substantial improvement of up to 40% in participants' target localization accuracy. We additionally provide guidelines for content creation to ensure coherent and seamless VR experiences.

Digital Technologies in the Architecture, Engineering and Construction (AEC) Industry-A Bibliometric-Qualitative Literature Review of Research Activities

Digital technologies (DTs) are proven helpful in the Architecture, Engineering and Construction (AEC) industry due to their varied benefits to project stakeholders, such as enhanced visualization, better data sharing, reduction in building waste, increased productivity, sustainable performance and safety improvement. Therefore, researchers have conducted various studies on DTs in the AEC industry over the year; however, this study explores the state-of-the-art research on DTs in the AEC industry by means of a bibliometric-qualitative review method. This research would uncover new knowledge gaps and practical needs in the domain of DTs in the AEC industry. In addition, bibliometric analysis was carried out by utilizing academic publications from Scopus (i.e., 11,047 publications for the AEC industry, 1956 for DTs and 1778 for DTs in the AEC industry). Furthermore, a qualitative review was further conducted on 200 screened selected research publications in the domain of DTs. This study brings attention to the body of knowledge by envisioning trends and patterns by defining key research interests, journals, countries, new advancements, challenges, negative attitudes and future directions towards DTs in the AEC industry. However, this study is the first in its vital importance and uniqueness by providing a broad updated review of DTs in the AEC literature. Furthermore, this research laid a foundation for future researchers, policy makers and practitioners to explore the limitations in future research.

The Effect of Music Tempo and Volume on Acoustic Perceptions under the Noise Environment

This study aimed to investigate the distracting or masking effects of music tempo and volume, based on subjective evaluation under noise conditions. Two experiments were conducted with 32 participants. In the first one, the experimental conditions were set as follow: (1) the sound pressure levels of music are 45 dB, 60 dB, and 75 dB; (2) music tempos are 70 beats per minute (BPM), 110 BPM, and 150 BPM; (3) sound pressure levels of noise are 45 dB, 60 dB, and 75 dB; and (4) the noise types are talkers’ babble, traffic noise, and construction noise. All conditions on human acoustic perception were analyzed by orthogonal experiment. Based on part one, the second experiment was conducted. Sound pressure levels (50 dB, 60 dB, and 70 dB) of noise and sound pressure levels (50 dB, 60 dB, and 70 dB) of music and music tempo (70 BPM, 110 BPM, and 150 BPM) were assessed by subjective evaluation. The results showed although different types of noise had different effects on human perceptions, noise types had a small effect on acoustic comfort considering the superimposed music. Music can improve the acoustic environment. The sound pressure levels had significant effects on acoustic sensation. The tempo of the music affected the acoustic sensation insignificantly. Sound pressure levels of noise, music tempo, and sound pressure levels of music significantly affect acoustic comfort. The best acoustic environment in this study utilized superimposed 70 BPM, 60 dB music in a 50 dB noise environment. These results suggest that music can enable new strategies to improve indoor environmental satisfaction. Based on the findings, the effect of music on acoustic perceptions under the noise environment should be taken into account when aiming to enhance comfort in noisy environments.

Ecological Validity of Immersive Virtual Reality (IVR) Techniques for the Perception of Urban Sound Environments

Immersive Virtual Reality (IVR) is a simulated technology used to deliver multisensory information to people under different environmental conditions. When IVR is generally applied in urban planning and soundscape research, it reveals attractive possibilities for the assessment of urban sound environments with higher immersion for human participation. In virtual sound environments, various topics and measures are designed to collect subjective responses from participants under simulated laboratory conditions. Soundscape or noise assessment studies during virtual experiences adopt an evaluation approach similar to in situ methods. This paper aims to review the approaches that are utilized to assess the ecological validity of IVR for the perception of urban sound environments and the necessary technologies during audio–visual reproduction to establish a dynamic IVR experience that ensures ecological validity. The review shows that, through the use of laboratory tests including subjective response surveys, cognitive performance tests and physiological responses, the ecological validity of IVR can be assessed for the perception of urban sound environments. The reproduction system with head-tracking functions synchronizing spatial audio and visual stimuli (e.g., head-mounted displays (HMDs) with first-order Ambisonics (FOA)-tracked binaural playback) represents the prevailing trend to achieve high ecological validity. These studies potentially contribute to the outcomes of a normalized evaluation framework for subjective soundscape and noise assessments in virtual environments.

Influence of the Acoustic Environment in Hospital Wards on Patient Physiological and Psychological Indices

Patients in general wards are often exposed to excessive levels of noise and activity, and high levels of noise have been associated with depression and anxiety. Previous studies have found that an appropriate acoustic environment is beneficial to the patient's therapeutic and treatment process; however, the soundscape is rarely intentionally designed or operated to improve patient recovery, especially for psychological rehabilitation. To gain the most accurate, and least variable, estimate of acoustic environmental stimuli/properties, virtual reality (VR) technology should be used to ensure that other environmental factors are stable and uniform in order to reduce the stimulation of other environmental factors. Therefore, this study aims to discuss the influence of the acoustic environment on patient physiological/psychological indicators and the mechanism of the effect on recovery using VR technology. A digital three-dimensional (3D) model of a hospital room was constructed, and experimental subjects wore VR glasses to visualize a real ward scene. Four typical sound categories were selected to analyze the effect of the acoustic environment on recovery; physiological indicators were monitored, and psychological factors were subjectively evaluated. The results show that music plays an important role in reducing stress as it can aid in a patient's physiological (skin conduction levels) and psychological stress recovery. Furthermore, mechanical and anthropogenic sounds exert negative effects on a patient's stress recovery. However, the effect is only limited to psychological stress indicators. The interaction effects of demographic characteristics and the acoustic environment are not significant, and future studies could consider the social-economic characteristics of patients. Based on these findings, we provide evidence that indicates that a hospital's acoustic environment is an important influencing factor on the stress recovery of patients and can serve as a reference for healthcare architects and policy makers.

Using Virtual Reality to Assess Landscape: A Comparative Study Between On-Site Survey and Virtual Reality of Aesthetic Preference and Landscape Cognition

In recent years, research on landscape perception has been generally overoptimistic about the use of virtual reality (VR); however, few have questioned the validity of VR. It is necessary to examine whether on-site stimulation can be substituted by VR. The purpose of this study was to assess the degree of agreement between on-site survey and VR for landscape perception. The sample included 11 representative landscapes from Tsuchiura city and Tsukuba city, Japan. On-site survey data was collected for 17 items related to aesthetic preference and landscape cognition. The same scenes were produced by VR and same survey data as on-site was collected. The agreement of both the overall mean of all landscapes and the ratings of all individuals in each landscape confirmed the high level of concordance of most cognitive attributes between the two stimuli. The findings support immersive VR as a reliable tool for assessing landscape cognition.

Implicit associations to infant cry: Genetics and early care experiences influence caregiving propensities

Adults' sensitive appraisal of and response to infant cry play a foundational role in child development. Employing a gene × environment (G × E) approach, this study investigated the interaction of genetic polymorphisms of the serotonin transporter gene (5-HTTLPR) and oxytocin receptor genes (OXTR; rs53576, rs2254298) with early parental care experiences in influencing adults' implicit associations to infant cry. Eighty nulliparous adults (40 females, 40 males) responded to the Parental Acceptance-Rejection Questionnaire (PARQ), a measure of early care experiences, and participated in a Single Category Implicit Association Task (SC-IAT) to measure implicit associations to infant cry. Independent of parental experience, the valence of the implicit response to infant cry is associated with the serotonin transporter gene polymorphism (5-HTTLPR), with LL-carriers showing more positive implicit associations than S-carriers. OXTR rs53576 moderated the relation between parental rejection and implicit appraisal of infant cry: A-carriers who experienced negative early care showed an implicit positive appraisal of infant cry, whereas in GG carriers, positive early care experiences were associated with an implicit positive reaction to infant cry. OXTR rs2254298 had no relation to implicit associations to infant cry or to early care experiences. These findings cast light on the possible interplay of genetic inheritance and early environment in influencing adults' responses to infant cry that may be incorporated into screening protocols aimed at identifying at-risk adult-infant interactions.

Acoustic Comfort in Virtual Inner Yards with Various Building Facades

Housing complex residents in urban areas are not only confronted with typical noise sources, but also everyday life sounds, e.g., in the yards. Therefore, they might benefit from the increasing interest in soundscape design and acoustic comfort improvement. Three laboratory experiments (with repeated-measures complete block designs) are reported here, in which effects of several variables on short-term acoustic comfort were investigated. A virtual reference inner yard in the ODEON software environment was systematically modified by absorbers on building facades, whereby single-channel recordings were spatialized for a 2D playback in laboratory. Facade absorption was found, generally, to increase acoustic comfort. Too much absorption, however, was not found to be helpful. In the absence of any absorbers on the facade, absorbing balcony ceilings tended to improve acoustic comfort, however, non-significantly. Pleasant and unpleasant sounds were associated with comfort and discomfort, accordingly. This should encourage architects and acousticians to create comfortable inner yard sound environments, where pleasant and unpleasant sound occurrence probabilities are designed to be high and low, respectively. Furthermore, significant differences were observed between acoustic comfort at distinct observer positions, which could be exploited when designing inner yards.

Effects of neighborhood building density, height, greenspace, and cleanliness on indoor environment and health of building occupants

The influences of indoor environment quality on occupant health have long been one of the main focuses in built environment and public health research. However, evidence to this effect has been inconsistent. Furthermore, previous urban studies have indicated the interaction between urban morphology and indoor environment. This study thus goes beyond indoor environment to investigate: i) the effects of neighborhood environment on occupant health; and ii) the mediating roles of indoor environment on the neighborhood environment and occupant health relationships. To achieve this aim, buildings located in different neighborhood environment in Hong Kong are selected. Data are collected by post-occupancy evaluation (occupant health), indoor environment assessment (thermal comfort, indoor air quality, ventilation, visual comfort, and acoustic comfort) and neighborhood environment assessment (neighborhood building density, building height, cleanliness and greenspace) through questionnaire survey. Through correlation analysis, regression modelling and Sobel test, it is found that: i) occupant health is significantly affected by neighborhood building height, building density and cleanliness; ii) the relationships between neighborhood environment and occupant health are significantly mediated by indoor environment, in terms of visual and acoustic comfort; and iii) neighborhood greenspace affects occupant health indirectly through influencing indoor air quality. To cross validate the results of the survey study, which is conducted using subjective data, objective measurements and analyses are further conducted. The objective study, echoing the survey study results, indicates that buildings with lower neighborhood building density and height, and cleaner neighborhood environment have better visual (higher illuminance level) and acoustic (lower noise level) performances.

Manipulating time and space: Collision prediction in peripersonal and extrapersonal space

Being able to predict potential collisions is a necessary survival prerequisite for all moving species. Temporal and spatial information is fundamental for this purpose. However, it is not clear yet if the peripersonal (i.e. near) and extrapersonal (i.e. far) distance between our body and the moving objects affects the way in which we can predict possible collisions. In order to assess this, we manipulated independently velocity and path of two balls moving one towards the other in such a way as to collide or not in peripersonal and extrapersonal space. In two experiments, participants had to judge if these balls were to collide or not. The results consistently showed a lower discrimination capacity and a more liberal tendency to predict collisions when the moving balls were in peripersonal space and their velocity was different rather than equal. This did not happen in extrapersonal space. Therefore, peripersonal space was particularly affected by temporal information. The possible link between the motor and anticipatory adaptive function of peripersonal space and collision prediction mechanisms is discussed.

Control of interior surface materials for speech privacy in high-speed train cabins

The effect of interior materials with various absorption coefficients on speech privacy was investigated in a 1:10 scale model of one high-speed train cabin geometry. The speech transmission index (STI) and privacy distance (r_P ) were measured in the train cabin to quantify speech privacy. Measurement cases were selected for the ceiling, sidewall, and front and back walls and were classified as high-, medium- and low-absorption coefficient cases. Interior materials with high absorption coefficients yielded a low r_P , and the ceiling had the largest impact on both the STI and r_P among the interior elements. Combinations of the three cases were measured, and the maximum reduction in r_P by the absorptive surfaces was 2.4 m, which exceeds the space between two rows of chairs in the high-speed train. Additionally, the contribution of the interior elements to speech privacy was analyzed using recorded impulse responses and a multiple regression model for r_P using the equivalent absorption area. The analysis confirmed that the ceiling was the most important interior element for improving speech privacy. These results can be used to find the relative decrease in r_P in the acoustic design of interior materials to improve speech privacy in train cabins.

Speech privacy and annoyance considerations in the acoustic environment of passenger cars of high-speed trains

It is necessary to consider not only annoyance of interior noises but also speech privacy to achieve acoustic comfort in a passenger car of a high-speed train because speech from other passengers can be annoying. This study aimed to explore an optimal acoustic environment to satisfy speech privacy and reduce annoyance in a passenger car. Two experiments were conducted using speech sources and compartment noise of a high speed train with varying speech-to-noise ratios (SNRA) and background noise levels (BNL). Speech intelligibility was tested in experiment I, and in experiment II, perceived speech privacy, annoyance, and acoustic comfort of combined sounds with speech and background noise were assessed. The results show that speech privacy and annoyance were significantly influenced by the SNRA. In particular, the acoustic comfort was evaluated as acceptable when the SNRA was less than -6 dB for both speech privacy and noise annoyance. In addition, annoyance increased significantly as the BNL exceeded 63 dBA, whereas the effect of the background-noise level on the speech privacy was not significant. These findings suggest that an optimal level of interior noise in a passenger car might exist between 59 and 63 dBA, taking normal speech levels into account.

Body space in social interactions: a comparison of reaching and comfort distance in immersive virtual reality

Background

Do peripersonal space for acting on objects and interpersonal space for interacting with con-specifics share common mechanisms and reflect the social valence of stimuli? To answer this question, we investigated whether these spaces refer to a similar or different physical distance.

Methodology

Participants provided reachability-distance (for potential action) and comfort-distance (for social processing) judgments towards human and non-human virtual stimuli while standing still (passive) or walking toward stimuli (active).

Principal Findings

Comfort-distance was larger than other conditions when participants were passive, but reachability and comfort distances were similar when participants were active. Both spaces were modulated by the social valence of stimuli (reduction with virtual females vs males, expansion with cylinder vs robot) and the gender of participants.

Conclusions

These findings reveal that peripersonal reaching and interpersonal comfort spaces share a common motor nature and are sensitive, at different degrees, to social modulation. Therefore, social processing seems embodied and grounded in the body acting in space.

Motor resources in peripersonal space are intrinsic to spatial encoding: evidence from motor interference

The aim of this study was to explore the role of motor resources in peripersonal space encoding: are they intrinsic to spatial processes or due to action potentiality of objects? To answer this question, we disentangled the effects of motor resources on object manipulability and spatial processing in peripersonal and extrapersonal spaces. Participants had to localize manipulable and non-manipulable 3-D stimuli presented within peripersonal or extrapersonal spaces of an immersive virtual reality scenario. To assess the contribution of motor resources to the spatial task a motor interference paradigm was used. In Experiment 1, localization judgments were provided with the left hand while the right dominant arm could be free or blocked. Results showed that participants were faster and more accurate in localizing both manipulable and non-manipulable stimuli in peripersonal space with their arms free. On the other hand, in extrapersonal space there was no significant effect of motor interference. Experiment 2 replicated these results by using alternatively both hands to give the response and controlling the possible effect of the orientation of object handles. Overall, the pattern of results suggests that the encoding of peripersonal space involves motor processes per se, and not because of the presence of manipulable stimuli. It is argued that this motor grounding reflects the adaptive need of anticipating what may happen near the body and preparing to react in time.

The effects of vision-related aspects on noise perception of wind turbines in quiet areas

Preserving the soundscape and geographic extension of quiet areas is a great challenge against the wide-spreading of environmental noise. The E.U. Environmental Noise Directive underlines the need to preserve quiet areas as a new aim for the management of noise in European countries. At the same time, due to their low population density, rural areas characterized by suitable wind are considered appropriate locations for installing wind farms. However, despite the fact that wind farms are represented as environmentally friendly projects, these plants are often viewed as visual and audible intruders, that spoil the landscape and generate noise. Even though the correlations are still unclear, it is obvious that visual impacts of wind farms could increase due to their size and coherence with respect to the rural/quiet environment. In this paper, by using the Immersive Virtual Reality technique, some visual and acoustical aspects of the impact of a wind farm on a sample of subjects were assessed and analyzed. The subjects were immersed in a virtual scenario that represented a situation of a typical rural outdoor scenario that they experienced at different distances from the wind turbines. The influence of the number and the colour of wind turbines on global, visual and auditory judgment were investigated. The main results showed that, regarding the number of wind turbines, the visual component has a weak effect on individual reactions, while the colour influences both visual and auditory individual reactions, although in a different way.

The influence of visual characteristics of barriers on railway noise perception

Noise annoyance is considered as the main effect of noise, it is a complex and multifaceted psychological concept dealing with immediate behavioral and evaluative aspects. In the last decades the research has intensely investigated the correlation between noise exposure and noise annoyance, nevertheless recent studies confirm that non-auditory factors influence the noise perception of individuals. In particular audio-video interaction can play a fundamental role. Today Immersive Virtual Reality (IVR) systems allow building laboratory test providing realistic experiences of the surrounding environment to detect more accurate information about the reactions of the local population. Regarding the interventions for environmental noise control the barriers represent the main solution; however some aspects related to their visual characteristic have to be further investigated. This paper presented a case study, where a sample of residents living close to a railway line assessed noise-related aspects for several barriers with different visual characteristics in an IVR laboratory test. In particular, three main factors were analyzed: the barrier type concerning the visibility of the noise source through the screen, the visual aspect of the barrier concerning some aesthetic issues and the noise level at the receiver concerning the acoustic performance of the barrier and the magnitude of the sound source. The main results of the ANOVA analysis showed that for transparent barriers Perceived Loudness and Noise Annoyance were judged lower than for opaque barriers; this difference increased as noise level increased.