Roll motion stimuli: sensory conflict, perceptual weighting and motion sickness

Differences in virtual and physical head orientation predict sickness during active head-mounted display-based virtual reality

During head-mounted display (HMD)-based virtual reality (VR), head movements and motion-to-photon-based display lag generate differences in our virtual and physical head pose (referred to as DVP). We propose that large-amplitude, time-varying patterns of DVP serve as the primary trigger for cybersickness under such conditions. We test this hypothesis by measuring the sickness and estimating the DVP experienced under different levels of experimentally imposed display lag (ranging from 0 to 222 ms on top of the VR system's ~ 4 ms baseline lag). On each trial, seated participants made continuous, oscillatory head rotations in yaw, pitch or roll while viewing a large virtual room with an Oculus Rift CV1 HMD (head movements were timed to a computer-generated metronome set at either 1.0 or 0.5 Hz). After the experiment, their head-tracking data were used to objectively estimate the DVP during each trial. The mean, peak, and standard deviation of these DVP data were then compared to the participant's cybersickness ratings for that trial. Irrespective of the axis, or the speed, of the participant's head movements, the severity of their cybersickness was found to increase with each of these three DVP summary measures. In line with our DVP hypothesis, cybersickness consistently increased with the amplitude and the variability of our participants' DVP. DVP similarly predicted their conscious experiences during HMD VR-such as the strength of their feelings of spatial presence and their perception of the virtual scene's stability.

Framing visual roll-motion affects postural sway and the subjective visual vertical

Effects of visual roll-motion on postural sway and the subjective visual vertical (SVV) often is studied using mechanical devices, whereas electronic displays offer cheaper and more flexible alternatives. These devices typically emit and reflect light scattered by the edges of the screen, providing Earth-fixed cues of verticality. These cues may decrease the effects of rotating stimuli, a possibility that has not been studied explicitly before in one experimental design. We exposed 16 participants to a visual dot pattern, either stationary, or rotating in roll, that was or was not surrounded by a visible Earth-fixed reference frame. To eliminate unintended visual cues, the experiment was performed in complete darkness and participants wore neutral density goggles passing only 1% of light. Postural sway was measured using a force platform. SVV measurements were obtained from a visible rod. To monitor the participants, motion sickness severity was obtained with an 11-point rating scale. Results showed that the presence of an Earth-fixed frame significantly decreased the effect of the rotating pattern on postural sway and SVV deviations. Therefore, when studying subjective verticality related effects of visual stimuli, it is imperative that all visual Earth-fixed cues are not just minimized but completely eliminated. The observation that an Earth-fixed frame significantly decreased the effect of the rotating pattern on both postural sway and the SVV points towards a common neural origin, possibly involving a neural representation of verticality. Finally, we showed that an electronic screen can yield similar effect sizes as those taken from the literature using mechanical devices.

Experience-Related Changes in Place Cell Responses to New Sensory Configuration That Does Not Occur in the Natural Environment in the Rat Hippocampus

The hippocampal formation (HF) is implicated in a comparator that detects sensory conflict (mismatch) among convergent inputs. This suggests that new place cells encoding the new configuration with sensory mismatch develop after the HF learns to accept the new configuration as a match. To investigate this issue, HF CA1 place cell activity in rats was analyzed after the adaptation of the rats to the same sensory mismatch condition. The rats were placed on a treadmill on a stage that was translocated in a figure 8-shaped pathway. We recorded HF neuronal activities under three conditions; (1) an initial control session, in which both the stage and the treadmill moved forward, (2) a backward (mismatch) session, in which the stage was translocated backward while the rats locomoted forward on the treadmill, and (3) the second control session. Of the 161 HF neurons, 56 place-differential activities were recorded from the HF CA1 subfield. These place-differential activities were categorized into four types; forward-related, backward-related, both-translocation-related, and session-dependent. Forward-related activities showed predominant spatial firings in the forward sessions, while backward-related activities showed predominant spatial firings in the backward sessions. Both-translocation-related activities showed consistent spatial firings in both the forward and backward conditions. On the other hand, session-dependent activities showed different spatial firings across the sessions. Detailed analyses of the place fields indicated that mean place field sizes were larger in the forward-related, backward-related, and both-translocation-related activities than in the session-dependent activities. Furthermore, firing rate distributions in the place fields were negatively skewed and asymmetric, which is similar to place field changes that occur after repeated experience. These results demonstrate that the HF encodes a naturally impossible new configuration of sensory inputs after adaptation, suggesting that the HF is capable of updating its stored memory to accept a new configuration as a match by repeated experience.

The impact of vehicle motion during transport on animal welfare

Motion sickness is a common response in humans and some species of farm livestock during transport, but research on the impact of motion has been primarily focused on the use of animal models for humans. During livestock transportation, animals seek to minimise uncontrolled movements to reduce energy consumption and maintain posture. Road and sea transport of livestock can produce motion sickness and stress responses. Clinical signs are the result of autonomous nervous system activation. Studies conducted on road transportation effects in domestic animals showed several motion sickness behaviours including vomiting and, in ruminants, a reduction in rumination. However, there is a lack of knowledge on the impact of sea transport motion. Despite the paucity of data on livestock, there is sufficient evidence to believe that motion might affect animal welfare when animals are transported by road or sea.

How do visual and postural cues combine for self-tilt perception during slow pitch rotations?

Self-orientation perception relies on the integration of multiple sensory inputs which convey spatially-related visual and postural cues. In the present study, an experimental set-up was used to tilt the body and/or the visual scene to investigate how these postural and visual cues are integrated for self-tilt perception (the subjective sensation of being tilted). Participants were required to repeatedly rate a confidence level for self-tilt perception during slow (0.05°·s(-1)) body and/or visual scene pitch tilts up to 19° relative to vertical. Concurrently, subjects also had to perform arm reaching movements toward a body-fixed target at certain specific angles of tilt. While performance of a concurrent motor task did not influence the main perceptual task, self-tilt detection did vary according to the visuo-postural stimuli. Slow forward or backward tilts of the visual scene alone did not induce a marked sensation of self-tilt contrary to actual body tilt. However, combined body and visual scene tilt influenced self-tilt perception more strongly, although this effect was dependent on the direction of visual scene tilt: only a forward visual scene tilt combined with a forward body tilt facilitated self-tilt detection. In such a case, visual scene tilt did not seem to induce vection but rather may have produced a deviation of the perceived orientation of the longitudinal body axis in the forward direction, which may have lowered the self-tilt detection threshold during actual forward body tilt.

Sensory mismatch induces autonomic responses associated with hippocampal theta waves in rats

Hippocampal (HIP) theta power increases during sensory mismatch, which has been suggested to induce motion sickness with autonomic abnormality (Zou et al., 2009 [29]). To investigate relationships between hippocampal theta rhythm and autonomic functions, theta waves in the HIP and electrocardiograms (ECGs) were recorded during sensory mismatch by backward translocation in awake rats. The rats were placed on a treadmill affixed to a motion stage that was translocated along a figure 8-shaped track. The rats were trained to run forward on the treadmill at the same speed as that of forward translocation of the motion stage (a forward condition) before the experimental (recording) sessions. In the experimental sessions, the rats were initially tested in the forward condition, and then tested in a backward (mismatch) condition, in which the motion stage was turned around by 180° before translocation. That is, the rats were moved backward by translocation of the stage although the rats ran forward on the treadmill. In this condition, proprioceptive information indicated forward movements while vestibular and visual information indicated backward movements. The theta (6-9 Hz) power was significantly increased in the backward condition compared with the forward condition. Spectral analysis of heart rate variability indicated that sympathetic nervous activity increased in the backward condition. These data (theta power and sympathetic nervous activity) were positively correlated. Furthermore, electrical stimulation of the HIP at theta rhythm (8 Hz) increased heart rate. These results suggest that sensory mismatch information activates the HIP to induce autonomic alteration in motion sickness.

Rat hippocampal theta rhythm during sensory mismatch

It has been suggested that sensory mismatch induces motion sickness, but its neural mechanisms remain unclear. To investigate this issue, theta waves in the hippocampal formation (HF) were studied during sensory mismatch by backward translocation in awake rats. A monopolar electrode was implanted into the dentate gyrus in the HF, from which local field potentials were recorded. The rats were placed on a treadmill affixed to a motion stage translocated along a figure 8-shaped track. The rats were trained to run forward on the treadmill at the same speed as that of forward translocation of the motion stage (a forward condition) before the experimental (recording) sessions. In the experimental sessions, the rats were initially tested in the forward condition, and then tested in a backward (mismatch) condition, in which the motion stage was turned around by 180 degrees before translocation. That is, the rats were moved backward by translocation of the stage although the rats ran forward on the treadmill. The theta (6-9 Hz) power was significantly increased in the backward condition compared with the forward condition. However, the theta power gradually decreased by repeated testing in the backward condition. Furthermore, backward translocation of the stage without locomotion did not increase theta power. These results suggest that the HF might function as a comparator to detect sensory mismatch, and that alteration in HF theta activity might induce motion sickness.

Motion sickness induced by otolith stimulation is correlated with otolith-induced eye movements

This article addresses the relationships between motion sickness (MS) and three-dimensional (3D) ocular responses during otolith stimulation. A group of 19 healthy subjects was tested for motion sickness during a 16 min otolith stimulation induced by off-vertical axis rotation (OVAR) (constant velocity 60 degrees /s, frequency 0.16 Hz). For each subject, the MS induced during the session was quantified, and based on this quantification, the subjects were divided into two groups of less susceptible (MS-), and more susceptible (MS+) subjects. The angular eye velocity induced by the otolith stimulation was analyzed in order to identify a possible correlation between susceptibility to MS and 3D eye velocity. The main results show that: (1) MS significantly correlates in a multiple regression with several components of the horizontal vestibular eye movements i.e. positively with the velocity modulation (P<0.01) and bias (P<0.05) of the otolith ocular reflex and negatively with the time constant of the vestibulo-ocular reflex (P<0.01) and (2) the length of the resultant 3D eye velocity vector is significantly larger in the MS+ as compared with the MS- group. Based on these results we suggest that the CNS, including the velocity storage mechanism, reconstructs an eye velocity vector modulated by head position whose length might predict MS occurrence during OVAR.

Space motion sickness

Motion sickness remains a persistent problem in spaceflight. The present review summarizes available knowledge concerning the incidence and onset of space motion sickness and aspects of the physiology of motion sickness. Proposed etiological factors in the elicitation of space motion sickness are evaluated including fluid shifts, head movements, visual orientation illusions, Coriolis cross-coupling stimulation, and otolith asymmetries. Current modes of treating space motion sickness are described. Theoretical models and proposed ground-based paradigms for understanding and studying space motion sickness are critically analyzed. Prediction tests and questionnaires for assessing susceptibility to space motion sickness and their limitations are discussed. We conclude that space motion sickness does represent a form of motion sickness and that it does not represent a unique diagnostic entity. Motion sickness arises when movements are made during exposure to unusual force backgrounds both higher and lower in magnitude than 1 g earth gravity.

Subjective somatosensory vertical during dynamic tilt is dependent on task, inertial condition, and multisensory concordance

To investigate how visual and vestibular cues are integrated for the perception of gravity during passive self-motion, we measured the ability to maintain a handheld object vertical relative to gravity without visual feedback during sinusoidal roll-tilt stimulation. Visual input, either concordant or discordant with actual dynamic roll-tilt, was delivered by a head-mounted display showing the laboratory. The four visual conditions were darkness, visual-vestibular concordance, stationary visual scene, and a visual scene 180 degrees phase-shifted relative to actual tilt. Tilt-indication performance using a solid, cylindrical joystick was better in the presence of concordant visual input relative to the other visual conditions. In addition, we compared performance when indicating the vertical by the joystick or a full glass of water. Subjects indicated the direction of gravity significantly better when holding the full glass of water than the joystick. Matching the inertial characteristics, including fluid properties, of the handheld object to the glass of water did not improve performance. There was no effect of visual input on tilt performance when using the glass of water to indicate gravitational vertical. The gain of object tilt motion did not change with roll-tilt amplitude and frequency (+/-7.5 degrees at 0.25 Hz, +/-10 degrees at 0.16 Hz, and +/-20 degrees at 0.08 Hz), however, the phase of object tilt relative to subject tilt showed significant phase-leads at the highest frequency tested (0.25 Hz). Comparison of the object and visual effects observed suggest that the task-dependent behavior change may be due to an attentional shift and/or shift in strategy.

Convergence reduces ocular counterroll (OCR) during static roll-tilt

When humans are roll-tilted around the naso-occipital axis, both eyes roll or tort in the opposite direction to roll-tilt, a phenomenon known as ocular counterroll (OCR). While the magnitude of OCR is primarily determined by vestibular, somatosensory, and proprioceptive input, direction of gaze also plays a major role. The aim of this study was to measure the interaction between some of these factors in the control of OCR. Videooculography was used to measure 3D eye position during maintained whole body (en bloc) static roll-tilt in darkness, while subjects fixated first on a distant (at 130 cm) and then a near (at 30 cm) head-fixed target aligned with the subject's midline. We found that while converging on the near target, human subjects displayed a significant reduction in OCR for both directions of roll-tilt--i.e. the interaction between OCR and vergence was not simple addition or subtraction of torsion induced by vergence with torsion induced by roll-tilt. To remove the possibility that the OCR reduction may be associated with the changed horizontal position of the eye in the orbit during symmetric convergence, we ran an experiment using asymmetric convergence in which the distant and near targets were aligned directly in front of one eye. We found the magnitude of OCR in this asymmetric convergence case was also reduced for near viewing by about the same amount as in the symmetric vergence condition, confirming that the convergence command rather than horizontal position of the eye underlies the OCR reduction, since there was no horizontal movement of the aligned eye in the orbit between fixation on the distant and near targets. Increasing vergence from 130 to 30 cm reduced OCR gain by around 35% on average. That reduction was equal in both eyes and occurred in both the symmetric and asymmetric convergence conditions. These results demonstrate the important role vergence plays in determining ocular counterroll during roll-tilt and may support the contention that vergence acts to reduce the conflict facing a stereopsis-generating mechanism.

The critical role of velocity storage in production of motion sickness

We propose that motion sickness is mediated through the orientation properties of velocity storage in the vestibular system that tend to align eye velocity produced by the angular vestibulo-ocular reflex (aVOR) with gravito-inertial acceleration (GIA). (GIA is the sum of the linear accelerations acting on the head. In the absence of translational accelerations, gravity is the GIA.) We further postulate that motion sickness produced by cross-coupled vestibular stimulation can be characterized by a metric composed of the disparity between the axis of eye rotation and the GIA, the strength of the response to angular motion, and the response duration, as determined by the central vestibular time constant, that is, by the time constant of velocity storage. The nodulus and uvula of the vestibulocerebellum are likely to be the central sites where the disparity is sensed, where the vestibular time constants are habituated, and where links are made to the autonomic system to produce the symptoms and signs.

The relation of motion sickness to the spatial-temporal properties of velocity storage

Tilting the head in roll to or from the upright while rotating at a constant velocity (roll while rotating, RWR) alters the position of the semicircular canals relative to the axis of rotation. This produces vertical and horizontal nystagmus, disorientation, vertigo, and nausea. With recurrent exposure, subjects habituate and can make more head movements before experiencing overpowering motion sickness. We questioned whether promethazine lessened the vertigo or delayed the habituation, whether habituation of the vertigo was related to the central vestibular time constant, i.e., to the time constant of velocity storage, and whether the severity of the motion sickness was related to deviation of the axis of eye velocity from gravity. Sixteen subjects received promethazine and placebo in a double-blind, crossover study in two consecutive 4-day test series 1 month apart, termed series I and II. Horizontal and vertical eye movements were recorded with video-oculography while subjects performed roll head movements of approx. 45 degrees over 2 s to and from the upright position while being rotated at 138 degrees /s around a vertical axis. Motion sickness was scaled from 1 (no sickness) to an endpoint of 20, at which time the subject was too sick to continue or was about to vomit. Habituation was determined by the number of head movements that subjects made before reaching the maximum motion sickness score of 20. Head movements increased steadily in each session with repeated testing, and there was no difference between the number of head movements made by the promethazine and placebo groups. Horizontal and vertical angular vestibulo-ocular reflex (aVOR) time constants declined in each test, with the declines being closely correlated to the increase in the number of head movements. The strength of vertiginous sensation was associated with the amount of deviation of the axis of eye velocity from gravity; the larger the deviation of the eye velocity axis from gravity, the more severe the motion sickness. Thus, promethazine neither reduced the nausea associated with RWR, nor retarded or hastened habituation. The inverse relationship between the aVOR time constants and number of head movements to motion sickness, and the association of the severity of motion sickness with the extent, strength, and time of deviation of eye velocity from gravity supports the postulate that the spatiotemporal properties of velocity storage, which are processed between the nodulus and uvula of the vestibulocerebellum and the vestibular nuclei, are likely to represent the source of the conflict responsible for producing motion sickness.

Posture and balance responses to a sensory challenge are related to anxiety in mice

Anxiety disorders and balance disorders share common clinical features related to perception such as spatial disorientation or dizziness. The search for the mechanism underlying this core of symptoms led us to investigate impairments in multisensory integration. In mice, the 'rotating beam test' allows analysis of changes in balance control and posture in response to a multisensory challenge. We used the BALB/c and C57BL/6 inbred strains of mice, known for their contrasted anxiety-related behavior. The level of anxiety was also manipulated using anxiolytic and anxiogenic pharmacological compounds. Despite equal sensori-motor abilities, anxious mice were more prone to fall off the rotating beam and showed more imbalance than non-anxious mice. Striking inter-strain differences in posture were also observed. Diazepam and beta-CCM reversed these strain-specific responses in opposite directions. We demonstrated that balance and postural strategies developed in response to a multisensory challenge vary as a function of the level of anxiety in mice.

Motion sickness

The number of recently published papers on motion sickness may convey the impression that motion sickness is far from being understood. The current review focusses on a concept which tends to unify the different manifestations and theories of motion sickness. The paper highlights the relations between ergonomic principles to minimise motion sickness and the concept predictions. The clinical management of sufferers from motion sickness in terms of selection, pharmacological measures and desensitisation courses is treated as well.