Inference for psychometric functions in the presence of nonstationary behavior

Characterizing correlations in partial credit speech recognition scoring with beta-binomial distributions

Partial credit scoring for speech recognition tasks can improve measurement precision. However, assessing the magnitude of this improvement with partial credit scoring is challenging because meaningful speech contains contextual cues, which create correlations between the probabilities of correctly identifying each token in a stimulus. Here, beta-binomial distributions were used to estimate recognition accuracy and intraclass correlation for phonemes in words and words in sentences in listeners with cochlear implants (N = 20). Estimates demonstrated substantial intraclass correlation in recognition accuracy within stimuli. These correlations were invariant across individuals. Intraclass correlations should be addressed in power analysis of partial credit scoring.

Development of amplitude modulation, voice onset time, and consonant identification in noise and reverberation

Children's speech understanding is vulnerable to indoor noise and reverberation: e.g., from classrooms. It is unknown how they develop the ability to use temporal acoustic cues, specifically amplitude modulation (AM) and voice onset time (VOT), which are important for perceiving distorted speech. Through three experiments, we investigated the typical development of AM depth detection in vowels (experiment I), categorical perception of VOT (experiment II), and consonant identification (experiment III) in quiet and in speech-shaped noise (SSN) and mild reverberation in 6- to 14-year-old children. Our findings suggested that AM depth detection using a naturally produced vowel at the rate of the fundamental frequency was particularly difficult for children and with acoustic distortions. While the VOT cue salience was monotonically attenuated with increasing signal-to-noise ratio of SSN, its utility for consonant discrimination was completely removed even under mild reverberation. The reverberant energy decay in distorting critical temporal cues provided further evidence that may explain the error patterns observed in consonant identification. By 11-14 years of age, children approached adult-like performance in consonant discrimination and identification under adverse acoustics, emphasizing the need for good acoustics for younger children as they develop auditory skills to process distorted speech in everyday listening environments.

Correctly establishing evidence for cue combination via gains in sensory precision: Why the choice of comparator matters

Studying how sensory signals from different sources (sensory cues) are integrated within or across multiple senses allows us to better understand the perceptual computations that lie at the foundation of adaptive behaviour. As such, determining the presence of precision gains - the classic hallmark of cue combination - is important for characterising perceptual systems, their development and functioning in clinical conditions. However, empirically measuring precision gains to distinguish cue combination from alternative perceptual strategies requires careful methodological considerations. Here, we note that the majority of existing studies that tested for cue combination either omitted this important contrast, or used an analysis approach that, unknowingly, strongly inflated false positives. Using simulations, we demonstrate that this approach enhances the chances of finding significant cue combination effects in up to 100% of cases, even when cues are not combined. We establish how this error arises when the wrong cue comparator is chosen and recommend an alternative analysis that is easy to implement but has only been adopted by relatively few studies. By comparing combined-cue perceptual precision with the best single-cue precision, determined for each observer individually rather than at the group level, researchers can enhance the credibility of their reported effects. We also note that testing for deviations from optimal predictions alone is not sufficient to ascertain whether cues are combined. Taken together, to correctly test for perceptual precision gains, we advocate for a careful comparator selection and task design to ensure that cue combination is tested with maximum power, while reducing the inflation of false positives.

Visual velocity perception dysfunction in Parkinson's disease

OBJECTIVE

Compared with motor deficits, sensory information processing in Parkinson's disease (PD) is relatively unexplored. While there is increasing interest in understanding the sensory manifestations of PD, the extent of sensory abnormality in PD has remained relatively unexplored. Furthermore, most investigations on the sensory aspects of PD involve motor aspects, causing confounding results. As sensory deficits often arise in early PD development stages, they present a potential technological target for diagnosis and disease monitoring that is affordable and accessible. Considering this, the current study's aim is to assess visual spatiotemporal perception independent of goal directed movements in PD by designing and using a scalable computational tool.

METHODS

A flexible 2-D virtual reality environment was created to evaluate various cases of visual perception. Using the tool, an experimental task quantifying the visual perception of velocity was tested on 37 individuals with PD and 17 age-matched control participants.

RESULTS

PD patients, both ON and OFF PD therapy, displayed perceptual impairments (p = 0.001 and p = 0.008, respectively) at slower tested velocity magnitudes. These impairments were even observed in early stages of PD (p = 0.015).

CONCLUSION

Visual velocity perception is impaired in PD patients, which suggests impairments in visual spatiotemporal processing occur in PD and provides a promising modality to be used with disease monitoring software.

SIGNIFICANCE

Visual velocity perception shows high sensitivity to PD at all stages of the disease. Dysfunction in visual velocity perception may contribute to observed motor dysfunction in PD.

Web-based psychoacoustics of binaural hearing: Two validation experiments

Web-based testing is an appealing option for expanding psychoacoustics research outside laboratory environments due to its simple logistics. For example, research participants partake in listening tasks using their own computer and audio hardware and can participate in a comfortable environment of their choice at their own pace. However, it is unknown how deviations from conventional in-lab testing affect data quality, particularly in binaural hearing tasks that traditionally require highly precise audio presentation. Here, we used an online platform to replicate two published in-lab experiments: lateralization to interaural time and level differences (ITD and ILD, experiment I) and dichotic and contralateral unmasking of speech (experiment II) in normal-hearing (NH) young adults. Lateralization data collected online were strikingly similar to in-lab results. Likewise, the amount of unmasking measured online and in-lab differed by less than 1 dB, although online participants demonstrated higher speech reception thresholds overall than those tested in-lab by up to ∼7 dB. Results from online participants who completed a hearing screening versus those who self-reported NH did not differ significantly. We conclude that web-based psychoacoustics testing is a viable option for assessing binaural hearing abilities among young NH adults and discuss important considerations for online study design.

Optimised adaptive procedures and analysis methods for conducting speech-in-noise tests

OBJECTIVE

Speech-in-noise testing is a valuable part of audiological test batteries. Test standardisation using precise methods is desirable for ease of administration. This study investigated the accuracy and reliability of different Bayesian and non-Bayesian adaptive procedures and analysis methods for conducting speech-in-noise testing.

DESIGN

Matrix sentence tests using different numbers of sentences (10, 20, 30 and 50) and target intelligibilities (50 and 75%) were simulated for modelled listeners with various characteristics. The accuracy and reliability of seven different measurement procedures and three different data analysis methods were assessed.

RESULTS

The estimation of 50% intelligibility was accurate and showed excellent reliability across the majority of methods tested, even with relatively few stimuli. Estimating 75% intelligibility resulted in decreased accuracy. For this target, more stimuli were required for sufficient accuracy and selected Bayesian procedures surpassed the performance of others. Some Bayesian procedures were also superior in the estimation of psychometric function width.

CONCLUSIONS

A single standardised procedure could improve the consistency of the matrix sentence test across a range of target intelligibilities. Candidate adaptive procedures and analysis methods are discussed. These could also be applicable for other speech materials. Further testing with human participants is required.

VIP interneurons regulate cortical size tuning and visual perception

Local cortical circuit function is regulated by diverse populations of GABAergic interneurons with distinct properties and extensive interconnectivity. Inhibitory-to-inhibitory interactions between interneuron populations may play key roles in shaping circuit operation according to behavioral context. A specialized population of GABAergic interneurons that co-express vasoactive intestinal peptide (VIP-INs) are activated during arousal and locomotion and innervate other local interneurons and pyramidal neurons. Although modulation of VIP-IN activity by behavioral state has been extensively studied, their role in regulating information processing and selectivity is less well understood. Using a combination of cellular imaging, short and long-term manipulation, and perceptual behavior, we examined the impact of VIP-INs on their synaptic target populations in the primary visual cortex of awake behaving mice. We find that loss of VIP-IN activity alters the behavioral state-dependent modulation of somatostatin-expressing interneurons (SST-INs) but not pyramidal neurons (PNs). In contrast, reduced VIP-IN activity disrupts visual feature selectivity for stimulus size in both populations. Inhibitory-to inhibitory interactions thus directly shape the selectivity of GABAergic interneurons for sensory stimuli. Moreover, the impact of VIP-IN activity on perceptual behavior varies with visual context and is more acute for small than large visual cues. VIP-INs thus contribute to both state-dependent modulation of cortical circuit activity and sensory context-dependent perceptual performance.

The visual benefits of correcting longitudinal and transverse chromatic aberration

We describe a system-the Binocular Varichrome and Accommodation Measurement System-that can be used to measure and correct the eye's longitudinal and transverse chromatic aberration (LCA and TCA) and to perform vision tests with custom corrections. We used the system to investigate how LCA and TCA affect visual performance. Specifically, we studied the effects of LCA and TCA on visual acuity, contrast sensitivity, and chromostereopsis. LCA exhibited inter subject variability but followed expected trends compared with previous reports. TCA at the fovea was variable between individuals but with a tendency for the shift at shorter wavelengths to be more temporalward in the visual field in each eye. We found that TCA was generally greater when LCA was corrected. For visual acuity, we found that a measurable benefit was realized only with both LCA and TCA correction unless the TCA was low. For contrast sensitivity, we found that the best sensitivity to a 10-cycle/degree polychromatic grating was attained when LCA and TCA were corrected. Finally, we found that the primary cause of chromostereopsis is the TCA of the eyes.

Virtual occlusion effects on the perception of self-initiated visual stimuli

Virtual reality (VR) has established itself as a useful tool in the study of human perception in the laboratory. A recent study introduced a new approach to examine visual sensory attenuation (SA) effects in VR. Hand movements triggered the appearance of Gabor stimuli, which were either presented behind the participant's hand - not rendered in VR ("virtual occlusion") - or elsewhere on the display. Virtual occlusion led to a rightward shift of the psychometric curve, suggesting that self-generated hand movements reduced the perceived contrast of the stimulus. Since such attenuation effects might provide a window into the predictive processing of the sensory and cognitive apparatus, we sought to better understand the nature of the virtual occlusion effects. In our study, the presentation of test stimuli was either self-initiated, self-initiated with a variable delay, or triggered externally; the test stimuli were occluded or not. In conflict with our hypothesis, we found moderate to strong evidence for an absence of any horizontal shifts between the psychometric curves. However, virtual occlusion was associated with a decrease in the slope of the psychometric function. Our results suggest that virtual occlusion attenuated the relative perceptual sensitivity, so that participants had more difficulty discriminating contrast differences when the test stimulus was presented behind the hand. We tentatively conclude that, in the visual domain, the discriminability of stimulus intensity is modified by internal predictive cues (i.e., proprioception), possibly linked to shifts in covert spatial attention.

Intact and deficient contextual processing in schizophrenia patients

Schizophrenia patients are known to have deficits in contextual vision. However, results are often very mixed. In some paradigms, patients do not take the context into account and, hence, perform more veridically than healthy controls. In other paradigms, context deteriorates performance much more strongly in patients compared to healthy controls. These mixed results may be explained by differences in the paradigms as well as by small or biased samples, given the large heterogeneity of patients' deficits. Here, we show that mixed results may also come from idiosyncrasies of the stimuli used because in variants of the same visual paradigm, tested with the same participants, we found intact and deficient processing.

The effect of self-generated versus externally generated actions on timing, duration, and amplitude of blood oxygen level dependent response for visual feedback processing

It has been widely assumed that internal forward models use efference copies to create predictions about the sensory consequences of our own actions. While these predictions have frequently been associated with a reduced blood oxygen level dependent (BOLD) response in sensory cortices, the timing and duration of the hemodynamic response for the processing of video feedback of self‐generated (active) versus externally generated (passive) movements is poorly understood. In the present study, we tested the hypothesis that predictive mechanisms for self‐generated actions lead to early and shorter neural processing compared with externally generated movements. We investigated active and passive movements using a custom‐made fMRI‐compatible movement device. Visual video feedback of the active and passive movements was presented in real time or with variable delays. Participants had to judge whether the feedback was delayed. Timing and duration of BOLD impulse response was calculated using a first (temporal derivative [TD]) and second‐order (dispersion derivative [DD]) Taylor approximation. Our reanalysis confirmed our previous finding of reduced BOLD response for active compared to passive movements. Moreover, we found positive effects of the TD and DD in the supplementary motor area, cerebellum, visual cortices, and subcortical structures, indicating earlier and shorter hemodynamic responses for active compared to passive movements. Furthermore, earlier activation in the putamen for active compared to passive conditions was associated with reduced delay detection performance. These findings indicate that efference copy‐based predictive mechanisms enable earlier processing of action feedback, which might have reduced the ability to detect short delays between action and feedback.

Effector-dependent stochastic reference frame transformations alter decision-making

Psychophysical, motor control, and modeling studies have revealed that sensorimotor reference frame transformations (RFTs) add variability to transformed signals. For perceptual decision-making, this phenomenon could decrease the fidelity of a decision signal's representation or alternatively improve its processing through stochastic facilitation. We investigated these two hypotheses under various sensorimotor RFT constraints. Participants performed a time-limited, forced-choice motion discrimination task under eight combinations of head roll and/or stimulus rotation while responding either with a saccade or button press. This paradigm, together with the use of a decision model, allowed us to parameterize and correlate perceptual decision behavior with eye-, head-, and shoulder-centered sensory and motor reference frames. Misalignments between sensory and motor reference frames produced systematic changes in reaction time and response accuracy. For some conditions, these changes were consistent with a degradation of motion evidence commensurate with a decrease in stimulus strength in our model framework. Differences in participant performance were explained by a continuum of eye–head–shoulder representations of accumulated motion evidence, with an eye-centered bias during saccades and a shoulder-centered bias during button presses. In addition, we observed evidence for stochastic facilitation during head-rolled conditions (i.e., head roll resulted in faster, more accurate decisions in oblique motion for a given stimulus–response misalignment). We show that perceptual decision-making and stochastic RFTs are inseparable within the present context. We show that by simply rolling one's head, perceptual decision-making is altered in a way that is predicted by stochastic RFTs.

Audiovisual adaptation is expressed in spatial and decisional codes

The brain adapts dynamically to the changing sensory statistics of its environment. Recent research has started to delineate the neural circuitries and representations that support this cross-sensory plasticity. Combining psychophysics and model-based representational fMRI and EEG we characterized how the adult human brain adapts to misaligned audiovisual signals. We show that audiovisual adaptation is associated with changes in regional BOLD-responses and fine-scale activity patterns in a widespread network from Heschl’s gyrus to dorsolateral prefrontal cortices. Audiovisual recalibration relies on distinct spatial and decisional codes that are expressed with opposite gradients and time courses across the auditory processing hierarchy. Early activity patterns in auditory cortices encode sounds in a continuous space that flexibly adapts to misaligned visual inputs. Later activity patterns in frontoparietal cortices code decisional uncertainty consistent with these spatial transformations. Our findings suggest that regions within the auditory processing hierarchy multiplex spatial and decisional codes to adapt flexibly to the changing sensory statistics in the environment.

The brain adapts dynamically to the statistics of its environment. Here, the authors use psychophysics and model-based representational fMRI and EEG to show that audiovisual recalibration relies on distinct spatial and decisional codes that are expressed with opposite gradients and time courses across the auditory processing hierarchy.

Placebo induced expectations of mood enhancement generate a positivity effect in emotional processing

A perceptual bias towards negative emotions is a consistent finding in mood disorders and a major target of therapeutic interventions. Placebo responses in antidepressant treatment are substantial, but it is unclear whether and how underlying expectancy effects can modulate response biases to emotional inputs. In a first attempt to approach this question, we investigated how placebo induced expectation can shape the perception of specific emotional stimuli in healthy individuals. In a controlled cross-over design, positive treatment expectations were induced by verbal instructions and a hidden training manipulation combined with an alleged oxytocin nasal spray before participants performed an emotion classification task on happy and fearful facial expressions with varying intensity. Analyses of response criterion and discrimination ability as derived from emotion-specific psychometric functions demonstrate that expectation specifically lowered participants’ threshold for identifying happy emotions in general, while they became less sensitive to subtle differences in emotional expressions. These indications of a positivity bias were directly correlated with participants’ treatment expectations as well as subjective experiences of treatment effects and went along with a significant mood enhancement. Our findings show that expectations can induce a perceptual positivity effect in healthy individuals which is probably modulated by top-down emotion regulation and which may be able to improve mood state. Clinical implications of these promising results now need to be explored in studies of expectation manipulation in patients with mood disorders.

The role of alpha oscillations in temporal binding within and across the senses

An intriguing notion in cognitive neuroscience posits that alpha oscillations mould how the brain parses the constant influx of sensory signals into discrete perceptual events. Yet, the evidence is controversial and the underlying neural mechanism unclear. Further, it is unknown whether alpha oscillations influence observers’ perceptual sensitivity (i.e. temporal resolution) or their top-down biases to bind signals within and across the senses. Combining EEG, psychophysics and signal detection theory, this multi-day study rigorously assessed the impact of alpha frequency on temporal binding of signals within and across the senses. In a series of two-flash discrimination experiments twenty human observers were presented with one or two flashes together with none, one or two sounds. Our results provide robust evidence that pre-stimulus alpha frequency as a dynamic neural state and an individual’s trait index does not influence observers’ perceptual sensitivity or bias for two-flash discrimination in any of the three sensory contexts. These results challenge the notion that alpha oscillations have a profound impact on how observers parse sensory inputs into discrete perceptual events.

Emerging experience-dependent dynamics in primary somatosensory cortex reflect behavioral adaptation

Behavioral experience and flexibility are crucial for survival in a constantly changing environment. Despite evolutionary pressures to develop adaptive behavioral strategies in a dynamically changing sensory landscape, the underlying neural correlates have not been well explored. Here, we use genetically encoded voltage imaging to measure signals in primary somatosensory cortex (S1) during sensory learning and behavioral adaptation in the mouse. In response to changing stimulus statistics, mice adopt a strategy that modifies their detection behavior in a context dependent manner as to maintain reward expectation. Surprisingly, neuronal activity in S1 shifts from simply representing stimulus properties to transducing signals necessary for adaptive behavior in an experience dependent manner. Our results suggest that neuronal signals in S1 are part of an adaptive framework that facilitates flexible behavior as individuals gain experience, which could be part of a general scheme that dynamically distributes the neural correlates of behavior during learning.

Waiblinger et al. investigate the role of primary sensory cortex in flexible behaviors. They show that neuronal signals in S1 are part of an adaptive and dynamic framework that facilitates flexible behavior as an individual gains experience, indicating a role for S1 in long-term adaptive strategies.

Experimentally disambiguating models of sensory cue integration

Sensory cue integration is one of the primary areas in which a normative mathematical framework has been used to define the “optimal” way in which to make decisions based upon ambiguous sensory information and compare these predictions to behavior. The conclusion from such studies is that sensory cues are integrated in a statistically optimal fashion. However, numerous alternative computational frameworks exist by which sensory cues could be integrated, many of which could be described as “optimal” based on different criteria. Existing studies rarely assess the evidence relative to different candidate models, resulting in an inability to conclude that sensory cues are integrated according to the experimenter's preferred framework. The aims of the present paper are to summarize and highlight the implicit assumptions rarely acknowledged in testing models of sensory cue integration, as well as to introduce an unbiased and principled method by which to determine, for a given experimental design, the probability with which a population of observers behaving in accordance with one model of sensory integration can be distinguished from the predictions of a set of alternative models.

Novel Approaches to Measure Spatial Release From Masking in Children With Bilateral Cochlear Implants

OBJECTIVES

To investigate the role of auditory cues for spatial release from masking (SRM) in children with bilateral cochlear implants (BiCIs) and compare their performance with children with normal hearing (NH). To quantify the contribution to speech intelligibility benefits from individual auditory cues: head shadow, binaural redundancy, and interaural differences; as well as from multiple cues: SRM and binaural squelch. To assess SRM using a novel approach of adaptive target-masker angular separation, which provides a more functionally relevant assessment in realistic complex auditory environments.

DESIGN

Children fitted with BiCIs (N = 11) and with NH (N = 18) were tested in virtual acoustic space that was simulated using head-related transfer functions measured from individual children with BiCIs behind the ear and from a standard head and torso simulator for all NH children. In experiment I, by comparing speech reception thresholds across 4 test conditions that varied in target-masker spatial separation (colocated versus separated at 180°) and listening conditions (monaural versus binaural/bilateral listening), intelligibility benefits were derived for individual auditory cues for SRM. In experiment II, SRM was quantified using a novel measure to find the minimum angular separation (MAS) between the target and masker to achieve a fixed 20% intelligibility improvement. Target speech was fixed at either +90 or -90° azimuth on the side closer to the better ear (+90° for all NH children) and masker locations were adaptively varied.

RESULTS

In experiment I, children with BiCIs as a group had smaller intelligibility benefits from head shadow than NH children. No group difference was observed in benefits from binaural redundancy or interaural difference cues. In both groups of children, individuals who gained a larger benefit from interaural differences relied less on monaural head shadow, and vice versa. In experiment II, all children with BiCIs demonstrated measurable MAS thresholds <180° and on average larger than that from NH children. Eight of 11 children with BiCIs and all NH children had a MAS threshold <90°, requiring interaural differences only to gain the target intelligibility benefit; whereas the other 3 children with BiCIs had a MAS between 120° and 137°, requiring monaural head shadow for SRM.

CONCLUSIONS

When target and maskers were separated at 180° on opposing hemifields, children with BiCIs demonstrated greater intelligibility benefits from head shadow and interaural differences than previous literature showed with a smaller separation. Children with BiCIs demonstrated individual differences in using auditory cues for SRM. From the MAS thresholds, more than half of the children with BiCIs demonstrated robust access to interaural differences without needing additional monaural head shadow for SRM. Both experiments led to the conclusion that individualized fitting strategies in the bilateral devices may be warranted to maximize spatial hearing for children with BiCIs in complex auditory environments.

A Square-Root Second-Order Extended Kalman Filtering Approach for Estimating Smoothly Time-Varying Parameters

Researchers collecting intensive longitudinal data (ILD) are increasingly looking to model psychological processes, such as emotional dynamics, that organize and adapt across time in complex and meaningful ways. This is also the case for researchers looking to characterize the impact of an intervention on individual behavior. To be useful, statistical models must be capable of characterizing these processes as complex, time-dependent phenomenon, otherwise only a fraction of the system dynamics will be recovered. In this paper we introduce a Square-Root Second-Order Extended Kalman Filtering approach for estimating smoothly time-varying parameters. This approach is capable of handling dynamic factor models where the relations between variables underlying the processes of interest change in a manner that may be difficult to specify in advance. We examine the performance of our approach in a Monte Carlo simulation and show the proposed algorithm accurately recovers the unobserved states in the case of a bivariate dynamic factor model with time-varying dynamics and treatment effects. Furthermore, we illustrate the utility of our approach in characterizing the time-varying effect of a meditation intervention on day-to-day emotional experiences.

Applying hierarchical bayesian modeling to experimental psychopathology data: An introduction and tutorial

Over the past 2 decades Bayesian methods have been gaining popularity in many scientific disciplines. However, to this date, they are rarely part of formal graduate statistical training in clinical science. Although Bayesian methods can be an attractive alternative to classical methods for answering certain research questions, they involve a heavy "overhead" (e.g., advanced mathematical methods, complex computations), which pose significant barriers to researchers interested in adding Bayesian methods to their statistical toolbox. To increase the accessibility of Bayesian methods for psychopathology researchers, this article presents a gentle introduction of the Bayesian inference framework and a tutorial on implementation. We first provide a primer on the key concepts of Bayesian inference and major implementation considerations related to Bayesian estimation. We then demonstrate how to apply hierarchical Bayesian modeling (HBM) to experimental psychopathology data. Using a real dataset collected from two clinical groups (schizophrenia and bipolar disorder) and a healthy comparison sample on a psychophysical gaze perception task, we illustrate how to model individual responses and group differences with probability functions respectful of the presumed underlying data-generating process and the hierarchical nature of the data. We provide the code with explanations and the data used to generate and visualize the results to facilitate learning. Finally, we discuss interpretation of the results in terms of posterior probabilities and compare the results with those obtained using a traditional method. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Spatial release from masking in reverberation for school-age children

Understanding speech in noisy environments, such as classrooms, is a challenge for children. When a spatial separation is introduced between the target and masker, as compared to when both are co-located, children demonstrate intelligibility improvement of the target speech. Such intelligibility improvement is known as spatial release from masking (SRM). In most reverberant environments, binaural cues associated with the spatial separation are distorted; the extent to which such distortion will affect children's SRM is unknown. Two virtual acoustic environments with reverberation times between 0.4 s and 1.1 s were compared. SRM was measured using a spatial separation with symmetrically displaced maskers to maximize access to binaural cues. The role of informational masking in modulating SRM was investigated through voice similarity between the target and masker. Results showed that, contradictory to previous developmental findings on free-field SRM, children's SRM in reverberation has not yet reached maturity in the 7-12 years age range. When reducing reverberation, an SRM improvement was seen in adults but not in children. Our findings suggest that, even though school-age children have access to binaural cues that are distorted in reverberation, they demonstrate immature use of such cues for speech-in-noise perception, even in mild reverberation.

Central auditory processing deficits in schizophrenia: Effects of auditory-based cognitive training

BACKGROUND

Sensory processing abnormalities are common in schizophrenia (SZ) and impact everyday functions, such as speech perception in noisy environments. Auditory-based targeted cognitive training (TCT) is a "bottom up" cognitive remediation intervention designed to enhance the speed and accuracy of low-level auditory information processing. However, the effects of TCT on behavioral measures of central auditory processing (CAP) and the role of CAP function on verbal learning outcomes in SZ are unknown.

METHODS

SZ (n = 42) and healthy subjects (CTL; n = 18) underwent comprehensive clinical, neurocognitive, and auditory assessments, including tests of hearing sensitivity and speech recognition (Words-in-Noise (WIN), Quick Speech-in-Noise (SIN)). SZ patients were randomized to receive either treatment-as-usual (TAU); or 30-h of TCT + TAU using a stratified, parallel design. SZ patients repeated assessments ~10-12 weeks later.

RESULTS

Patients exhibited deficits in both WIN (p < 0.05, d = 0.50) and SIN (p < 0.01, d = 0.63). A treatment × time interaction on WIN (p < 0.05, d = 0.74), but not SIN discriminability, was seen in the TCT group relative to TAU. Specific enhancements in the 4-dB over background range drove gains in WIN performance. Moreover, SZ patients with greater CAP deficits experienced robust gains in verbal learning after 30-h of TCT relative to SZ patients without CAP impairment (p < 0.01, d = 1.28).

CONCLUSION

Findings demonstrate that intensive auditory training enhances the fidelity of auditory processing and perception, such that specific CAP deficits were 'normalized' and were predictive of gains in verbal learning after TCT. It is conceivable that patients with deficiencies in CAP measures may benefit most from TCT and other interventions targeting auditory dysfunction in SZ.

Impaired Spatial Inhibition Processes for Interhemispheric Anti-saccades following Dorsal Posterior Parietal Lesions

Anti-saccades are eye movements that require inhibition to stop the automatic saccade to the visual target and to perform instead a saccade in the opposite direction. The inhibitory processes underlying anti-saccades have been primarily associated with frontal cortex areas for their role in executive control. Impaired performance in anti-saccades has also been associated with the parietal cortex, but its role in inhibitory processes remains unclear. Here, we tested the assumption that the dorsal parietal cortex contributes to spatial inhibition processes of contralateral visual target. We measured anti-saccade performance in 2 unilateral optic ataxia patients and 15 age-matched controls. Participants performed 90 degree (across and within visual fields) and 180 degree inversion anti-saccades, as well as pro-saccades. The main result was that our patients took longer to inhibit visually guided saccades when the visual target was presented in the ataxic hemifield and the task required a saccade across hemifields. This was observed through anti-saccades latencies and error rates. These deficits show the crucial role of the dorsal posterior parietal cortex in spatial inhibition of contralateral visual target representations to plan an accurate anti-saccade toward the ipsilesional side.

Dissecting (un)crowding

In crowding, perception of a target deteriorates in the presence of nearby flankers. Surprisingly, perception can be rescued from crowding if additional flankers are added (uncrowding). Uncrowding is a major challenge for all classic models of crowding and vision in general, because the global configuration of the entire stimulus is crucial. However, it is unclear which characteristics of the configuration impact (un)crowding. Here, we systematically dissected flanker configurations and showed that (un)crowding cannot be easily explained by the effects of the sub-parts or low-level features of the stimulus configuration. Our modeling results suggest that (un)crowding requires global processing. These results are well in line with previous studies showing the importance of global aspects in crowding.

Abnormal Vision-Based Displacement Perception in Parkinson's Disease

In this work, we investigate the effect of Parkinson’s disease (PD), and common corresponding therapies on vision-based perception of motion, a critical perceptual ability required for performing a wide range of activities of daily livings. While PD has been recognized as mainly a motor disorder, sensory manifestation of PD can also play a major role in the resulting disability. In this paper, for the first time, the effect of disease duration and common therapies on vision-based perception of displacement were investigated. The study is conducted in a movement-independent manner, to reject the shadowing effects and isolate the targeted perceptual disorder to the maximum possible extent. Data was collected using a computerized graphical tool on 37 PD patients [6 early-stage de novo, 25 mid-stage using levodopa therapy, six later-stage using deep brain stimulation (DBS)] and 15 control participants. Besides the absolute measurement of perception through a psychometric analysis on two tested position reference magnitudes, we also investigated the linearity in perception using Weber’s fraction. The results showed that individuals with PD displayed significant perceptual impairments compared to controls, though early-stage patients were not impaired. Mid-stage patients displayed impairments at the greater of the two tested reference magnitudes, while late-stage patients were impaired at both reference magnitudes. Levodopa and DBS use did not cause statistically significant differences in absolute displacement perception. The findings suggest abnormal visual processing in PD increasing with disease development, perhaps contributing to sensory-based impairments of PD such as bradykinesia, visuospatial deficits, and abnormal object recognition.

A Sparse Probabilistic Code Underlies the Limits of Behavioral Discrimination

The cortical code that underlies perception must enable subjects to perceive the world at time scales relevant for behavior. We find that mice can integrate visual stimuli very quickly (<100 ms) to reach plateau performance in an orientation discrimination task. To define features of cortical activity that underlie performance at these time scales, we measured single-unit responses in the mouse visual cortex at time scales relevant to this task. In contrast to high-contrast stimuli of longer duration, which elicit reliable activity in individual neurons, stimuli at the threshold of perception elicit extremely sparse and unreliable responses in the primary visual cortex such that the activity of individual neurons does not reliably report orientation. Integrating information across neurons, however, quickly improves performance. Using a linear decoding model, we estimate that integrating information over 50–100 neurons is sufficient to account for behavioral performance. Thus, at the limits of visual perception, the visual system integrates information encoded in the probabilistic firing of unreliable single units to generate reliable behavior.

Statistical approaches to identifying lapses in psychometric response data

Psychometric curve fits relate physical stimuli to an observer's performance. In experiments an observer may "lapse" and respond with a random guess, which may negatively impact (e.g., bias) the psychometric fit parameters. A lapse-rate model has been popularized by Wichmann and Hill, which reduces the impact of lapses on other estimated parameters by adding a parameter to model the lapse rate. Since lapses are discrete events, we developed a discrete lapse theory and tested a "lapse identification" algorithm to identify individual outlier trials (i.e., potential lapses) based upon an approximate statistical criterion and discard these trials. Specifically, we focused on stimuli sampled using an adaptive staircase for a one-interval, direction-recognition task (i.e., psychometric function ranging from 0 to 1 and the spread of the curve corresponds to the threshold, which is often a parameter of interest for many fitted psychometric functions). Through simulations, we found that as the lapse rate increased the threshold became substantially overestimated, consistent with earlier analyses. While the lapse-rate model reduced the overestimation of threshold with many lapses, with lower lapse rates it yielded substantial threshold underestimation, though less so when fitting many (e.g., 1,000) trials. In comparison, the lapse-identification algorithm yielded accurate threshold estimates across a wide range of lapse rates (from 0 to 5%), which is critical since the lapse rate is seldom known. We further demonstrate the performance of the lapse-identification algorithm to be suitable for a variety of experimental conditions and conclude with some considerations of its use. In particular, we suggest using the lapse-identification algorithm unless the experiment has many trials (e.g., >500) or if somehow the lapse rate is known to be high (e.g., ≥5%), for which the lapse-rate model approaches remain preferred.

A Directional Congruency Effect of Amplified Dilated Time Perception Induced by Looming Stimuli With Implied Motion Cues

The perception of time is not veridical, but, rather, it is susceptible to environmental context, like the intrinsic dynamics of moving stimuli. The direction of motion has been reported to affect time perception such that movement of objects toward an observer (i.e., looming stimuli) is perceived as longer in duration than movement of objects away from the observer (i.e., receding stimuli). In the current study we investigated whether this looming/receding temporal asymmetry can be modulated by the direction of movement implied by static cues of images. Participants were presented with images of a running person, rendered from either the front or the back (i.e., representing movement toward or away from the observer). In Experiment 1, the size of the images was constant. In Experiment 2, the image sizes varied (i.e., increasing: looming; or decreasing: receding). In both experiments, participants performed a temporal bisection task by judging the duration of the image presentation as "short" or "long". In Experiment 1, we found no influence of implied-motion direction in the participants' duration perceptions. In Experiment 2, however, participants overestimated the duration of the looming, as compared to the receding image in relation to real motion. This finding replicated previous findings of the looming/receding asymmetry using naturalistic human-character stimuli. Further, in Experiment 2 we observed a directional congruency effect between real and implied motion; stimuli were perceived as lasting longer when the directions of real and implied motion were congruent versus when these directions were incongruent. Thus, looming (versus receding) movement, a perceptually salient stimulus, elicits differential temporal processing, and higher-order motion processing integrates signals of real and implied motion in time perception.

Simultaneous tracking of psychophysical detection thresholds and evoked potentials to study nociceptive processing

Measuring altered nociceptive processing involved in chronic pain is difficult due to a lack of objective methods. Potential methods to characterize human nociceptive processing involve measuring neurophysiological activity and psychophysical responses to well-defined stimuli. To reliably measure neurophysiological activity in response to nociceptive stimulation using EEG, synchronized activation of nerve fibers and a large number of stimuli are required. On the other hand, to reliably measure psychophysical detection thresholds, selection of stimulus amplitudes around the detection threshold and many stimulus-response pairs are required. Combining the two techniques helps in quantifying the properties of nociceptive processing related to detected and non-detected stimuli around the detection threshold.The two techniques were combined in an experiment including 20 healthy participants to study the effect of intra-epidermal electrical stimulus properties (i.e. amplitude, single- or double-pulse and trial number) on the detection thresholds and vertex potentials. Generalized mixed regression and linear mixed regression were used to quantify the psychophysical detection probability and neurophysiological EEG responses, respectively.It was shown that the detection probability is significantly modulated by the stimulus amplitude, trial number, and the interaction between stimulus type and amplitude. Furthermore, EEG responses were significantly modulated by stimulus detection and trial number. Hence, we successfully demonstrated the possibility to simultaneously obtain information on psychophysical and neurophysiological properties of nociceptive processing. These results warrant further investigation of the potential of this method to observe altered nociceptive processing.

The Role of Interaural Differences, Head Shadow, and Binaural Redundancy in Binaural Intelligibility Benefits Among School-Aged Children

In complex listening environments, children can benefit from auditory spatial cues to understand speech in noise. When a spatial separation is introduced between the target and masker and/or listening with two ears versus one ear, children can gain intelligibility benefits with access to one or more auditory cues for unmasking: monaural head shadow, binaural redundancy, and interaural differences. This study systematically quantified the contribution of individual auditory cues in providing binaural speech intelligibility benefits for children with normal hearing between 6 and 15 years old. In virtual auditory space, target speech was presented from  + 90° azimuth (i.e., listener's right), and two-talker babble maskers were either co-located (+ 90° azimuth) or separated by 180° (-90° azimuth, listener's left). Testing was conducted over headphones in monaural (i.e., right ear) or binaural (i.e., both ears) conditions. Results showed continuous improvement of speech reception threshold (SRT) between 6 and 15 years old and immature performance at 15 years of age for both SRTs and intelligibility benefits from more than one auditory cue. With early maturation of head shadow, the prolonged maturation of unmasking was likely driven by children's poorer ability to gain full benefits from interaural difference cues. In addition, children demonstrated a trade-off between the benefits from head shadow versus interaural differences, suggesting an important aspect of individual differences in accessing auditory cues for binaural intelligibility benefits during development.

Abrupt darkening under high dynamic range (HDR) luminance invokes facilitation for high-contrast targets and grouping by luminance similarity

When scanning across a scene, luminance can vary by up to 100,000-to-1 (high dynamic range, HDR), requiring multiple normalizing mechanisms spanning from the retina to the cortex to support visual acuity and recognition. Vision models based on standard dynamic range (SDR) luminance contrast ratios below 100-to-1 have limited ability to generalize to real-world scenes with HDR luminance. To characterize how orientation and luminance are linked in brain mechanisms for luminance normalization, we measured orientation discrimination of Gabor targets under HDR luminance dynamics. We report a novel phenomenon, that abrupt 10- to 100-fold darkening engages contextual facilitation, distorting the apparent orientation of a high-contrast central target. Surprisingly, facilitation was influenced by grouping by luminance similarity, as well as by the degree of luminance variability in the surround. These results challenge vision models based solely on activity normalization and raise new questions that will lead to models that perform better in real-world scenes.

fNIRS Assessment of Speech Comprehension in Children with Normal Hearing and Children with Hearing Aids in Virtual Acoustic Environments: Pilot Data and Practical Recommendations

The integration of virtual acoustic environments (VAEs) with functional near-infrared spectroscopy (fNIRS) offers novel avenues to investigate behavioral and neural processes of speech-in-noise (SIN) comprehension in complex auditory scenes. Particularly in children with hearing aids (HAs), the combined application might offer new insights into the neural mechanism of SIN perception in simulated real-life acoustic scenarios. Here, we present first pilot data from six children with normal hearing (NH) and three children with bilateral HAs to explore the potential applicability of this novel approach. Children with NH received a speech recognition benefit from low room reverberation and target-distractors' spatial separation, particularly when the pitch of the target and the distractors was similar. On the neural level, the left inferior frontal gyrus appeared to support SIN comprehension during effortful listening. Children with HAs showed decreased SIN perception across conditions. The VAE-fNIRS approach is critically compared to traditional SIN assessments. Although the current study shows that feasibility still needs to be improved, the combined application potentially offers a promising tool to investigate novel research questions in simulated real-life listening. Future modified VAE-fNIRS applications are warranted to replicate the current findings and to validate its application in research and clinical settings.

Neural modelling of the semantic predictability gain under challenging listening conditions

When speech intelligibility is reduced, listeners exploit constraints posed by semantic context to facilitate comprehension. The left angular gyrus (AG) has been argued to drive this semantic predictability gain. Taking a network perspective, we ask how the connectivity within language-specific and domain-general networks flexibly adapts to the predictability and intelligibility of speech. During continuous functional magnetic resonance imaging (fMRI), participants repeated sentences, which varied in semantic predictability of the final word and in acoustic intelligibility. At the neural level, highly predictable sentences led to stronger activation of left-hemispheric semantic regions including subregions of the AG (PGa, PGp) and posterior middle temporal gyrus when speech became more intelligible. The behavioural predictability gain of single participants mapped onto the same regions but was complemented by increased activity in frontal and medial regions. Effective connectivity from PGa to PGp increased for more intelligible sentences. In contrast, inhibitory influence from pre-supplementary motor area to left insula was strongest when predictability and intelligibility of sentences were either lowest or highest. This interactive effect was negatively correlated with the behavioural predictability gain. Together, these results suggest that successful comprehension in noisy listening conditions relies on an interplay of semantic regions and concurrent inhibition of cognitive control regions when semantic cues are available.

A decision-time account of individual variability in context-dependent orientation estimation

Following exposure to an oriented stimulus, the perceived orientation is slightly shifted, a phenomenon termed the tilt aftereffect (TAE). This estimation bias, as well as other context-dependent biases, is speculated to reflect statistical mechanisms of inference that optimize visual processing. Importantly, although measured biases are extremely robust in the population, the magnitude of individual bias can be extremely variable. For example, measuring different individuals may result in TAE magnitudes that differ by a factor of 5. Such findings appear to challenge the accounts of bias in terms of learned statistics: is inference so different across individuals? Here, we found that a strong correlation exists between reaction time and TAE, with slower individuals having much less TAE. In the tilt illusion, the spatial analogue of the TAE, we found a similar, though weaker, correlation. These findings can be explained by a theory predicting that bias, caused by a change in the initial conditions of evidence accumulation (e.g., priors), decreases with decision time (*Communications Biology 3 (2020) 1-12). We contend that the context-dependence of visual processing is more homogeneous in the population than was previously thought, with the measured variability of perceptual bias explained, at least in part, by the flexibility of decision-making. Homogeneity in processing might reflect the similarity of the learned statistics.

Development of Binaural Sensitivity: Eye Gaze as a Measure of Real-time Processing

Children localize sounds using binaural cues when navigating everyday auditory environments. While sensitivity to binaural cues reaches maturity by 8-10 years of age, large individual variability has been observed in the just-noticeable-difference (JND) thresholds for interaural time difference (ITD) among children in this age range. To understand the development of binaural sensitivity beyond JND thresholds, the "looking-while-listening" paradigm was adapted in this study to reveal the real-time decision-making behavior during ITD processing. Children ages 8-14 years with normal hearing (NH) and a group of young NH adults were tested. This novel paradigm combined eye gaze tracking with behavioral psychoacoustics to estimate ITD JNDs in a two-alternative forced-choice discrimination task. Results from simultaneous eye gaze recordings during ITD processing suggested that children had adult-like ITD JNDs, but they demonstrated immature decision-making strategies. While the time course of arriving at the initial fixation and final decision in providing a judgment of the ITD direction was similar, children exhibited more uncertainty than adults during decision-making. Specifically, children made more fixation changes, particularly when tested using small ITD magnitudes, between the target and non-target response options prior to finalizing a judgment. These findings suggest that, while children may exhibit adult-like sensitivity to ITDs, their eye gaze behavior reveals that the processing of this binaural cue is still developing through late childhood.

Distinct Roles for the Cerebellum, Angular Gyrus, and Middle Temporal Gyrus in Action-Feedback Monitoring

Action-feedback monitoring is essential to ensure meaningful interactions with the external world. This process involves generating efference copy-based sensory predictions and comparing these with the actual action-feedback. As neural correlates of comparator processes, previous fMRI studies have provided heterogeneous results, including the cerebellum, angular and middle temporal gyrus. However, these studies usually comprised only self-generated actions. Therefore, they might have induced not only action-based prediction errors, but also general sensory mismatch errors. Here, we aimed to disentangle these processes using a custom-made fMRI-compatible movement device, generating active and passive hand movements with identical sensory feedback. Online visual feedback of the hand was presented with a variable delay. Participants had to judge whether the feedback was delayed. Activity in the right cerebellum correlated more positively with delay in active than in passive trials. Interestingly, we also observed activation in the angular and middle temporal gyri, but across both active and passive conditions. This suggests that the cerebellum is a comparator area specific to voluntary action, whereas angular and middle temporal gyri seem to detect more general intersensory conflict. Correlations with behavior and cerebellar activity nevertheless suggest involvement of these temporoparietal areas in processing and awareness of temporal discrepancies in action-feedback monitoring.

Nonretinocentric localization of successively presented flashes during smooth pursuit eye movements

Keeping track of objects in our environment across body and eye movements is essential for perceptual stability and localization of external objects. As of yet, it is largely unknown how this perceptual stability is achieved. A common behavioral approach to investigate potential neuronal mechanisms underlying spatial vision has been the presentation of one brief visual stimulus across eye movements. Here, we adopted this approach and aimed to determine the reference frame of the perceptual localization of two successively presented flashes during fixation and smooth pursuit eye movements (SPEMs). To this end, eccentric flashes with a stimulus onset asynchrony of zero or ± 200 ms had to be localized with respect to each other during fixation and SPEMs. The results were used to evaluate different models predicting the reference frame in which the spatial information is represented. First, we were able to reproduce the well-known effect of relative mislocalization during fixation. Second, smooth pursuit led to a characteristic relative mislocalization, different from that during fixation. A model assuming that relative localization takes place in a nonretinocentric reference frame described our data best. This suggests that the relative localization judgment is performed at a stage of visual processing in which retinal and nonretinal information is available.

Interaction of contexts in context-dependent orientation estimation

The processing of a visual stimulus is known to be influenced by the statistics in recent visual history and by the stimulus' visual surround. Such contextual influences lead to perceptually salient phenomena, such as the tilt aftereffect and the tilt illusion. Despite much research on the influence of an isolated context, it is not clear how multiple, possibly competing sources of contextual influence interact. Here, using psychophysical methods, we compared the combined influence of multiple contexts to the sum of the isolated context influences. The results showed large deviations from linear additivity for adjacent or overlapping contexts, and remarkably, clear additivity when the contexts were sufficiently separated. Specifically, for adjacent or overlapping contexts, the combined effect was often lower than the sum of the isolated component effects (sub-additivity), or was more influenced by one component than another (selection). For contexts that were separated in time (600 ms), the combined effect measured the exact sum of the isolated component effects (in degrees of bias). Overall, the results imply an initial compressive transformation during visual processing, followed by selection between the processed parts.

But Still It Moves: Static Image Statistics Underlie How We See Motion

Seeing movement promotes survival. It results from an uncertain interplay between evolution and experience, making it hard to isolate the drivers of computational architectures found in brains. Here we seek insight into motion perception using a neural network (MotionNet) trained on moving images to classify velocity. The network recapitulates key properties of motion direction and speed processing in biological brains, and we use it to derive, and test, understanding of motion (mis)perception at the computational, neural, and perceptual levels. We show that diverse motion characteristics are largely explained by the statistical structure of natural images, rather than motion per se. First, we show how neural and perceptual biases for particular motion directions can result from the orientation structure of natural images. Second, we demonstrate an interrelation between speed and direction preferences in (macaque) MT neurons that can be explained by image autocorrelation. Third, we show that natural image statistics mean that speed and image contrast are related quantities. Finally, using behavioral tests (humans, both sexes), we show that it is knowledge of the speed-contrast association that accounts for motion illusions, rather than the distribution of movements in the environment (the “slow world” prior) as premised by Bayesian accounts. Together, this provides an exposition of motion speed and direction estimation, and produces concrete predictions for future neurophysiological experiments. More broadly, we demonstrate the conceptual value of marrying artificial systems with biological characterization, moving beyond “black box” reproduction of an architecture to advance understanding of complex systems, such as the brain.

SIGNIFICANCE STATEMENT Using an artificial systems approach, we show that physiological properties of motion can result from natural image structure. In particular, we show that the anisotropic distribution of orientations in natural statistics is sufficient to explain the cardinal bias for motion direction. We show that inherent autocorrelation in natural images means that speed and direction are related quantities, which could shape the relationship between speed and direction tuning of MT neurons. Finally, we show that movement speed and image contrast are related in moving natural images, and that motion misperception can be explained by this speed-contrast association not a “slow world” prior.

Perceptual bias is reduced with longer reaction times during visual discrimination

Fast and slow decisions exhibit distinct behavioral properties, such as the presence of decision bias in faster but not slower responses. This dichotomy is currently explained by assuming that distinct cognitive processes map to separate brain mechanisms. Here, we suggest an alternative single-process account based on the stochastic properties of decision processes. Our experimental results show perceptual biases in a variety of tasks (specifically: learned priors, tilt aftereffect, and tilt illusion) that are much reduced with increasing reaction time. To account for this, we consider a simple yet general explanation: prior and noisy decision-related evidence are integrated serially, with evidence and noise accumulating over time (as in the standard drift diffusion model). With time, owing to noise accumulation, the prior effect is predicted to diminish. This illustrates that a clear behavioral separation—presence vs. absence of bias—may reflect a simple stochastic mechanism.

Ron Dekel and Dov Sagi use a visual discrimination task to show that when making a choice, longer reaction times decrease human perceptual bias without affecting accuracy. This decrease in perceptual bias can be explained by the accumulation of evidence and noise over time.

Vigabatrin-Induced Retinal Functional Alterations and Second-Order Neuron Plasticity in C57BL/6J Mice

Purpose

Vigabatrin (VGB) is an effective antiepileptic that increases concentrations of inhibitory γ-aminobutyric acid (GABA) by inhibiting GABA transaminase. Reports of VGB-associated visual field loss limit its clinical usefulness, and retinal toxicity studies in laboratory animals have yielded conflicting results.

Methods

We examined the functional and morphologic effects of VGB in C57BL/6J mice that received either VGB or saline IP from 10 to 18 weeks of age. Retinal structure and function were assessed in vivo by optical coherence tomography (OCT), ERG, and optomotor response. After euthanasia, retinas were processed for immunohistochemistry, and retinal GABA, and VGB quantified by mass spectrometry.

Results

No significant differences in visual acuity or total retinal thickness were identified between groups by optomotor response or optical coherence tomography, respectively. After 4 weeks of VGB treatment, ERG b-wave amplitude was enhanced, and amplitudes of oscillatory potentials were reduced. Dramatic rod and cone bipolar and horizontal cell remodeling, with extension of dendrites into the outer nuclear layer, was observed in retinas of VGB-treated mice. VGB treatment resulted in a mean 3.3-fold increase in retinal GABA concentration relative to controls and retinal VGB concentrations that were 20-fold greater than brain.

Conclusions

No evidence of significant retinal thinning or ERG a- or b-wave deficits were apparent, although we describe significant alterations in ERG b-wave and oscillatory potentials and in retinal cell morphology in VGB-treated C57BL/6J mice. The dramatic concentration of VGB in retina relative to the target tissue (brain), with a corresponding increase in retinal GABA, offers insight into the pathophysiology of VGB-associated visual field loss.

Differential Temporal Perception Abilities in Parkinson's Disease Patients Based on Timing Magnitude

Non-motor symptoms in Parkinson's Disease (PD) predate motor symptoms and substantially decrease quality of life; however, detection, monitoring, and treatments are unavailable for many of these symptoms. Temporal perception abnormalities in PD are generally attributed to altered Basal Ganglia (BG) function. Present studies are confounded by motor control facilitating movements that are integrated into protocols assessing temporal perception. There is uncertainty regarding the BG's influence on timing processes of different time scales and how PD therapies affect this perception. In this study, PD patients using Levodopa (n = 25), Deep Brain Stimulation (DBS; n = 6), de novo patients (n = 6), and healthy controls (n = 17) completed a visual temporal perception task in seconds and sub-section timing scales using a computer-generated graphical tool. For all patient groups, there were no impairments seen at the smaller tested magnitudes (using sub-second timing). However, all PD groups displayed significant impairments at the larger tested magnitudes (using interval timing). Neither Levodopa nor DBS therapy led to significant improvements in timing abilities. Levodopa resulted in a strong trend towards impairing timing processes and caused a deterioration in perceptual coherency according to Weber's Law. It is shown that timing abnormalities in PD occur in the seconds range but do not extend to the sub-second range. Furthermore, observed timing deficits were shown to not be solely caused by motor deficiency. This provides evidence to support internal clock models involving the BG (among other neural regions) in interval timing, and cerebellar control of sub-second timing. This study also revealed significant temporal perception deficits in recently diagnosed PD patients; thus, temporal perception abnormalities might act as an early disease marker, with the graphical tool showing potential for disease monitoring.

Evidence From Parkinson's Disease That the Superior Colliculus Couples Action and Perception

BACKGROUND

Action and perception should be coordinated for good visual-motor performance. The mechanism coupling action and perception may be a prominence map in the intermediate layer of the superior colliculus that modulates motor and attentional/perceptual processes. This coordination comes with a cost: the misperception that briefly overlapping stimuli are separated in time. Our model predicts that abnormal intermediate layer of the superior colliculus inhibition, such as that arising from increased basal ganglia output, would affect the action and perception coupling, and it would worsen the misperception.

OBJECTIVE

To test the prominence map model by measuring reaction times and perceptions in human intermediate layer of the superior colliculus dysfunction.

METHODS

We measured the saccadic and perceptual reaction time changes and the percept for different temporal asynchronies between fixation point offset and peripheral target onset in Parkinson's disease (PD).

RESULTS

We found that increased basal ganglia inhibitory output to the intermediate layer of the superior colliculus prominence map disrupted the normal coupling of action and perception. With increasing temporal asynchronies, the PD perceptual reaction times increased approximately 3 times more than the increase of the saccadic reaction times. Also, PD subjects misperceive small overlaps as gaps for temporal asynchronies up to 3 times longer than controls. The results can be reproduced by an intermediate layer of the superior colliculus rostral-caudal gradient of inhibition.

CONCLUSION

These findings support the hypothesis that a prominence map in the intermediate layer of the superior colliculus couples action and perception through modulation of attention. A dysfunction of this network quantifies abnormal basal ganglia output and could underlie visual deficits, including common, yet poorly understood, misperceptions and visual-motor deficits of PD. © 2019 International Parkinson and Movement Disorder Society.

Surface Stickiness Perception by Auditory, Tactile, and Visual Cues

This study aimed to explore the psychophysical bases of multisensory surface stickiness perception by investigating how sensitively humans perceive different levels of stickiness intensity conveyed by auditory, tactile, and visual cues. First, we sorted five different sticky stimuli by perceived intensity in ascending order for each modality separately and evaluated the discrimination sensitivities of each participant using a fitted psychometric curve. Results showed that perceptual intensity orders were not identical to physical intensity order and that the sequential order of perceived intensities for different modalities was inconsistent. Moreover, estimated perceptual sensitivities to surface stickiness indicated that auditory cues result in better discrimination sensitivity than tactile and visual cues. Second, we calculated the relative perceptual distances of stickiness intensities using multidimensional scaling. A follow-up statistical test demonstrated that the perceptual mapping of vision and touch are similar but that auditory perception is different. These results suggest that the discriminability of stickiness intensity is best served by auditory cues and that texture information processing in the auditory domain is distinctive from that of other modalities.

Movement Improves the Quality of Temporal Perception and Decision-Making

A critical aspect of behavior is that mobile organisms must be able to precisely determine where and when to move. A better understanding of the mechanisms underlying precise movement timing and action planning is therefore crucial to understanding how we interact with the world around us. Recent evidence suggests that our experience of time is directly and intrinsically computed within the motor system, consistent with the theory of embodied cognition. To investigate the role of the motor system, we tested human subjects (n = 40) on a novel task combining reaching and time estimation. In this task, subjects were required to move a robotic manipulandum to one of two physical locations to categorize a concurrently timed suprasecond. Critically, subjects were divided into two groups: one in which movement during the interval was unrestricted and one in which they were restricted from moving until the stimulus interval had elapsed. Our results revealed a higher degree of precision for subjects in the free-moving group. A further experiment (n = 14) verified that these findings were not due to proximity to the target, counting strategies, bias, or movement length. A final experiment (n = 10) replicated these findings using a within-subjects design, performing a time reproduction task, in which movement during encoding of the interval led to more precise performance. Our findings suggest that time estimation may be instantiated within the motor system as an ongoing readout of timing judgment and confidence.

Frequency and power of human alpha oscillations drift systematically with time-on-task

Oscillatory neural activity is a fundamental characteristic of the mammalian brain spanning multiple levels of spatial and temporal scale. Current theories of neural oscillations and analysis techniques employed to investigate their functional significance are based on an often implicit assumption: In the absence of experimental manipulation, the spectral content of any given EEG- or MEG-recorded neural oscillator remains approximately stationary over the course of a typical experimental session (∼1 h), spontaneously fluctuating only around its dominant frequency. Here, we examined this assumption for ongoing neural oscillations in the alpha-band (8-13 Hz). We found that alpha peak frequency systematically decreased over time, while alpha-power increased. Intriguingly, these systematic changes showed partial independence of each other: Statistical source separation (independent component analysis) revealed that while some alpha components displayed concomitant power increases and peak frequency decreases, other components showed either unique power increases or frequency decreases. Interestingly, we also found these components to differ in frequency. Components that showed mixed frequency/power changes oscillated primarily in the lower alpha-band (∼8-10 Hz), while components with unique changes oscillated primarily in the higher alpha-band (∼9-13 Hz). Our findings provide novel clues on the time-varying intrinsic properties of large-scale neural networks as measured by M/EEG, with implications for the analysis and interpretation of studies that aim at identifying functionally relevant oscillatory networks or at driving them through external stimulation.

Integration of audiovisual spatial signals is not consistent with maximum likelihood estimation

Multisensory perception is regarded as one of the most prominent examples where human behaviour conforms to the computational principles of maximum likelihood estimation (MLE). In particular, observers are thought to integrate auditory and visual spatial cues weighted in proportion to their relative sensory reliabilities into the most reliable and unbiased percept consistent with MLE. Yet, evidence to date has been inconsistent. The current pre-registered, large-scale (N = 36) replication study investigated the extent to which human behaviour for audiovisual localization is in line with maximum likelihood estimation. The acquired psychophysics data show that while observers were able to reduce their multisensory variance relative to the unisensory variances in accordance with MLE, they weighed the visual signals significantly stronger than predicted by MLE. Simulations show that this dissociation can be explained by a greater sensitivity of standard estimation procedures to detect deviations from MLE predictions for sensory weights than for audiovisual variances. Our results therefore suggest that observers did not integrate audiovisual spatial signals weighted exactly in proportion to their relative reliabilities for localization. These small deviations from the predictions of maximum likelihood estimation may be explained by observers' uncertainty about the world's causal structure as accounted for by Bayesian causal inference.

Border ownership-dependent tilt aftereffect for shape defined by binocular disparity and motion parallax

Discerning objects from their surrounds (i.e., figure-ground segmentation) in a way that guides adaptive behaviors is a fundamental task of the brain. Neurophysiological work has revealed a class of cells in the macaque visual cortex that may be ideally suited to support this neural computation: border ownership cells (Zhou H, Friedman HS, von der Heydt R. J Neurosci 20: 6594–6611, 2000). These orientation-tuned cells appear to respond conditionally to the borders of objects. A behavioral correlate supporting the existence of these cells in humans was demonstrated with two-dimensional luminance-defined objects (von der Heydt R, Macuda T, Qiu FT. J Opt Soc Am A Opt Image Sci Vis 22: 2222–2229, 2005). However, objects in our natural visual environments are often signaled by complex cues, such as motion and binocular disparity. Thus for border ownership systems to effectively support figure-ground segmentation and object depth ordering, they must have access to information from multiple depth cues with strict depth order selectivity. Here we measured in humans (of both sexes) border ownership-dependent tilt aftereffects after adaptation to figures defined by either motion parallax or binocular disparity. We find that both depth cues produce a tilt aftereffect that is selective for figure-ground depth order. Furthermore, we find that the effects of adaptation are transferable between cues, suggesting that these systems may combine depth cues to reduce uncertainty (Bülthoff HH, Mallot HA. J Opt Soc Am A 5: 1749–1758, 1988). These results suggest that border ownership mechanisms have strict depth order selectivity and access to multiple depth cues that are jointly encoded, providing compelling psychophysical support for their role in figure-ground segmentation in natural visual environments.

NEW & NOTEWORTHY Figure-ground segmentation is a critical function that may be supported by “border ownership” neural systems that conditionally respond to object borders. We measured border ownership-dependent tilt aftereffects to figures defined by motion parallax or binocular disparity and found aftereffects for both cues. These effects were transferable between cues but selective for figure-ground depth order, suggesting that the neural systems supporting figure-ground segmentation have strict depth order selectivity and access to multiple depth cues that are jointly encoded.