Selective Integration during Sequential Sampling in Posterior Neural Signals

Decisions are typically made after integrating information about multiple attributes of alternatives in a choice set. Where observers are obliged to consider attributes in turn, a computational framework known as "selective integration" can capture salient biases in human choices. The model proposes that successive attributes compete for processing resources and integration is biased towards the alternative with the locally preferred attribute. Quantitative analysis shows that this model, although it discards choice-relevant information, is optimal when the observers' decisions are corrupted by noise that occurs beyond the sensory stage. Here, we used electroencephalography (EEG) to test a neural prediction of the model: that locally preferred attributes should be encoded with higher gain in neural signals over the posterior cortex. Over two sessions, human observers judged which of the two simultaneous streams of bars had the higher (or lower) average height. The selective integration model fits the data better than a rival model without bias. Single-trial analysis showed that neural signals contralateral to the preferred attribute covaried more steeply with the decision information conferred by locally preferred attributes. These findings provide neural evidence in support of selective integration, complementing existing behavioral work.

Dynamic Interplay of Value and Sensory Information in High-Speed Decision Making

In dynamic environments, split-second sensorimotor decisions must be prioritized according to potential payoffs to maximize overall rewards. The impact of relative value on deliberative perceptual judgments has been examined extensively [1-6], but relatively little is known about value-biasing mechanisms in the common situation where physical evidence is strong but the time to act is severely limited. In prominent decision models, a noisy but statistically stationary representation of sensory evidence is integrated over time to an action-triggering bound, and value-biases are affected by starting the integrator closer to the more valuable bound. Here, we show significant departures from this account for humans making rapid sensory-instructed action choices. Behavior was best explained by a simple model in which the evidence representation-and hence, rate of accumulation-is itself biased by value and is non-stationary, increasing over the short decision time frame. Because the value bias initially dominates, the model uniquely predicts a dynamic "turn-around" effect on low-value cues, where the accumulator first launches toward the incorrect action but is then re-routed to the correct one. This was clearly exhibited in electrophysiological signals reflecting motor preparation and evidence accumulation. Finally, we construct an extended model that implements this dynamic effect through plausible sensory neural response modulations and demonstrate the correspondence between decision signal dynamics simulated from a behavioral fit of that model and the empirical decision signals. Our findings suggest that value and sensory information can exert simultaneous and dynamically countervailing influences on the trajectory of the accumulation-to-bound process, driving rapid, sensory-guided actions.

The Pointing Errors in Optic Ataxia Reveal the Role of "Peripheral Magnification" of the PPC

Interaction with visual objects in the environment requires an accurate correspondence between visual space and its internal representation within the brain. Many clinical conditions involve some impairment in visuo-motor control and the errors created by the lesion of a specific brain region are neither random nor uninformative. Modern approaches to studying the neuropsychology of action require powerful data-driven analyses and error modeling in order to understand the function of the lesioned areas. In the present paper we carried out mixed-effect analyses of the pointing errors of seven optic ataxia patients and seven control subjects. We found that a small parameter set is sufficient to explain the pointing errors produced by unilateral optic ataxia patients. In particular, the extremely stereotypical errors made when pointing toward the contralesional visual field can be fitted by mathematical models similar to those used to model central magnification in cortical or sub-cortical structure(s). Our interpretation is that visual areas that contain this footprint of central magnification guide pointing movements when the posterior parietal cortex (PPC) is damaged and that the functional role of the PPC is to actively compensate for the under-representation of peripheral vision that accompanies central magnification. Optic ataxia misreaching reveals what would be hand movement accuracy and precision if the human motor system did not include elaborated corrective processes for reaching and grasping to non-foveated targets.

Ghosts in the decision machine

Humans and monkeys occasionally report the presence of a stimulus that has not occurred. A new study by Carnevale et al. (2015) sheds light on the nature and timing of the neural mechanisms that give rise to false detections.

Electrophysiological indices of surround suppression in humans

Surround suppression is a well-known example of contextual interaction in visual cortical neurophysiology, whereby the neural response to a stimulus presented within a neuron's classical receptive field is suppressed by surrounding stimuli. Human psychophysical reports present an obvious analog to the effects seen at the single-neuron level: stimuli are perceived as lower-contrast when embedded in a surround. Here we report on a visual paradigm that provides relatively direct, straightforward indices of surround suppression in human electrophysiology, enabling us to reproduce several well-known neurophysiological and psychophysical effects, and to conduct new analyses of temporal trends and retinal location effects. Steady-state visual evoked potentials (SSVEP) elicited by flickering "foreground" stimuli were measured in the context of various static surround patterns. Early visual cortex geometry and retinotopic organization were exploited to enhance SSVEP amplitude. The foreground response was strongly suppressed as a monotonic function of surround contrast. Furthermore, suppression was stronger for surrounds of matching orientation than orthogonally-oriented ones, and stronger at peripheral than foveal locations. These patterns were reproduced in psychophysical reports of perceived contrast, and peripheral electrophysiological suppression effects correlated with psychophysical effects across subjects. Temporal analysis of SSVEP amplitude revealed short-term contrast adaptation effects that caused the foreground signal to either fall or grow over time, depending on the relative contrast of the surround, consistent with stronger adaptation of the suppressive drive. This electrophysiology paradigm has clinical potential in indexing not just visual deficits but possibly gain control deficits expressed more widely in the disordered brain.

Adaptation of naturally paced saccades

In the natural environment, humans make saccades almost continuously. In many eye movement experiments, however, observers are required to fixate for unnaturally long periods of time. The resulting long and monotonous experimental sessions can become especially problematic when collecting data in a clinical setting, where time can be scarce and subjects easily fatigued. With this in mind, we tested whether the well-studied motor learning process of saccade adaptation could be induced with a dramatically shortened intertrial interval. Observers made saccades to targets that stepped left or right either ∼250 ms or ∼1,600 ms after the saccade landed. In experiment I, we tested baseline saccade parameters to four different target amplitudes (5°, 10°, 15°, and 20°) in the two timing settings. In experiments II and III, we adapted 10° saccades via 2° intrasaccadic steps either backwards or forwards, respectively. Seven subjects performed eight separate adaptation sessions (2 intertrial timings × 2 adaptation direction × 2 session trial lengths). Adaptation proceeded remarkably similarly in both timing conditions across the multiple sessions. In the faster-paced sessions, robust adaptation was achieved in under 2 min, demonstrating the efficacy of our approach to streamlining saccade adaptation experiments. Although saccade amplitudes were similar between conditions, the faster-paced condition unexpectedly resulted in significantly higher peak velocities in all subjects. This surprising finding demonstrates that the stereotyped "main sequence" relationship between saccade amplitude and peak velocity is not as fixed as originally thought.

Exploiting individual primary visual cortex geometry to boost steady state visual evoked potentials

OBJECTIVE

The steady-state visual evoked potential (SSVEP) is an electroencephalographic response to flickering stimuli generated partly in primary visual area V1. The typical 'cruciform' geometry and retinotopic organization of V1 is such that certain neighboring visual regions project to neighboring cortical regions of opposite orientation. Here, we explored ways to exploit this organization in order to boost scalp SSVEP amplitude via oscillatory summation.

APPROACH

We manipulated flicker-phase offsets among angular segments of a large annular stimulus in three ways, and compared the resultant SSVEP power to a conventional condition with no temporal phase offsets. (1) We divided the annulus into standard octants for all subjects, and flickered upper horizontal octants with opposite temporal phase to the lower horizontal ones, and left vertical octants opposite to the right vertical ones; (2) we individually adjusted the boundaries between the eight contiguous segments of the standard octants condition to coincide with cruciform-consistent, early-latency topographical shifts in pattern-pulse multifocal visual-evoked potentials (PPMVEP) derived for each of 32 equal-sized segments; (3) we assigned phase offsets to stimulus segments following an automatic algorithm based on the relative amplitudes of vertically- and horizontally-oriented PPMVEP components.

MAIN RESULTS

The three flicker-phase manipulations resulted in a significant enhancement of normalized SSVEP power of (1) 202%, (2) 383%, and (3) 300%, respectively.

SIGNIFICANCE

We have thus demonstrated a means to obtain more reliable measures of visual evoked activity purely through consideration of cortical geometry. This principle stands to impact both basic and clinical research using SSVEPs.

Right-hemispheric dominance for visual remapping in humans

We review evidence showing a right-hemispheric dominance for visuo-spatial processing and representation in humans. Accordingly, visual disorganization symptoms (intuitively related to remapping impairments) are observed in both neglect and constructional apraxia. More specifically, we review findings from the intervening saccade paradigm in humans--and present additional original data--which suggest a specific role of the asymmetrical network at the temporo-parietal junction (TPJ) in the right hemisphere in visual remapping: following damage to the right dorsal posterior parietal cortex (PPC) as well as part of the corpus callosum connecting the PPC to the frontal lobes, patient OK in a double-step saccadic task exhibited an impairment when the second saccade had to be directed rightward. This singular and lateralized deficit cannot result solely from the patient's cortical lesion and, therefore, we propose that it is due to his callosal lesion that may specifically interrupt the interhemispheric transfer of information necessary to execute accurate rightward saccades towards a remapped target location. This suggests a specialized right-hemispheric network for visuo-spatial remapping that subsequently transfers target location information to downstream planning regions, which are symmetrically organized.

Parietal modules for reaching

Optic ataxia (OA) is classically defined as a deficit of visually guided movements that follows lesions of the posterior part of the posterior parietal cortex (PPC). Since the formalisation of the double stream of visual information processing [Milner, A. D., & Goodale, M. A. (1995). The visual brain in action. Oxford: Oxford University Press] and the use of OA as an argument in favour of the involvement of the posterior parietal cortex (dorsal stream) in visually guided movements, many studies have looked at the visuomotor deficits of these patients. In parallel, the development of neuroimaging methods have led to increasing information about the role of the posterior parietal cortex in visually guided actions. In this article, we discuss the similarities and differences in the results that emerged from these two complementary viewpoints by combining a meta-analysis of neuroimaging data on reaching with lesion studies from OA patients and results of our own fMRI study on reaching in the ipsi- and contra-lateral visual field. We identified four bilateral parietal foci from the meta-analysis and found that the more posterior foci showed greater lateralisation for contralateral visual stimulation than more anterior ones Additionally, the more anterior foci showed greater lateralisation for the use of the contralateral hand than the more posterior ones. Therefore, we can demonstrate that they are organised along a postero-anterior gradient of visual-to-somatic information integration. Furthermore, from the combination of imaging and lesion data it can be inferred that a lesion of the three most posterior foci responsible for the target-hand integration could explain the hand and field effect revealed in OA reaching behaviour.

Deficits in peripheral visual attention in patients with optic ataxia

Earlier research has suggested that optic ataxia, a deficit in reaching in peripheral vision, can be isolated from Balint's syndrome as it is primarily a visuomotor disorder, independent of perceptual or attentional deficits. Yet almost no research has examined the attentional abilities of these patients. We examined peripheral visual attention in two patients with unilateral optic ataxia. Results indicated that both patients were slower to respond to targets in their ataxic visual field, irrespective of cuing condition (i.e. validly, invalidly, and no cue conditions), consistent with an overall decrease in the salience of stimuli in the ataxic field. Attentional deficits in peripheral vision are therefore an important factor to consider when examining visuomotor control deficits in optic ataxia.

Optic ataxia is not only 'optic': impaired spatial integration of proprioceptive information

Optic ataxia is considered to be a specific visuo-manual guidance deficit, which combines pointing errors due to the use of the contralesional hand ("hand effect") and to the presentation of the visual target in the contralesional field ("field effect"). The nature of the hand effect has not been identified. The field effect is acknowledged as an impaired spatial integration of visual target location. However, spatial integration of proprioceptive information from the arm has never been experimentally tested in these patients. Here, we specifically investigated the capacity of two patients with unilateral optic ataxia in tasks requiring different levels of proprioceptive integration from primary information processing to proprioceptivo-motor integration. In a first experiment -proprioceptive pointing with the ipsilesional hand toward the index finger of the contralesional hand- revealed a large mislocalisation of the ataxic hand accounting for the hand effect. In a second experiment -proprioceptive pointing with the ataxic arm toward the finger of the ipsilesional hand- revealed reaching errors for non-visual targets, i.e. optic ataxia is not specific to 'optic' targets. Altogether, the present results call for a redefinition of this neurological condition in the framework of parietal functions.

Do visual illusions probe the visual brain? Illusions in action without a dorsal visual stream

Visual illusions have been shown to affect perceptual judgements more so than motor behaviour, which was interpreted as evidence for a functional division of labour within the visual system. The dominant perception-action theory argues that perception involves a holistic processing of visual objects or scenes, performed within the ventral, inferior temporal cortex. Conversely, visuomotor action involves the processing of the 3D relationship between the goal of the action and the body, performed predominantly within the dorsal, posterior parietal cortex. We explored the effect of well-known visual illusions (a size-contrast illusion and the induced Roelofs effect) in a patient (IG) suffering bilateral lesions of the dorsal visual stream. According to the perception-action theory, IG's perceptual judgements and control of actions should rely on the intact ventral stream and hence should both be sensitive to visual illusions. The finding that IG performed similarly to controls in three different illusory contexts argues against such expectations and shows, furthermore, that the dorsal stream does not control all aspects of visuomotor behaviour. Assuming that the patient's dorsal stream visuomotor system is fully lesioned, these results suggest that her visually guided action can be planned and executed independently of the dorsal pathways, possibly through the inferior parietal lobule.