Behavioral detection of electrical microstimulation in different cortical visual areas

Comparison of electrical microstimulation artifact removal methods for high-channel-count prostheses

BACKGROUND

Neuroprostheses are used to electrically stimulate the brain, modulate neural activity and restore sensory and motor function following injury or disease, such as blindness, paralysis, and other movement and psychiatric disorders. Recordings are often made simultaneously with stimulation, allowing the monitoring of neural signals and closed-loop control of devices. However, stimulation-evoked artifacts may obscure neural activity, particularly when stimulation and recording sites are nearby. Several methods have been developed to remove stimulation artifacts, but it remains challenging to validate and compare these methods because the 'ground-truth' of the neuronal signals may be contaminated by artifacts.

NEW METHOD

Here, we delivered stimulation to the visual cortex via a high-channel-count prosthesis while recording neuronal activity and stimulation artifacts. We quantified the waveforms and temporal properties of stimulation artifacts from the cortical visual prosthesis (CVP) and used them to build a dataset, in which we simulated the neuronal activity and the stimulation artifacts. We illustrate how to use the simulated data to evaluate the performance of six software-based artifact removal methods (Template subtraction, Linear interpolation, Polynomial fitting, Exponential fitting, SALPA and ERAASR) in a CVP application scenario.

RESULTS

We here focused on stimulation artifacts caused by electrical stimulation through a high-channel-count cortical prosthesis device. We find that the Polynomial fitting and Exponential fitting methods outperform the other methods in recovering spikes and multi-unit activity. Linear interpolation and Template subtraction recovered the local-field potentials.

CONCLUSION

Polynomial fitting and Exponential fitting provided a good trade-off between the quality of the recovery of spikes and multi-unit activity (MUA) and the computational complexity for a cortical prosthesis.

Perceptography unveils the causal contribution of inferior temporal cortex to visual perception

Neurons in the inferotemporal (IT) cortex respond selectively to complex visual features, implying their role in object perception. However, perception is subjective and cannot be read out from neural responses; thus, bridging the causal gap between neural activity and perception demands independent characterization of perception. Historically, though, the complexity of the perceptual alterations induced by artificial stimulation of IT cortex has rendered them impossible to quantify. To address this old problem, we tasked male macaque monkeys to detect and report optical impulses delivered to their IT cortex. Combining machine learning with high-throughput behavioral optogenetics, we generated complex and highly specific images that were hard for the animal to distinguish from the state of being cortically stimulated. These images, named "perceptograms" for the first time, reveal and depict the contents of the complex hallucinatory percepts induced by local neural perturbation in IT cortex. Furthermore, we found that the nature and magnitude of these hallucinations highly depend on concurrent visual input, stimulation location, and intensity. Objective characterization of stimulation-induced perceptual events opens the door to developing a mechanistic theory of visual perception. Further, it enables us to make better visual prosthetic devices and gain a greater understanding of visual hallucinations in mental disorders.

The influence of cortical activity on perception depends on behavioral state and sensory context

The mechanistic link between neural circuit activity and behavior remains unclear. While manipulating cortical activity can bias certain behaviors and elicit artificial percepts, some tasks can still be solved when cortex is silenced or removed. Here, mice were trained to perform a visual detection task during which we selectively targeted groups of visually responsive and co-tuned neurons in L2/3 of primary visual cortex (V1) for two-photon photostimulation. The influence of photostimulation was conditional on two key factors: the behavioral state of the animal and the contrast of the visual stimulus. The detection of low-contrast stimuli was enhanced by photostimulation, while the detection of high-contrast stimuli was suppressed, but crucially, only when mice were highly engaged in the task. When mice were less engaged, our manipulations of cortical activity had no effect on behavior. The behavioral changes were linked to specific changes in neuronal activity. The responses of non-photostimulated neurons in the local network were also conditional on two factors: their functional similarity to the photostimulated neurons and the contrast of the visual stimulus. Functionally similar neurons were increasingly suppressed by photostimulation with increasing visual stimulus contrast, correlating with the change in behavior. Our results show that the influence of cortical activity on perception is not fixed, but dynamically and contextually modulated by behavioral state, ongoing activity and the routing of information through specific circuits.

Towards biologically plausible phosphene simulation for the differentiable optimization of visual cortical prostheses

Blindness affects millions of people around the world. A promising solution to restoring a form of vision for some individuals are cortical visual prostheses, which bypass part of the impaired visual pathway by converting camera input to electrical stimulation of the visual system. The artificially induced visual percept (a pattern of localized light flashes, or 'phosphenes') has limited resolution, and a great portion of the field's research is devoted to optimizing the efficacy, efficiency, and practical usefulness of the encoding of visual information. A commonly exploited method is non-invasive functional evaluation in sighted subjects or with computational models by using simulated prosthetic vision (SPV) pipelines. An important challenge in this approach is to balance enhanced perceptual realism, biologically plausibility, and real-time performance in the simulation of cortical prosthetic vision. We present a biologically plausible, PyTorch-based phosphene simulator that can run in real-time and uses differentiable operations to allow for gradient-based computational optimization of phosphene encoding models. The simulator integrates a wide range of clinical results with neurophysiological evidence in humans and non-human primates. The pipeline includes a model of the retinotopic organization and cortical magnification of the visual cortex. Moreover, the quantitative effects of stimulation parameters and temporal dynamics on phosphene characteristics are incorporated. Our results demonstrate the simulator's suitability for both computational applications such as end-to-end deep learning-based prosthetic vision optimization as well as behavioral experiments. The modular and open-source software provides a flexible simulation framework for computational, clinical, and behavioral neuroscientists working on visual neuroprosthetics.

A Fine-Scale and Minimally Invasive Marking Method for Use with Conventional Tungsten Microelectrodes

In neurophysiology, achieving precise correlation between physiological responses and anatomic structures is a significant challenge. Therefore, the accuracy of the electrode marking method is crucial. In this study, we describe a tungsten-deposition method, in which tungsten oxide is generated by applying biphasic current pulses to conventional tungsten electrodes. The electrical current used was 40-50 μA, which is similar to that used in electrical microstimulation experiments. The size of the markings ranged from 10 to 100 μm, corresponding to the size of the electrode tip, which is smaller than that of existing marking methods. Despite the small size of the markings, detection is easy as the marking appears in bright red under dark-field observation after Nissl staining. This marking technique resulted in low tissue damage and was maintained in vivo for at least two years. The feasibility of this method was tested in mouse and macaque brains.

Chronic stability of a neuroprosthesis comprising multiple adjacent Utah arrays in monkeys

Objective. Electrical stimulation of visual cortex via a neuroprosthesis induces the perception of dots of light ('phosphenes'), potentially allowing recognition of simple shapes even after decades of blindness. However, restoration of functional vision requires large numbers of electrodes, and chronic, clinical implantation of intracortical electrodes in the visual cortex has only been achieved using devices of up to 96 channels. We evaluated the efficacy and stability of a 1024-channel neuroprosthesis system in non-human primates (NHPs) over more than 3 years to assess its suitability for long-term vision restoration.Approach.We implanted 16 microelectrode arrays (Utah arrays) consisting of 8 × 8 electrodes with iridium oxide tips in the primary visual cortex (V1) and visual area 4 (V4) of two sighted macaques. We monitored the animals' health and measured electrode impedances and neuronal signal quality by calculating signal-to-noise ratios of visually driven neuronal activity, peak-to-peak voltages of the waveforms of action potentials, and the number of channels with high-amplitude signals. We delivered cortical microstimulation and determined the minimum current that could be perceived, monitoring the number of channels that successfully yielded phosphenes. We also examined the influence of the implant on a visual task after 2-3 years of implantation and determined the integrity of the brain tissue with a histological analysis 3-3.5 years post-implantation.Main results. The monkeys remained healthy throughout the implantation period and the device retained its mechanical integrity and electrical conductivity. However, we observed decreasing signal quality with time, declining numbers of phosphene-evoking electrodes, decreases in electrode impedances, and impaired performance on a visual task at visual field locations corresponding to implanted cortical regions. Current thresholds increased with time in one of the two animals. The histological analysis revealed encapsulation of arrays and cortical degeneration. Scanning electron microscopy on one array revealed degradation of IrOxcoating and higher impedances for electrodes with broken tips.Significance. Long-term implantation of a high-channel-count device in NHP visual cortex was accompanied by deformation of cortical tissue and decreased stimulation efficacy and signal quality over time. We conclude that improvements in device biocompatibility and/or refinement of implantation techniques are needed before future clinical use is feasible.

Behavioral optogenetics in nonhuman primates; a psychological perspective

Optogenetics has been a promising and developing technology in systems neuroscience throughout the past decade. It has been difficult though to reliably establish the potential behavioral effects of optogenetic perturbation of the neural activity in nonhuman primates. This poses a challenge on the future of optogenetics in humans as the concepts and technology need to be developed in nonhuman primates first. Here, I briefly summarize the viable approaches taken to improve nonhuman primate behavioral optogenetics, then focus on one approach: improvements in the measurement of behavior. I bring examples from visual behavior and show how the choice of method of measurement might conceal large behavioral effects. I will then discuss the "cortical perturbation detection" task in detail as an example of a sensitive task that can record the behavioral effects of optogenetic cortical stimulation with high fidelity. Finally, encouraged by the rich scientific landscape ahead of behavioral optogenetics, I invite technology developers to improve the chronically implantable devices designed for simultaneous neural recording and optogenetic intervention in nonhuman primates.

Neural Plasticity in Sensorimotor Brain-Machine Interfaces

Brain-machine interfaces (BMIs) aim to treat sensorimotor neurological disorders by creating artificial motor and/or sensory pathways. Introducing artificial pathways creates new relationships between sensory input and motor output, which the brain must learn to gain dexterous control. This review highlights the role of learning in BMIs to restore movement and sensation, and discusses how BMI design may influence neural plasticity and performance. The close integration of plasticity in sensory and motor function influences the design of both artificial pathways and will be an essential consideration for bidirectional devices that restore both sensory and motor function.

Image-dependence of the detectability of optogenetic stimulation in macaque inferotemporal cortex

Artificial activation of neurons in early visual areas induces perception of simple visual flashes.1,2 Accordingly, stimulation in high-level visual cortices is expected to induce perception of complex features.3,4 However, results from studies in human patients challenge this expectation. Stimulation rarely induces any detectable visual event, and never a complex one, in human subjects with closed eyes.2 Stimulation of the face-selective cortex in a human patient led to remarkable hallucinations only while the subject was looking at faces.5 In contrast, stimulations of color- and face-selective sites evoke notable hallucinations independent of the object being viewed.6 These anecdotal observations suggest that stimulation of high-level visual cortex can evoke perception of complex visual features, but these effects depend on the availability and content of visual input. In this study, we introduce a novel psychophysical task to systematically investigate characteristics of the perceptual events evoked by optogenetic stimulation of macaque inferior temporal (IT) cortex. We trained macaque monkeys to detect and report optogenetic impulses delivered to their IT cortices7,8,9 while holding fixation on object images. In a series of experiments, we show that detection of cortical stimulation is highly dependent on the choice of images presented to the eyes and it is most difficult when fixating on a blank screen. These findings suggest that optogenetic stimulation of high-level visual cortex results in easily detectable distortions of the concurrent contents of vision.

Behavioral detectability of optogenetic stimulation of inferior temporal cortex varies with the size of concurrently viewed objects

We have previously demonstrated that macaque monkeys can behaviorally detect a subtle optogenetic impulse delivered to their inferior temporal (IT) cortex. We have also shown that the ability to detect the cortical stimulation impulse varies depending on some characteristics of the visual images viewed at the time of brain stimulation, revealing the visual nature of the perceptual events induced by stimulation of the IT cortex. Here we systematically studied the effect of the size of viewed objects on behavioral detectability of optogenetic stimulation of the central IT cortex. Surprisingly, we found that behavioral detection of the same optogenetic impulse highly varies with the size of the viewed object images. Reduction of the object size in four steps from 8 to 1 degree of visual angle significantly decreased detection performance. These results show that identical stimulation impulses delivered to the same neural population induce variable perceptual events depending on the mere size of the objects viewed at the time of brain stimulation.

Effects of top-down influence suppression on behavioral and V1 neuronal contrast sensitivity functions in cats

To explore the relative contributions of higher-order and primary visual cortex (V1) to visual perception, we compared cats' behavioral and V1 neuronal contrast sensitivity functions (CSF) and threshold versus external noise contrast (TvC) functions before and after top-down influence of area 7 (A7) was modulated with transcranial direct current stimulation (tDCS). We found that suppressing top-down influence of A7 with cathode-tDCS, but not sham-tDCS, reduced behavioral and neuronal contrast sensitivity in the same range of spatial frequencies and increased behavioral and neuronal contrast thresholds in the same range of external noise levels. The neuronal CSF and TvC functions were highly correlated with their behavioral counterparts both before and after the top-down suppression. Analysis of TvC functions using the Perceptual Template Model (PTM) indicated that top-down influence of A7 increased both behavioral and V1 neuronal contrast sensitivity by reducing internal additive noise and the impact of external noise.

•

Top-down suppression lowers both behavioral and V1 neuronal CSF functions

•

Top-down suppression raises both behavioral and V1 neuronal TvC functions

•

The neuronal CSFs and TvCs are highly correlated with their behavioral counterparts

•

Top-down influence lowers internal additive noise and impact of external noise in V1

Percepts evoked by multi-electrode stimulation of human visual cortex

BACKGROUND

Direct electrical stimulation of early visual cortex evokes the perception of small spots of light known as phosphenes. Previous studies have examined the location, size, and brightness of phosphenes evoked by stimulation of single electrodes. While it has been envisioned that concurrent stimulation of many electrodes could be used as the basis for a visual cortical prosthesis, the percepts resulting from multi-electrode stimulation have not been fully characterized.

OBJECTIVE

To understand the rules governing perception of phosphenes evoked by multi-electrode stimulation of visual cortex.

METHODS

Multi-electrode stimulation was conducted in human epilepsy patients. We examined the number and spatial arrangement of phosphenes evoked by stimulation of individual multi-electrode groups (n = 8), and the ability of subjects to discriminate between the pattern of phosphenes generated by stimulation of different multi-electrode groups (n = 7).

RESULTS

Simultaneous stimulation of pairs of electrodes separated by greater than 4 mm tended to produce perception of two distinct phosphenes. Simultaneous stimulation of three electrodes gave rise to a consistent spatial pattern of phosphenes, but with significant variation in the absolute location, size, and orientation of that pattern perceived on each trial. Although multi-electrode stimulation did not produce perception of recognizable forms, subjects could use the pattern of phosphenes evoked by stimulation to perform simple discriminations.

CONCLUSIONS

The number of phosphenes produced by multi-electrode stimulation can be predicted using a model for spread of activity in early visual cortex, but there are additional subtle effects that must be accounted for.

Probing neural codes with two-photon holographic optogenetics

Optogenetics ushered in a revolution in how neuroscientists interrogate brain function. Because of technical limitations, the majority of optogenetic studies have used low spatial resolution activation schemes that limit the types of perturbations that can be made. However, neural activity manipulations at finer spatial scales are likely to be important to more fully understand neural computation. Spatially precise multiphoton holographic optogenetics promises to address this challenge and opens up many new classes of experiments that were not previously possible. More specifically, by offering the ability to recreate extremely specific neural activity patterns in both space and time in functionally defined ensembles of neurons, multiphoton holographic optogenetics could allow neuroscientists to reveal fundamental aspects of the neural codes for sensation, cognition and behavior that have been beyond reach. This Review summarizes recent advances in multiphoton holographic optogenetics that substantially expand its capabilities, highlights outstanding technical challenges and provides an overview of the classes of experiments it can execute to test and validate key theoretical models of brain function. Multiphoton holographic optogenetics could substantially accelerate the pace of neuroscience discovery by helping to close the loop between experimental and theoretical neuroscience, leading to fundamental new insights into nervous system function and disorder.

Shape perception via a high-channel-count neuroprosthesis in monkey visual cortex

Blindness affects 40 million people across the world. A neuroprosthesis could one day restore functional vision in the blind. We implanted a 1024-channel prosthesis in areas V1 and V4 of the visual cortex of monkeys and used electrical stimulation to elicit percepts of dots of light (called phosphenes) on hundreds of electrodes, the locations of which matched the receptive fields of the stimulated neurons. Activity in area V4 predicted phosphene percepts that were elicited in V1. We simultaneously stimulated multiple electrodes to impose visible patterns composed of a number of phosphenes. The monkeys immediately recognized them as simple shapes, motions, or letters. These results demonstrate the potential of electrical stimulation to restore functional, life-enhancing vision in the blind.

Mice Preferentially Use Increases in Cerebral Cortex Spiking to Detect Changes in Visual Stimuli

Whenever the retinal image changes, some neurons in visual cortex increase their rate of firing whereas others decrease their rate of firing. Linking specific sets of neuronal responses with perception and behavior is essential for understanding mechanisms of neural circuit computation. We trained mice of both sexes to perform visual detection tasks and used optogenetic perturbations to increase or decrease neuronal spiking primary visual cortex (V1). Perceptual reports were always enhanced by increments in V1 spike counts and impaired by decrements, even when increments and decrements in spiking were generated in the same neuronal populations. Moreover, detecting changes in cortical activity depended on spike count integration rather than instantaneous changes in spiking. Recurrent neural networks trained in the task similarly relied on increments in neuronal activity when activity has costs. This work clarifies neuronal decoding strategies used by cerebral cortex to translate cortical spiking into percepts that can be used to guide behavior.SIGNIFICANCE STATEMENT Visual responses in the primary visual cortex (V1) are diverse, in that neurons can be either excited or inhibited by the onset of a visual stimulus. We selectively potentiated or suppressed V1 spiking in mice while they performed contrast change detection tasks. In other experiments, excitation or inhibition was delivered to V1 independent of visual stimuli. Mice readily detected increases in V1 spiking while equivalent reductions in V1 spiking suppressed the probability of detection, even when increases and decreases in V1 spiking were generated in the same neuronal populations. Our data raise the striking possibility that only increments in spiking are used to render information to structures downstream of V1.

Focal Electrical Stimulation of Cortical Functional Networks

Traditional electrical stimulation of brain tissue typically affects relatively large volumes of tissue spanning multiple millimeters. This low spatial resolution stimulation results in nonspecific functional effects. In addition, a primary shortcoming of these designs was the failure to take advantage of inherent functional organization in the cerebral cortex. Here, we describe a new method to electrically stimulate the brain which achieves selective targeting of single feature-specific domains in visual cortex. We provide evidence that this paradigm achieves mesoscale, functional network-specificity, and intensity dependence in a way that mimics visual stimulation. Application of this approach to known feature domains (such as color, orientation, motion, and depth) in visual cortex may lead to important functional improvements in the specificity and sophistication of brain stimulation methods and has implications for visual cortical prosthetic design.

Mapping mesoscale cortical connectivity in monkey sensorimotor cortex with optical imaging and microstimulation

To map in vivo cortical circuitry at the mesoscale, we applied a novel approach to map interareal functional connectivity. Electrical intracortical microstimulation (ICMS) in conjunction with optical imaging of intrinsic signals (OIS) was used map functional connections in somatosensory cortical areas in anesthetized squirrel monkeys. ICMS produced activations that were focal and that displayed responses which were stimulation intensity dependent. ICMS in supragranular layers of Brodmann Areas 3b, 1, 2, 3a, and M1 evoked interareal activation patterns that were topographically appropriate and appeared consistent with known anatomical connectivity. Specifically, ICMS revealed Area 3b connections with Area 1; Area 1 connections with Areas 2 and 3a; Area 2 connections with Areas 1, 3a, and M1; Area 3a connections with Areas M1, 1, and 2; and M1 connections with Areas 3a, 1, and 2. These somatosensory connectivity patterns were reminiscent of feedforward patterns observed anatomically, although feedback contributions are also likely present. Further consistent with anatomical connectivity, intra-areal and intra-areal patterns of activation were patchy with patch sizes of 200-300 μm. In summary, ICMS with OIS is a novel approach for mapping interareal and intra-areal connections in vivo. Comparisons with feedforward and feedback anatomical connectivity are discussed.

Turning Touch into Perception

Many brain areas modulate their activity during vibrotactile tasks. The activity from these areas may code the stimulus parameters, stimulus perception, or perceptual reports. Here, we discuss findings obtained in behaving monkeys aimed to understand these processes. In brief, neurons from the somatosensory thalamus and primary somatosensory cortex (S1) only code the stimulus parameters during the stimulation periods. In contrast, areas downstream of S1 code the stimulus parameters during not only the task components but also perception. Surprisingly, the midbrain dopamine system is an actor not considered before in perception. We discuss the evidence that it codes the subjective magnitude of a sensory percept. The findings reviewed here may help us to understand where and how sensation transforms into perception in the brain.

A Role for the Superior Colliculus in Decision Criteria

Simple decisions arise from the evaluation of sensory evidence. But decisions are determined by more than just evidence. Individuals establish internal decision criteria that influence how they respond. Where or how decision criteria are established in the brain remains poorly understood. Here, we show that neuronal activity in the superior colliculus (SC) predicts changes in decision criteria. Using a novel "Yes-No" task that isolates changes in decision criterion from changes in decision sensitivity, and computing neuronal measures of sensitivity and criterion, we find that SC neuronal activity correlates with the decision criterion regardless of the location of the choice report. We also show that electrical manipulation of activity within the SC produces changes in decisions consistent with changes in decision criteria and are largely independent of the choice report location. Our correlational and causal results together provide strong evidence that SC activity signals the position of a decision criterion. VIDEO ABSTRACT.

Probing Sensory Readout via Combined Choice-Correlation Measures and Microstimulation Perturbation

It is controversial whether covariation between neuronal activity and perceptual choice (i.e., choice correlation) reflects the functional readout of sensory signals. Here, we combined choice-correlation measures and electrical microstimulation on a site-to-site basis in the medial superior temporal area (MST), middle temporal area (MT), and ventral intraparietal area (VIP) when macaques discriminated between motion directions in both fine and coarse tasks. Microstimulation generated comparable effects between tasks but heterogeneous effects across and within brain regions. Within the MST and MT, microstimulation significantly biased an animal's choice toward the sensory preference instead of choice-related signals of the stimulated units. This was particularly evident for sites with conflict preference of sensory and choice-related signals. In the VIP, microstimulation failed to produce significant effects in either task despite strong choice correlations presented in this area. Our results suggest that sensory readout may not be inferred from choice-related signals during perceptual decision-making tasks.

Regaining the senses of touch and movement

Artificially activating neurons in the cortex can make a tetraplegic patient feel naturalistic sensations of skin pressure and arm movement.

Single-Cell Stimulation in Barrel Cortex Influences Psychophysical Detection Performance

A single whisker stimulus elicits action potentials in a sparse subset of neurons in somatosensory cortex. The precise contribution of these neurons to the animal's perception of a whisker stimulus is unknown. Here we show that single-cell stimulation in rat barrel cortex of both sexes influences the psychophysical detection of a near-threshold whisker stimulus in a cell type-dependent manner, without affecting false alarm rate. Counterintuitively, stimulation of single fast-spiking putative inhibitory neurons increased detection performance. Single-cell stimulation of putative excitatory neurons failed to change detection performance, except for a small subset of deep-layer neurons that were highly sensitive to whisker stimulation and that had an unexpectedly strong impact on detection performance. These findings indicate that the perceptual impact of excitatory barrel cortical neurons relates to their firing response to whisker stimulation and that strong activity in a single highly sensitive neuron in barrel cortex can already enhance sensory detection. Our data suggest that sensory detection is based on a decoding mechanism that lends a disproportionally large weight to interneurons and to deep-layer neurons showing a strong response to sensory stimulation.SIGNIFICANCE STATEMENT Rat whisker somatosensory cortex contains a variety of neuronal cell types with distinct anatomical and physiological characteristics. How each of these different cell types contribute to the animal's perception of whisker stimuli is unknown. We explored this question by using a powerful electrophysiological stimulation technique that allowed us to target and stimulate single neurons with different sensory response types in whisker cortex. In awake, behaving animals, trained to detect whisker stimulation, only costimulation of single fast-spiking inhibitory neurons or single deep-layer excitatory neurons with strong responses to whisker stimulation enhanced detection performance. Our data demonstrate that single cortical neurons can have measurable impact on the detection of sensory stimuli and suggest a decoding mechanism based on select cell types.

Electrical Stimulation of Visual Cortex: Relevance for the Development of Visual Cortical Prosthetics

Electrical stimulation of the cerebral cortex is a powerful tool for exploring cortical function. Stimulation of early visual cortical areas is easily detected by subjects and produces simple visual percepts known as phosphenes. A device implanted in visual cortex that generates patterns of phosphenes could be used as a substitute for natural vision in blind patients. We review the possibilities and limitations of such a device, termed a visual cortical prosthetic. Currently, we can predict the location and size of phosphenes produced by stimulation of single electrodes. A functional prosthetic, however, must produce spatial temporal patterns of activity that will result in the perception of complex visual objects. Although stimulation of later visual cortical areas alone usually does not lead to a visual percept, it can alter visual perception and the performance of visual behaviors, and training subjects to use signals injected into these areas may be possible.

Attention Increases Spike Count Correlations between Visual Cortical Areas

Visual attention, which improves perception of attended locations or objects, has long been known to affect many aspects of the responses of neuronal populations in visual cortex. There are two nonmutually exclusive hypotheses concerning the neuronal mechanisms that underlie these perceptual improvements. The first hypothesis, that attention improves the information encoded by a population of neurons in a particular cortical area, has considerable physiological support. The second hypothesis is that attention improves perception by selectively communicating relevant visual information. This idea has been tested primarily by measuring interactions between neurons on very short timescales, which are mathematically nearly independent of neuronal interactions on longer timescales. We tested the hypothesis that attention changes the way visual information is communicated between cortical areas on longer timescales by recording simultaneously from neurons in primary visual cortex (V1) and the middle temporal area (MT) in rhesus monkeys. We used two independent and complementary approaches. Our correlative experiment showed that attention increases the trial-to-trial response variability that is shared between the two areas. In our causal experiment, we electrically microstimulated V1 and found that attention increased the effect of stimulation on MT responses. Together, our results suggest that attention affects both the way visual stimuli are encoded within a cortical area and the extent to which visual information is communicated between areas on behaviorally relevant timescales.

SIGNIFICANCE STATEMENT

Visual attention dramatically improves the perception of attended stimuli. Attention has long been thought to act by selecting relevant visual information for further processing. It has been hypothesized that this selection is accomplished by increasing communication between neurons that encode attended information in different cortical areas. We recorded simultaneously from neurons in primary visual cortex and the middle temporal area while rhesus monkeys performed an attention task. We found that attention increased shared variability between neurons in the two areas and that attention increased the effect of microstimulation in V1 on the firing rates of MT neurons. Our results provide support for the hypothesis that attention increases communication between neurons in different brain areas on behaviorally relevant timescales.

Distinct Feedforward and Feedback Effects of Microstimulation in Visual Cortex Reveal Neural Mechanisms of Texture Segregation

The visual cortex is hierarchically organized, with low-level areas coding for simple features and higher areas for complex ones. Feedforward and feedback connections propagate information between areas in opposite directions, but their functional roles are only partially understood. We used electrical microstimulation to perturb the propagation of neuronal activity between areas V1 and V4 in monkeys performing a texture-segregation task. In both areas, microstimulation locally caused a brief phase of excitation, followed by inhibition. Both these effects propagated faithfully in the feedforward direction from V1 to V4. Stimulation of V4, however, caused little V1 excitation, but it did yield a delayed suppression during the late phase of visually driven activity. This suppression was pronounced for the V1 figure representation and weaker for background representations. Our results reveal functional differences between feedforward and feedback processing in texture segregation and suggest a specific modulating role for feedback connections in perceptual organization.

A computational model that predicts behavioral sensitivity to intracortical microstimulation

OBJECTIVE

Intracortical microstimulation (ICMS) is a powerful tool to investigate the neural mechanisms of perception and can be used to restore sensation for patients who have lost it. While sensitivity to ICMS has previously been characterized, no systematic framework has been developed to summarize the detectability of individual ICMS pulse trains or the discriminability of pairs of pulse trains.

APPROACH

We develop a simple simulation that describes the responses of a population of neurons to a train of electrical pulses delivered through a microelectrode. We then perform an ideal observer analysis on the simulated population responses to predict the behavioral performance of non-human primates in ICMS detection and discrimination tasks.

MAIN RESULTS

Our computational model can predict behavioral performance across a wide range of stimulation conditions with high accuracy (R ² = 0.97) and generalizes to novel ICMS pulse trains that were not used to fit its parameters. Furthermore, the model provides a theoretical basis for the finding that amplitude discrimination based on ICMS violates Weber's law.

SIGNIFICANCE

The model can be used to characterize the sensitivity to ICMS across the range of perceptible and safe stimulation regimes. As such, it will be a useful tool for both neuroscience and neuroprosthetics.

Transient Pupil Dilation after Subsaccadic Microstimulation of Primate Frontal Eye Fields

Pupillometry provides a simple and noninvasive index for a variety of cognitive processes, including perception, attention, task consolidation, learning, and memory. The neural substrates by which such cognitive processes influence pupil diameter remain somewhat unclear, although cortical inputs to the locus coeruleus mediating arousal are likely involved. Changes in pupil diameter also accompany covert orienting; hence the oculomotor system may provide an alternative substrate for cognitive influences on pupil diameter. Here, we show that low-level electrical microstimulation of the primate frontal eye fields (FEFs), a cortical component of the oculomotor system strongly connected to the intermediate layers of the superior colliculus (SCi), evoked robust pupil dilation even in the absence of evoked saccades. The magnitude of such dilation scaled with increases in stimulation parameters, depending strongly on the intensity and number of pulses. Although there are multiple pathways by which FEF stimulation could cause pupil dilation, the timing and profile of dilation closely resembled that evoked by SCi stimulation. Moreover, pupil dilation evoked from the FEFs increased when presumed oculomotor activity was higher at the time of stimulation. Our findings implicate the oculomotor system as a potential substrate for how cognitive processes can influence pupil diameter. We suggest that a pathway from the frontal cortex through the SCi operates in parallel with frontal inputs to arousal circuits to regulate task-dependent modulation of pupil diameter, perhaps indicative of an organization wherein one pathway assumes primacy for a given cognitive process.

SIGNIFICANCE STATEMENT

Pupillometry (the measurement of pupil diameter) provides a simple and noninvasive index for a variety of cognitive processes, offering a biomarker that has value in both health and disease. But how do cognitive processes influence pupil diameter? Here, we show that low-level stimulation of the primate frontal eye fields can induce robust pupil dilation without saccades. Pupil dilation scaled with the number and intensity of stimulation pulses and varied with endogenous oculomotor activity at the time of stimulation. The oculomotor system therefore provides a plausible pathway by which cognitive processes may influence pupil diameter, perhaps operating in conjunction with systems regulating arousal.

Playing the electric light orchestra--how electrical stimulation of visual cortex elucidates the neural basis of perception

Vision research has the potential to reveal fundamental mechanisms underlying sensory experience. Causal experimental approaches, such as electrical microstimulation, provide a unique opportunity to test the direct contributions of visual cortical neurons to perception and behaviour. But in spite of their importance, causal methods constitute a minority of the experiments used to investigate the visual cortex to date. We reconsider the function and organization of visual cortex according to results obtained from stimulation techniques, with a special emphasis on electrical stimulation of small groups of cells in awake subjects who can report their visual experience. We compare findings from humans and monkeys, striate and extrastriate cortex, and superficial versus deep cortical layers, and identify a number of revealing gaps in the ‘causal map′ of visual cortex. Integrating results from different methods and species, we provide a critical overview of the ways in which causal approaches have been used to further our understanding of circuitry, plasticity and information integration in visual cortex. Electrical stimulation not only elucidates the contributions of different visual areas to perception, but also contributes to our understanding of neuronal mechanisms underlying memory, attention and decision-making.

The difference between electrical microstimulation and direct electrical stimulation – towards new opportunities for innovative functional brain mapping?

Both electrical microstimulation (EMS) and direct electrical stimulation (DES) of the brain are used to perform functional brain mapping. EMS is applied to animal fundamental neuroscience experiments, whereas DES is performed in the operating theatre on neurosurgery patients. The objective of the present review was to shed new light on electrical stimulation techniques in brain mapping by comparing EMS and DES. There is much controversy as to whether the use of DES during wide-awake surgery is the ‘gold standard’ for studying the brain function. As part of this debate, it is sometimes wrongly assumed that EMS and DES induce similar effects in the nervous tissues and have comparable behavioural consequences. In fact, the respective stimulation parameters in EMS and DES are clearly different. More surprisingly, there is no solid biophysical rationale for setting the stimulation parameters in EMS and DES; this may be due to historical, methodological and technical constraints that have limited the experimental protocols and prompted the use of empirical methods. In contrast, the gap between EMS and DES highlights the potential for new experimental paradigms in electrical stimulation for functional brain mapping. In view of this gap and recent technical developments in stimulator design, it may now be time to move towards alternative, innovative protocols based on the functional stimulation of peripheral nerves (for which a more solid theoretical grounding exists).

Microelectrode array stimulation combined with intrinsic optical imaging: A novel tool for functional brain mapping

BACKGROUND

Functional brain mapping via cortical microstimulation is a widely used clinical and experimental tool. However, data are traditionally collected point by point, making the technique very time consuming. Moreover, even in skilled hands, consistent penetration depths are difficult to achieve. Finally, the effects of microstimulation are assessed behaviorally, with no attempt to capture the activity of the local cortical circuits being stimulated.

NEW METHOD

We propose a novel method for functional brain mapping, which combines the use of a microelectrode array with intrinsic optical imaging. The precise spacing of electrodes allows for fast, accurate mapping of the area of interest in a regular grid. At the same time, the optical window allows for visualization of local neural connections when stimulation is combined with intrinsic optical imaging.

RESULTS

We demonstrate the efficacy of our technique using the primate motor cortex as a sample application, using a combination of microstimulation, imaging and electrophysiological recordings during wakefulness and under anesthesia. Comparison with current method: We find the data collected with our method is consistent with previous data published by others. We believe that our approach enables data to be collected faster and in a more consistent fashion and makes possible a number of studies that would be difficult to carry out with the traditional approach.

CONCLUSIONS

Our technique allows for simultaneous modulation and imaging of cortical sensorimotor networks in wakeful subjects over multiple sessions which is highly desirable for both the study of cortical organization and the design of brain machine interfaces.

Behavioral assessment of sensitivity to intracortical microstimulation of primate somatosensory cortex

Intracortical microstimulation (ICMS) is a powerful tool to investigate the functional role of neural circuits and may provide a means to restore sensation for patients for whom peripheral stimulation is not an option. In a series of psychophysical experiments with nonhuman primates, we investigate how stimulation parameters affect behavioral sensitivity to ICMS. Specifically, we deliver ICMS to primary somatosensory cortex through chronically implanted electrode arrays across a wide range of stimulation regimes. First, we investigate how the detectability of ICMS depends on stimulation parameters, including pulse width, frequency, amplitude, and pulse train duration. Then, we characterize the degree to which ICMS pulse trains that differ in amplitude lead to discriminable percepts across the range of perceptible and safe amplitudes. We also investigate how discriminability of pulse amplitude is modulated by other stimulation parameters-namely, frequency and duration. Perceptual judgments obtained across these various conditions will inform the design of stimulation regimes for neuroscience and neuroengineering applications.

Intracortical Microstimulation Parameters Dictate the Amplitude and Latency of Evoked Responses

BACKGROUND

Microstimulation of brain tissue plays a key role in a variety of sensory prosthetics, clinical therapies and research applications. However, the effects of stimulation parameters on the responses they evoke remain widely unknown.

OBJECTIVE

We aimed to investigate the contribution of each stimulation parameter to the response and identify interactions existing between parameters.

METHODS

Parameters of the constant-current, biphasic square waveform were examined in acute terminal experiments under ketamine anaesthesia. The motor cortex of 7 Sprague-Dawley rats was stimulated while recording motor evoked potentials (MEP) from the forelimb. Intracortical microstimulation (ICMS) parameters were systematically tested in a pair-wise fashion to observe the influence of each parameter on the amplitude and latency of the MEP.

RESULTS

The amplitude of the MEP increased continually with stimulus amplitude (p < 0.001) and pulse duration (p = 0.001) throughout the range tested. Increases were also observed when stimuli were raised from low to moderate values of frequency (p = 0.022) and train duration (p = 0.045), after which no further excitation occurs. The latency of MEP initiation decreased when stimulus amplitude (p = 0.037) and frequency (p = 0.001) were raised from low to moderate values, after which the responses plateaued. MEP latencies were further reduced by increasing the pulse duration (p = 0.011), but train duration had no effect.

CONCLUSIONS

Our data indicate that MEP amplitude and onset latency can be modulated by alterations to a number of stimulus parameters, even in restrictive paradigms, and suggest that the parameters of the standard ICMS signal used for evoking movements from the motor cortex can be further optimized.

In Vivo Mapping of Cortical Columnar Networks in the Monkey with Focal Electrical and Optical Stimulation

There are currently largescale efforts to understand the brain as a connection machine. However, there has been little emphasis on understanding connection patterns between functionally specific cortical columns. Here, we review development and application of focal electrical and optical stimulation methods combined with optical imaging and fMRI mapping in the non-human primate. These new approaches, when applied systematically on a large scale, will elucidate functionally specific intra-areal and inter-areal network connection patterns. Such functionally specific network data can provide accurate views of brain network topology.

Understanding the brain by controlling neural activity

Causal methods to interrogate brain function have been employed since the advent of modern neuroscience in the nineteenth century. Initially, randomly placed electrodes and stimulation of parts of the living brain were used to localize specific functions to these areas. Recent technical developments have rejuvenated this approach by providing more precise tools to dissect the neural circuits underlying behaviour, perception and cognition. Carefully controlled behavioural experiments have been combined with electrical devices, targeted genetically encoded tools and neurochemical approaches to manipulate information processing in the brain. The ability to control brain activity in these ways not only deepens our understanding of brain function but also provides new avenues for clinical intervention, particularly in conditions where brain processing has gone awry.

Detection of optogenetic stimulation in somatosensory cortex by non-human primates--towards artificial tactile sensation

Neuroprosthesis research aims to enable communication between the brain and external assistive devices while restoring lost functionality such as occurs from stroke, spinal cord injury or neurodegenerative diseases. In future closed-loop sensorimotor prostheses, one approach is to use neuromodulation as direct stimulus to the brain to compensate for a lost sensory function and help the brain to integrate relevant information for commanding external devices via, e.g. movement intention. Current neuromodulation techniques rely mainly of electrical stimulation. Here we focus specifically on the question of eliciting a biomimetically relevant sense of touch by direct stimulus of the somatosensory cortex by introducing optogenetic techniques as an alternative to electrical stimulation. We demonstrate that light activated opsins can be introduced to target neurons in the somatosensory cortex of non-human primates and be optically activated to create a reliably detected sensation which the animal learns to interpret as a tactile sensation localized within the hand. The accomplishment highlighted here shows how optical stimulation of a relatively small group of mostly excitatory somatosensory neurons in the nonhuman primate brain is sufficient for eliciting a useful sensation from data acquired by simultaneous electrophysiology and from behavioral metrics. In this first report to date on optically neuromodulated behavior in the somatosensory cortex of nonhuman primates we do not yet dissect the details of the sensation the animals exerience or contrast it to those evoked by electrical stimulation, issues of considerable future interest.

Modifying cognition and behavior with electrical microstimulation: implications for cognitive prostheses

A fundamental goal of cognitive neuroscience is to understand how brain activity generates complex mental states and behaviors. While neuronal activity may predict or correlate with behavioral responses in a cognitive task, the use of electrical microstimulation presents the possibility to augment such correlational findings with direct evidence for causal relationships. Although microstimulation has been used for many years as a tool for mapping sensory and motor function, its role in learning, memory and decision-making has emerged only recently. Focal microstimulation of higher cortical areas can produce complex mental states and sequences of action. However, the relationship between the locus of stimulation and the percepts or actions evoked is often stereotyped and inflexible. The challenge is to develop stimulation systems that do not have fixed output but can flexibly contribute to complex cognitive and behavioral tasks. We discuss how microstimulation has been instrumental in manipulating a wide spectrum of cognitive functions including working memory, perceptual decisions and executive control by enhancing attention, re-ordering temporal sequence of saccades, improving associative learning or cognitive performance. For example, stimulation in prefrontal, parietal and sensory cortices may establish causal effects on decision-making, while microstimulation of inferotemporal cortex or caudate nucleus enhances associative learning. Building cognitive prosthetics based on the insights gleaned from such studies may depend on the development of multiple-input, multiple-output (MIMO) devices that allow subjects to control stimulation with their own thoughts in a closed-loop system.

Effects of cortical microstimulation on confidence in a perceptual decision

Decisions are often associated with a degree of certainty, or confidence--an estimate of the probability that the chosen option will be correct. Recent neurophysiological results suggest that the central processing of evidence leading to a perceptual decision also establishes a level of confidence. Here we provide a causal test of this hypothesis by electrically stimulating areas of the visual cortex involved in motion perception. Monkeys discriminated the direction of motion in a noisy display and were sometimes allowed to opt out of the direction choice if their confidence was low. Microstimulation did not reduce overall confidence in the decision but instead altered confidence in a manner that mimicked a change in visual motion, plus a small increase in sensory noise. The results suggest that the same sensory neural signals support choice, reaction time, and confidence in a decision and that artificial manipulation of these signals preserves the quantitative relationship between accumulated evidence and confidence.

Cortical neural populations can guide behavior by integrating inputs linearly, independent of synchrony

Neurons are sensitive to the relative timing of inputs, both because several inputs must coincide to reach spike threshold and because active dendritic mechanisms can amplify synchronous inputs. To determine if input synchrony can influence behavior, we trained mice to report activation of excitatory neurons in visual cortex using channelrhodopsin-2. We used light pulses that varied in duration from a few milliseconds to 100 ms and measured neuronal responses and animals' detection ability. We found detection performance was well predicted by the total amount of light delivered. Short pulses provided no behavioral advantage, even when they concentrated evoked spikes into an interval a few milliseconds long. Arranging pulses into trains of varying frequency from beta to gamma also produced no behavioral advantage. Light intensities required to drive behavior were low (at low intensities, channelrhodopsin-2 conductance varies linearly with intensity), and the accompanying changes in firing rate were small (over 100 ms, average change: 1.1 spikes per s). Firing rate changes varied linearly with pulse intensity and duration, and behavior was predicted by total spike count independent of temporal arrangement. Thus, animals' detection performance reflected the linear integration of total input over 100 ms. This behavioral linearity despite neurons' nonlinearities can be explained by a population code using noisy neurons. Ongoing background activity creates probabilistic spiking, allowing weak inputs to change spike probability linearly, with little amplification of coincident input. Summing across a population then yields a total spike count that weights inputs equally, regardless of their arrival time.

Saccade modulation by optical and electrical stimulation in the macaque frontal eye field

Recent studies have demonstrated that strong neural modulations can be evoked with optogenetic stimulation in macaque motor cortex without observing any evoked movements (Han et al., 2009, 2011; Diester et al., 2011). It remains unclear why such perturbations do not generate movements and if conditions exist under which they may evoke movements. In this study, we examine the effects of five optogenetic constructs in the macaque frontal eye field and use electrical microstimulation to assess whether optical perturbation of the local network leads to observable motor changes during optical, electrical, and combined stimulation. We report a significant increase in the probability of evoking saccadic eye movements when low current electrical stimulation is coupled to optical stimulation compared with when electrical stimulation is used alone. Experiments combining channelrhodopsin 2 (ChR2) and electrical stimulation with simultaneous fMRI revealed no discernible fMRI activity at the electrode tip with optical stimulation but strong activity with electrical stimulation. Our findings suggest that stimulation with current ChR2 optogenetic constructs generates subthreshold activity that contributes to the initiation of movements but, in most cases, is not sufficient to evoke a motor response.

Optical imaging of cortical networks via intracortical microstimulation

Understanding cortical organization is key to understanding brain function. Distinct neural networks underlie the functional organization of the cerebral cortex; however, little is known about how different nodes in the cortical network interact during perceptual processing and motor behavior. To study cortical network function we examined whether the optical imaging of intrinsic signals (OIS) reveals the functional patterns of activity evoked by electrical cortical microstimulation. We examined the effects of current amplitude, train duration, and depth of cortical stimulation on the hemodynamic response to electrical microstimulation (250-Hz train, 0.4-ms pulse duration) in anesthetized New World monkey somatosensory cortex. Electrical stimulation elicited a restricted cortical response that varied according to stimulation parameters and electrode depth. Higher currents of stimulation recruited more areas of cortex than smaller currents. The largest cortical responses were seen when stimulation was delivered around cortical layer 4. Distinct local patches of activation, highly suggestive of local projections, around the site of stimulation were observed at different depths of stimulation. Thus we find that specific electrical stimulation parameters can elicit activation of single cortical columns and their associated columnar networks, reminiscent of anatomically labeled networks. This novel functional tract tracing method will open new avenues for investigating relationships of local cortical organization.

Electrical induction of vision

We assess what monkeys see during electrical stimulation of primary visual cortex (area V1) and relate the findings to visual percepts evoked electrically from human V1. Discussed are: (1) the electrical, cytoarchitectonic, and visuo-behavioural factors that affect the ability of monkeys to detect currents in V1; (2) the methods used to ascertain what monkeys see when electrical stimulation is delivered to V1; (3) a corticofugal mechanism for the induction of visual percepts; and (4) the quantity of information transferred to V1 by electrical stimulation. Experiments are proposed that should advance our understanding of how electrical stimulation affects macaque and human V1. This work contributes to the development of a cortical visual prosthesis for the blind. We dedicate this work to the late Robert W. Doty.

Spatial and temporal characteristics of V1 microstimulation during chronic implantation of a microelectrode array in a behaving macaque

OBJECTIVE

It has been hypothesized that a vision prosthesis capable of evoking useful visual percepts can be based upon electrically stimulating the primary visual cortex (V1) of a blind human subject via penetrating microelectrode arrays. As a continuation of earlier work, we examined several spatial and temporal characteristics of V1 microstimulation.

APPROACH

An array of 100 penetrating microelectrodes was chronically implanted in V1 of a behaving macaque monkey. Microstimulation thresholds were measured using a two-alternative forced choice detection task. Relative locations of electrically-evoked percepts were measured using a memory saccade-to-target task.

MAIN RESULTS

The principal finding was that two years after implantation we were able to evoke behavioural responses to electric stimulation across the spatial extent of the array using groups of contiguous electrodes. Consistent responses to stimulation were evoked at an average threshold current per electrode of 204 ± 49 µA (mean ± std) for groups of four electrodes and 91 ± 25 µA for groups of nine electrodes. Saccades to electrically-evoked percepts using groups of nine electrodes showed that the animal could discriminate spatially distinct percepts with groups having an average separation of 1.6 ± 0.3 mm (mean ± std) in cortex and 1.0° ± 0.2° in visual space. Significance. These results demonstrate chronic perceptual functionality and provide evidence for the feasibility of a cortically-based vision prosthesis for the blind using penetrating microelectrodes.

Are hemianopic monkeys and a human hemianope aware of visual events in the blind field?

In three hemianopic monkeys and one normal monkey who subsequently became hemianopic and in one human hemianope we measured reaction times to touch the remembered position of a brief visual target presented in the normal hemifield or in the blind hemifield, or on the blank trials where no visual target occurred and the correct response was to touch a separate and permanently outlined part of the display. This is the same procedure as first used to demonstrate blindsight in these hemianopic monkeys. In the present experiment physically salient high-contrast (0.95) grating stimuli, which we have previously shown are easily detected and localized in the blind field, were used, and the monkeys' reaction times were also measured. With rare exceptions the monkeys indicated that the visual targets in the blind field were blanks, but their otherwise identical motor responses to targets and blanks had significantly different latencies, which were longer for real targets than for blanks. The results indicate that when the monkeys detect that the stimulus has occurred but do not perceive it as a light, or are just guessing, reaction times are longer. Even when the target in the blind field was moving, it was categorized as a blank. In the human hemianope both high- and low-contrast stimuli were used, and the subject had to indicate whether he had been 'aware' or 'unaware' of the target, after making the reaching response. The latencies when he was correct and aware were significantly shorter than when he was unaware and 'just guessing'. However, he was also significantly faster to respond correctly to the blind-field target when he was unaware and correct than when he was unaware and incorrect, a difference reflected in his percentage correct scores even when totally unaware. Collectively, the results support the notion that the hemianopic monkeys, like the human hemianope, know that something has happened in the blind field as long as the stimuli are physically salient even though the stimuli are categorized as blanks, presumably because, like the human hemianope, there was no phenomenal visual percept.