Percepts evoked by multi-electrode stimulation of human visual cortex

Optimal placement of high-channel visual prostheses in human retinotopic visual cortex

Objective.Recent strides in neurotechnology show potential to restore vision in individuals with visual impairments due to early visual pathway damage. As neuroprostheses mature and become available to a larger population, manual placement and evaluation of electrode designs become costly and impractical. An automatic method to simulate and optimize the implantation process of electrode arrays at large-scale is currently lacking.Approach.Here, we present a comprehensive method to automatically optimize electrode placement for visual prostheses, with the objective of matching predefined phosphene distributions. Our approach makes use of retinotopic predictions combined with individual anatomy data to minimize discrepancies between simulated and target phosphene patterns. While demonstrated with a 1000-channel 3D electrode array in V1, our simulation pipeline is versatile, potentially accommodating any electrode design and allowing for design evaluation.Main results.Notably, our results show that individually optimized placements in 362 brain hemispheres outperform average brain solutions, underscoring the significance of anatomical specificity. We further show how virtual implantation of multiple individual brains highlights the challenges of achieving full visual field coverage owing to single electrode constraints, which may be overcome by introducing multiple arrays of electrodes. Including additional surgical considerations, such as intracranial vasculature, in future iterations could refine the optimization process.Significance.Our open-source software streamlines the refinement of surgical procedures and facilitates simulation studies, offering a realistic exploration of electrode configuration possibilities.

Selective activation of mesoscale functional circuits via multichannel infrared stimulation of cortical columns in ultra-high-field 7T MRI

To restore vision in the blind, advances in visual cortical prosthetics (VCPs) have offered high-channel-count electrical interfaces. Here, we design a 100-fiber optical bundle interface apposed to known feature-specific (color, shape, motion, and depth) functional columns that populate the visual cortex in humans, primates, and cats. Based on a non-viral optical stimulation method (INS, infrared neural stimulation; 1,875 nm), it can deliver dynamic patterns of stimulation, is non-penetrating and non-damaging to tissue, and is movable and removable. In addition, its magnetic resonance (MR) compatibility (INS-fMRI) permits systematic mapping of brain-wide circuits. In the MRI, we illustrate (1) the single-point activation of functionally specific networks, (2) shifting cortical networks activated via shifting points of stimulation, and (3) "moving dot" stimulation-evoked activation of higher-order motion-selective areas. We suggest that, by mimicking patterns of columnar activation normally activated by visual stimuli, a columnar VCP opens doors for the planned activation of feature-specific circuits and their associated visual percepts.

Longitudinal stability of individual brain plasticity patterns in blindness

The primary visual cortex (V1) in blindness is engaged in a wide spectrum of tasks and sensory modalities, including audition, touch, language, and memory. This widespread involvement raises questions regarding the constancy of its role and whether it might exhibit flexibility in its function over time, connecting to diverse network functions specific to task demands. This would suggest that reorganized V1 assumes a role like multiple-demand system regions. Alternatively, varying patterns of plasticity in blind V1 may be attributed to individual factors, with different blind individuals recruiting V1 preferentially for different functions. In support of this, we recently showed that V1 functional connectivity (FC) varies greatly across blind individuals. But do these represent stable individual patterns of plasticity, or are they driven more by instantaneous changes, like a multiple-demand system now inhabiting V1? Here, we tested whether individual FC patterns from the V1 of blind individuals are stable over time. We show that over two years, FC from the V1 is unique and highly stable in a small sample of repeatedly sampled congenitally blind individuals. Further, using multivoxel pattern analysis, we demonstrate that the unique reorganization patterns of these individuals allow decoding of participant identity. Together with recent evidence for substantial individual differences in V1 connectivity, this indicates that there may be a consistent role for V1 in blindness, which may differ for each individual. Further, it suggests that the variability in visual reorganization in blindness across individuals could be used to seek stable neuromarkers for sight rehabilitation and assistive approaches.

A novel interface for cortical columnar neuromodulation with multipoint infrared neural stimulation

Cutting edge advances in electrical visual cortical prosthetics have evoked perception of shapes, motion, and letters in the blind. Here, we present an alternative optical approach using pulsed infrared neural stimulation. To interface with dense arrays of cortical columns with submillimeter spatial precision, both linear array and 100-fiber bundle array optical fiber interfaces were devised. We deliver infrared stimulation through these arrays in anesthetized cat visual cortex and monitor effects by optical imaging in contralateral visual cortex. Infrared neural stimulation modulation of response to ongoing visual oriented gratings produce enhanced responses in orientation-matched domains and suppressed responses in non-matched domains, consistent with a known higher order integration mediated by callosal inputs. Controls include dynamically applied speeds, directions and patterns of multipoint stimulation. This provides groundwork for a distinct type of prosthetic targeted to maps of visual cortical columns.

Comparison of electrical microstimulation artifact removal methods for high-channel-count prostheses

BACKGROUND

Neuroprostheses are used to electrically stimulate the brain, modulate neural activity and restore sensory and motor function following injury or disease, such as blindness, paralysis, and other movement and psychiatric disorders. Recordings are often made simultaneously with stimulation, allowing the monitoring of neural signals and closed-loop control of devices. However, stimulation-evoked artifacts may obscure neural activity, particularly when stimulation and recording sites are nearby. Several methods have been developed to remove stimulation artifacts, but it remains challenging to validate and compare these methods because the 'ground-truth' of the neuronal signals may be contaminated by artifacts.

NEW METHOD

Here, we delivered stimulation to the visual cortex via a high-channel-count prosthesis while recording neuronal activity and stimulation artifacts. We quantified the waveforms and temporal properties of stimulation artifacts from the cortical visual prosthesis (CVP) and used them to build a dataset, in which we simulated the neuronal activity and the stimulation artifacts. We illustrate how to use the simulated data to evaluate the performance of six software-based artifact removal methods (Template subtraction, Linear interpolation, Polynomial fitting, Exponential fitting, SALPA and ERAASR) in a CVP application scenario.

RESULTS

We here focused on stimulation artifacts caused by electrical stimulation through a high-channel-count cortical prosthesis device. We find that the Polynomial fitting and Exponential fitting methods outperform the other methods in recovering spikes and multi-unit activity. Linear interpolation and Template subtraction recovered the local-field potentials.

CONCLUSION

Polynomial fitting and Exponential fitting provided a good trade-off between the quality of the recovery of spikes and multi-unit activity (MUA) and the computational complexity for a cortical prosthesis.

A virtual patient simulation modeling the neural and perceptual effects of human visual cortical stimulation, from pulse trains to percepts

The field of cortical sight restoration prostheses is making rapid progress with three clinical trials of visual cortical prostheses underway. However, as yet, we have only limited insight into the perceptual experiences produced by these implants. Here we describe a computational model or 'virtual patient', based on the neurophysiological architecture of V1, which successfully predicts the perceptual experience of participants across a wide range of previously published human cortical stimulation studies describing the location, size, brightness and spatiotemporal shape of electrically induced percepts in humans. Our simulations suggest that, in the foreseeable future the perceptual quality of cortical prosthetic devices is likely to be limited by the neurophysiological organization of visual cortex, rather than engineering constraints.

Evoking artificial speech perception through invasive brain stimulation for brain-computer interfaces: current challenges and future perspectives

Encoding artificial perceptions through brain stimulation, especially that of higher cognitive functions such as speech perception, is one of the most formidable challenges in brain-computer interfaces (BCI). Brain stimulation has been used for functional mapping in clinical practices for the last 70 years to treat various disorders affecting the nervous system, including epilepsy, Parkinson's disease, essential tremors, and dystonia. Recently, direct electrical stimulation has been used to evoke various forms of perception in humans, ranging from sensorimotor, auditory, and visual to speech cognition. Successfully evoking and fine-tuning artificial perceptions could revolutionize communication for individuals with speech disorders and significantly enhance the capabilities of brain-computer interface technologies. However, despite the extensive literature on encoding various perceptions and the rising popularity of speech BCIs, inducing artificial speech perception is still largely unexplored, and its potential has yet to be determined. In this paper, we examine the various stimulation techniques used to evoke complex percepts and the target brain areas for the input of speech-like information. Finally, we discuss strategies to address the challenges of speech encoding and discuss the prospects of these approaches.

Neurosurgery and the Brain-Computer Interface

Brain-computer interfaces (BCIs) are devices that connect the human brain to an effector via a computer and electrode interface. BCIs may also transmit sensory data to the brain. We describe progress with the many types of surgically implanted BCIs, in which electrodes contact or penetrate the cerebral cortex. BCIs developed for restoration of movement in paralyzed limbs or control a robotic arm; restoration of somatic sensation, speech, vision, memory, hearing, and olfaction are also presented. Most devices remain experimental. Commercialization is costly, incurs financial risk, and is time consuming. There are many ethical principles that should be considered by neurosurgeons and by all those responsible for the care of people with serious neurological disability. These considerations are also paramount when the technology is used in for the purpose of enhancement of normal function and where commercial gain is a factor. A new regulatory and legislative framework is urgently required. The evolution of BCIs is occurring rapidly with advances in computer science, artificial intelligence, electronic engineering including wireless transmission, and materials science. The era of the brain-"cloud" interface is approaching.

Visual Neuroprosthesis - Stimulation of Visual Cortical Centers in The Brain. Design of Non-Invasive Transcranial Stimulation of Functional Neurons

PURPOSE

The purpose of the article is to present the history and current status of visual cortical neuroprostheses, and to present a new method of stimulating intact visual cortex cells.

METHODS

This paper contains an overview of the history and current status of visual cortex stimulation in severe visual impairment, but also highlights its shortcomings. These include mainly the stimulation of currently damaged cortical cells over a small area and, from a morphological point of view, possible damage to the stimulated neurons by the electrodes and their encapsulation by gliotic tissue.

RESULTS

The paper also presents a proposal for a new technology of image processing and its transformation into a form of non-invasive transcranial stimulation of undamaged parts of the brain, which is protected by a national and international patent.

CONCLUSION

The paper presents a comprehensive review of the current options for compensating for lost vision at the level of the cerebral cortex and a proposal for a new non-invasive method of stimulating the functional neurons of the visual cortex.

Longitudinal stability of individual brain plasticity patterns in blindness

The primary visual cortex (V1) in individuals born blind is engaged in a wide spectrum of tasks and sensory modalities, including audition, touch, language, and memory. This widespread involvement raises questions regarding the constancy of its role and whether it might exhibit flexibility in its function over time, connecting to diverse network functions in response to task-specific demands. This would suggest that reorganized V1 takes on a role similar to cognitive multiple-demand system regions. Alternatively, it is possible that the varying patterns of plasticity observed in the blind V1 can be attributed to individual factors, whereby different blind individuals recruit V1 for different functions, highlighting the immense idiosyncrasy of plasticity. In support of this second account, we have recently shown that V1 functional connectivity varies greatly across blind individuals. But do these represent stable individual patterns of plasticity or merely instantaneous changes, for a multiple-demand system now inhabiting V1? Here we tested if individual connectivity patterns from the visual cortex of blind individuals are stable over time. We show that over two years, fMRI functional connectivity from the primary visual cortex is unique and highly stable in a small sample of repeatedly sampled congenitally blind individuals. Further, using multivoxel pattern analysis, we demonstrate that the unique reorganization patterns of these individuals allow decoding of participant identity. Together with recent evidence for substantial individual differences in visual cortex connectivity, this indicates there may be a consistent role for the visual cortex in blindness, which may differ for each individual. Further, it suggests that the variability in visual reorganization in blindness across individuals could be used to seek stable neuromarkers for sight rehabilitation and assistive approaches.

Attitudes of potential recipients toward emerging visual prosthesis technologies

With the advent of multiple visual prosthesis devices to treat blindness, the question of how potential patients view such interventions becomes important in order to understand the levels of expectation and acceptance, and the perceived risk-reward balance across the different device approaches. Building on previous work on single device approaches done with blind individuals in Chicago and Detroit, USA, Melbourne, Australia, and Bejing, China, we investigated attitudes in blind individuals in Athens, Greece with coverage expanded to three of the contemporary approaches, Retinal, Thalamic, and Cortical. We presented an informational lecture on the approaches, had potential participants fill out a preliminary Questionnaire 1, then organized selected subjects into focus groups for guided discussion on visual prostheses, and finally had these subjects fill out a more detailed Questionnaire 2. We report here the first quantitative data that compares multiple prosthesis approaches. Our primary findings are that for these potential patients, perceived risk continues to outweigh perceived benefits, with the Retinal approach having the least negative overall impression and the Cortical approach the most negative. Concerns about the quality of restored vision were primary. Factors that drove the choice of hypothetical participation in a clinical trial were age and years of blindness. Secondary factors focused on positive clinical outcomes. The focus groups served to swing the impressions of each approach from neutrality toward the extremes of a Likert scale, and shifted the overall willingness to participate in a clinical trial from neutral to negative. These results, coupled with informal assessment of audience questions after the informational lecture, suggest that a substantial improvement in performance over currently available devices will be necessary before visual prostheses gain wide acceptance.

Chronic stability of a neuroprosthesis comprising multiple adjacent Utah arrays in monkeys

Objective. Electrical stimulation of visual cortex via a neuroprosthesis induces the perception of dots of light ('phosphenes'), potentially allowing recognition of simple shapes even after decades of blindness. However, restoration of functional vision requires large numbers of electrodes, and chronic, clinical implantation of intracortical electrodes in the visual cortex has only been achieved using devices of up to 96 channels. We evaluated the efficacy and stability of a 1024-channel neuroprosthesis system in non-human primates (NHPs) over more than 3 years to assess its suitability for long-term vision restoration.Approach.We implanted 16 microelectrode arrays (Utah arrays) consisting of 8 × 8 electrodes with iridium oxide tips in the primary visual cortex (V1) and visual area 4 (V4) of two sighted macaques. We monitored the animals' health and measured electrode impedances and neuronal signal quality by calculating signal-to-noise ratios of visually driven neuronal activity, peak-to-peak voltages of the waveforms of action potentials, and the number of channels with high-amplitude signals. We delivered cortical microstimulation and determined the minimum current that could be perceived, monitoring the number of channels that successfully yielded phosphenes. We also examined the influence of the implant on a visual task after 2-3 years of implantation and determined the integrity of the brain tissue with a histological analysis 3-3.5 years post-implantation.Main results. The monkeys remained healthy throughout the implantation period and the device retained its mechanical integrity and electrical conductivity. However, we observed decreasing signal quality with time, declining numbers of phosphene-evoking electrodes, decreases in electrode impedances, and impaired performance on a visual task at visual field locations corresponding to implanted cortical regions. Current thresholds increased with time in one of the two animals. The histological analysis revealed encapsulation of arrays and cortical degeneration. Scanning electron microscopy on one array revealed degradation of IrOxcoating and higher impedances for electrodes with broken tips.Significance. Long-term implantation of a high-channel-count device in NHP visual cortex was accompanied by deformation of cortical tissue and decreased stimulation efficacy and signal quality over time. We conclude that improvements in device biocompatibility and/or refinement of implantation techniques are needed before future clinical use is feasible.

Toward a personalized closed-loop stimulation of the visual cortex: Advances and challenges

Current cortical visual prosthesis approaches are primarily unidirectional and do not consider the feed-back circuits that exist in just about every part of the nervous system. Herein, we provide a brief overview of some recent developments for better controlling brain stimulation and present preliminary human data indicating that closed-loop strategies could considerably enhance the effectiveness, safety, and long-term stability of visual cortex stimulation. We propose that the development of improved closed-loop strategies may help to enhance our capacity to communicate with the brain.