Neuromodulation techniques for modulating cognitive function: Enhancing stimulation precision and intervention effects

Neuromodulation techniques effectively intervene in cognitive function, holding considerable scientific and practical value in fields such as aerospace, medicine, life sciences, and brain research. These techniques utilize electrical stimulation to directly or indirectly target specific brain regions, modulating neural activity and influencing broader brain networks, thereby regulating cognitive function. Regulating cognitive function involves an understanding of aspects such as perception, learning and memory, attention, spatial cognition, and physical function. To enhance the application of cognitive regulation in the general population, this paper reviews recent publications from the Web of Science to assess the advancements and challenges of invasive and non-invasive stimulation methods in modulating cognitive functions. This review covers various neuromodulation techniques for cognitive intervention, including deep brain stimulation, vagus nerve stimulation, and invasive methods using microelectrode arrays. The non-invasive techniques discussed include transcranial magnetic stimulation, transcranial direct current stimulation, transcranial alternating current stimulation, transcutaneous electrical acupoint stimulation, and time interference stimulation for activating deep targets. Invasive stimulation methods, which are ideal for studying the pathogenesis of neurological diseases, tend to cause greater trauma and have been less researched in the context of cognitive function regulation. Non-invasive methods, particularly newer transcranial stimulation techniques, are gentler and more appropriate for regulating cognitive functions in the general population. These include transcutaneous acupoint electrical stimulation using acupoints and time interference methods for activating deep targets. This paper also discusses current technical challenges and potential future breakthroughs in neuromodulation technology. It is recommended that neuromodulation techniques be combined with neural detection methods to better assess their effects and improve the accuracy of non-invasive neuromodulation. Additionally, researching closed-loop feedback neuromodulation methods is identified as a promising direction for future development.

Quantifying physical degradation alongside recording and stimulation performance of 980 intracortical microelectrodes chronically implanted in three humans for 956-2130 days

The clinical success of brain computer interfaces (BCI) depends on overcoming both biological and material challenges to ensure a long-term stable connection for neural recording and stimulation. This study systematically quantified damage that microelectrodes sustained during chronical implantation in three people with tetraplegia for 956-2130 days. Using scanning electron microscopy (SEM), we imaged 980 microelectrodes from eleven Neuroport arrays tipped with platinum (Pt, n = 8) and sputtered iridium oxide film (SIROF, n = 3). Arrays were implanted/explanted from posterior parietal, motor and somatosensory cortices across three clinical sites (Caltech/UCLA, Caltech/USC, APL/Johns Hopkins). From the electron micrographs, we quantified and correlated physical damage with functional outcomes measured in vivo, prior to explant (recording quality, noise, impedance and stimulation ability). Despite greater physical degradation, SIROF electrodes were twice as likely to record neural activity than Pt (measured by SNR). For SIROF, 1 kHz impedance significantly correlated with all physical damage metrics, recording metrics, and stimulation performance, suggesting a reliable measurement of in vivo degradation. We observed a new degradation type, primarily on stimulated electrodes ("pockmarked" vs "cracked") electrodes; however, no significant degradation due to stimulation or amount of charge delivered. We hypothesize erosion of the silicon shank accelerates damage to the electrode / tissue interface, following damage to the tip metal. These findings link quantitative measurements to the microelectrodes' physical condition and their capacity to record/stimulate. These data could lead to improved manufacturing processes or novel electrode designs to improve long-term performance of BCIs, making them vitally important as multi-year clinical trials of BCIs are becoming more common. STATEMENT OF SIGNIFICANCE: Long-term performance stability of the electrode-tissue interface is essential for clinical viability of brain computer interface (BCI) devices; currently, materials degradation is a critical component for performance loss. Across three human participants, ten micro-electrode arrays (plus one control) were implanted for 956-2130 days. Using scanning electron microscopy (SEM), we analyzed degradation of 980 electrodes, comparing two types of commonly implanted electrode tip metals: Platinum (Pt) and Sputtered Iridium Oxide Film (SIROF). We correlated observed degradation with in vivo electrode performance: recording (signal-to-noise ratio, noise, impedance) and stimulation (evoked somatosensory percepts). We hypothesize penetration of the electrode tip by biotic processes leads to erosion of the supporting silicon core, which then accelerates further tip metal damage. These data could lead to improved manufacturing processes or novel electrode designs towards the goal of a stable BCI electrical interface, spanning a multi-decade participant lifetime.

On the origin of memory neurons in the human hippocampus

The hippocampus is essential for episodic memory, yet its coding mechanism remains debated. In humans, two main theories have been proposed: one suggests that concept neurons represent specific elements of an episode, while another posits a conjunctive code, where index neurons code the entire episode. Here, we integrate new findings of index neurons in humans and other animals with the concept-specific memory framework, proposing that concept neurons evolve from index neurons through overlapping memories. This process is supported by engram literature, which posits that neurons are allocated to a memory trace based on excitability and that reactivation induces excitability. By integrating these insights, we connect two historically disparate fields of neuroscience: engram research and human single neuron episodic memory research.

High-resolution prosthetic hearing with a soft auditory brainstem implant in macaques

Individuals with compromised cochlear nerves are ineligible for cochlear implants and instead rely on auditory brainstem implants (ABIs). Most users of ABIs experience sound awareness, which aids in lip reading, yet not speech intelligibility. Here we engineered a dual-site (brainstem and cortex) implantable system, scaled to macaque anatomy, for the analysis of auditory perception evoked by electrical stimulation of the cochlear nucleus. A soft multichannel ABI, fabricated using thin-film processing, provided high-resolution auditory percepts, with spatially distinct stimulation sites eliciting cortical responses akin to frequency-specific tuning. Behavioural responses collected over several months were sufficiently precise to distinguish stimulations from adjacent channels. Soft multichannel ABIs may aid the rehabilitation of individuals with profound hearing loss who are ineligible for cochlear implants.

Spatially and temporally mismatched blood flow and neuronal activity by high-intensity intracortical microstimulation

INTRODUCTION

Intracortial microstimulation (ICMS) is widely used in neuroprosthetic brain-machine interfacing, particularly in restoring lost sensory and motor functions. Spiking neuronal activity requires increased cerebral blood flow to meet local metabolic demands, a process conventionally denoted as neurovascular coupling (NVC). However, it is unknown precisely how and to what extent ICMS elicits NVC and how the neuronal and blood flow responses to ICMS correlate. Suboptimal NVC by ICMS may compromise oxygen and energy delivery to the activated neurons thus impair neuroprosthetic functionality.

MATERIAL AND METHOD

We used wide-field imaging (WFI), laser speckle imaging (LSI) and two-photon microscopy (TPM) to study living, transgenic mice expressing calcium (Ca2+) fluorescent indicators in either neurons or vascular mural cells (VMC), as well as to measure vascular inner lumen diameters.

RESULT

By testing a range of stimulation amplitudes and examining cortical tissue responses at different distances from the stimulating electrode tip, we found that high stimulation intensities (≥50 μA) elicited a spatial and temporal neurovascular decoupling in regions most adjacent to electrode tip (<200 μm), with significantly delayed onset times of blood flow responses to ICMS and compromised maximum blood flow increases. We attribute these effects respectively to delayed Ca2+ signalling and decreased Ca2+ sensitivity in VMCs.

CONCLUSION

Our study offers new insights into ICMS-associated neuronal and vascular physiology with potentially critical implications towards the optimal design of ICMS in neuroprosthetic therapies: low intensities preserve NVC; high intensities disrupt NVC responses and potentially precipitate blood supply deficits.

Inkjet-printed transparent electrodes: Design, characterization, and initial in vivo evaluation for brain stimulation

Electrical stimulation is a powerful tool for investigating and modulating brain activity, as well as for treating neurological disorders. However, understanding the precise effects of electrical stimulation on neural activity has been hindered by limitations in recording neuronal responses near the stimulating electrode, such as stimulation artifacts in electrophysiology or obstruction of the field of view in imaging. In this study, we introduce a novel stimulation device fabricated from conductive polymers that is transparent and therefore compatible with optical imaging techniques. The device is manufactured using a combination of microfabrication and inkjet printing techniques and is flexible, allowing better adherence to the brain's natural curvature. We characterized the electrical and optical properties of the electrodes, focusing on the trade-off between the maximum current that can be delivered and optical transmittance. We found that a 1 mm diameter, 350 nm thick PEDOT:PSS electrode could be used to apply a maximum current of 130 μA while maintaining 84% transmittance (approximately 50% under 2-photon imaging conditions). We then evaluated the electrode performance in the brain of an anesthetized mouse by measuring the electric field with a nearby recording electrode and found values up to 30 V/m. Finally, we combined experimental data with a finite-element model of the in vivo experimental setup to estimate the distribution of the electric field underneath the electrode in the mouse brain. Our findings indicate that the device can generate an electric field as high as 300 V/m directly beneath the electrode, demonstrating its potential for studying and manipulating neural activity using a range of electrical stimulation techniques relevant to human applications. Overall, this work presents a promising approach for developing versatile new tools to apply and study electrical brain stimulation.

Volumetric mesoscopic electrophysiology: a new imaging modality for the nonhuman primate

The primate brain is a densely interconnected organ whose function is best understood by recording from the entire structure in parallel, rather than parts of it in sequence. However, available methods either have limited temporal resolution (functional magnetic resonance imaging; fMRI), limited spatial resolution (macroscopic electroencephalography), or a limited field of view (microscopic electrophysiology). To address this need, we developed a volumetric, mesoscopic recording approach (MePhys) by tessellating the volume of a monkey hemisphere with 992 electrode contacts that were distributed across 62 chronically implanted multielectrode shafts. We showcase the scientific promise of MePhys by describing the functional interactions of local field potentials between the more than 300,000 simultaneously recorded pairs of electrodes. We find that a subanesthetic dose of ketamine-believed to mimic certain aspects of psychosis-can create a pronounced state of functional disconnection and prevent the formation of stable large-scale intrinsic states. We conclude that MePhys provides a new and fundamentally distinct window into brain function whose unique profile of strengths and weaknesses complements existing approaches in synergistic ways.NEW & NOTEWORTHY We created a new imaging modality for the nonhuman primate, mesoscopic electrophysiology, or MePhys by sampling local field potentials (LFPs) in a dense three-dimensional grid from across the volume of one entire hemisphere. MePhys combines the millisecond temporal resolution of electrophysiology with the large field of view and millimeter spatial resolution of functional magnetic resonance imaging (fMRI). MePhys' unique profile of strengths and limitations makes it an ideal imaging method for the nonhuman primate brain observatories of the future.

Interfacing with the Brain: How Nanotechnology Can Contribute

Interfacing artificial devices with the human brain is the central goal of neurotechnology. Yet, our imaginations are often limited by currently available paradigms and technologies. Suggestions for brain-machine interfaces have changed over time, along with the available technology. Mechanical levers and cable winches were used to move parts of the brain during the mechanical age. Sophisticated electronic wiring and remote control have arisen during the electronic age, ultimately leading to plug-and-play computer interfaces. Nonetheless, our brains are so complex that these visions, until recently, largely remained unreachable dreams. The general problem, thus far, is that most of our technology is mechanically and/or electrically engineered, whereas the brain is a living, dynamic entity. As a result, these worlds are difficult to interface with one another. Nanotechnology, which encompasses engineered solid-state objects and integrated circuits, excels at small length scales of single to a few hundred nanometers and, thus, matches the sizes of biomolecules, biomolecular assemblies, and parts of cells. Consequently, we envision nanomaterials and nanotools as opportunities to interface with the brain in alternative ways. Here, we review the existing literature on the use of nanotechnology in brain-machine interfaces and look forward in discussing perspectives and limitations based on the authors' expertise across a range of complementary disciplines─from neuroscience, engineering, physics, and chemistry to biology and medicine, computer science and mathematics, and social science and jurisprudence. We focus on nanotechnology but also include information from related fields when useful and complementary.

Optimal placement of high-channel visual prostheses in human retinotopic visual cortex

Objective.Recent strides in neurotechnology show potential to restore vision in individuals with visual impairments due to early visual pathway damage. As neuroprostheses mature and become available to a larger population, manual placement and evaluation of electrode designs become costly and impractical. An automatic method to simulate and optimize the implantation process of electrode arrays at large-scale is currently lacking.Approach.Here, we present a comprehensive method to automatically optimize electrode placement for visual prostheses, with the objective of matching predefined phosphene distributions. Our approach makes use of retinotopic predictions combined with individual anatomy data to minimize discrepancies between simulated and target phosphene patterns. While demonstrated with a 1000-channel 3D electrode array in V1, our simulation pipeline is versatile, potentially accommodating any electrode design and allowing for design evaluation.Main results.Notably, our results show that individually optimized placements in 362 brain hemispheres outperform average brain solutions, underscoring the significance of anatomical specificity. We further show how virtual implantation of multiple individual brains highlights the challenges of achieving full visual field coverage owing to single electrode constraints, which may be overcome by introducing multiple arrays of electrodes. Including additional surgical considerations, such as intracranial vasculature, in future iterations could refine the optimization process.Significance.Our open-source software streamlines the refinement of surgical procedures and facilitates simulation studies, offering a realistic exploration of electrode configuration possibilities.

An extensive dataset of spiking activity to reveal the syntax of the ventral stream

Visual neuroscience benefits from high-quality datasets with neuronal responses to many images. Several neuroimaging datasets have been published in recent years, but no comparable dataset with spiking activity exists. Here, we introduce the THINGS ventral stream spiking dataset (TVSD). We extensively sampled neuronal activity in response to >25,000 natural images from the THINGS database in macaques, using high-channel-count implants in three key cortical regions: primary visual cortex (V1), V4, and the inferotemporal cortex. We showcase the utility of TVSD by using an artificial neural network to visualize the tuning of neurons. We also characterize the correlated fluctuations in activity within and between areas and demonstrate that these noise correlations are strongest between neurons with similar tuning. The TVSD allows researchers to answer many questions about neuronal tuning, analyze the interactions within and between cortical regions, and compare spiking activity in monkeys to human neuroimaging data.

Selective activation of mesoscale functional circuits via multichannel infrared stimulation of cortical columns in ultra-high-field 7T MRI

To restore vision in the blind, advances in visual cortical prosthetics (VCPs) have offered high-channel-count electrical interfaces. Here, we design a 100-fiber optical bundle interface apposed to known feature-specific (color, shape, motion, and depth) functional columns that populate the visual cortex in humans, primates, and cats. Based on a non-viral optical stimulation method (INS, infrared neural stimulation; 1,875 nm), it can deliver dynamic patterns of stimulation, is non-penetrating and non-damaging to tissue, and is movable and removable. In addition, its magnetic resonance (MR) compatibility (INS-fMRI) permits systematic mapping of brain-wide circuits. In the MRI, we illustrate (1) the single-point activation of functionally specific networks, (2) shifting cortical networks activated via shifting points of stimulation, and (3) "moving dot" stimulation-evoked activation of higher-order motion-selective areas. We suggest that, by mimicking patterns of columnar activation normally activated by visual stimuli, a columnar VCP opens doors for the planned activation of feature-specific circuits and their associated visual percepts.

Local field potential phase modulates the evoked response to electrical stimulation in visual cortex

Objective.Development of cortical visual prostheses requires optimization of evoked responses to electrical stimulation to reduce charge requirements and improve safety, efficiency, and efficacy. One promising approach is timing stimulation to the local field potential (LFP), where action potentials have been found to occur preferentially at specific phases. To assess the relationship between electrical stimulation and the phase of the LFP, we recorded action potentials from primary (V1) and secondary (V2) visual cortex in marmosets while delivering single-pulse electrical microstimulation at different phases of the LFP.Approach.A 64-channel 4 shank probe was inserted into V1 and V2. Microstimulation (single biphasic pulse, 10µA and 200µs per phase) was applied to selected channels in V1, and action potentials recorded simultaneously in V1 and V2. Microstimulation pulses were jittered in time to randomize the phase of the LFP at the time of stimulation.Results.We found frequency-specific phase modulation in a subset of units, where microstimulation in V1 evokes a higher firing rate in both V1 and V2 when delivered at specific phases of the LFP. We characterize phase modulation in terms of the preferred phase and frequency of V1 stimulation for responses in both V1 and V2, and effect size as a function of phase estimation accuracy.Significance.Phase modulation could reduce charge requirements for neural activation, reducing the volume of activated tissue and improving the safety, efficacy, and specificity of cortical visual prostheses. Phase modulation could allow cortical visual prostheses to stimulate using more simultaneous electrodes, with improved neural specificity, and, potentially, targeting downstream cortical activation.

Tactile edges and motion via patterned microstimulation of the human somatosensory cortex

Intracortical microstimulation (ICMS) of somatosensory cortex evokes tactile sensations whose properties can be systematically manipulated by varying stimulation parameters. However, ICMS currently provides an imperfect sense of touch, limiting manual dexterity and tactile experience. Leveraging our understanding of how tactile features are encoded in the primary somatosensory cortex (S1), we sought to inform individuals with paralysis about local geometry and apparent motion of objects on their skin. We simultaneously delivered ICMS through electrodes with spatially patterned projected fields (PFs), evoking sensations of edges. We then created complex PFs that encode arbitrary tactile shapes and skin indentation patterns. By delivering spatiotemporally patterned ICMS, we evoked sensation of motion across the skin, the speed and direction of which could be controlled. Thus, we improved individuals' tactile experience and use of brain-controlled bionic hands.

A computational model to design wide field-of-view optic nerve neuroprostheses

Retinal stimulation (RS) allows restoring vision in blind patients, but it covers only a narrow region of the visual field. Optic nerve stimulation (ONS) has the potential to produce visual perceptions spanning the whole visual field, but it produces very irregular phosphenes. We introduced a geometrical model converting retinal and optic nerve firing rates into visual perceptions and vice versa and a method to estimate the best perceptions elicitable through an electrode configuration. We then compared in silico ONS and RS through simulated prosthetic vision of static and dynamic visual scenes. Both simulations and SPV experiments showed that it might be possible to reconstruct natural visual scenes with ONS and RS, and that ONS wide field-of-view allows the perception of more detail in dynamic scenarios than RS. Our findings suggest that ONS could represent an interesting approach for vision restoration and that our model can be used to optimize it.

Patterned electrical brain stimulation by a wireless network of implantable microdevices

Transmitting meaningful information into brain circuits by electronic means is a challenge facing brain-computer interfaces. A key goal is to find an approach to inject spatially structured local current stimuli across swaths of sensory areas of the cortex. Here, we introduce a wireless approach to multipoint patterned electrical microstimulation by a spatially distributed epicortically implanted network of silicon microchips to target specific areas of the cortex. Each sub-millimeter-sized microchip harvests energy from an external radio-frequency source and converts this into biphasic current injected focally into tissue by a pair of integrated microwires. The amplitude, period, and repetition rate of injected current from each chip are controlled across the implant network by implementing a pre-scheduled, collision-free bitmap wireless communication protocol featuring sub-millisecond latency. As a proof-of-concept technology demonstration, a network of 30 wireless stimulators was chronically implanted into motor and sensory areas of the cortex in a freely moving rat for three months. We explored the effects of patterned intracortical electrical stimulation on trained animal behavior at average RF powers well below regulatory safety limits.

Precise control of neural activity using dynamically optimized electrical stimulation

Neural implants have the potential to restore lost sensory function by electrically evoking the complex naturalistic activity patterns of neural populations. However, it can be difficult to predict and control evoked neural responses to simultaneous multi-electrode stimulation due to nonlinearity of the responses. We present a solution to this problem and demonstrate its utility in the context of a bidirectional retinal implant for restoring vision. A dynamically optimized stimulation approach encodes incoming visual stimuli into a rapid, greedily chosen, temporally dithered and spatially multiplexed sequence of simple stimulation patterns. Stimuli are selected to optimize the reconstruction of the visual stimulus from the evoked responses. Temporal dithering exploits the slow time scales of downstream neural processing, and spatial multiplexing exploits the independence of responses generated by distant electrodes. The approach was evaluated using an experimental laboratory prototype of a retinal implant: large-scale, high-resolution multi-electrode stimulation and recording of macaque and rat retinal ganglion cells ex vivo. The dynamically optimized stimulation approach substantially enhanced performance compared to existing approaches based on static mapping between visual stimulus intensity and current amplitude. The modular framework enabled parallel extensions to naturalistic viewing conditions, incorporation of perceptual similarity measures, and efficient implementation for an implantable device. A direct closed-loop test of the approach supported its potential use in vision restoration.

Advanced neuroprosthetic electrode design optimized by electromagnetic finite element simulation: innovations and applications

Based on electrophysiological activity, neuroprostheses can effectively monitor and control neural activity. Currently, electrophysiological neuroprostheses are widely utilized in treating neurological disorders, particularly in restoring motor, visual, auditory, and somatosensory functions after nervous system injuries. They also help alleviate inflammation, regulate blood pressure, provide analgesia, and treat conditions such as epilepsy and Alzheimer's disease, offering significant research, economic, and social value. Enhancing the targeting capabilities of neuroprostheses remains a key objective for researchers. Modeling and simulation techniques facilitate the theoretical analysis of interactions between neuroprostheses and the nervous system, allowing for quantitative assessments of targeting efficiency. Throughout the development of neuroprostheses, these modeling and simulation methods can save time, materials, and labor costs, thereby accelerating the rapid development of highly targeted neuroprostheses. This article introduces the fundamental principles of neuroprosthesis simulation technology and reviews how various simulation techniques assist in the design and performance enhancement of neuroprostheses. Finally, it discusses the limitations of modeling and simulation and outlines future directions for utilizing these approaches to guide neuroprosthesis design.

Multifunctional human visual pathway-replicated hardware based on 2D materials

Artificial visual system empowered by 2D materials-based hardware simulates the functionalities of the human visual system, leading the forefront of artificial intelligence vision. However, retina-mimicked hardware that has not yet fully emulated the neural circuits of visual pathways is restricted from realizing more complex and special functions. In this work, we proposed a human visual pathway-replicated hardware that consists of crossbar arrays with split floating gate 2D tungsten diselenide (WSe2) unit devices that simulate the retina and visual cortex, and related connective peripheral circuits that replicate connectomics between the retina and visual cortex. This hardware experimentally displays advanced multi-functions of red-green color-blindness processing, low-power shape recognition, and self-driven motion tracking, promoting the development of machine vision, driverless technology, brain-computer interfaces, and intelligent robotics.

Wireless and Opto-Stimulated Flexible Implants: Artificial Retina Constructed by Ferroelectric BiFeO3-BaTiO3/P(VDF-TrFE) Composites

The degeneration of retinal photoreceptors is one of the primary causes of blindness, and the implantation of retinal prostheses offers hope for vision restoration in individuals who are completely blind. Flexible bioelectronic devices present a promising avenue for the next generation of retinal prostheses owing to their soft mechanical properties and tissue friendliness. In this study, we developed flexible composite films of ferroelectric BiFeO3-BaTiO3 (BFO-BTO) particles synthesized by the hydrothermal method and ferroelectric poly(vinyldene difluoride-trifluoroethylene) (P(VDF-TrFE)) polymer and investigated their applications in artificial retinas. Owing to the coupling of the photothermal effect of BFO-BTO particles and the pyroelectric effect of the P(VDF-TrFE) polymer, the composite films demonstrate a strong photoelectric response (a maximum peak-to-peak photovoltage > 80 V under blue light of 100 mW/cm2) in a wide wavelength range of light (from visible to infrared) with the inherent flexibility and ease of preparation, making it an attractive candidate for artificial retinal applications. Experimental results showed that blind rats implanted with artificial retinas of the composites display light-responsive behavior, showcasing the effectiveness of vision restoration. This study demonstrates a novel approach for employing ferroelectric materials in vision restoration and offers insights into future artificial retina design.

The Quest for an Integrated Set of Neural Mechanisms Underlying Object Recognition in Primates

Inferences made about objects via vision, such as rapid and accurate categorization, are core to primate cognition despite the algorithmic challenge posed by varying viewpoints and scenes. Until recently, the brain mechanisms that support these capabilities were deeply mysterious. However, over the past decade, this scientific mystery has been illuminated by the discovery and development of brain-inspired, image-computable, artificial neural network (ANN) systems that rival primates in these behavioral feats. Apart from fundamentally changing the landscape of artificial intelligence, modified versions of these ANN systems are the current leading scientific hypotheses of an integrated set of mechanisms in the primate ventral visual stream that support core object recognition. What separates brain-mapped versions of these systems from prior conceptual models is that they are sensory computable, mechanistic, anatomically referenced, and testable (SMART). In this article, we review and provide perspective on the brain mechanisms addressed by the current leading SMART models. We review their empirical brain and behavioral alignment successes and failures, discuss the next frontiers for an even more accurate mechanistic understanding, and outline the likely applications.

A novel interface for cortical columnar neuromodulation with multipoint infrared neural stimulation

Cutting edge advances in electrical visual cortical prosthetics have evoked perception of shapes, motion, and letters in the blind. Here, we present an alternative optical approach using pulsed infrared neural stimulation. To interface with dense arrays of cortical columns with submillimeter spatial precision, both linear array and 100-fiber bundle array optical fiber interfaces were devised. We deliver infrared stimulation through these arrays in anesthetized cat visual cortex and monitor effects by optical imaging in contralateral visual cortex. Infrared neural stimulation modulation of response to ongoing visual oriented gratings produce enhanced responses in orientation-matched domains and suppressed responses in non-matched domains, consistent with a known higher order integration mediated by callosal inputs. Controls include dynamically applied speeds, directions and patterns of multipoint stimulation. This provides groundwork for a distinct type of prosthetic targeted to maps of visual cortical columns.

Comparison of electrical microstimulation artifact removal methods for high-channel-count prostheses

BACKGROUND

Neuroprostheses are used to electrically stimulate the brain, modulate neural activity and restore sensory and motor function following injury or disease, such as blindness, paralysis, and other movement and psychiatric disorders. Recordings are often made simultaneously with stimulation, allowing the monitoring of neural signals and closed-loop control of devices. However, stimulation-evoked artifacts may obscure neural activity, particularly when stimulation and recording sites are nearby. Several methods have been developed to remove stimulation artifacts, but it remains challenging to validate and compare these methods because the 'ground-truth' of the neuronal signals may be contaminated by artifacts.

NEW METHOD

Here, we delivered stimulation to the visual cortex via a high-channel-count prosthesis while recording neuronal activity and stimulation artifacts. We quantified the waveforms and temporal properties of stimulation artifacts from the cortical visual prosthesis (CVP) and used them to build a dataset, in which we simulated the neuronal activity and the stimulation artifacts. We illustrate how to use the simulated data to evaluate the performance of six software-based artifact removal methods (Template subtraction, Linear interpolation, Polynomial fitting, Exponential fitting, SALPA and ERAASR) in a CVP application scenario.

RESULTS

We here focused on stimulation artifacts caused by electrical stimulation through a high-channel-count cortical prosthesis device. We find that the Polynomial fitting and Exponential fitting methods outperform the other methods in recovering spikes and multi-unit activity. Linear interpolation and Template subtraction recovered the local-field potentials.

CONCLUSION

Polynomial fitting and Exponential fitting provided a good trade-off between the quality of the recovery of spikes and multi-unit activity (MUA) and the computational complexity for a cortical prosthesis.

Assessment of visual function in blind mice and monkeys with subretinally implanted nanowire arrays as artificial photoreceptors

Retinal prostheses could restore image-forming vision in conditions of photoreceptor degeneration. However, contrast sensitivity and visual acuity are often insufficient. Here we report the performance, in mice and monkeys with induced photoreceptor degeneration, of subretinally implanted gold-nanoparticle-coated titania nanowire arrays providing a spatial resolution of 77.5 μm and a temporal resolution of 3.92 Hz in ex vivo retinas (as determined by patch-clamp recording of retinal ganglion cells). In blind mice, the arrays allowed for the detection of drifting gratings and flashing objects at light-intensity thresholds of 15.70-18.09 μW mm-2, and offered visual acuities of 0.3-0.4 cycles per degree, as determined by recordings of visually evoked potentials and optomotor-response tests. In monkeys, the arrays were stable for 54 weeks, allowed for the detection of a 10-μW mm-2 beam of light (0.5° in beam angle) in visually guided saccade experiments, and induced plastic changes in the primary visual cortex, as indicated by long-term in vivo calcium imaging. Nanomaterials as artificial photoreceptors may ameliorate visual deficits in patients with photoreceptor degeneration.

Neural manifolds in V1 change with top-down signals from V4 targeting the foveal region

High-dimensional brain activity is often organized into lower-dimensional neural manifolds. However, the neural manifolds of the visual cortex remain understudied. Here, we study large-scale multi-electrode electrophysiological recordings of macaque (Macaca mulatta) areas V1, V4, and DP with a high spatiotemporal resolution. We find that the population activity of V1 contains two separate neural manifolds, which correlate strongly with eye closure (eyes open/closed) and have distinct dimensionalities. Moreover, we find strong top-down signals from V4 to V1, particularly to the foveal region of V1, which are significantly stronger during the eyes-open periods. Finally, in silico simulations of a balanced spiking neuron network qualitatively reproduce the experimental findings. Taken together, our analyses and simulations suggest that top-down signals modulate the population activity of V1. We postulate that the top-down modulation during the eyes-open periods prepares V1 for fast and efficient visual responses, resulting in a type of visual stand-by state.

On the spatial synaptic propagation of excitations induced by repetitive microstimulation pulses in the mouse visual cortex

The spatial synaptic propagation of membrane excitation in response to the trains of microstimulation pulses applied to the cortical layer II/III in the mouse cerebral tissue slices was analyzed by means of the voltage-sensitive dye imaging and the numerical simulation with a one-dimensional network model. The present model was able to simulate the spatial dynamics of the post-synaptic component of response induced by the repetitive current pulses.

Flexible Polymer Electrodes for Stable Prosthetic Visual Perception in Mice

Brain interfaces that can stimulate neurons, cause minimal damage, and work for a long time will be central for future neuroprosthetics. Here, the long-term performance of highly flexible, thin polyimide shanks with several small (<15 µm) electrodes during electrical microstimulation of the visual cortex, is reported. The electrodes exhibit a remarkable stability when several billions of electrical pulses are applied in vitro. When the devices are implanted in the primary visual cortex (area V1) of mice and the animals are trained to detect electrical microstimulation, it is found that the perceptual thresholds are 2-20 microamperes (µA), which is far below the maximal currents that the electrodes can withstand. The long-term functionality of the devices in vivo is excellent, with stable performance for up to more than a year and little damage to the brain tissue. These results demonstrate the potential of thin floating electrodes for the long-term restoration of lost sensory functions.

Noninvasive imaging-guided ultrasonic neurostimulation with arbitrary 2D patterns and its application for high-quality vision restoration

Retinal degeneration, a leading cause of irreversible low vision and blindness globally, can be partially addressed by retina prostheses which stimulate remaining neurons in the retina. However, existing electrode-based treatments are invasive, posing substantial risks to patients and healthcare providers. Here, we introduce a completely noninvasive ultrasonic retina prosthesis, featuring a customized ultrasound two-dimensional array which allows for simultaneous imaging and stimulation. With synchronous three-dimensional imaging guidance and auto-alignment technology, ultrasonic retina prosthesis can generate programmed ultrasound waves to dynamically and precisely form arbitrary wave patterns on the retina. Neuron responses in the brain's visual center mirrored these patterns, evidencing successful artificial vision creation, which was further corroborated in behavior experiments. Quantitative analysis of the spatial-temporal resolution and field of view demonstrated advanced performance of ultrasonic retina prosthesis and elucidated the biophysical mechanism of retinal stimulation. As a noninvasive blindness prosthesis, ultrasonic retina prosthesis could lead to a more effective, widely acceptable treatment for blind patients. Its real-time imaging-guided stimulation strategy with a single ultrasound array, could also benefit ultrasound neurostimulation in other diseases.

Volumetric mesoscopic electrophysiology: a new imaging modality for the non-human primate

The primate brain is a densely interconnected organ whose function is best understood by recording from the entire structure in parallel, rather than parts of it in sequence. However, available methods either have limited temporal resolution (functional magnetic resonance imaging), limited spatial resolution (macroscopic electroencephalography), or a limited field of view (microscopic electrophysiology). To address this need, we developed a volumetric, mesoscopic recording approach ( MePhys ) by tessellating the volume of a monkey hemisphere with 992 electrode contacts that were distributed across 62 chronically implanted multi-electrode shafts. We showcase the scientific promise of MePhys by describing the functional interactions of local field potentials between the more than 300,000 simultaneously recorded pairs of electrodes. We find that a subanesthetic dose of ketamine -believed to mimic certain aspects of psychosis- can create a pronounced state of functional disconnection and prevent the formation of stable large-scale intrinsic states. We conclude that MePhys provides a new and fundamentally distinct window into brain function whose unique profile of strengths and weaknesses complements existing approaches in synergistic ways.

Transparent and Conformal Microcoil Arrays for Spatially Selective Neuronal Activation

Micromagnetic stimulation (μMS) using small, implantable microcoils is a promising method for achieving neuronal activation with high spatial resolution and low toxicity. Herein, we report a microcoil array for localized activation of cortical neurons and retinal ganglion cells. We developed a computational model to relate the electric field gradient (activating function) to the geometry and arrangement of microcoils, and selected a design that produced an anisotropic region of activation <50 μm wide. The device was comprised of an SU-8/Cu/SU-8 tri-layer structure, which was flexible, transparent and conformal and featured four individually-addressable microcoils. Interfaced with cortex or retina explants from GCaMP6-expressing mice, we observed that individual neurons localized within 40 μm of a microcoil tip could be activated repeatedly and in a dose- (power-) dependent fashion. These results demonstrate the potential of μMS devices for brain-machine interfaces and could enable routes toward bioelectronic therapies including prosthetic vision devices.

Gaze-contingent processing improves mobility, scene recognition and visual search in simulated head-steered prosthetic vision

Objective.The enabling technology of visual prosthetics for the blind is making rapid progress. However, there are still uncertainties regarding the functional outcomes, which can depend on many design choices in the development. In visual prostheses with a head-mounted camera, a particularly challenging question is how to deal with the gaze-locked visual percept associated with spatial updating conflicts in the brain. The current study investigates a recently proposed compensation strategy based on gaze-contingent image processing with eye-tracking. Gaze-contingent processing is expected to reinforce natural-like visual scanning and reestablished spatial updating based on eye movements. The beneficial effects remain to be investigated for daily life activities in complex visual environments.Approach.The current study evaluates the benefits of gaze-contingent processing versus gaze-locked and gaze-ignored simulations in the context of mobility, scene recognition and visual search, using a virtual reality simulated prosthetic vision paradigm with sighted subjects.Main results.Compared to gaze-locked vision, gaze-contingent processing was consistently found to improve the speed in all experimental tasks, as well as the subjective quality of vision. Similar or further improvements were found in a control condition that ignores gaze-dependent effects, a simulation that is unattainable in the clinical reality.Significance.Our results suggest that gaze-locked vision and spatial updating conflicts can be debilitating for complex visually-guided activities of daily living such as mobility and orientation. Therefore, for prospective users of head-steered prostheses with an unimpaired oculomotor system, the inclusion of a compensatory eye-tracking system is strongly endorsed.

Activation and depression of neural and hemodynamic responses induced by the intracortical microstimulation and visual stimulation in the mouse visual cortex

Objective. Intracortical microstimulation (ICMS) can be an effective method for restoring sensory perception in contemporary brain-machine interfaces. However, the mechanisms underlying better control of neuronal responses remain poorly understood, as well as the relationship between neuronal activity and other concomitant phenomena occurring around the stimulation site.Approach. Different microstimulation frequencies were investigatedin vivoon Thy1-GCaMP6s mice using widefield and two-photon imaging to evaluate the evoked excitatory neural responses across multiple spatial scales as well as the induced hemodynamic responses. Specifically, we quantified stimulation-induced neuronal activation and depression in the mouse visual cortex and measured hemodynamic oxyhemoglobin and deoxyhemoglobin signals using mesoscopic-scale widefield imaging.Main results. Our calcium imaging findings revealed a preference for lower-frequency stimulation in driving stronger neuronal activation. A depressive response following the neural activation preferred a slightly higher frequency stimulation compared to the activation. Hemodynamic signals exhibited a comparable spatial spread to neural calcium signals. Oxyhemoglobin concentration around the stimulation site remained elevated during the post-activation (depression) period. Somatic and neuropil calcium responses measured by two-photon microscopy showed similar dependence on stimulation parameters, although the magnitudes measured in soma was greater than in neuropil. Furthermore, higher-frequency stimulation induced a more pronounced activation in soma compared to neuropil, while depression was predominantly induced in soma irrespective of stimulation frequencies.Significance. These results suggest that the mechanism underlying depression differs from activation, requiring ample oxygen supply, and affecting neurons. Our findings provide a novel understanding of evoked excitatory neuronal activity induced by ICMS and offer insights into neuro-devices that utilize both activation and depression phenomena to achieve desired neural responses.

Axonal stimulation affects the linear summation of single-point perception in three Argus II users

Objective.Retinal implants use electrical stimulation to elicit perceived flashes of light ('phosphenes'). Single-electrode phosphene shape has been shown to vary systematically with stimulus parameters and the retinal location of the stimulating electrode, due to incidental activation of passing nerve fiber bundles. However, this knowledge has yet to be extended to paired-electrode stimulation.Approach.We retrospectively analyzed 3548 phosphene drawings made by three blind participants implanted with an Argus II Retinal Prosthesis. Phosphene shape (characterized by area, perimeter, major and minor axis length) and number of perceived phosphenes were averaged across trials and correlated with the corresponding single-electrode parameters. In addition, the number of phosphenes was correlated with stimulus amplitude and neuroanatomical parameters: electrode-retina and electrode-fovea distance as well as the electrode-electrode distance to ('between-axon') and along axon bundles ('along-axon'). Statistical analyses were conducted using linear regression and partial correlation analysis.Main results.Simple regression revealed that each paired-electrode shape descriptor could be predicted by the sum of the two corresponding single-electrode shape descriptors (p < .001). Multiple regression revealed that paired-electrode phosphene shape was primarily predicted by stimulus amplitude and electrode-fovea distance (p < .05). Interestingly, the number of elicited phosphenes tended to increase with between-axon distance (p < .05), but not with along-axon distance, in two out of three participants.Significance.The shape of phosphenes elicited by paired-electrode stimulation was well predicted by the shape of their corresponding single-electrode phosphenes, suggesting that two-point perception can be expressed as the linear summation of single-point perception. The impact of the between-axon distance on the perceived number of phosphenes provides further evidence in support of the axon map model for epiretinal stimulation. These findings contribute to the growing literature on phosphene perception and have important implications for the design of future retinal prostheses.

Towards biologically plausible phosphene simulation for the differentiable optimization of visual cortical prostheses

Blindness affects millions of people around the world. A promising solution to restoring a form of vision for some individuals are cortical visual prostheses, which bypass part of the impaired visual pathway by converting camera input to electrical stimulation of the visual system. The artificially induced visual percept (a pattern of localized light flashes, or 'phosphenes') has limited resolution, and a great portion of the field's research is devoted to optimizing the efficacy, efficiency, and practical usefulness of the encoding of visual information. A commonly exploited method is non-invasive functional evaluation in sighted subjects or with computational models by using simulated prosthetic vision (SPV) pipelines. An important challenge in this approach is to balance enhanced perceptual realism, biologically plausibility, and real-time performance in the simulation of cortical prosthetic vision. We present a biologically plausible, PyTorch-based phosphene simulator that can run in real-time and uses differentiable operations to allow for gradient-based computational optimization of phosphene encoding models. The simulator integrates a wide range of clinical results with neurophysiological evidence in humans and non-human primates. The pipeline includes a model of the retinotopic organization and cortical magnification of the visual cortex. Moreover, the quantitative effects of stimulation parameters and temporal dynamics on phosphene characteristics are incorporated. Our results demonstrate the simulator's suitability for both computational applications such as end-to-end deep learning-based prosthetic vision optimization as well as behavioral experiments. The modular and open-source software provides a flexible simulation framework for computational, clinical, and behavioral neuroscientists working on visual neuroprosthetics.

An actor-model framework for visual sensory encoding

A fundamental challenge in neuroengineering is determining a proper artificial input to a sensory system that yields the desired perception. In neuroprosthetics, this process is known as artificial sensory encoding, and it holds a crucial role in prosthetic devices restoring sensory perception in individuals with disabilities. For example, in visual prostheses, one key aspect of artificial image encoding is to downsample images captured by a camera to a size matching the number of inputs and resolution of the prosthesis. Here, we show that downsampling an image using the inherent computation of the retinal network yields better performance compared to learning-free downsampling methods. We have validated a learning-based approach (actor-model framework) that exploits the signal transformation from photoreceptors to retinal ganglion cells measured in explanted mouse retinas. The actor-model framework generates downsampled images eliciting a neuronal response in-silico and ex-vivo with higher neuronal reliability than the one produced by a learning-free approach. During the learning process, the actor network learns to optimize contrast and the kernel's weights. This methodological approach might guide future artificial image encoding strategies for visual prostheses. Ultimately, this framework could be applicable for encoding strategies in other sensory prostheses such as cochlear or limb.

Activation and depression of neural and hemodynamic responses induced by the intracortical microstimulation and visual stimulation in the mouse visual cortex

Objective . Intracortical microstimulation can be an effective method for restoring sensory perception in contemporary brain-machine interfaces. However, the mechanisms underlying better control of neuronal responses remain poorly understood, as well as the relationship between neuronal activity and other concomitant phenomena occurring around the stimulation site. Approach . Different microstimulation frequencies were investigated in vivo on Thy1-GCaMP6s mice using widefield and two-photon imaging to evaluate the evoked excitatory neural responses across multiple spatial scales as well as the induced hemodynamic responses. Specifically, we quantified stimulation-induced neuronal activation and depression in the mouse visual cortex and measured hemodynamic oxyhemoglobin and deoxyhemoglobin signals using mesoscopic-scale widefield imaging. Main results . Our calcium imaging findings revealed a preference for lower-frequency stimulation in driving stronger neuronal activation. A depressive response following the neural activation preferred a slightly higher frequency stimulation compared to the activation. Hemodynamic signals exhibited a comparable spatial spread to neural calcium signals. Oxyhemoglobin concentration around the stimulation site remained elevated during the post-activation (depression) period. Somatic and neuropil calcium responses measured by two-photon microscopy showed similar dependence on stimulation parameters, although the magnitudes measured in soma was greater than in neuropil. Furthermore, higher-frequency stimulation induced a more pronounced activation in soma compared to neuropil, while depression was predominantly induced in soma irrespective of stimulation frequencies. Significance . These results suggest that the mechanism underlying depression differs from activation, requiring ample oxygen supply, and affecting neurons. Our findings provide a novel understanding of evoked excitatory neuronal activity induced by intracortical microstimulation and offer insights into neuro-devices that utilize both activation and depression phenomena to achieve desired neural responses.

Axonal stimulation affects the linear summation of single-point perception in three Argus II users

Purpose

Retinal implants use electrical stimulation to elicit perceived flashes of light ("phosphenes"). Single-electrode phosphene shape has been shown to vary systematically with stimulus parameters and the retinal location of the stimulating electrode, due to incidental activation of passing nerve fiber bundles. However, this knowledge has yet to be extended to paired-electrode stimulation.

Methods

We retrospectively analyzed 3548 phosphene drawings made by three blind participants implanted with an Argus II Retinal Prosthesis. Phosphene shape (characterized by area, perimeter, major and minor axis length) and number of perceived phosphenes were averaged across trials and correlated with the corresponding single-electrode parameters. In addition, the number of phosphenes was correlated with stimulus amplitude and neuroanatomical parameters: electrode-retina and electrode-fovea distance as well as the electrode-electrode distance to ("between-axon") and along axon bundles ("along-axon"). Statistical analyses were conducted using linear regression and partial correlation analysis.

Results

Simple regression revealed that each paired-electrode shape descriptor could be predicted by the sum of the two corresponding single-electrode shape descriptors (p < .001). Multiple regression revealed that paired-electrode phosphene shape was primarily predicted by stimulus amplitude and electrode-fovea distance (p < .05). Interestingly, the number of elicited phosphenes tended to increase with between-axon distance (p < .05), but not with along-axon distance, in two out of three participants.

Conclusions

The shape of phosphenes elicited by paired-electrode stimulation was well predicted by the shape of their corresponding single-electrode phosphenes, suggesting that two-point perception can be expressed as the linear summation of single-point perception. The notable impact of the between-axon distance on the perceived number of phosphenes provides further evidence in support of the axon map model for epiretinal stimulation. These findings contribute to the growing literature on phosphene perception and have important implications for the design of future retinal prostheses.

Fabrication of a photo-crosslinkable fluoropolymer-passivated flexible neural probe and acute recording and stimulation performances in vivo

Herein, we fabricated fluorine-containing, polymer-based, flexible neural probes with fluorinated ethylene propylene (FEP) films as the substrates and photo-crosslinkable fluoropolymers as the passivation material. For fabrication, metal-free Au layer formation on the FEP film, the simultaneous photo-adhesion and photo-patterning technique, and the pulsed-laser scanning probe shaping technique were combined, followed by Au electrode surface modification. The resultant probes achieved a charge injection limit equal to 5.18 mC cm-2 by implementing iridium oxide-modified nanoporous Au (IrOx/NPG) structures. We performed simultaneous in vivo micro-stimulations of the Schaffer collateral fibres and recorded the evoked field excitatory postsynaptic potentials (fEPSPs) in the stratum radiatum layer of the hippocampal Cornu Ammonis 1 region using a single probe. Inducing the fEPSP at very low charge per pulse settings (3.2-3.6 nC/pulse) indicates the efficient charge injection capability of the IrOx/NPG electrode, thereby enabling safe, prolonged, and thrifty micro-stimulations. Furthermore, the single probe-induced and recorded long-term potentiation persisted for periods longer than 60 min following theta-burst stimulation. The materials used in this study are all biocompatible and chemically robust. The fabricated neural probes can be applied in chronic clinical trials in vivo.

Optogenetic activation of visual thalamus generates artificial visual percepts

The lateral geniculate nucleus (LGN), a retinotopic relay center where visual inputs from the retina are processed and relayed to the visual cortex, has been proposed as a potential target for artificial vision. At present, it is unknown whether optogenetic LGN stimulation is sufficient to elicit behaviorally relevant percepts, and the properties of LGN neural responses relevant for artificial vision have not been thoroughly characterized. Here, we demonstrate that tree shrews pretrained on a visual detection task can detect optogenetic LGN activation using an AAV2-CamKIIα-ChR2 construct and readily generalize from visual to optogenetic detection. Simultaneous recordings of LGN spiking activity and primary visual cortex (V1) local field potentials (LFPs) during optogenetic LGN stimulation show that LGN neurons reliably follow optogenetic stimulation at frequencies up to 60 Hz and uncovered a striking phase locking between the V1 LFP and the evoked spiking activity in LGN. These phase relationships were maintained over a broad range of LGN stimulation frequencies, up to 80 Hz, with spike field coherence values favoring higher frequencies, indicating the ability to relay temporally precise information to V1 using light activation of the LGN. Finally, V1 LFP responses showed sensitivity values to LGN optogenetic activation that were similar to the animal's behavioral performance. Taken together, our findings confirm the LGN as a potential target for visual prosthetics in a highly visual mammal closely related to primates.

A novel simulation paradigm utilising MRI-derived phosphene maps for cortical prosthetic vision

Objective.We developed a realistic simulation paradigm for cortical prosthetic vision and investigated whether we can improve visual performance using a novel clustering algorithm.Approach.Cortical visual prostheses have been developed to restore sight by stimulating the visual cortex. To investigate the visual experience, previous studies have used uniform phosphene maps, which may not accurately capture generated phosphene map distributions of implant recipients. The current simulation paradigm was based on the Human Connectome Project retinotopy dataset and the placement of implants on the cortices from magnetic resonance imaging scans. Five unique retinotopic maps were derived using this method. To improve performance on these retinotopic maps, we enabled head scanning and a density-based clustering algorithm was then used to relocate centroids of visual stimuli. The impact of these improvements on visual detection performance was tested. Using spatially evenly distributed maps as a control, we recruited ten subjects and evaluated their performance across five sessions on the Berkeley Rudimentary Visual Acuity test and the object recognition task.Main results.Performance on control maps is significantly better than on retinotopic maps in both tasks. Both head scanning and the clustering algorithm showed the potential of improving visual ability across multiple sessions in the object recognition task.Significance.The current paradigm is the first that simulates the experience of cortical prosthetic vision based on brain scans and implant placement, which captures the spatial distribution of phosphenes more realistically. Utilisation of evenly distributed maps may overestimate the performance that visual prosthetics can restore. This simulation paradigm could be used in clinical practice when making plans for where best to implant cortical visual prostheses.

Attitudes of potential recipients toward emerging visual prosthesis technologies

With the advent of multiple visual prosthesis devices to treat blindness, the question of how potential patients view such interventions becomes important in order to understand the levels of expectation and acceptance, and the perceived risk-reward balance across the different device approaches. Building on previous work on single device approaches done with blind individuals in Chicago and Detroit, USA, Melbourne, Australia, and Bejing, China, we investigated attitudes in blind individuals in Athens, Greece with coverage expanded to three of the contemporary approaches, Retinal, Thalamic, and Cortical. We presented an informational lecture on the approaches, had potential participants fill out a preliminary Questionnaire 1, then organized selected subjects into focus groups for guided discussion on visual prostheses, and finally had these subjects fill out a more detailed Questionnaire 2. We report here the first quantitative data that compares multiple prosthesis approaches. Our primary findings are that for these potential patients, perceived risk continues to outweigh perceived benefits, with the Retinal approach having the least negative overall impression and the Cortical approach the most negative. Concerns about the quality of restored vision were primary. Factors that drove the choice of hypothetical participation in a clinical trial were age and years of blindness. Secondary factors focused on positive clinical outcomes. The focus groups served to swing the impressions of each approach from neutrality toward the extremes of a Likert scale, and shifted the overall willingness to participate in a clinical trial from neutral to negative. These results, coupled with informal assessment of audience questions after the informational lecture, suggest that a substantial improvement in performance over currently available devices will be necessary before visual prostheses gain wide acceptance.

Electrical stimulation thresholds differ between V1 and V2

Cortical visual prostheses are designed to treat blindness by restoring visual perceptions through artificial electrical stimulation of the primary visual cortex (V1). Intracortical microelectrodes produce the smallest visual percepts and thus higher resolution vision - like a higher density of pixels on a monitor. However, intracortical microelectrodes must maintain a minimum spacing to preserve tissue integrity. One solution to increase the density of percepts is to implant and stimulate multiple visual areas, such as V1 and V2, although the properties of microstimulation in V2 remain largely unexplored. We provide a direct comparison of V1 and V2 microstimulation in two common marmoset monkeys. We find similarities in response trends between V1 and V2 but differences in threshold, neural activity duration, and spread of activity at the threshold current. This has implications for using multi-area stimulation to increase the resolution of cortical visual prostheses.

Utilization of brain scans to create realistic phosphene maps for cortical visual prosthesis simulation studies

It has been shown that we can restore sensations of light by stimulating the visual cortex. Cortical prosthetic vision consists of light perception in the visual field named phosphenes. Phosphenes are like pixels on a monitor which we can control to form the desired perception. However, the locations of phosphenes evoked vary between individuals. One of the biggest challenges is how to utilize phosphenes to present recognizable patterns that represent real-world scenes. Because of the difficulties of recruiting participants, and the risks of neurosurgery, researchers have used computer simulations to investigate the outcome of cortical visual prostheses. Previous simulations used regular phosphene maps, which may overestimate the visual ability cortical visual prosthesis can provide. This study aims to develop a more realistic simulation for cortical visual prostheses. We derived realistic phosphene maps using an existing cortical retinotopy dataset and decided implant placement by considering neurosurgery restrictions. We rendered some visual stimuli to evaluate the usability of those phosphene maps. The results indicate that presenting information on phosphenes maps may be more challenging than previously estimated.

Chronic stability of a neuroprosthesis comprising multiple adjacent Utah arrays in monkeys

Objective. Electrical stimulation of visual cortex via a neuroprosthesis induces the perception of dots of light ('phosphenes'), potentially allowing recognition of simple shapes even after decades of blindness. However, restoration of functional vision requires large numbers of electrodes, and chronic, clinical implantation of intracortical electrodes in the visual cortex has only been achieved using devices of up to 96 channels. We evaluated the efficacy and stability of a 1024-channel neuroprosthesis system in non-human primates (NHPs) over more than 3 years to assess its suitability for long-term vision restoration.Approach.We implanted 16 microelectrode arrays (Utah arrays) consisting of 8 × 8 electrodes with iridium oxide tips in the primary visual cortex (V1) and visual area 4 (V4) of two sighted macaques. We monitored the animals' health and measured electrode impedances and neuronal signal quality by calculating signal-to-noise ratios of visually driven neuronal activity, peak-to-peak voltages of the waveforms of action potentials, and the number of channels with high-amplitude signals. We delivered cortical microstimulation and determined the minimum current that could be perceived, monitoring the number of channels that successfully yielded phosphenes. We also examined the influence of the implant on a visual task after 2-3 years of implantation and determined the integrity of the brain tissue with a histological analysis 3-3.5 years post-implantation.Main results. The monkeys remained healthy throughout the implantation period and the device retained its mechanical integrity and electrical conductivity. However, we observed decreasing signal quality with time, declining numbers of phosphene-evoking electrodes, decreases in electrode impedances, and impaired performance on a visual task at visual field locations corresponding to implanted cortical regions. Current thresholds increased with time in one of the two animals. The histological analysis revealed encapsulation of arrays and cortical degeneration. Scanning electron microscopy on one array revealed degradation of IrOxcoating and higher impedances for electrodes with broken tips.Significance. Long-term implantation of a high-channel-count device in NHP visual cortex was accompanied by deformation of cortical tissue and decreased stimulation efficacy and signal quality over time. We conclude that improvements in device biocompatibility and/or refinement of implantation techniques are needed before future clinical use is feasible.

Learning in a sensory cortical microstimulation task is associated with elevated representational stability

Sensory cortical representations can be highly dynamic, raising the question of how representational stability impacts learning. We train mice to discriminate the number of photostimulation pulses delivered to opsin-expressing pyramidal neurons in layer 2/3 of primary vibrissal somatosensory cortex. We simultaneously track evoked neural activity across learning using volumetric two-photon calcium imaging. In well-trained animals, trial-to-trial fluctuations in the amount of photostimulus-evoked activity predicted animal choice. Population activity levels declined rapidly across training, with the most active neurons showing the largest declines in responsiveness. Mice learned at varied rates, with some failing to learn the task in the time provided. The photoresponsive population showed greater instability both within and across behavioral sessions among animals that failed to learn. Animals that failed to learn also exhibited a faster deterioration in stimulus decoding. Thus, greater stability in the stimulus response is associated with learning in a sensory cortical microstimulation task.

Low-threshold, high-resolution, chronically stable intracortical microstimulation by ultraflexible electrodes

Intracortical microstimulation (ICMS) enables applications ranging from neuroprosthetics to causal circuit manipulations. However, the resolution, efficacy, and chronic stability of neuromodulation are often compromised by adverse tissue responses to the indwelling electrodes. Here we engineer ultraflexible stim-nanoelectronic threads (StimNETs) and demonstrate low activation threshold, high resolution, and chronically stable ICMS in awake, behaving mouse models. In vivo two-photon imaging reveals that StimNETs remain seamlessly integrated with the nervous tissue throughout chronic stimulation periods and elicit stable, focal neuronal activation at low currents of 2 μA. Importantly, StimNETs evoke longitudinally stable behavioral responses for over 8 months at a markedly low charge injection of 0.25 nC/phase. Quantified histological analyses show that chronic ICMS by StimNETs induces no neuronal degeneration or glial scarring. These results suggest that tissue-integrated electrodes provide a path for robust, long-lasting, spatially selective neuromodulation at low currents, which lessens risk of tissue damage or exacerbation of off-target side effects.

Emerging Penetrating Neural Electrodes: In Pursuit of Large Scale and Longevity

Penetrating neural electrodes provide a powerful approach to decipher brain circuitry by allowing for time-resolved electrical detections of individual action potentials. This unique capability has contributed tremendously to basic and translational neuroscience, enabling both fundamental understandings of brain functions and applications of human prosthetic devices that restore crucial sensations and movements. However, conventional approaches are limited by the scarce number of available sensing channels and compromised efficacy over long-term implantations. Recording longevity and scalability have become the most sought-after improvements in emerging technologies. In this review, we discuss the technological advances in the past 5-10 years that have enabled larger-scale, more detailed, and longer-lasting recordings of neural circuits at work than ever before. We present snapshots of the latest advances in penetration electrode technology, showcase their applications in animal models and humans, and outline the underlying design principles and considerations to fuel future technological development.

BMI 2.0: Toward a technological interface with brainwide networks

The field of brain machine interface has long sought a technology for brainwide interaction. In this issue of Neuron, Kim et al.1 present a novel method for dynamic, patterned, and precise optogenetic stimulation of mouse cortex in ultra-high-field MRI that portends such an interface.

Human acute microelectrode array recordings with broad cortical access, single-unit resolution, and parallel behavioral monitoring

There are vast gaps in our understanding of the organization and operation of the human nervous system at the level of individual neurons and their networks. Here, we report reliable and robust acute multichannel recordings using planar microelectrode arrays (MEAs) implanted intracortically in awake brain surgery with open craniotomies that grant access to large parts of the cortical hemisphere. We obtained high-quality extracellular neuronal activity at the microcircuit, local field potential level and at the cellular, single-unit level. Recording from the parietal association cortex, a region rarely explored in human single-unit studies, we demonstrate applications on these complementary spatial scales and describe traveling waves of oscillatory activity as well as single-neuron and neuronal population responses during numerical cognition, including operations with uniquely human number symbols. Intraoperative MEA recordings are practicable and can be scaled up to explore cellular and microcircuit mechanisms of a wide range of human brain functions.

Dynamic amplitude modulation of microstimulation evokes biomimetic onset and offset transients and reduces depression of evoked calcium responses in sensory cortices

BACKGROUND

Intracortical microstimulation (ICMS) is an emerging approach to restore sensation to people with neurological injury or disease. Biomimetic microstimulation, or stimulus trains that mimic neural activity in the brain through encoding of onset and offset transients, could improve the utility of ICMS for brain-computer interface (BCI) applications, but how biomimetic microstimulation affects neural activation is not understood. Current "biomimetic" ICMS trains aim to reproduce the strong onset and offset transients evoked in the brain by sensory input through dynamic modulation of stimulus parameters. Stimulus induced depression of neural activity (decreases in evoked intensity over time) is also a potential barrier to clinical implementation of sensory feedback, and dynamic microstimulation may reduce this effect.

OBJECTIVE

We evaluated how bio-inspired ICMS trains with dynamic modulation of amplitude and/or frequency change the calcium response, spatial distribution, and depression of neurons in the somatosensory and visual cortices.

METHODS

Calcium responses of neurons were measured in Layer 2/3 of visual and somatosensory cortices of anesthetized GCaMP6s mice in response to ICMS trains with fixed amplitude and frequency (Fixed) and three dynamic ICMS trains that increased the stimulation intensity during the onset and offset of stimulation by modulating the amplitude (DynAmp), frequency (DynFreq), or amplitude and frequency (DynBoth). ICMS was provided for either 1-s with 4-s breaks (Short) or for 30-s with 15-s breaks (Long).

RESULTS

DynAmp and DynBoth trains evoked distinct onset and offset transients in recruited neural populations, while DynFreq trains evoked population activity similar to Fixed trains. Individual neurons had heterogeneous responses primarily based on how quickly they depressed to ICMS, where neurons farther from the electrode depressed faster and a small subpopulation (1-5%) were modulated by DynFreq trains. Neurons that depressed to Short trains were also more likely to depress to Long trains, but Long trains induced more depression overall due to the increased stimulation length. Increasing the amplitude during the hold phase resulted in an increase in recruitment and intensity which resulted in more depression and reduced offset responses. Dynamic amplitude modulation reduced stimulation induced depression by 14.6 ± 0.3% for Short and 36.1 ± 0.6% for Long trains. Ideal observers were 0.031 ± 0.009 s faster for onset detection and 1.33 ± 0.21 s faster for offset detection with dynamic amplitude encoding.

CONCLUSIONS

Dynamic amplitude modulation evokes distinct onset and offset transients, reduces depression of neural calcium activity, and decreases total charge injection for sensory feedback in BCIs by lowering recruitment of neurons during long maintained periods of ICMS. In contrast, dynamic frequency modulation evokes distinct onset and offset transients in a small subpopulation of neurons but also reduces depression in recruited neurons by reducing the rate of activation.