Perception of microstimulation frequency in human somatosensory cortex

Visual context affects the perceived timing of tactile sensations elicited through intra-cortical microstimulation

Intra-cortical microstimulation (ICMS) is a technique to provide tactile sensations for a somatosensory brain-machine interface (BMI). A viable BMI must function within the rich, multisensory environment of the real world, but how ICMS is integrated with other sensory modalities is poorly understood. To investigate how ICMS percepts are integrated with visual information, ICMS and visual stimuli were delivered at varying times relative to one another. Both visual context and ICMS current amplitude were found to bias the qualitative experience of ICMS. In two tetraplegic participants, ICMS and visual stimuli were more likely to be experienced as occurring simultaneously when visual stimuli were more realistic, demonstrating an effect of visual context on the temporal binding window. The peak of the temporal binding window varied but was consistently offset from zero, suggesting that multisensory integration with ICMS can suffer from temporal misalignment. Recordings from primary somatosensory cortex (S1) during catch trials where visual stimuli were delivered without ICMS demonstrated that S1 represents visual information related to ICMS across visual contexts.

Protocol for recording neural activity evoked by electrical stimulation in mice using two-photon calcium imaging

Electrical stimulation provides a clinically viable approach for treating neurological disorders. Here, we present a protocol for recording neural activity evoked by electrical stimulation in mice using two-photon calcium imaging. We detail steps for chronically implanting a head fixation bar, a stimulating electrode, and a glass imaging window. We additionally describe the procedures for viral injections and awake head-fixed recordings. For complete details on the use and execution of this protocol, please refer to Dadarlat et al.1.

Electrode sharpness and insertion speed reduce tissue damage near high-density penetrating arrays

Objective. Over the past decade, neural electrodes have played a crucial role in bridging biological tissues with electronic and robotic devices. This study focuses on evaluating the optimal tip profile and insertion speed for effectively implanting Paradromics' high-density fine microwire arrays (FμA) prototypes into the primary visual cortex (V1) of mice and rats, addressing the challenges associated with the 'bed-of-nails' effect and tissue dimpling.Approach. Tissue response was assessed by investigating the impact of electrodes on the blood-brain barrier (BBB) and cellular damage, with a specific emphasis on tailored insertion strategies to minimize tissue disruption during electrode implantation.Main results.Electro-sharpened arrays demonstrated a marked reduction in cellular damage within 50μm of the electrode tip compared to blunt and angled arrays. Histological analysis revealed that slow insertion speeds led to greater BBB compromise than fast and pneumatic methods. Successful single-unit recordings validated the efficacy of the optimized electro-sharpened arrays in capturing neural activity.Significance.These findings underscore the critical role of tailored insertion strategies in minimizing tissue damage during electrode implantation, highlighting the suitability of electro-sharpened arrays for long-term implant applications. This research contributes to a deeper understanding of the complexities associated with high-channel-count microelectrode array implantation, emphasizing the importance of meticulous assessment and optimization of key parameters for effective integration and minimal tissue disruption. By elucidating the interplay between insertion parameters and tissue response, our study lays a strong foundation for the development of advanced implantable devices with a reduction in reactive gliosis and improved performance in neural recording applications.

The evolution of neuromodulation for chronic stroke: From neuroplasticity mechanisms to brain-computer interfaces

Stroke is one of the most common and debilitating neurological conditions worldwide. Those who survive experience motor, sensory, speech, vision, and/or cognitive deficits that severely limit remaining quality of life. While rehabilitation programs can help improve patients' symptoms, recovery is often limited, and patients frequently continue to experience impairments in functional status. In this review, invasive neuromodulation techniques to augment the effects of conventional rehabilitation methods are described, including vagus nerve stimulation (VNS), deep brain stimulation (DBS) and brain-computer interfaces (BCIs). In addition, the evidence base for each of these techniques, pivotal trials, and future directions are explored. Finally, emerging technologies such as functional near-infrared spectroscopy (fNIRS) and the shift to artificial intelligence-enabled implants and wearables are examined. While the field of implantable devices for chronic stroke recovery is still in a nascent stage, the data reviewed are suggestive of immense potential for reducing the impact and impairment from this globally prevalent disorder.

Activity-dependent recruitment of inhibition and excitation in the awake mammalian cortex during electrical stimulation

Electrical stimulation is an effective tool for mapping and altering brain connectivity, with applications ranging from treating pharmacology-resistant neurological disorders to providing sensory feedback for neural prostheses. Paramount to the success of these applications is the ability to manipulate electrical currents to precisely control evoked neural activity patterns. However, little is known about stimulation-evoked responses in inhibitory neurons nor how stimulation-evoked activity patterns depend on ongoing neural activity. In this study, we used 2-photon imaging and cell-type specific labeling to measure single-cell responses of excitatory and inhibitory neurons to electrical stimuli in the visual cortex of awake mice. Our data revealed strong interactions between electrical stimulation and pre-stimulus activity of single neurons in awake animals and distinct recruitment and response patterns for excitatory and inhibitory neurons. This work demonstrates the importance of cell-type-specific labeling of neurons in future studies.

Neural mechanisms of the temporal response of cortical neurons to intracortical microstimulation

BACKGROUND

Intracortical microstimulation (ICMS) is used to map neuronal circuitry in the brain and restore lost sensory function, including vision, hearing, and somatosensation. The temporal response of cortical neurons to single pulse ICMS is remarkably stereotyped and comprises short latency excitation followed by prolonged inhibition and, in some cases, rebound excitation. However, the neural origin of the different response components to ICMS are poorly understood, and the interactions between the three response components during trains of ICMS pulses remains unclear.

OBJECTIVE

We used computational modeling to determine the mechanisms contributing to the temporal response to ICMS in model cortical neurons.

METHODS

We implemented a biophysically based computational model of a cortical column comprising neurons with realistic morphology and synapses and quantified the temporal response of cortical neurons to different ICMS protocols. We characterized the temporal responses to single pulse ICMS across stimulation intensities and inhibitory (GABA-B/GABA-A) synaptic strengths. To probe interactions between response components, we quantified the response to paired pulse ICMS at different inter-pulse intervals and the response to short trains at different stimulation frequencies. Finally, we evaluated the performance of biomimetic ICMS trains in evoking sustained neural responses.

RESULTS

Single pulse ICMS evoked short latency excitation followed by a period of inhibition, but model neurons did not exhibit post-inhibitory excitation. The strength of short latency excitation increased and the duration of inhibition increased with increased stimulation amplitude. Prolonged inhibition resulted from both after-hyperpolarization currents and GABA-B synaptic transmission. During the paired pulse protocol, the strength of short latency excitation evoked by a test pulse decreased marginally compared to those evoked by a single pulse for interpulse intervals (IPI) < 100 m s. Further, the duration of inhibition evoked by the test pulse was prolonged compared to single pulse for IPIs <50 m s and was not predicted by linear superposition of individual inhibitory responses. For IPIs>50 m s, the duration of inhibition evoked by the test pulse was comparable to those evoked by a single pulse. Short ICMS trains evoked repetitive excitatory responses against a background of inhibition. However, the strength of the repetitive excitatory response declined during ICMS at higher frequencies. Further, the duration of inhibition at the cessation of ICMS at higher frequencies was prolonged compared to the duration following a single pulse. Biomimetic pulse trains evoked comparable neural response between the onset and offset phases despite the presence of stimulation induced inhibition.

CONCLUSIONS

The cortical column model replicated the short latency excitation and long-lasting inhibitory components of the stereotyped neural response documented in experimental studies of ICMS. Both cellular and synaptic mechanisms influenced the response components generated by ICMS. The non-linear interactions between response components resulted in dynamic ICMS-evoked neural activity and may play an important role in mediating the ICMS-induced precepts.

Biomimetic computer-to-brain communication enhancing naturalistic touch sensations via peripheral nerve stimulation

Artificial communication with the brain through peripheral nerve stimulation shows promising results in individuals with sensorimotor deficits. However, these efforts lack an intuitive and natural sensory experience. In this study, we design and test a biomimetic neurostimulation framework inspired by nature, capable of "writing" physiologically plausible information back into the peripheral nervous system. Starting from an in-silico model of mechanoreceptors, we develop biomimetic stimulation policies. We then experimentally assess them alongside mechanical touch and common linear neuromodulations. Neural responses resulting from biomimetic neuromodulation are consistently transmitted towards dorsal root ganglion and spinal cord of cats, and their spatio-temporal neural dynamics resemble those naturally induced. We implement these paradigms within the bionic device and test it with patients (ClinicalTrials.gov identifier NCT03350061). He we report that biomimetic neurostimulation improves mobility (primary outcome) and reduces mental effort (secondary outcome) compared to traditional approaches. The outcomes of this neuroscience-driven technology, inspired by the human body, may serve as a model for advancing assistive neurotechnologies.

Primary somatosensory cortex organization for engineering artificial somatosensation

Somatosensory deficits from stroke, spinal cord injury, or other neurologic damage can lead to a significant degree of functional impairment. The primary (SI) and secondary (SII) somatosensory cortices encode information in a medial to lateral organization. SI is generally organized topographically, with more discrete cortical representations of specific body regions. SII regions corresponding to anatomical areas are less discrete and may represent a more functional rather than topographic organization. Human somatosensory research continues to map cortical areas of sensory processing with efforts primarily focused on hand and upper extremity information in SI. However, research into SII and other body regions is lacking. In this review, we synthesize the current state of knowledge regarding the cortical organization of human somatosensation and discuss potential applications for brain computer interface. In addition to accurate individualized mapping of cortical somatosensation, further research is required to uncover the neurophysiological mechanisms of how somatosensory information is encoded in the cortex.

Neuromorphic hardware for somatosensory neuroprostheses

In individuals with sensory-motor impairments, missing limb functions can be restored using neuroprosthetic devices that directly interface with the nervous system. However, restoring the natural tactile experience through electrical neural stimulation requires complex encoding strategies. Indeed, they are presently limited in effectively conveying or restoring tactile sensations by bandwidth constraints. Neuromorphic technology, which mimics the natural behavior of neurons and synapses, holds promise for replicating the encoding of natural touch, potentially informing neurostimulation design. In this perspective, we propose that incorporating neuromorphic technologies into neuroprostheses could be an effective approach for developing more natural human-machine interfaces, potentially leading to advancements in device performance, acceptability, and embeddability. We also highlight ongoing challenges and the required actions to facilitate the future integration of these advanced technologies.

Amplitude- and frequency-dependent activation of layer II/III neurons by intracortical microstimulation

Intracortical microstimulation (ICMS) has been used for the development of brain machine interfaces. However, further understanding about the spatiotemporal responses of neurons to different electrical stimulation parameters is necessary to inform the design of optimal therapies. In this study, we employed in vivo electrophysiological recording, two-photon calcium imaging, and electric field simulation to evaluate the acute effect of ICMS on layer II/III neurons. Our results show that stimulation frequency non-linearly modulates neuronal responses, whereas the magnitude of responses is linearly correlated to the electric field strength and stimulation amplitude before reaching a steady state. Temporal dynamics of neurons' responses depends more on stimulation frequency and their distance to the stimulation electrode. In addition, amplitude-dependent post-stimulation suppression was observed within ∼500 μm of the stimulation electrode, as evidenced by both calcium imaging and local field potentials. These findings provide insights for selecting stimulation parameters to achieve desirable spatiotemporal specificity of ICMS.

Microstimulation of human somatosensory cortex evokes task-dependent, spatially patterned responses in motor cortex

The primary motor (M1) and somatosensory (S1) cortices play critical roles in motor control but the signaling between these structures is poorly understood. To fill this gap, we recorded - in three participants in an ongoing human clinical trial (NCT01894802) for people with paralyzed hands - the responses evoked in the hand and arm representations of M1 during intracortical microstimulation (ICMS) in the hand representation of S1. We found that ICMS of S1 activated some M1 neurons at short, fixed latencies consistent with monosynaptic activation. Additionally, most of the ICMS-evoked responses in M1 were more variable in time, suggesting indirect effects of stimulation. The spatial pattern of M1 activation varied systematically: S1 electrodes that elicited percepts in a finger preferentially activated M1 neurons excited during that finger's movement. Moreover, the indirect effects of S1 ICMS on M1 were context dependent, such that the magnitude and even sign relative to baseline varied across tasks. We tested the implications of these effects for brain-control of a virtual hand, in which ICMS conveyed tactile feedback. While ICMS-evoked activation of M1 disrupted decoder performance, this disruption was minimized using biomimetic stimulation, which emphasizes contact transients at the onset and offset of grasp, and reduces sustained stimulation.

Neuronal functional connectivity is impaired in a layer dependent manner near the chronically implanted microelectrodes

Objective

This study aims to reveal longitudinal changes in functional network connectivity within and across different brain structures near the chronically implanted microelectrode. While it is well established that the foreign-body response (FBR) contributes to the gradual decline of the signals recorded from brain implants over time, how does the FBR impact affect the functional stability of neural circuits near implanted Brain-Computer Interfaces (BCIs) remains unknown. This research aims to illuminate how the chronic FBR can alter local neural circuit function and the implications for BCI decoders.

Approach

This study utilized multisite Michigan-style microelectrodes that span all cortical layers and the hippocampal CA1 region to collect spontaneous and visually-evoked electrophysiological activity. Alterations in neuronal activity near the microelectrode were tested assessing cross-frequency synchronization of LFP and spike entrainment to LFP oscillatory activity throughout 16 weeks after microelectrode implantation.

Main Results

The study found that cortical layer 4, the input-receiving layer, maintained activity over the implantation time. However, layers 2/3 rapidly experienced severe impairment, leading to a loss of proper intralaminar connectivity in the downstream output layers 5/6. Furthermore, the impairment of interlaminar connectivity near the microelectrode was unidirectional, showing decreased connectivity from Layers 2/3 to Layers 5/6 but not the reverse direction. In the hippocampus, CA1 neurons gradually became unable to properly entrain to the surrounding LFP oscillations.

Significance

This study provides a detailed characterization of network connectivity dysfunction over long-term microelectrode implantation periods. This new knowledge could contribute to the development of targeted therapeutic strategies aimed at improving the health of the tissue surrounding brain implants and potentially inform engineering of adaptive decoders as the FBR progresses. Our study's understanding of the dynamic changes in the functional network over time opens the door to developing interventions for improving the long-term stability and performance of intracortical microelectrodes.

Interactions between cathodic- and anodic-pulses during high-frequency stimulations with the monophasic-pulses alternating in polarity at axons-experiment and simulation studies

Background. Electrical neuromodulation therapies commonly utilize high-frequency stimulations (HFS) of biphasic-pulses to treat neurological disorders. The biphasic pulse consists of a leading cathodic-phase to activate neurons and a lagging anodic-phase to balance electrical charges. Because both monophasic cathodic- and anodic-pulses can depolarize neuronal membranes, splitting biphasic-pulses into alternate cathodic- and anodic-pulses could be a feasible strategy to improve stimulation efficiency.Objective. We speculated that neurons in the volume initially activated by both polarity pulses could change to be activated only by anodic-pulses during sustained HFS of alternate monophasic-pulses. To verify the hypothesis, we investigated the interactions of the monophasic pulses during HFS and revealed possible underlying mechanisms.Approach. Different types of pulse stimulations were applied at the alvear fibers (i.e. the axons of CA1 pyramidal neurons) to antidromically activate the neuronal cell bodies in the hippocampal CA1 region of anesthetized ratsin-vivo. Sequences of antidromic HFS (A-HFS) were applied with alternate monophasic-pulses or biphasic-pulses. The pulse frequency in the A-HFS sequences was 50 or 100 Hz. The A-HFS duration was 120 s. The amplitude of antidromically-evoked population spike was measured to evaluate the neuronal firing induced by each pulse. A computational model of axon was used to explore the possible mechanisms of neuronal modulations. The changes of model variables during sustained A-HFS were analyzed.Main results. In rat experiments, with a same pulse intensity, the activation volume of a cathodic-pulse was greater than that of an anodic-pulse. In paired-pulse tests, a preceding cathodic-pulse was able to prevent a following anodic-pulse from activating neurons due to refractory period. This indicated that the activation volume of a cathodic-pulse covered that of an anodic-pulse. However, during sustained A-HFS of alternate monophasic-pulses, the anodic-pulses were able to prevail over the cathodic-pulses in activating neurons in the overlapped activation volume. Model simulation results show the mechanisms of the activation failures of cathodic-pulses. They include the excessive membrane depolarization caused by an accumulation of potassium ions, the obstacle of hyperpolarization in the conduction pathway and the interactions from anodic-pulses.Significance. The study firstly showed the domination of anodic-pulses over cathodic-pulses in their competitions to activate neurons during sustained HFS. The finding provides new clues for designing HFS paradigms to improve the efficiency of neuromodulation therapies.

Aberrant accumulation of age- and disease-associated factors following neural probe implantation in a mouse model of Alzheimer's disease

Objective. Electrical stimulation has had a profound impact on our current understanding of nervous system physiology and provided viable clinical options for addressing neurological dysfunction within the brain. Unfortunately, the brain's immune suppression of indwelling microelectrodes currently presents a major roadblock in the long-term application of neural recording and stimulating devices. In some ways, brain trauma induced by penetrating microelectrodes produces similar neuropathology as debilitating brain diseases, such as Alzheimer's disease (AD), while also suffering from end-stage neuron loss and tissue degeneration. The goal of the present study was to understand whether there may be any parallel mechanisms at play between brain injury from chronic microelectrode implantation and those of neurodegenerative disorder.Approach. We used two-photon microscopy to visualize the accumulation, if any, of age- and disease-associated factors around chronically implanted electrodes in both young and aged mouse models of AD.Main results. We determined that electrode injury leads to aberrant accumulation of lipofuscin, an age-related pigment, in wild-type and AD mice alike. Furthermore, we reveal that chronic microelectrode implantation reduces the growth of pre-existing Alzheimer's plaques while simultaneously elevating amyloid burden at the electrode-tissue interface. Lastly, we uncover novel spatial and temporal patterns of glial reactivity, axonal and myelin pathology, and neurodegeneration related to neurodegenerative disease around chronically implanted microelectrodes.Significance. This study offers multiple novel perspectives on the possible neurodegenerative mechanisms afflicting chronic brain implants, spurring new potential avenues of neuroscience investigation and design of more targeted therapies for improving neural device biocompatibility and treatment of degenerative brain disease.

Neural Plasticity in Sensorimotor Brain-Machine Interfaces

Brain-machine interfaces (BMIs) aim to treat sensorimotor neurological disorders by creating artificial motor and/or sensory pathways. Introducing artificial pathways creates new relationships between sensory input and motor output, which the brain must learn to gain dexterous control. This review highlights the role of learning in BMIs to restore movement and sensation, and discusses how BMI design may influence neural plasticity and performance. The close integration of plasticity in sensory and motor function influences the design of both artificial pathways and will be an essential consideration for bidirectional devices that restore both sensory and motor function.

Aberrant accumulation of age- and disease-associated factors following neural probe implantation in a mouse model of Alzheimer's disease

Electrical stimulation has had a profound impact on our current understanding of nervous system physiology and provided viable clinical options for addressing neurological dysfunction within the brain. Unfortunately, the brain's immune suppression of indwelling microelectrodes currently presents a major roadblock in the long-term application of neural recording and stimulating devices. In some ways, brain trauma induced by penetrating microelectrodes produces similar neuropathology as debilitating brain diseases, such as Alzheimer's disease (AD), while also suffering from end-stage neuron loss and tissue degeneration. To understand whether there may be any parallel mechanisms at play between brain injury from chronic microelectrode implantation and those of neurodegenerative disorder, we used two-photon microscopy to visualize the accumulation, if any, of age- and disease-associated factors around chronically implanted electrodes in both young and aged mouse models of AD. With this approach, we determined that electrode injury leads to aberrant accumulation of lipofuscin, an age-related pigment, in wild-type and AD mice alike. Furthermore, we reveal that chronic microelectrode implantation reduces the growth of pre-existing amyloid plaques while simultaneously elevating amyloid burden at the electrode-tissue interface. Lastly, we uncover novel spatial and temporal patterns of glial reactivity, axonal and myelin pathology, and neurodegeneration related to neurodegenerative disease around chronically implanted microelectrodes. This study offers multiple novel perspectives on the possible neurodegenerative mechanisms afflicting chronic brain implants, spurring new potential avenues of neuroscience investigation and design of more targeted therapies for improving neural device biocompatibility and treatment of degenerative brain disease.

Neuroprosthetics: from sensorimotor to cognitive disorders

Neuroprosthetics is a multidisciplinary field at the interface between neurosciences and biomedical engineering, which aims at replacing or modulating parts of the nervous system that get disrupted in neurological disorders or after injury. Although neuroprostheses have steadily evolved over the past 60 years in the field of sensory and motor disorders, their application to higher-order cognitive functions is still at a relatively preliminary stage. Nevertheless, a recent series of proof-of-concept studies suggest that electrical neuromodulation strategies might also be useful in alleviating some cognitive and memory deficits, in particular in the context of dementia. Here, we review the evolution of neuroprosthetics from sensorimotor to cognitive disorders, highlighting important common principles such as the need for neuroprosthetic systems that enable multisite bidirectional interactions with the nervous system.

In vivo spatiotemporal dynamics of astrocyte reactivity following neural electrode implantation

Brain computer interfaces (BCIs), including penetrating microelectrode arrays, enable both recording and stimulation of neural cells. However, device implantation inevitably causes injury to brain tissue and induces a foreign body response, leading to reduced recording performance and stimulation efficacy. Astrocytes in the healthy brain play multiple roles including regulating energy metabolism, homeostatic balance, transmission of neural signals, and neurovascular coupling. Following an insult to the brain, they are activated and gather around the site of injury. These reactive astrocytes have been regarded as one of the main contributors to the formation of a glial scar which affects the performance of microelectrode arrays. This study investigates the dynamics of astrocytes within the first 2 weeks after implantation of an intracortical microelectrode into the mouse brain using two-photon microscopy. From our observation astrocytes are highly dynamic during this period, exhibiting patterns of process extension, soma migration, morphological activation, and device encapsulation that are spatiotemporally distinct from other glial cells, such as microglia or oligodendrocyte precursor cells. This detailed characterization of astrocyte reactivity will help to better understand the tissue response to intracortical devices and lead to the development of more effective intervention strategies to improve the functional performance of neural interfacing technology.

Clinical neuroscience and neurotechnology: An amazing symbiosis

In the last decades, clinical neuroscience found a novel ally in neurotechnologies, devices able to record and stimulate electrical activity in the nervous system. These technologies improved the ability to diagnose and treat neural disorders. Neurotechnologies are concurrently enabling a deeper understanding of healthy and pathological dynamics of the nervous system through stimulation and recordings during brain implants. On the other hand, clinical neurosciences are not only driving neuroengineering toward the most relevant clinical issues, but are also shaping the neurotechnologies thanks to clinical advancements. For instance, understanding the etiology of a disease informs the location of a therapeutic stimulation, but also the way stimulation patterns should be designed to be more effective/naturalistic. Here, we describe cases of fruitful integration such as Deep Brain Stimulation and cortical interfaces to highlight how this symbiosis between clinical neuroscience and neurotechnology is closer to a novel integrated framework than to a simple interdisciplinary interaction.

Characterizing the short-latency evoked response to intracortical microstimulation across a multi-electrode array

OBJECTIVE

Persons with tetraplegia can use brain-machine interfaces to make visually guided reaches with robotic arms. Without somatosensory feedback, these movements will likely be slow and imprecise, like those of persons who retain movement but have lost proprioception. Intracortical microstimulation (ICMS) has promise for providing artificial somatosensory feedback. If ICMS can mimic naturally occurring neural activity, afferent interfaces may be more informative and easier to learn than interfaces that evoke unnaturalistic activity. To develop such biomimetic stimulation patterns, it is important to characterize the responses of neurons to ICMS.

APPROACH

Using a Utah multi-electrode array, we recorded activity evoked by single pulses and trains of ICMS at a wide range of amplitudes and frequencies in two rhesus macaques. As the electrical artifact caused by ICMS typically prevents recording for many milliseconds, we deployed a custom rapid-recovery amplifier with nonlinear gain to limit signal saturation on the stimulated electrode. Across all electrodes after stimulation, we removed the remaining slow return to baseline with acausal high-pass filtering of time-reversed recordings.

MAIN RESULTS

After single pulses of stimulation, we recorded what was likely transsynaptically-evoked activity even on the stimulated electrode as early as ~0.7 ms. This was immediately followed by suppressed neural activity lasting 10-150 ms. After trains, this long-lasting inhibition was replaced by increased firing rates for ~100 ms. During long trains, the evoked response on the stimulated electrode decayed rapidly while the response was maintained on non-stimulated channels.

SIGNIFICANCE

The detailed description of the spatial and temporal response to ICMS can be used to better interpret results from experiments that probe circuit connectivity or function of cortical areas. These results can also contribute to the design of stimulation patterns to improve afferent interfaces for artificial sensory feedback.

The science and engineering behind sensitized brain-controlled bionic hands

Advances in our understanding of brain function, along with the development of neural interfaces that allow for the monitoring and activation of neurons, have paved the way for brain-machine interfaces (BMIs), which harness neural signals to reanimate the limbs via electrical activation of the muscles or to control extracorporeal devices, thereby bypassing the muscles and senses altogether. BMIs consist of reading out motor intent from the neuronal responses monitored in motor regions of the brain and executing intended movements with bionic limbs, reanimated limbs, or exoskeletons. BMIs also allow for the restoration of the sense of touch by electrically activating neurons in somatosensory regions of the brain, thereby evoking vivid tactile sensations and conveying feedback about object interactions. In this review, we discuss the neural mechanisms of motor control and somatosensation in able-bodied individuals and describe approaches to use neuronal responses as control signals for movement restoration and to activate residual sensory pathways to restore touch. Although the focus of the review is on intracortical approaches, we also describe alternative signal sources for control and noninvasive strategies for sensory restoration.

Evaluation of multiple perceptual qualities of transcutaneous electrical nerve stimulation for evoked tactile sensation in forearm amputees

OBJECTIVE

Evoked tactile sensation (ETS) elicited by transcutaneous electrical nerve stimulation (TENS) is promising to convey digit-specific sensory information to amputees naturally and non-invasively. Fitting ETS-based sensory feedback to amputees entails customizing coding of multiple sensory information for each stimulation site. This study was to elucidate the consistency of percepts and qualities by TENS at multiple stimulation sites in amputees retaining ETS.

APPROACH

Five transradial amputees with ETS and fourteen able-bodied subjects participated in this study. Surface electrodes with small size (10 mm in diameter) were adopted to fit the restricted projected finger map on the forearm stump of amputees. Effects of stimulus frequency on sensory types were assessed, and the map of perceptual threshold for each sensation was characterized. Sensitivity for vibration and buzz sensations was measured using distinguishable difference in stimulus pulse width. Rapid assessments for modulation ranges of pulse width at fixed amplitude and frequency were developed for coding sensory information. Buzz sensation was demonstrated for location discrimination relating to prosthetic fingers.

MAIN RESULTS

Vibration and buzz sensations were consistently evoked at 20 Hz and 50 Hz as dominant sensation types in all amputees and able-bodied subjects. Perceptual thresholds of different sensations followed a similar strength-duration curve relating stimulus amplitude to pulse width. The averaged distinguishable difference in pulse width was 12.84 ± 7.23 μs for vibration and 15.21 ± 6.47 μs for buzz in able-bodied subjects, and 14.91 ± 10.54 μs for vibration and 11.30 ± 3.42 μs for buzz in amputees. Buzz coding strategy enabled five amputees to discriminate contact of individual fingers with an overall accuracy of 77.85%.

SIGNIFICANCE

The consistency in perceptual qualities of dominant sensations can be exploited for coding multi-modality sensory feedback. A fast protocol of sensory coding is possible for fitting ETS-based, non-invasive sensory feedback to amputees.

Frequency Shapes the Quality of Tactile Percepts Evoked through Electrical Stimulation of the Nerves

Electrical stimulation of the peripheral nerves of human participants provides a unique opportunity to study the neural determinants of perceptual quality using a causal manipulation. A major challenge in the study of neural coding of touch has been to isolate the role of spike timing-at the scale of milliseconds or tens of milliseconds-in shaping the sensory experience. In the present study, we address this question by systematically varying the pulse frequency (PF) of electrical stimulation pulse trains delivered to the peripheral nerves of seven participants with upper and lower extremity limb loss via chronically implanted neural interfaces. We find that increases in PF lead to systematic increases in perceived frequency, up to ∼50 Hz, at which point further changes in PF have little to no impact on sensory quality. Above this transition frequency, ratings of perceived frequency level off, the ability to discriminate changes in PF is abolished, and verbal descriptors selected to characterize the sensation change abruptly. We conclude that sensation quality is shaped by temporal patterns of neural activation, even if these patterns are imposed on a fixed neural population, but this temporal patterning can only be resolved up to ∼50 Hz. These findings highlight the importance of spike timing in shaping the quality of a sensation and will contribute to the development of encoding strategies for conveying touch feedback through bionic hands and feet.SIGNIFICANCE STATEMENT A major challenge in the study of neural coding of touch has been to understand how temporal patterns in neuronal responses shape the sensory experience. We address this question by varying the pulse frequency (PF) of electrical pulse trains delivered through implanted nerve interfaces in seven amputees. We concomitantly vary pulse width to separate the effect of changing PF on sensory quality from its effect on perceived magnitude. We find that increases in PF lead to increases in perceived frequency, a qualitative dimension, up to ∼50 Hz, beyond which changes in PF have little impact on quality. We conclude that temporal patterning in the neuronal response can shape quality and discuss the implications for restoring touch via neural interfaces.

Intracortical microstimulation pulse waveform and frequency recruits distinct spatiotemporal patterns of cortical neuron and neuropil activation

OBJECTIVE

Neural prosthetics often use intracortical microstimulation (ICMS) for sensory restoration. To restore natural and functional feedback, we must first understand how stimulation parameters influence the recruitment of neural populations. ICMS waveform asymmetry modulates the spatial activation of neurons around an electrode at 10 Hz; however, it is unclear how asymmetry may differentially modulate population activity at frequencies typically employed in the clinic (e.g. 100 Hz). We hypothesized that stimulation waveform asymmetry would differentially modulate preferential activation of certain neural populations, and the differential population activity would be frequency-dependent.

APPROACH

We quantified how asymmetric stimulation waveforms delivered at 10 Hz or 100 Hz for 30s modulated spatiotemporal activity of cortical layer II/III pyramidal neurons using in vivo two-photon and mesoscale calcium imaging in anesthetized mice. Asymmetry is defined in terms of the ratio of the duration of the leading phase to the duration of the return phase of charge-balanced cathodal- and anodal-first waveforms (i.e. longer leading phase relative to return has larger asymmetry).

MAIN RESULTS

Neurons within 40-60µm of the electrode display stable stimulation-induced activity indicative of direct activation, which was independent of waveform asymmetry. The stability of 72% of activated neurons and the preferential activation of 20-90 % of neurons depended on waveform asymmetry. Additionally, this asymmetry-dependent activation of different neural populations was associated with differential progression of population activity. Specifically, neural activity tended to increase over time during 10 hz stimulation for some waveforms, whereas activity remained at the same level throughout stimulation for other waveforms. During 100 Hz stimulation, neural activity decreased over time for all waveforms, but decreased more for the waveforms that resulted in increasing neural activity during 10 Hz stimulation.

SIGNIFICANCE

These data demonstrate that at frequencies commonly used for sensory restoration, stimulation waveform alters the pattern of activation of different but overlapping populations of excitatory neurons. The impact of these waveform specific responses on the activation of different subtypes of neurons as well as sensory perception merits further investigation.

Intracortical Somatosensory Stimulation to Elicit Fingertip Sensations in an Individual With Spinal Cord Injury

BACKGROUND AND OBJECTIVES

The restoration of touch to fingers and fingertips is critical to achieving dexterous neuroprosthetic control for individuals with sensorimotor dysfunction. However, localized fingertip sensations have not been evoked via intracortical microstimulation (ICMS).

METHODS

Using a novel intraoperative mapping approach, we implanted electrode arrays in the finger areas of left and right somatosensory cortex and delivered ICMS over a 2-year period in a human participant with spinal cord injury.

RESULTS

Stimulation evoked tactile sensations in 8 fingers, including fingertips, spanning both hands. Evoked percepts followed expected somatotopic arrangements. The subject was able to reliably identify up to 7 finger-specific sites spanning both hands in a finger discrimination task. The size of the evoked percepts was on average 33% larger than a finger pad, as assessed via manual markings of a hand image. The size of the evoked percepts increased modestly with increased stimulation intensity, growing 21% as pulse amplitude increased from 20 to 80 µA. Detection thresholds were estimated on a subset of electrodes, with estimates of 9.2 to 35 µA observed, roughly consistent with prior studies.

DISCUSSION

These results suggest that ICMS can enable the delivery of consistent and localized fingertip sensations during object manipulation by neuroprostheses for individuals with somatosensory deficits.

CLINICALTRIALSGOV IDENTIFIER

NCT03161067.

The Relationship Between Tactile Intensity Perception and Afferent Spike Count is Moderated by a Function of Frequency

It has been suggested that tactile intensity perception can be explained by a linear function of spike rate weighted by afferent type. Other than relying on mathematical models, verifying this experimentally is difficult due to the frequency tuning of different afferent types and changes in population recruitment patterns with vibrotactile frequency. To overcome these complexities, we used pulsatile mechanical stimuli which activate the same afferent population regardless of the repetition rate (frequency), generating one action potential per pulse. We used trains of different frequencies (20-200 Hz) to investigate perceived intensity. Subjects' magnitude ratings increased with pulse rate up to ∼100 Hz and plateaued beyond this frequency. This was true regardless of pulse amplitude, from small pulses that exclusively activated Pacinian (PC) afferents, to pulses large enough to activate other afferents including slowly adapting. Electrical stimulation, which activates afferents indiscriminately, plateaued at a similar frequency, although not in all subjects. As the plateauing did not depend on indentation magnitude and hence on afferent weights, we propose that the contribution of spike count to intensity perception is weighted by a function of frequency. This may explain why fine textures evoking high frequency vibrations of a small magnitude do not feel disproportionally intense.

Perception of microstimulation frequency in human somatosensory cortex

Microstimulation in the somatosensory cortex can evoke artificial tactile percepts and can be incorporated into bidirectional brain–computer interfaces (BCIs) to restore function after injury or disease. However, little is known about how stimulation parameters themselves affect perception. Here, we stimulated through microelectrode arrays implanted in the somatosensory cortex of two human participants with cervical spinal cord injury and varied the stimulus amplitude, frequency, and train duration. Increasing the amplitude and train duration increased the perceived intensity on all tested electrodes. Surprisingly, we found that increasing the frequency evoked more intense percepts on some electrodes but evoked less-intense percepts on other electrodes. These different frequency–intensity relationships were divided into three groups, which also evoked distinct percept qualities at different stimulus frequencies. Neighboring electrode sites were more likely to belong to the same group. These results support the idea that stimulation frequency directly controls tactile perception and that these different percepts may be related to the organization of somatosensory cortex, which will facilitate principled development of stimulation strategies for bidirectional BCIs.