1
|
Valle G, Alamri AH, Downey JE, Lienkämper R, Jordan PM, Sobinov AR, Endsley LJ, Prasad D, Boninger ML, Collinger JL, Warnke PC, Hatsopoulos NG, Miller LE, Gaunt RA, Greenspon CM, Bensmaia SJ. Tactile edges and motion via patterned microstimulation of the human somatosensory cortex. Science 2025; 387:315-322. [PMID: 39818881 PMCID: PMC11994950 DOI: 10.1126/science.adq5978] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2024] [Accepted: 11/01/2024] [Indexed: 01/19/2025]
Abstract
Intracortical microstimulation (ICMS) of somatosensory cortex evokes tactile sensations whose properties can be systematically manipulated by varying stimulation parameters. However, ICMS currently provides an imperfect sense of touch, limiting manual dexterity and tactile experience. Leveraging our understanding of how tactile features are encoded in the primary somatosensory cortex (S1), we sought to inform individuals with paralysis about local geometry and apparent motion of objects on their skin. We simultaneously delivered ICMS through electrodes with spatially patterned projected fields (PFs), evoking sensations of edges. We then created complex PFs that encode arbitrary tactile shapes and skin indentation patterns. By delivering spatiotemporally patterned ICMS, we evoked sensation of motion across the skin, the speed and direction of which could be controlled. Thus, we improved individuals' tactile experience and use of brain-controlled bionic hands.
Collapse
Affiliation(s)
- Giacomo Valle
- Department of Organismal Biology and Anatomy, University of Chicago, 60637 Chicago, IL
- Department of Electrical Engineering, Chalmers University of Technology, 41296 Goteborg, Sweden
| | - Ali H. Alamri
- Committee on Computational Neuroscience, University of Chicago, 60637 Chicago, IL
| | - John E. Downey
- Department of Organismal Biology and Anatomy, University of Chicago, 60637 Chicago, IL
| | - Robin Lienkämper
- Rehab Neural Engineering Labs, University of Pittsburgh, 15219 Pittsburgh, PA
| | - Patrick M. Jordan
- Department of Organismal Biology and Anatomy, University of Chicago, 60637 Chicago, IL
| | - Anton R. Sobinov
- Department of Organismal Biology and Anatomy, University of Chicago, 60637 Chicago, IL
| | - Linnea J. Endsley
- Department of Organismal Biology and Anatomy, University of Chicago, 60637 Chicago, IL
| | - Dillan Prasad
- Department of Organismal Biology and Anatomy, University of Chicago, 60637 Chicago, IL
| | - Michael L. Boninger
- Rehab Neural Engineering Labs, University of Pittsburgh, 15219 Pittsburgh, PA
- Department of Physical Medicine and Rehabilitation, University of Pittsburgh, 15213 Pittsburgh, PA
- Department of Bioengineering, University of Pittsburgh, 15260 Pittsburgh, PA
| | - Jennifer L. Collinger
- Rehab Neural Engineering Labs, University of Pittsburgh, 15219 Pittsburgh, PA
- Department of Physical Medicine and Rehabilitation, University of Pittsburgh, 15213 Pittsburgh, PA
- Department of Bioengineering, University of Pittsburgh, 15260 Pittsburgh, PA
| | - Peter C. Warnke
- Department of Neurological Surgery, University of Chicago, 60637 Chicago, IL
| | - Nicholas G. Hatsopoulos
- Department of Organismal Biology and Anatomy, University of Chicago, 60637 Chicago, IL
- Committee on Computational Neuroscience, University of Chicago, 60637 Chicago, IL
- Neuroscience Institute, University of Chicago, 60637 Chicago, IL
| | - Lee E. Miller
- Department of Neuroscience, Northwestern University, 60611 Chicago, IL
- Department of Biomedical Engineering, Northwestern University, 60208 Evanston, IL
- Department of Physical Medicine and Rehabilitation, Northwestern University, 60611 Chicago, IL
- Shirley Ryan Ability Lab, 60611 Chicago, IL
| | - Robert A. Gaunt
- Rehab Neural Engineering Labs, University of Pittsburgh, 15219 Pittsburgh, PA
- Department of Physical Medicine and Rehabilitation, University of Pittsburgh, 15213 Pittsburgh, PA
- Department of Bioengineering, University of Pittsburgh, 15260 Pittsburgh, PA
| | - Charles M. Greenspon
- Department of Organismal Biology and Anatomy, University of Chicago, 60637 Chicago, IL
| | - Sliman J. Bensmaia
- Department of Organismal Biology and Anatomy, University of Chicago, 60637 Chicago, IL
- Committee on Computational Neuroscience, University of Chicago, 60637 Chicago, IL
- Neuroscience Institute, University of Chicago, 60637 Chicago, IL
| |
Collapse
|
2
|
Eguchi R, Vacek D, Godzinski C, Okamura AM. Between-Tactor Display Using Dynamic Tactile Stimuli for Directional Cueing in Vibrating Environments. IEEE TRANSACTIONS ON HAPTICS 2024; 17:503-508. [PMID: 37578911 DOI: 10.1109/toh.2023.3304953] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/16/2023]
Abstract
Torso-worn vibrotactile devices have been used in many studies on directional cueing and navigation in environments where visual feedback is limited. These devices aim to indicate directions with high resolution while using the smallest possible number of vibration motors (tactors). Resolution can be increased using between-tactor displays, but their performance in vibrating environments (e.g., a helicopter) are unknown. This study proposes a between-tactor display using dynamic stimuli and verifies its effectiveness when the user sits in a vibrating chair. We developed a waist belt device that displays 12 directions using 6 tactors. Static stimuli display virtual (between-tactor) locations by constantly vibrating two adjacent tactors equally, whereas dynamic stimuli move the virtual vibration position back and forth between tactors. We performed two studies in which participants felt tactile stimuli and used a joystick to move a cursor on a screen to a target in the perceived direction. Direction recognition accuracy and task completion time were measured under combined conditions of two belt orientations (tactor alignments), with and without chair vibration, and with and without audio white noise to mask tactor sound. In all conditions, dynamic stimuli increased recognition accuracy while maintaining task completion time compared to static stimuli.
Collapse
|
3
|
Gardella N, Riggs SL. Establishing Natural Tactile Mappings: Mapping Tactile Parameters to Continuous Data Concepts. IEEE TRANSACTIONS ON HAPTICS 2024; 17:80-85. [PMID: 38294920 DOI: 10.1109/toh.2024.3357416] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/02/2024]
Abstract
There has been limited work developing natural mappings between tactile signals and common data concepts in data rich domains. If these mappings can be established, tactile displays can become more intuitive and readily adopted. The present study aims to identify general natural mappings between perceptual dimensions of vibration and continuous data concepts. Twenty-one participants were tasked to map four different tactile parameters to four different data concepts-pressure, concentration, size, and speed. We found that an increase in intensity was good at conveying increases for all data concepts. We also found that speed, pressure, concentration, and size all have at least one strong natural mapping.
Collapse
|
4
|
Abstract
Dealing safely with nuclear waste is an imperative for the nuclear industry. Increasingly, robots are being developed to carry out complex tasks such as perceiving, grasping, cutting, and manipulating waste. Radioactive material can be sorted, and either stored safely or disposed of appropriately, entirely through the actions of remotely controlled robots. Radiological characterisation is also critical during the decommissioning of nuclear facilities. It involves the detection and labelling of radiation levels, waste materials, and contaminants, as well as determining other related parameters (e.g., thermal and chemical), with the data visualised as 3D scene models. This paper overviews work by researchers at the QMUL Centre for Advanced Robotics (ARQ), a partner in the UK EPSRC National Centre for Nuclear Robotics (NCNR), a consortium working on the development of radiation-hardened robots fit to handle nuclear waste. Three areas of nuclear-related research are covered here: human–robot interfaces for remote operations, sensor delivery, and intelligent robotic manipulation.
Collapse
|
5
|
Gomes KM, Reeves ST, Riggs SL. The Evaluation of Tactile Parameters and Display Prototype to Support Physiological Monitoring and Multitasking for Anesthesia Providers in the Operating Room. IEEE TRANSACTIONS ON HAPTICS 2020; 13:628-644. [PMID: 31869800 DOI: 10.1109/toh.2019.2960017] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Communicating physiological information via the tactile modality is shown as a promising means to address data overload faced by anesthesia providers. However, it is important to ensure that the tactile parameters which represent information are intuitive. There is currently no consensus on which tactile parameters should be used to present information within anesthesia. The two studies presented here evaluate: (a) a set of 24 tactile cues manipulating intensity, temporal, and spatial tactile parameters in a usability study and (b) a prototype tactile display based on the usability study's findings in a single and dual-task scenario. Findings of the usability study show intensity and temporal were rated most urgent and had the most potential to represent changes in physiological measures. This was confirmed in the follow up study as increases/decreases in intensity were shown to represent increases/decreases in a physiological measure and using different spatial locations to represent physiological measures resulted in greater than 95% response accuracy. Response times and accuracy were not adversely affected while performing a secondary task. The findings contribute to a better understanding of how to map tactile parameters to physiological information and demonstrate the effectiveness of end-user feedback in tactile display design to develop intuitive alerts.
Collapse
|