Clinical evaluation of wireless inductive tongue computer interface for control of computers and assistive devices

Assistive Technologies and Quadriplegia: A Map Point on the Development and Spread of the Tongue Barbell Piercing

The barbell piercing can be used as an assistive device that allows people with severe disabilities, such as tetraplegia, to control their environments using the movement of the tongue. The human tongue can move rapidly and accurately, such that the tip can touch every tooth. Lingual control systems allow people with disabilities to take advantage of their residual skills for easier communication and to improve the control of mobility and the surrounding environment. The aim of this study was to conduct a narrative review of the development and dissemination of the assistive technologies based on tongue control by means of the barbell piercing. The design of the study was based on: (I) an overview of Pubmed complemented with other databases and Web searches (also institutional); (II) an organization according to a standardized checklist for narrative reviews; (III) an arrangement with four different perspectives: the trends in the scientific literature, technological evolution and categorization, dominant approaches, issues of incorporation into the health domain-such as acceptance, safety, and regulations. The results have highlighted: (1) that the volume of scientific productions, which started in this sector before the smartphone expansion, has not increased; (2) that it is possible to make a map point of the technological evolution and categorization; (3) that these assistive technologies have a high degree of acceptance and performance, especially when integrated with aid tools with mechatronics; (4) and the complexity of the regulatory framework in this area. The study, from a general point of view, highlighted the high potential of these systems and we suggest investing the energy into agreement tools for assistive technologies (AT)s, such as health technology assessment studies, comparative assessment analysis, or consensus conferences that could allow a better diffusion and use of ATs, including these systems.

User Based Development and Test of the EXOTIC Exoskeleton: Empowering Individuals with Tetraplegia Using a Compact, Versatile, 5-DoF Upper Limb Exoskeleton Controlled through Intelligent Semi-Automated Shared Tongue Control

This paper presents the EXOTIC- a novel assistive upper limb exoskeleton for individuals with complete functional tetraplegia that provides an unprecedented level of versatility and control. The current literature on exoskeletons mainly focuses on the basic technical aspects of exoskeleton design and control while the context in which these exoskeletons should function is less or not prioritized even though it poses important technical requirements. We considered all sources of design requirements, from the basic technical functions to the real-world practical application. The EXOTIC features: (1) a compact, safe, wheelchair-mountable, easy to don and doff exoskeleton capable of facilitating multiple highly desired activities of daily living for individuals with tetraplegia; (2) a semi-automated computer vision guidance system that can be enabled by the user when relevant; (3) a tongue control interface allowing for full, volitional, and continuous control over all possible motions of the exoskeleton. The EXOTIC was tested on ten able-bodied individuals and three users with tetraplegia caused by spinal cord injury. During the tests the EXOTIC succeeded in fully assisting tasks such as drinking and picking up snacks, even for users with complete functional tetraplegia and the need for a ventilator. The users confirmed the usability of the EXOTIC.

TongueToSpeech (TTS): Wearable wireless assistive device for augmented speech

Speech is an important aspect of human communication; individuals with speech impairment are unable to communicate vocally in real time. Our team has developed the TongueToSpeech (TTS) device with the goal of augmenting speech communication for the vocally impaired. The proposed device is a wearable wireless assistive device that incorporates a capacitive touch keyboard interface embedded inside a discrete retainer. This device connects to a computer, tablet or a smartphone via Bluetooth connection. The developed TTS application converts text typed by the tongue into audible speech. Our studies have concluded that an 8-contact point configuration between the tongue and the TTS device would yield the best user precision and speed performance. On average using the TTS device inside the oral cavity takes 2.5 times longer than the pointer finger using a T9 (Text on 9 keys) keyboard configuration to type the same phrase. In conclusion, we have developed a discrete noninvasive wearable device that allows the vocally impaired individuals to communicate in real time.

Error-Free Text Typing Performance of an Inductive Intra-Oral Tongue Computer Interface for Severely Disabled Individuals

For severely paralyzed individuals, alternative computer interfaces are becoming increasingly essential for everyday life as social and vocational activities are facilitated by information technology and as the environment becomes more automatic and remotely controllable. Tongue computer interfaces have proven to be desirable by the users partly due to their high degree of aesthetic acceptability, but so far the mature systems have shown a relatively low error-free text typing efficiency. This paper evaluated the intra-oral inductive tongue computer interface (ITCI) in its intended use: Error-free text typing in a generally available text editing system, Word. Individuals with tetraplegia and able bodied individuals used the ITCI for typing using a MATLAB interface and for Word typing for 4 to 5 experimental days, and the results showed an average error-free text typing rate in Word of 11.6 correct characters/min across all participants and of 15.5 correct characters/min for participants familiar with tongue piercings. Improvements in typing rates between the sessions suggest that typing ratescan be improved further through long-term use of the ITCI.

Tongue-controlled robotic rehabilitation: A feasibility study in people with stroke

Stroke survivors with severe upper limb (UL) impairment face years of therapy to recover function. Robot-assisted therapy (RT) is increasingly used in the field for goal-oriented rehabilitation as a means to improve function in ULs. To be used effectively for wrist and hand therapy, the current RT systems require the patient to have a minimal active range of movement in the UL, and those that do not have active voluntary movement cannot use these systems. We have overcome this limitation by harnessing tongue motion to allow patients to control a robot using synchronous tongue and hand movement. This novel RT device combines a commercially available UL exoskeleton, the Hand Mentor, and our custom-designed Tongue Drive System as its controller. We conducted a proof-of-concept study on six nondisabled participants to evaluate the system usability and a case series on three participants with movement limitations from poststroke hemiparesis. Data from two stroke survivors indicate that for patients with chronic, moderate UL impairment following stroke, a 15-session training regimen resulted in modest decreases in impairment, with functional improvement and improved quality of life. The improvement met the standard of minimal clinically important difference for activities of daily living, mobility, and strength assessments.

Development and functional demonstration of a wireless intraoral inductive tongue computer interface for severely disabled persons

PURPOSE

Individuals with tetraplegia depend on alternative interfaces in order to control computers and other electronic equipment. Current interfaces are often limited in the number of available control commands, and may compromise the social identity of an individual due to their undesirable appearance. The purpose of this study was to implement an alternative computer interface, which was fully embedded into the oral cavity and which provided multiple control commands.

METHODS

The development of a wireless, intraoral, inductive tongue computer was described. The interface encompassed a 10-key keypad area and a mouse pad area. This system was embedded wirelessly into the oral cavity of the user. The functionality of the system was demonstrated in two tetraplegic individuals and two able-bodied individuals Results: The system was invisible during use and allowed the user to type on a computer using either the keypad area or the mouse pad. The maximal typing rate was 1.8 s for repetitively typing a correct character with the keypad area and 1.4 s for repetitively typing a correct character with the mouse pad area.

CONCLUSION

The results suggest that this inductive tongue computer interface provides an esthetically acceptable and functionally efficient environmental control for a severely disabled user. Implications for Rehabilitation New Design, Implementation and detection methods for intra oral assistive devices. Demonstration of wireless, powering and encapsulation techniques suitable for intra oral embedment of assistive devices. Demonstration of the functionality of a rechargeable and fully embedded intra oral tongue controlled computer input device.

Control of a Robotic Hand Using a Tongue Control System-A Prosthesis Application

OBJECTIVE

The aim of this study was to investigate the feasibility of using an inductive tongue control system (ITCS) for controlling robotic/prosthetic hands and arms.

METHODS

This study presents a novel dual modal control scheme for multigrasp robotic hands combining standard electromyogram (EMG) with the ITCS. The performance of the ITCS control scheme was evaluated in a comparative study. Ten healthy subjects used both the ITCS control scheme and a conventional EMG control scheme to complete grasping exercises with the IH1 Azzurra robotic hand implementing five grasps. Time to activate a desired function or grasp was used as the performance metric.

RESULTS

Statistically significant differences were found when comparing the performance of the two control schemes. On average, the ITCS control scheme was 1.15 s faster than the EMG control scheme, corresponding to a 35.4% reduction in the activation time. The largest difference was for grasp 5 with a mean AT reduction of 45.3% (2.38 s).

CONCLUSION

The findings indicate that using the ITCS control scheme could allow for faster activation of specific grasps or functions compared with a conventional EMG control scheme.

SIGNIFICANCE

For transhumeral and especially bilateral amputees, the ITCS control scheme could have a significant impact on the prosthesis control. In addition, the ITCS would provide bilateral amputees with the additional advantage of environmental and computer control for which the ITCS was originally developed.

Medical tongue piercing - development and evaluation of a surgical protocol and the perception of procedural discomfort of the participants

BACKGROUND

A system providing disabled persons with control of various assistive devices with the tongue has been developed at Aalborg University in Denmark. The system requires an activation unit attached to the tongue with a small piercing. The aim of this study was to establish and evaluate a safe and tolerable procedure for medical tongue piercing and to evaluate the expected and perceived procedural discomfort.

METHODS

Four tetraplegic subjects volunteered for the study. A surgical protocol for a safe insertion of a tongue barbell piercing was presented using sterilized instruments and piercing parts. Moreover, post-procedural observations of participant complications such as bleeding, edema, and infection were recorded. Finally, procedural discomforts were monitored by VAS scores of pain, changes in taste and speech as well as problems related to hitting the teeth.

RESULTS

The piercings were all successfully inserted in less than 5 min and the pain level was moderate compared with oral injections. No bleeding, infection, embedding of the piercing, or tooth/gingival injuries were encountered; a moderate edema was found in one case without affecting the speech. In two cases the piercing rod later had to be replaced by a shorter rod, because participants complained that the rod hit their teeth. The replacements prevented further problems. Moreover, loosening of balls was encountered, which could be prevented with the addition of dental glue. No cases of swallowing or aspiration of the piercing parts were recorded.

CONCLUSIONS

The procedure proved simple, fast, and safe for insertion of tongue piercings for tetraplegic subjects in a clinical setting. The procedure represented several precautions in order to avoid risks in these susceptible participants with possible co-morbidity. No serious complications were encountered, and the procedure was found tolerable to the participants. The procedure may be used in future studies with tongue piercings being a prerequisite for similar systems, and this may include insertion in an out-patient setting.

Alternative design of inductive pointing device for oral interface for computers and wheelchairs

An inductive pointing device was designed and implemented successfully in a tongue controlled oral interface. Sensors were manufactured as an assembly of multilayer coils in the printed circuit board technology on two pads. The sensor pads were encapsulated together with electronics and battery in a mouthpiece, placed in the upper palate of the oral cavity. The PCB technology allowed surface activation of one or more sensors by gliding over the surface of the coils assembly of a small cylindrical unit attached to the tongue. The model consisted of 8 sensors and allowed real time proportional control of both speed and direction similar to a joystick. However, the size of the oral cavity, the number and geometry of the coil loops and characteristics of the activation unit impose limits in designing the sensors and call for an alternative layout design. Two alternative sensor designs are proposed in this paper, aiming to reduce the size of the sensor pad by one third, extending the target group, including children, and increasing the easiness of wear of the oral interface.

Mapping sensor activation time for typing tasks performed with a tongue controlled oral interface

Two tetraplegic subjects performed typing tasks on a computer in an experiment using a tongue controlled oral interface. This paper reports mapping of the sensor activation time for a full alphabet text input using 10 inductive sensors. A small cylindrical piece of soft ferromagnetic material activated the sensors when placed at or glided along the surface of the sensor. The activation unit was attached to the tongue as the upper ball of a piercing. The tasks consisted of typing characters according to ordered (rows and columns) or random test strings during 30 seconds, with and without deleting characters typed by mistake. Visual feedback assisted the subjects to perform the typing tasks. Average activation times were of 0.82+/-0.38 and 1.06 +/-0.27 seconds respectively for the two subjects. Analysis of activation times may be useful in characterization of the tongue ability to activate the interface as well as in design optimization of the layout of the sensors.

Quantitative and comparative assessment of learning in a tongue-operated computer input device--part II: navigation tasks

Tongue drive system (TDS) is a novel tongue-operated assistive technology (AT) for the mobility impaired, to empower them to access computers and drive powered wheelchairs (PWC) using their free voluntary tongue motion. We have evaluated the TDS performance in five sessions over 5-8 weeks to study the learning process in different tasks of computer access and PWC navigation on nine able-bodied subjects who already had tongue piercing and used our magnetic tongue studs throughout the trial. Computer access tasks included on-screen maze navigation and issuing random commands to measure the TDS information transfer rate. PWC navigation included driving through a ~50-m obstacle course using three control strategies. Some of the qualitative aspects of using the TDS were also evaluated based on the two Likert scale questionnaires, one of which was short (eight questions) and asked at the end of each session and the other one (46 questions) at the end of the trial. Included in this study was also a task to measure the tongue fatigue as a result of using the TDS continuously for a few hours. All performance measures showed significant improvement from the first to the second session as well as further gradual improvements throughout the rest of the sessions, suggesting a rapid learning process.

Recent trends in assistive technology for mobility

Loss of physical mobility makes maximal participation in desired activities more difficult and in the worst case fully prevents participation. This paper surveys recent work in assistive technology to improve mobility for persons with a disability, drawing on examples observed during a tour of academic and industrial research sites in Europe. The underlying theme of this recent work is a more seamless integration of the capabilities of the user and the assistive technology. This improved integration spans diverse technologies, including powered wheelchairs, prosthetic limbs, functional electrical stimulation, and wearable exoskeletons. Improved integration is being accomplished in three ways: 1) improving the assistive technology mechanics; 2) improving the user-technology physical interface; and 3) sharing of control between the user and the technology. We provide an overview of these improvements in user-technology integration and discuss whether such improvements have the potential to be transformative for people with mobility impairments.

TongueWise: Tongue-computer interface software for people with tetraplegia

Many computer interfaces and assistive devices for people with motor disabilities limit the input dimensionality from user to system, in many cases leading to single switch interfaces where the user can only press one button. This can, either limit the level of direct access to the functionalities of the operating system, or slow down speed of interaction. In this paper we present TongueWise: a software developed for a tongue computer interface that can be activated with the tip of the tongue and that provides direct input that covers most of the standard keyboard and mouse commands.