New algorithm to control a cycle ergometer using electrical stimulation

Towards AI-Controlled Movement Restoration: Learning FES-Cycling Stimulation with Reinforcement Learning

Functional electrical stimulation (FES) has been increasingly integrated with other rehabilitation devices, including rehabilitation robots. FES cycling is one of the common FES applications in rehabilitation, which is performed by stimulating leg muscles in a certain pattern. The appropriate pattern varies across individuals and requires manual tuning which can be time-consuming and challenging for the individual user. Here, we present an AI-based method for finding the patterns, which requires no extra hardware or sensors. Our method starts with finding model-based patterns using reinforcement learning (RL) and customised cycling models. Next, our method fine-tunes the pattern using real cycling data and offline RL. We test our method both in simulation and experimentally on a stationary tricycle. Our method can robustly deliver model-based patterns for different cycling configurations. In the experimental evaluation, the model-based pattern can induce higher cycling speed than an EMG-based pattern. And by using just 100 seconds of cycling data, our method can deliver a fine-tuned pattern with better cycling performance. Beyond FES cycling, this work is a case study, displaying the feasibility and potential of human-in-the-loop AI in real-world rehabilitation.

ICEP: An Instrumented Cycling Ergometer Platform for the Assessment of Advanced FES Strategies

BACKGROUND

Functional electrical stimulation (FES) cycling has seen an upsurge in interest over the last decade. The present study describes the novel instrumented cycling ergometer platform designed to assess the efficiency of electrical stimulation strategies. The capabilities of the platform are showcased in an example determining the adequate stimulation patterns for reproducing a cycling movement of the paralyzed legs of a spinal cord injury (SCI) subject.

METHODS

Two procedures have been followed to determine the stimulation patterns: (1) using the EMG recordings of the able-bodied subject; (2) using the recordings of the forces produced by the SCI subject's stimulated muscles.

RESULTS

the stimulation pattern derived from the SCI subject's force output was found to produce 14% more power than the EMG-derived stimulation pattern.

CONCLUSIONS

the cycling platform proved useful for determining and assessing stimulation patterns, and it can be used to further investigate advanced stimulation strategies.

Robust tracking for functional electrical stimulation cycling with unknown time-varying input delays: A switched systems approach

Motorized functional electrical stimulation (FES) cycling has been demonstrated to have numerous health benefits for individuals suffering from neurological disorders. FES-cycling is usually designed to track the desired trajectories in real time. However, there are input delays between the exertion of the stimulation and the corresponding muscle contraction that potentially destabilize the system and undermine training efforts. Meanwhile, muscle fatigue gives rise to a time-varying input delay and decreased force. Moreover, switching between FES and motor control can be chattering and destabilizing owing to the high frequency. This article constructs Lyapunov-Krasovskii functionals to analyze the stability and robustness of the nonlinear cycling system with time-varying input delay. A new average dwell time condition is then provided to ensure the input-to-state stability of the considered systems. Finally, numerical simulations are illustrated to verify the effectiveness of the developed controller.

OIDA: An optimal interval detection algorithm for automatized determination of stimulation patterns for FES-Cycling in individuals with SCI

Background

FES-Cycling is an exciting recreational activity, which allows certain individuals after spinal cord injury or stroke to exercise their paralyzed muscles. The key for a successful application is to activate the right muscles at the right time.

Methods

While a stimulation pattern is usually determined empirically, we propose an approach using the torque feedback provided by a commercially available crank power-meter installed on a standard trike modified for FES-Cycling. By analysing the difference between active (with stimulation) and passive (without stimulation) torques along a full pedalling cycle, it is possible to differentiate between contributing and resisting phases for a particular muscle group. In this article we present an algorithm for the detection of optimal stimulation intervals and demonstrate its functionality, bilaterally for the quadriceps and hamstring muscles, in one subject with complete SCI on a home trainer. Stimulation patterns were automatically determined for two sensor input modalities: the crank-angle and a normalized thigh-angle (i.e. cycling phase, measured via inertial measurement units). In contrast to previous studies detecting automatic stimulation intervals on motorised ergo-cycles, our approach does not rely on a constant angular velocity provided by a motor, thus being applicable to the domain of mobile FES-Cycling.

Results

The algorithm was successfully able to identify stimulation intervals, individually for the subject’s left and right quadriceps and hamstring muscles. Smooth cycling was achieved without further adaptation, for both input signals (i.e. crank-angle and normalized thigh-angle).

Conclusion

The automatic determination of stimulation patterns, on basis of the positive net-torque generated during electrical stimulation, can help to reduce the duration of the initial fitting phase and to improve the quality of pedalling during a FES-Cycling session. In contrast to previous works, the presented algorithm does not rely on a constant angular velocity and thus can be effectively implemented into mobile FES-Cycling systems. As each muscle or muscle group is assessed individually, our algorithm can be used to evaluate the efficiency of novel electrode configurations and thus could promote increased performances during FES-Cycling.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12984-022-01018-2.

Electromechanical delay during functional electrical stimulation induced cycling is a function of lower limb position

INTRODUCTION

Functional electrical stimulation (FES) induced cycling has been shown to be an effective rehabilitation for those with lower limb movement disorders. However, a consequence of FES is an electromechanical delay (EMD) existing between the stimulation input and the onset of muscle force. The objective of this study is to determine if the cycle crank angle has an effect on the EMD.

METHODS

Experiments were performed on 10 participants, five healthy and five with neurological conditions resulting in movement disorders. A motor fixed the crank arm of a FES-cycle in 10° increments and at each angle stimulation was applied in a random sequence to a combination of the quadriceps femoris and gluteal muscle groups. The EMD was examined by considering the contraction delay (CD) and the residual delay (RD), where the CD (RD) is the time latency between the start (end) of stimulation and the onset (cessation) of torque. Two different measurements were used to examine the CD and RD. Further, two multiple linear regressions were performed on each measurement, one for the left and one for the right muscle groups.

RESULTS

The crank angle was determined to be statistically relevant for both the CD and RD.

CONCLUSIONS

Since the crank angle has a significant effect on both the CD and RD, the angle has a significant effect on the EMD. Therefore, future efforts should consider the importance of the crank angle when modelling or estimating the EMD to improve control designs and ultimately improve rehabilitative treatments.Implications for rehabilitationNew model predicts the delayed response of muscle torque production to electrical stimulation as a function of limb position during FES cycling.The model can inform closed-loop electrical stimulation induced rehabilitative cycling.

Characterization of the Time-Varying Nature of Electromechanical Delay During FES-Cycling

Functional electrical stimulation (FES) induced cycling is a common rehabilitative technique for people with neuromuscular disorders. A challenge for closed-loop FES control is that there exists a potentially destabilizing time-varying input delay, termed electromechanical delay (EMD), between the application of the electric field and the corresponding muscle contraction. In this article, the FES-induced torque production and EMD are quantified on an FES-cycle for the quadriceps femoris and gluteal muscle groups. Experiments were performed on five able-bodied individuals and five individuals with neurological conditions. Closed-loop FES-cycling was applied to induce fatigue and torque and EMD measurements were made during isometric conditions before and after each minute of cycling to quantify the effect of fatigue on EMD and torque production. A multiple linear regression and other descriptive statistics were performed to establish a range of expected EMD values and bounds on the rate of change of the EMD across a diverse population. The results from these experiments can be used to assist in the development of closed-loop controllers for FES-cycling that are robust to time-varying EMD and changes in torque production.

FES Cycling in Stroke: Novel Closed-Loop Algorithm Accommodates Differences in Functional Impairments

OBJECTIVE

The objective of this paper was to develop and test a novel control algorithm that enables stroke survivors to pedal a cycle in a desired cadence range despite varying levels of functional abilities after stroke.

METHODS

A novel algorithm was developed which automatically adjusts 1) the intensity of functional electrical stimulation (FES) delivered to the leg muscles, and 2) the current delivered to an electric motor. The algorithm automatically switches between assistive, uncontrolled, and resistive modes to accommodate for differences in functional impairment, based on the mismatch between the desired and actual cadence. Lyapunov-based methods were used to theoretically prove that the rider's cadence converges to the desired cadence range. To demonstrate the controller's real-world performance, nine chronic stroke survivors performed two cycling trials: 1) volitional effort only and 2) volitional effort accompanied by the control algorithm assisting and resisting pedaling as needed.

RESULTS

With a desired cadence range of 50-55 r/min, the developed controller resulted in an average rms cadence error of 1.90 r/min, compared to 6.16 r/min during volitional-only trials.

CONCLUSION

Using FES and an electric motor with a two-sided cadence control objective to assist and resist volitional efforts enabled stroke patients with varying strength and abilities to pedal within a desired cadence range.

SIGNIFICANCE

A protocol design that constrains volitional movements with assistance and resistance from FES and a motor shows potential for FES cycles and other rehabilitation robots during stroke rehabilitation.

Cadence Tracking and Disturbance Rejection in Functional Electrical Stimulation Cycling for Paraplegic Subjects: A Case Study

Functional electrical stimulation cycling has been proposed as an assistive technology with numerous health and fitness benefits for people with spinal cord injury, such as improvement in cardiovascular function, increase in muscular mass, and reduction of bone mass loss. However, some limitations, for example, lack of optimal control strategies that would delay fatigue, may still prevent this technology from achieving its full potential. In this work, we performed experiments on a person with complete spinal cord injury using a stationary tadpole trike when both cadence tracking and disturbance rejection were evaluated. In addition, two sets of experiments were conducted 6 months apart and considering activation of different muscles. The results showed that reference tracking is achieved above the cadence of 25 rpm with mean absolute errors between 1.9 and 10% when only quadriceps are activated. The disturbance test revealed that interferences may drop the cadence but do not interrupt a continuous movement if the cadence does not drop below 25 rpm, again when only quadriceps are activated. When other muscle groups were added, strong spasticity caused larger errors on reference tracking, but not when a disturbance was applied. In addition, spasticity caused the last experiments to result in less smooth cycling.

Heart rate regulation during cycle-ergometer exercise via event-driven biofeedback

This paper is devoted to the problem of regulating the heart rate response along a predetermined reference profile, for cycle-ergometer exercises designed for training or cardio-respiratory rehabilitation. The controller designed in this study is a non-conventional, non-model-based, proportional, integral and derivative (PID) controller. The PID controller commands can be transmitted as biofeedback auditory commands, which can be heard and interpreted by the exercising subject to increase or reduce exercise intensity. However, in such a case, for the purposes of effectively communicating to the exercising subject a change in the required exercise intensity, the timing of this feedback signal relative to the position of the pedals becomes critical. A feedback signal delivered when the pedals are not in a suitable position to efficiently exert force may be ineffective and this may, in turn, lead to the cognitive disengagement of the user from the feedback controller. This note examines a novel form of control system which has been expressly designed for this project. The system is called an "actuator-based event-driven control system". The proposed control system was experimentally verified using 24 healthy male subjects who were randomly divided into two separate groups, along with cross-validation scheme. A statistical analysis was employed to test the generalisation of the PID tunes, derived based on the average transfer functions of the two groups, and it revealed that there were no significant differences between the mean values of root mean square of the tracking error of two groups (3.9 vs. 3.7 bpm, [Formula: see text]). Furthermore, the results of a second statistical hypothesis test showed that the proposed PID controller with novel synchronised biofeedback mechanism has better performance compared to a conventional PID controller with a fixed-rate biofeedback mechanism (Group 1: 3.9 vs. 5.0 bpm, Group 2: 3.7 vs. 4.4 bpm, [Formula: see text]).

Switched Control of Cadence During Stationary Cycling Induced by Functional Electrical Stimulation

Functional electrical stimulation (FES) can be used to activate the dysfunctional lower limb muscles of individuals with neurological disorders to produce cycling as a means of rehabilitation. However, previous literature suggests that poor muscle control and nonphysiological muscle fiber recruitment during FES-cycling causes lower efficiency and power output at the cycle crank than able-bodied cycling, thus motivating the investigation of improved control methods for FES-cycling. In this paper, a stimulation pattern is designed based on the kinematic effectiveness of the rider's hip and knee joints to produce a forward torque about the cycle crank. A robust controller is designed for the uncertain, nonlinear cycle-rider system with autonomous, state-dependent switching. Provided sufficient conditions are satisfied, the switched controller yields ultimately bounded tracking of a desired cadence. Experimental results on four able-bodied subjects demonstrate cadence tracking errors of 0.05 ±1.59 and 5.27 ±2.14 revolutions per minute during volitional and FES-induced cycling, respectively. To establish feasibility of FES-assisted cycling in subjects with Parkinson's disease, experimental results with one subject demonstrate tracking errors of 0.43 ± 4.06 and 0.17 ±3.11 revolutions per minute during volitional and FES-induced cycling, respectively.

An automatic identification procedure to promote the use of FES-cycling training for hemiparetic patients

Cycling induced by Functional Electrical Stimulation (FES) training currently requires a manual setting of different parameters, which is a time-consuming and scarcely repeatable procedure. We proposed an automatic procedure for setting session-specific parameters optimized for hemiparetic patients. This procedure consisted of the identification of the stimulation strategy as the angular ranges during which FES drove the motion, the comparison between the identified strategy and the physiological muscular activation strategy, and the setting of the pulse amplitude and duration of each stimulated muscle. Preliminary trials on 10 healthy volunteers helped define the procedure. Feasibility tests on 8 hemiparetic patients (5 stroke, 3 traumatic brain injury) were performed. The procedure maximized the motor output within the tolerance constraint, identified a biomimetic strategy in 6 patients, and always lasted less than 5 minutes. Its reasonable duration and automatic nature make the procedure usable at the beginning of every training session, potentially enhancing the performance of FES-cycling training.

The effect of using variable frequency trains during functional electrical stimulation cycling

Objectives.  This paper describes an experimental investigation of variable frequency stimulation patterns as a means of increasing torque production and, hence, performance in cycling induced by functional electrical stimulation. Materials and Methods.  Experiments were conducted on six able-bodied subjects stimulating both quadriceps during isokinetic trials. Constant-frequency trains (CFT) with 50-msec interpulse intervals and four catchlike-inducing trains (CIT) were tested. The CITs had an initial, brief, high-frequency burst of two pulses at the onset of or within a subtetanic low-frequency stimulation train. Each stimulation train consisted of the same number of pulses. The active torques produced by each train were compared. Parametric main effect ANOVA tests were performed on the active torque-time integral (TTI), on the active torque peaks and on the time needed to reach those peaks (T2P). Results.  The electrical stimulation of the quadriceps produced active torques with mean peak values in the range of 1.6-3.5 Nm and a standard error below 0.2 Nm. CITs produced a significant increase of TTI and torque peaks compared with CFTs in all the experimental conditions. In particular, during the postfatigue trials, the CITs with the doublet placed in the middle of the train produced TTIs and torque peaks about 61% and 28% larger than the CFT pattern, respectively. In addition, the CITs showed the lowest reduction of the performance between prefatigue and postfatigue conditions. Conclusions.  The use of CITs improves the functional electrical stimulation cycling performance compared with CFT stimulation. This application might have a relevant clinical importance for individuals with stroke where the residual sensation is still present and thus the maximization of the performance without an excessive increase of the stimulation intensity is advisable. Therefore, exercise intensity can be increased yielding a better muscle strength and endurance that may be beneficially for later gait training in individuals with stroke.

Can the efficacy of electrically stimulated pedaling using a commercially available ergometer BE improved by minimizing the muscle stress-time integral?

INTRODUCTION

The cardiorespiratory and muscular strength benefits of functional electrical stimulation (FES) pedaling for spinal cord injury (SCI) subjects are limited because the endurance of electrically stimulated muscle is low.

METHODS

We tested new electrical stimulation timing patterns (Stim3, designed using a forward dynamic simulation to minimize the muscle stress-time integral) to determine whether SCI subjects could increase work and metabolic responses when pedaling a commercial FES ergometer. Work, rate of oxygen uptake (VO(2)), and blood lactate data were taken from 11 subjects (injury level T4-T12) on repeated trials.

RESULTS

Subjects performed 11% more work pedaling with Stim3 than with existing stimulation patterns (StimErg) (P = 0.043). Average (VO(2)) and blood lactate concentrations were not significantly different between Stim3 (442 ml/min, 5.9 mmol/L) and StimErg (417 ml/min, 5.9 mmol/L).

CONCLUSION

The increased mechanical work performed with Stim3 supports the use of patterns that minimize the muscle stress-time integral to prolong FES pedaling.

Comparison of stimulation patterns for FES-cycling using measures of oxygen cost and stimulation cost

AIM

The energy efficiency of FES-cycling in spinal cord injured subjects is very much lower than that of normal cycling, and efficiency is dependent upon the parameters of muscle stimulation. We investigated measures which can be used to evaluate the effect on cycling performance of changes in stimulation parameters, and which might therefore be used to optimise them. We aimed to determine whether oxygen cost and stimulation cost measurements are sensitive enough to allow discrimination between the efficacy of different activation ranges for stimulation of each muscle group during constant-power cycling.

METHODS

We employed a custom FES-cycling ergometer system, with accurate control of cadence and stimulated exercise workrate. Two sets of muscle activation angles ("stimulation patterns"), denoted "P1" and "P2", were applied repeatedly (eight times each) during constant-power cycling, in a repeated measures design with a single paraplegic subject. Pulmonary oxygen uptake was measured in real time and used to determine the oxygen cost of the exercise. A new measure of stimulation cost of the exercise is proposed, which represents the total rate of stimulation charge applied to the stimulated muscle groups during cycling. A number of energy-efficiency measures were also estimated.

RESULTS

Average oxygen cost and stimulation cost of P1 were found to be significantly lower than those for P2 (paired t-test, p<0.05): oxygen costs were 0.56+/-0.03l min-1 and 0.61+/-0.04l min-1 (mean+/-S.D.), respectively; stimulation costs were 74.91+/-12.15 mC min-1 and 100.30+/-14.78 mC min-1 (mean+/-S.D.), respectively. Correspondingly, all efficiency estimates for P1 were greater than those for P2.

CONCLUSION

Oxygen cost and stimulation cost measures both allow discrimination between the efficacy of different muscle activation patterns during constant-power FES-cycling. However, stimulation cost is more easily determined in real time, and responds more rapidly and with greatly improved signal-to-noise properties than the ventilatory oxygen uptake measurements required for estimation of oxygen cost. These measures may find utility in the adjustment of stimulation patterns for achievement of optimal cycling performance.

The effect of previous weight training and concurrent weight training on endurance for functional electrical stimulation cycle ergometry

Forty-five paraplegic subjects participated in three series of experiments to examine the interrelationships between previous weight training, concurrent weight training and muscle strength and endurance during cycle ergometry elicited by functional electrical stimulation (FES). When subjects only underwent isokinetic weight training (series 1) three times per week on the quadriceps, hamstring and gluteus maximus groups for 12 weeks, strength increased linearly with time for all three muscle groups from an initial average of 17 N to 269 N at the end of training, a 15-fold increase. In the second series of experiments, different groups of subjects either underwent no strength training prior to cycle ergometry or underwent strength training of these same three muscle groups for 2 weeks, four weeks, or 6 weeks prior to cycle ergometry. Any strength training was effective in increasing endurance for cycle ergometry. However, the rate of increase in endurance during cycle ergometry with no prior strength training was only 5 min per week, whereas the rate of increase in cycle endurance during ergometry was 14.6, 25.0, and 33.3 min per week increase in endurance after strength training for 2.4 and 6 weeks, respectively. When weight training was accomplished during FES cycle ergometry (concurrently) in a third series of experiments, there was an additional increase in endurance during cycling if strength training was concurrently accomplished. With no weight training, endurance increased 23 min per week, whereas with concurrent weight training at three times per week, endurance increased during cycling by 41.6 min per week. The results of these experiments seem to show a clear advantage of weight training concurrently and before FES cycle ergometry. Results are given as mean (SD).