Characterization of Bimanual Cyclical Tasks from Single-trial EEG-fNIRS Measurements

Systematic review of AI/ML applications in multi-domain robotic rehabilitation: trends, gaps, and future directions

Robotic technology is expected to transform rehabilitation settings, by providing precise, repetitive, and task-specific interventions, thereby potentially improving patients' clinical outcomes. Artificial intelligence (AI) and machine learning (ML) have been widely applied in different areas to support robotic rehabilitation, from controlling robot movements to real-time patient assessment. To provide an overview of the current landscape and the impact of AI/ML use in robotics rehabilitation, we performed a systematic review focusing on the use of AI and robotics in rehabilitation from a broad perspective, encompassing different pathologies and body districts, and considering both motor and neurocognitive rehabilitation. We searched the Scopus and IEEE Xplore databases, focusing on the studies involving human participants. After article retrieval, a tagging phase was carried out to devise a comprehensive and easily-interpretable taxonomy: its categories include the aim of the AI/ML within the rehabilitation system, the type of algorithms used, and the location of robots and sensors. The 201 selected articles span multiple domains and diverse aims, such as movement classification, trajectory prediction, and patient evaluation, demonstrating the potential of ML to revolutionize personalized therapy and improve patient engagement. ML is reported as highly effective in predicting movement intentions, assessing clinical outcomes, and detecting compensatory movements, providing insights into the future of personalized rehabilitation interventions. Our analysis also reveals pitfalls in the current use of AI/ML in this area, such as potential explainability issues and poor generalization ability when these systems are applied in real-world settings.

Strategic Integration: A Cross-Disciplinary Review of the fNIRS-EEG Dual-Modality Imaging System for Delivering Multimodal Neuroimaging to Applications

Background: Recent years have seen a surge of interest in dual-modality imaging systems that integrate functional near-infrared spectroscopy (fNIRS) and electroencephalography (EEG) to probe brain function. This review aims to explore the advancements and clinical applications of this technology, emphasizing the synergistic integration of fNIRS and EEG. Methods: The review begins with a detailed examination of the fundamental principles and distinctive features of fNIRS and EEG techniques. It includes critical technical specifications, data-processing methodologies, and analysis techniques, alongside an exhaustive evaluation of 30 seminal studies that highlight the strengths and weaknesses of the fNIRS-EEG bimodal system. Results: The paper presents multiple case studies across various clinical domains-such as attention-deficit hyperactivity disorder, infantile spasms, depth of anesthesia, intelligence quotient estimation, and epilepsy-demonstrating the fNIRS-EEG system's potential in uncovering disease mechanisms, evaluating treatment efficacy, and providing precise diagnostic options. Noteworthy research findings and pivotal breakthroughs further reinforce the developmental trajectory of this interdisciplinary field. Conclusions: The review addresses challenges and anticipates future directions for the fNIRS-EEG dual-modal imaging system, including improvements in hardware and software, enhanced system performance, cost reduction, real-time monitoring capabilities, and broader clinical applications. It offers researchers a comprehensive understanding of the field, highlighting the potential applications of fNIRS-EEG systems in neuroscience and clinical medicine.

Neural Correlate and Movement Decoding of Simultaneous-and-Sequential Bimanual Movements Using EEG Signals

Bimanual coordination is important for developing a natural motor brain-computer interface (BCI) from electroencephalogram (EEG) signals, covering the aspects of bilateral arm training for rehabilitation, bimanual coordination for daily-life assistance, and also improving the multidimensional control of BCIs. For the same task targets of both hands, simultaneous and sequential bimanual movements are two different bimanual coordination manners. Planning and performing motor sequences are the fundamental abilities of humans, and it is more natural to execute sequential movements compared to simultaneous movements in many complex tasks. However, to date, for these two different manners in which two hands coordinated to reach the same task targets, the differences in the neural correlate and also the feasibility of movement discrimination have not been explored. In this study, we aimed to investigate these two issues based on a bimanual reaching task for the first time. Finally, neural correlates in the view of the movement-related cortical potentials, event-related oscillations, and source imaging showed unique neural encoding patterns of sequential movements. Besides, for the same task targets of both hands, the simultaneous and sequential bimanual movements were successfully discriminated in both pre-movement and movement execution periods. This study revealed the neural encoding patterns of sequential bimanual movements and presented its values in developing a more natural and good-performance motor BCI.

Within-Session Reliability of fNIRS in Robot-Assisted Upper-Limb Training

Functional near-infrared spectroscopy (fNIRS) seems opportune for neurofeedback in robot-assisted rehabilitation training due to its noninvasive, less physical restriction, and no electromagnetic disturbance. Previous research has proved the cross-session reliability of fNIRS responses to non-motor tasks (e.g., visual stimuli) and fine-motor tasks (e.g., finger tapping). However, it is still unknown whether fNIRS responses remain reliable 1) in gross-motor tasks, 2) within a training session, and 3) for different training parameters. Hence, this study aimed to investigate the within-session reliability of fNIRS responses to gross-motor tasks for different training parameters. Ten healthy participants were recruited to conduct right elbow extension-flexion in three robot-assisted modes. The Passive mode was fully motor-actuated, while Active1 and Active2 modes involved active engagement with different resistance levels. FNIRS data of three identical runs were used to assess the within-session reliability in terms of the map- ( R2 ) and cluster-wise ( Roverlap ) spatial reproducibility and the intraclass correlation (ICC) of temporal features. The results revealed good spatial reliability ( R2 up to 0.69, Roverlap up to 0.68) at the subject level. Besides, the within-session temporal reliabilities of Slope, Max/Min, and Mean were between good and excellent ( ICC < 0.86). We also found that the within-session reliability was positively correlated with the intensity of the training mode, except for the temporal reliability of HbO in Active2 mode. Overall, our results demonstrated good within-session reliability of fNIRS responses, suggesting fNIRS as reliable neurofeedback for constructing closed-loop robot-assisted rehabilitation systems.

Repetitive Transcranial Alternating Current Stimulation to Improve Working Memory: An EEG-fNIRS Study

Transcranial electrical stimulation has demonstrated the potential to enhance cognitive functions such as working memory, learning capacity, and attentional allocation. Recently, it was shown that periodic stimulation within a specific duration could augment the human brain's neuroplasticity. This study investigates the effects of repetitive transcranial alternating current stimulation (tACS; 1 mA, 5 Hz, 2 min duration) on cognitive function, functional connectivity, and topographic changes using both electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS). Fifteen healthy subjects were recruited to measure brain activity in the pre-, during-, and post-stimulation sessions under tACS and sham stimulation conditions. Fourteen trials of working memory tasks and eight repetitions of tACS/sham stimulation with a 1-minute intersession interval were applied to the frontal cortex of the participants. The working memory score, EEG band-wise powers, EEG topography, concentration changes of oxygenated hemoglobin, and functional connectivity (FC) were individually analyzed to quantify the behavioral and neurophysiological effects of tACS. Our results indicate that tACS increases: i) behavioral scores (i.e., 15.08, ) and EEG band-wise powers (i.e., theta and beta bands) compared to the sham stimulation condition, ii) FC of both EEG-fNIRS signals, especially in the large-scale brain network communication and interhemispheric connections, and iii) the hemodynamic response in comparison to the pre-stimulation session and the sham condition. Conclusively, the repetitive theta-band tACS stimulation improves the working memory capacity regarding behavioral and neuroplasticity perspectives. Additionally, the proposed fNIRS biomarkers (mean, slope), EEG band-wise powers, and FC can be used as neuro-feedback indices for closed-loop brain stimulation.

A New Compound-Limbs Paradigm: Integrating Upper-Limb Swing Improves Lower-Limb Stepping Intention Decoding From EEG

Brain-computer interface (BCI) systems based on spontaneous electroencephalography (EEG) hold the promise to implement human voluntary control of lower-extremity powered exoskeletons. However, current EEG-BCI paradigms do not consider the cooperation of upper and lower limbs during walking, which is inconsistent with natural human stepping patterns. To deal with this problem, this study proposed a stepping-matched human EEG-BCI paradigm that involved actions of both unilateral lower and contralateral upper limbs (also referred to as compound-limbs movement). Experiments were conducted in motor execution (ME) and motor imagery (MI) conditions to validate the feasibility. Common spatial pattern (CSP) proposed subject-specific CSP (SSCSP), and filter-bank CSP (FBCSP) methods were applied for feature extraction, respectively. The best average classification results based on SSCSP indicated that the accuracies of compound-limbs paradigms in ME and MI conditions achieved 89.02% ± 12.84% and 73.70% ± 12.47%, respectively. Although they were 2.03% and 5.68% lower than those of the single-upper-limb mode that does not match human stepping patterns, they were 24.30% and 11.02% higher than those of the single-lower-limb mode. These findings indicated that the proposed compound-limbs EEG-BCI paradigm is feasible for decoding human stepping intention and thus provides a potential way for natural human control of walking assistance devices.

Stroke-Related Alterations in the Brain's Functional Connectivity Response Associated with Upper Limb Multi-Joint Linkage Movement

Stroke is one of the primary causes of motor disorders, which can seriously affect the patient's quality of life. However, the assessment of the upper limb affected by stroke is commonly based on scales, and the characteristics of brain reorganization induced by limb movement are not clear. Thus, this study aimed to investigate stroke-related cortical reorganization based on functional near infrared spectroscopy (fNIRS) during upper limb multi-joint linkage movement with reference to the Fugl-Meyer Assessment of the upper extremities (FMA-UE). In total, 15 stroke patients and 15 healthy subjects participated in this study. The functional connectivity (FC) between channels and the regions of interest (ROI) was calculated by Pearson's correlation coefficient. The results showed that compared with the control group, the FC between the prefrontal cortex and the motor cortex was significantly increased in the resting state and the affected upper limb's multi-joint linkage movements, while the FC between the motor cortex was significantly decreased during the unaffected upper limb's multi-joint linkage movements. Moreover, the significantly increased ROI FC in the resting state showed a significantly positive correlation with FMA-UE in stroke patients (p < 0.05). This study highlights a new biomarker for evaluating the function of movement in stroke patients and provides guidance for rehabilitation training.

Variable Impedance Control Based on Target Position and Tracking Error for Rehabilitation Robots During a Reaching Task

To obtain an anthropomorphic performance in physical human-robot interaction during a reaching task, a variable impedance control (vIC) algorithm with human-like characteristics is proposed in this article. The damping value of the proposed method is varied with the target position as well as through the tracking error. The proposed control algorithm is compared with the impedance control algorithm with constant parameters (IC) and another vIC algorithm, which is only changed with the tracking error (vIC-e). The different control algorithms are validated through the simulation study, and are experimentally implemented on a cable-driven rehabilitation robot. The results show that the proposed vIC can improve the tracking accuracy and trajectory smoothness, and reduce the interaction force at the same time.