1
|
da Silva Soares R, Ramirez-Chavez KL, Tufanoglu A, Barreto C, Sato JR, Ayaz H. Cognitive Effort during Visuospatial Problem Solving in Physical Real World, on Computer Screen, and in Virtual Reality. SENSORS (BASEL, SWITZERLAND) 2024; 24:977. [PMID: 38339693 PMCID: PMC10857420 DOI: 10.3390/s24030977] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/13/2023] [Revised: 01/30/2024] [Accepted: 01/30/2024] [Indexed: 02/12/2024]
Abstract
Spatial cognition plays a crucial role in academic achievement, particularly in science, technology, engineering, and mathematics (STEM) domains. Immersive virtual environments (VRs) have the growing potential to reduce cognitive load and improve spatial reasoning. However, traditional methods struggle to assess the mental effort required for visuospatial processes due to the difficulty in verbalizing actions and other limitations in self-reported evaluations. In this neuroergonomics study, we aimed to capture the neural activity associated with cognitive workload during visuospatial tasks and evaluate the impact of the visualization medium on visuospatial task performance. We utilized functional near-infrared spectroscopy (fNIRS) wearable neuroimaging to assess cognitive effort during spatial-reasoning-based problem-solving and compared a VR, a computer screen, and a physical real-world task presentation. Our results reveal a higher neural efficiency in the prefrontal cortex (PFC) during 3D geometry puzzles in VR settings compared to the settings in the physical world and on the computer screen. VR appears to reduce the visuospatial task load by facilitating spatial visualization and providing visual cues. This makes it a valuable tool for spatial cognition training, especially for beginners. Additionally, our multimodal approach allows for progressively increasing task complexity, maintaining a challenge throughout training. This study underscores the potential of VR in developing spatial skills and highlights the value of comparing brain data and human interaction across different training settings.
Collapse
Affiliation(s)
- Raimundo da Silva Soares
- School of Biomedical Engineering, Science and Health Systems, Drexel University, Philadelphia, PA 19104, USA; (K.L.R.-C.); (A.T.); (C.B.)
- Center of Mathematics Computation and Cognition, Universidade Federal do ABC, São Bernardo do Campo 09606-405, Brazil;
| | - Kevin L. Ramirez-Chavez
- School of Biomedical Engineering, Science and Health Systems, Drexel University, Philadelphia, PA 19104, USA; (K.L.R.-C.); (A.T.); (C.B.)
| | - Altona Tufanoglu
- School of Biomedical Engineering, Science and Health Systems, Drexel University, Philadelphia, PA 19104, USA; (K.L.R.-C.); (A.T.); (C.B.)
| | - Candida Barreto
- School of Biomedical Engineering, Science and Health Systems, Drexel University, Philadelphia, PA 19104, USA; (K.L.R.-C.); (A.T.); (C.B.)
| | - João Ricardo Sato
- Center of Mathematics Computation and Cognition, Universidade Federal do ABC, São Bernardo do Campo 09606-405, Brazil;
| | - Hasan Ayaz
- School of Biomedical Engineering, Science and Health Systems, Drexel University, Philadelphia, PA 19104, USA; (K.L.R.-C.); (A.T.); (C.B.)
- Department of Psychological and Brain Sciences, College of Arts and Sciences, Drexel University, Philadelphia, PA 19104, USA
- Drexel Solutions Institute, Drexel University, Philadelphia, PA 19104, USA
- A.J. Drexel Autism Institute, Drexel University, Philadelphia, PA 19104, USA
- Department of Family and Community Health, University of Pennsylvania, Philadelphia, PA 19104, USA
- Center for Injury Research and Prevention, Children’s Hospital of Philadelphia, Philadelphia, PA 19104, USA
| |
Collapse
|
2
|
Lin NH, Liu CH, Lee P, Guo LY, Sung JL, Yen CW, Liaw LJ. Backward Walking Induces Significantly Larger Upper-Mu-Rhythm Suppression Effects Than Forward Walking Does. SENSORS 2020; 20:s20247250. [PMID: 33348821 PMCID: PMC7767098 DOI: 10.3390/s20247250] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/10/2020] [Revised: 12/06/2020] [Accepted: 12/15/2020] [Indexed: 11/24/2022]
Abstract
Studies have compared the differences and similarities between backward walking and forward walking, and demonstrated the potential of backward walking for gait rehabilitation. However, current evidence supporting the benefits of backward walking over forward walking remains inconclusive. Considering the proven association between gait and the cerebral cortex, we used electroencephalograms (EEG) to differentiate the effects of backward walking and forward walking on cortical activities, by comparing the sensorimotor rhythm (8–12 Hz, also called mu rhythm) of EEG signals. A systematic signal procedure was used to eliminate the motion artifacts induced by walking to safeguard EEG signal fidelity. Statistical test results of our experimental data demonstrated that walking motions significantly suppressed mu rhythm. Moreover, backward walking exhibited significantly larger upper mu rhythm (10–12 Hz) suppression effects than forward walking did. This finding implies that backward walking induces more sensorimotor cortex activity than forward walking does, and provides a basis to support the potential benefits of backward walking over forward walking. By monitoring the upper mu rhythm throughout the rehabilitation process, medical experts can adaptively adjust the intensity and duration of each walking training session to improve the efficacy of a walking ability recovery program.
Collapse
Affiliation(s)
- Nan-Hung Lin
- Department of Mechanical and Electro-Mechanical Engineering, National Sun Yat-Sen University, Kaohsiung 80424, Taiwan; (N.-H.L.); (J.-L.S.)
| | - Chin-Hsuan Liu
- Department of Occupational Therapy, Kaohsiung Municipal Kai-Syuan Psychiatric Hospital, Kaohsiung 82445, Taiwan;
- Department of Occupational Therapy, I-Shou University, Kaohsiung 82445, Taiwan;
| | - Posen Lee
- Department of Occupational Therapy, I-Shou University, Kaohsiung 82445, Taiwan;
| | - Lan-Yuen Guo
- Department of Sports Medicine, Kaohsiung Medical University, Kaohsiung 80708, Taiwan;
| | - Jia-Li Sung
- Department of Mechanical and Electro-Mechanical Engineering, National Sun Yat-Sen University, Kaohsiung 80424, Taiwan; (N.-H.L.); (J.-L.S.)
| | - Chen-Wen Yen
- Department of Mechanical and Electro-Mechanical Engineering, National Sun Yat-Sen University, Kaohsiung 80424, Taiwan; (N.-H.L.); (J.-L.S.)
- Department of Physical Therapy, College of Health Science, Kaohsiung Medical University, Kaohsiung 80708, Taiwan
- Neuroscience Research Center, Kaohsiung Medical University, Kaohsiung 80708, Taiwan
- Correspondence: (C.-W.Y.); (L.-J.L.); Tel.: +886-7-52-54-232 (C.-W.Y.); +886-7-31-21-101 (ext. 2663) (L.-J.L.)
| | - Lih-Jiun Liaw
- Department of Physical Therapy, College of Health Science, Kaohsiung Medical University, Kaohsiung 80708, Taiwan
- Neuroscience Research Center, Kaohsiung Medical University, Kaohsiung 80708, Taiwan
- Department of Physical Medicine and Rehabilitation, Kaohsiung Medical University Hospital, Kaohsiung 80708, Taiwan
- Department of Medical Research, Kaohsiung Medical University Hospital, Kaohsiung 80708, Taiwan
- Correspondence: (C.-W.Y.); (L.-J.L.); Tel.: +886-7-52-54-232 (C.-W.Y.); +886-7-31-21-101 (ext. 2663) (L.-J.L.)
| |
Collapse
|
3
|
A Novel Application of Levenshtein Distance for Assessment of High-Level Motor Planning Underlying Performance During Learning of Complex Motor Sequences. JOURNAL OF MOTOR LEARNING AND DEVELOPMENT 2020. [DOI: 10.1123/jmld.2018-0060] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Few studies have examined high-level motor plans underlying cognitive-motor performance during practice of complex action sequences. These investigations have assessed performance through fairly simple metrics without examining how practice affects the structures of action sequences. By adapting the Levenshtein distance (LD) method to the motor domain, we propose a computational approach to accurately capture performance dynamics during practice of action sequences. Practice performance dynamics were assessed by computing the LD based on the number of insertions, deletions, and substitutions of actions needed to transform any sequence into a reference sequence (having a minimal number of actions to complete the task). Also, combining LD-based performance with mental workload metrics allowed assessment of cognitive-motor efficiency dynamics. This approach was tested on the Tower of Hanoi task. The findings revealed that throughout practice this method could capture: i) action sequence performance improvements as indexed by a reduced LD (decrease of insertions and substitutions), ii) structural modifications of the high-level plans, iii) an attenuation of mental workload, and iv) enhanced cognitive-motor efficiency. This effort complements prior work examining the practice of complex action sequences in healthy adults and has potential for probing cognitive-motor impairment in clinical populations as well as the development/assessment of cognitive robotic controllers.
Collapse
|