Robotic Simulators for Tissue Examination Training with Multimodal Sensory Feedback

The Effects of Different Motor Teaching Strategies on Learning a Complex Motor Task

During the learning of a new sensorimotor task, individuals are usually provided with instructional stimuli and relevant information about the target task. The inclusion of haptic devices in the study of this kind of learning has greatly helped in the understanding of how an individual can improve or acquire new skills. However, the way in which the information and stimuli are delivered has not been extensively explored. We have designed a challenging task with nonintuitive visuomotor perturbation that allows us to apply and compare different motor strategies to study the teaching process and to avoid the interference of previous knowledge present in the naïve subjects. Three subject groups participated in our experiment, where the learning by repetition without assistance, learning by repetition with assistance, and task Segmentation Learning techniques were performed with a haptic robot. Our results show that all the groups were able to successfully complete the task and that the subjects' performance during training and evaluation was not affected by modifying the teaching strategy. Nevertheless, our results indicate that the presented task design is useful for the study of sensorimotor teaching and that the presented metrics are suitable for exploring the evolution of the accuracy and precision during learning.

A Surrogate Model Based on a Finite Element Model of Abdomen for Real-Time Visualisation of Tissue Stress during Physical Examination Training

Robotic patients show great potential for helping to improve medical palpation training, as they can provide feedback that cannot be obtained in a real patient. They provide information about internal organ deformation that can significantly enhance palpation training by giving medical trainees visual insight based on the pressure they apply for palpation. This can be achieved by using computational models of abdomen mechanics. However, such models are computationally expensive, and thus unable to provide real-time predictions. In this work, we proposed an innovative surrogate model of abdomen mechanics by using machine learning (ML) and finite element (FE) modelling to virtually render internal tissue deformation in real time. We first developed a new high-fidelity FE model of the abdomen mechanics from computerized tomography (CT) images. We performed palpation simulations to produce a large database of stress distribution on the liver edge, an area of interest in most examinations. We then used artificial neural networks (ANNs) to develop the surrogate model and demonstrated its application in an experimental palpation platform. Our FE simulations took 1.5 h to predict stress distribution for each palpation while this only took a fraction of a second for the surrogate model. Our results show that our artificial neural network (ANN) surrogate has an accuracy of 92.6%. We also showed that the surrogate model is able to use the experimental input of palpation location and force to provide real-time projections onto the robotics platform. This enhanced robotics platform has the potential to be used as a training simulator for trainees to hone their palpation skills.