1
|
Lampen N, Kim D, Xu X, Fang X, Lee J, Kuang T, Deng HH, Liebschner MAK, Gateno J, Yan P. Learning soft tissue deformation from incremental simulations. Med Phys 2025; 52:1914-1925. [PMID: 39642013 DOI: 10.1002/mp.17554] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2023] [Revised: 04/19/2024] [Accepted: 11/19/2024] [Indexed: 12/08/2024] Open
Abstract
BACKGROUND Surgical planning for orthognathic procedures demands swift and accurate biomechanical modeling of facial soft tissues. Efficient simulations are vital in the clinical pipeline, as surgeons may iterate through multiple plans. Biomechanical simulations typically use the finite element method (FEM). Prior works divide FEM simulations into increments to enhance convergence and accuracy. However, this practice elongates simulation time, thereby impeding clinical integration. To accelerate simulations, deep learning (DL) models have been explored. Yet, previous efforts either perform simulations in a single step or neglect the temporal aspects in incremental simulations. PURPOSE This study investigates the use of spatiotemporal incremental modeling for biomechanics simulations of facial soft tissue. METHODS We implement the method using a graph neural network. Our method synergizes spatial features with temporal aggregation using DL networks trained on incremental FEM simulations from 17 subjects that underwent orthognathic surgery. RESULTS Our proposed spatiotemporal incremental method achieved a mean accuracy of 0.37 mm with a mean computation time of 1.52 s. In comparison, a spatial-only incremental method yielded a mean accuracy of 0.44 mm and a mean computation time of 1.60 s, while a spatial-only single-step method yielded a mean accuracy of 0.41 mm and a mean computation time of 0.05 s. CONCLUSIONS Statistical analysis demonstrated that the spatiotemporal incremental method reduced mean errors compared to the spatial-only incremental method, emphasizing the importance of incorporating temporal information in incremental simulations. Overall, we successfully implemented spatiotemporal incremental learning tailored to simulate soft tissue deformation while substantially reducing simulation time compared to FEM.
Collapse
Affiliation(s)
- Nathan Lampen
- Department of Biomedical Engineering and the Center for Biotechnology and Interdisciplinary Studies at Rensselaer Polytechnic Institute, Troy, New York, USA
| | - Daeseung Kim
- Department of Oral and Maxillofacial Surgery at Houston Methodist Research Institute, Houston, Texas, USA
| | - Xuanang Xu
- Department of Biomedical Engineering and the Center for Biotechnology and Interdisciplinary Studies at Rensselaer Polytechnic Institute, Troy, New York, USA
| | - Xi Fang
- Department of Biomedical Engineering and the Center for Biotechnology and Interdisciplinary Studies at Rensselaer Polytechnic Institute, Troy, New York, USA
| | - Jungwook Lee
- Department of Biomedical Engineering and the Center for Biotechnology and Interdisciplinary Studies at Rensselaer Polytechnic Institute, Troy, New York, USA
| | - Tianshu Kuang
- Department of Oral and Maxillofacial Surgery at Houston Methodist Research Institute, Houston, Texas, USA
| | - Hannah H Deng
- Department of Oral and Maxillofacial Surgery at Houston Methodist Research Institute, Houston, Texas, USA
| | | | - Jaime Gateno
- Department of Oral and Maxillofacial Surgery at Houston Methodist Research Institute, Houston, Texas, USA
- Department of Surgery (Oral and Maxillofacial Surgery) at Weill Medical College at Cornell University, New York, New York, USA
| | - Pingkun Yan
- Department of Biomedical Engineering and the Center for Biotechnology and Interdisciplinary Studies at Rensselaer Polytechnic Institute, Troy, New York, USA
| |
Collapse
|
2
|
Chavoshnejad P, Li G, Solhtalab A, Liu D, Razavi MJ. A theoretical framework for predicting the heterogeneous stiffness map of brain white matter tissue. Phys Biol 2024; 21:066004. [PMID: 39427682 DOI: 10.1088/1478-3975/ad88e4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2024] [Accepted: 10/20/2024] [Indexed: 10/22/2024]
Abstract
Finding the stiffness map of biological tissues is of great importance in evaluating their healthy or pathological conditions. However, due to the heterogeneity and anisotropy of biological fibrous tissues, this task presents challenges and significant uncertainty when characterized only by single-mode loading experiments. In this study, we propose a new theoretical framework to map the stiffness landscape of fibrous tissues, specifically focusing on brain white matter tissue. Initially, a finite element (FE) model of the fibrous tissue was subjected to six loading cases, and their corresponding stress-strain curves were characterized. By employing multiobjective optimization, the material constants of an equivalent anisotropic material model were inversely extracted to best fit all six loading modes simultaneously. Subsequently, large-scale FE simulations were conducted, incorporating various fiber volume fractions and orientations, to train a convolutional neural network capable of predicting the equivalent anisotropic material properties solely based on the fibrous architecture of any given tissue. The proposed method, leveraging brain fiber tractography, was applied to a localized volume of white matter, demonstrating its effectiveness in precisely mapping the anisotropic behavior of fibrous tissue. In the long-term, the proposed method may find applications in traumatic brain injury, brain folding studies, and neurodegenerative diseases, where accurately capturing the material behavior of the tissue is crucial for simulations and experiments.
Collapse
Affiliation(s)
- Poorya Chavoshnejad
- Department of Mechanical Engineering, Binghamton University, State University of New York, Binghamton, NY 13902, United States of America
| | - Guangfa Li
- Department of Mechanical Engineering, Binghamton University, State University of New York, Binghamton, NY 13902, United States of America
| | - Akbar Solhtalab
- Department of Mechanical Engineering, Binghamton University, State University of New York, Binghamton, NY 13902, United States of America
| | - Dehao Liu
- Department of Mechanical Engineering, Binghamton University, State University of New York, Binghamton, NY 13902, United States of America
| | - Mir Jalil Razavi
- Department of Mechanical Engineering, Binghamton University, State University of New York, Binghamton, NY 13902, United States of America
| |
Collapse
|
3
|
Elstak I, Salmon P, McLean S. Artificial intelligence applications in the football codes: A systematic review. J Sports Sci 2024; 42:1184-1199. [PMID: 39140400 DOI: 10.1080/02640414.2024.2383065] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2023] [Accepted: 07/15/2024] [Indexed: 08/15/2024]
Abstract
Artificial Intelligence (AI) is increasingly being adopted across many domains such as transport, healthcare, defence and sport, with football codes no exception. Though there is a range of potential benefits of AI, concern has also been expressed regarding potential risks. An important first step in ensuring that AI applications in football are usable, beneficial, safe and ethical is to understand the current range of applications, the AI models adopted and their proposed functions. This systematic review aimed to identify different applications of AI across football codes to synthesise current knowledge and determine whether potential risks are being considered. The systematic review included 190 peer-reviewed articles. Nine areas of application were found ranging from athlete evaluation and event detection to match outcome prediction and injury detection and prediction. In total, 27 different AI models were identified, with artificial neural networks the most frequently applied. Five AI assessment metrics were identified including specificity, recall, precision, accuracy and F1-score. Four potential risks were identified, concerning data security, usability, data biases and inappropriate athlete load management. It is concluded that, though a wide range of AI applications currently exist, further work is required to develop AI for football and identify and manage potential risks.
Collapse
Affiliation(s)
- Isaiah Elstak
- Centre for Human Factors and Sociotechnical Systems, University of the Sunshine Coast, Sippy Downs, Queensland, Australia
| | - Paul Salmon
- Centre for Human Factors and Sociotechnical Systems, University of the Sunshine Coast, Sippy Downs, Queensland, Australia
| | - Scott McLean
- Centre for Human Factors and Sociotechnical Systems, University of the Sunshine Coast, Sippy Downs, Queensland, Australia
| |
Collapse
|
4
|
Tappan I, Lindbeck EM, Nichols JA, Harley JB. Explainable AI Elucidates Musculoskeletal Biomechanics: A Case Study Using Wrist Surgeries. Ann Biomed Eng 2024; 52:498-509. [PMID: 37943340 PMCID: PMC11293275 DOI: 10.1007/s10439-023-03394-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2023] [Accepted: 10/20/2023] [Indexed: 11/10/2023]
Abstract
As datasets increase in size and complexity, biomechanists have turned to artificial intelligence (AI) to aid their analyses. This paper explores how explainable AI (XAI) can enhance the interpretability of biomechanics data derived from musculoskeletal simulations. We use machine learning to classify the simulated lateral pinch data as belonging to models with healthy or one of two types of surgically altered wrists. This simulation-based classification task is analogous to using biomechanical movement and force data to clinically diagnose a pathological state. The XAI describes which musculoskeletal features best explain the classifications and, in turn, the pathological states, at both the local (individual decision) level and global (entire algorithm) level. We demonstrate that these descriptions agree with assessments in the literature and additionally identify the blind spots that can be missed with traditional statistical techniques.
Collapse
Affiliation(s)
- Isaly Tappan
- Department of Electrical and Computer Engineering, University of Florida, Gainesville, FL, 32611, USA
| | - Erica M Lindbeck
- Department of Electrical and Computer Engineering, University of Florida, Gainesville, FL, 32611, USA
| | - Jennifer A Nichols
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, FL, 32611, USA
| | - Joel B Harley
- Department of Electrical and Computer Engineering, University of Florida, Gainesville, FL, 32611, USA.
| |
Collapse
|
5
|
Menghani RR, Das A, Kraft RH. A sensor-enabled cloud-based computing platform for computational brain biomechanics. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 233:107470. [PMID: 36958108 DOI: 10.1016/j.cmpb.2023.107470] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/27/2022] [Revised: 02/24/2023] [Accepted: 03/06/2023] [Indexed: 06/18/2023]
Abstract
BACKGROUND AND OBJECTIVES Driven by the risk of repetitive head trauma, sensors have been integrated into mouthguards to measure head impacts in contact sports and military activities. These wearable devices, referred to as "instrumented" or "smart" mouthguards are being actively developed by various research groups and organizations. These instrumented mouthguards provide an opportunity to further study and understand the brain biomechanics due to impact. In this study, we present a brain modeling service that can use information from these sensors to predict brain injury metrics in an automated fashion. METHODS We have built a brain modeling platform using several of Amazon's Web Services (AWS) to enable cloud computing and scalability. We use a custom-built cloud-based finite element modeling code to compute the physics-based nonlinear response of the intracranial brain tissue and provide a frontend web application and an application programming interface for groups working on head impact sensor technology to include simulated injury predictions into their research pipeline. RESULTS The platform results have been validated against experimental data available in literature for brain-skull relative displacements, brain strains and intracranial pressure. The parallel processing capability of the platform has also been tested and verified. We also studied the accuracy of the custom head surfaces generated by Avatar 3D. CONCLUSION We present a validated cloud-based computational brain modeling platform that uses sensor data as input for numerical brain models and outputs a quantitative description of brain tissue strains and injury metrics. The platform is expected to generate transparent, reproducible, and traceable brain computing results.
Collapse
Affiliation(s)
- Ritika R Menghani
- Department of Mechanical Engineering, The Pennsylvania State University, University Park, 16802, USA
| | - Anil Das
- Department of Mechanical Engineering, The Pennsylvania State University, University Park, 16802, USA
| | - Reuben H Kraft
- Department of Mechanical Engineering, The Pennsylvania State University, University Park, 16802, USA; Department of Biomedical Engineering, The Pennsylvania State University, University Park, 16802, USA; Institute for Computational and Data Sciences, The Pennsylvania State University, University Park, 16802, USA.
| |
Collapse
|
6
|
Deep learning methodology for predicting time history of head angular kinematics from simulated crash videos. Sci Rep 2022; 12:6526. [PMID: 35444174 PMCID: PMC9021239 DOI: 10.1038/s41598-022-10480-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2021] [Accepted: 03/30/2022] [Indexed: 11/12/2022] Open
Abstract
Head kinematics information is important as it is used to measure brain injury risk. Currently, head kinematics are measured using wearable devices or instrumentation mounted on the head. This paper evaluates the deep learning approach in predicting time history of head angular kinematics directly from videos without any instrumentation. To prove the concept, a deep learning model was developed for predicting time history of head angular velocities using finite element (FE) based crash simulation videos. This FE dataset was split into training, validation, and test datasets. A combined convolutional neural network and recurrent neural network based deep learning model was developed using the training and validations sets. The test (unseen) dataset was used to evaluate the predictive capability of the deep learning model. On the test dataset, correlation coefficient obtained between the actual and predicted peak angular velocities was 0.73, 0.85, and 0.92 for X, Y, and Z components respectively.
Collapse
|