Manifold learning based data-driven modeling for soft biological tissues

MetaNO: How to Transfer Your Knowledge on Learning Hidden Physics

Gradient-based meta-learning methods have primarily been applied to classical machine learning tasks such as image classification. Recently, PDE-solving deep learning methods, such as neural operators, are starting to make an important impact on learning and predicting the response of a complex physical system directly from observational data. Taking the material modeling problems for example, the neural operator approach learns a surrogate mapping from the loading field to the corresponding material response field, which can be seen as learning the solution operator of a hidden PDE. The microstructure and mechanical parameters of each material specimen correspond to the (possibly heterogeneous) parameter field in this hidden PDE. Due to the limitation on experimental measurement techniques, the data acquisition for each material specimen is commonly challenging and costly. This fact calls for the utilization and transfer of existing knowledge to new and unseen material specimens, which corresponds to sampling efficient learning of the solution operator of a hidden PDE with a different parameter field. Herein, we propose a novel meta-learning approach for neural operators, which can be seen as transferring the knowledge of solution operators between governing (unknown) PDEs with varying parameter fields. Our approach is a provably universal solution operator for multiple PDE solving tasks, with a key theoretical observation that underlying parameter fields can be captured in the first layer of neural operator models, in contrast to typical final-layer transfer in existing meta-learning methods. As applications, we demonstrate the efficacy of our proposed approach on PDE-based datasets and a real-world material modeling problem, illustrating that our method can handle complex and nonlinear physical response learning tasks while greatly improving the sampling efficiency in unseen tasks.

A multi-resolution physics-informed recurrent neural network: formulation and application to musculoskeletal systems

This work presents a multi-resolution physics-informed recurrent neural network (MR PI-RNN), for simultaneous prediction of musculoskeletal (MSK) motion and parameter identification of the MSK systems. The MSK application was selected as the model problem due to its challenging nature in mapping the high-frequency surface electromyography (sEMG) signals to the low-frequency body joint motion controlled by the MSK and muscle contraction dynamics. The proposed method utilizes the fast wavelet transform to decompose the mixed frequency input sEMG and output joint motion signals into nested multi-resolution signals. The prediction model is subsequently trained on coarser-scale input-output signals using a gated recurrent unit (GRU), and then the trained parameters are transferred to the next level of training with finer-scale signals. These training processes are repeated recursively under a transfer-learning fashion until the full-scale training (i.e., with unfiltered signals) is achieved, while satisfying the underlying dynamic equilibrium. Numerical examples on recorded subject data demonstrate the effectiveness of the proposed framework in generating a physics-informed forward-dynamics surrogate, which yields higher accuracy in motion predictions of elbow flexion-extension of an MSK system compared to the case with single-scale training. The framework is also capable of identifying muscle parameters that are physiologically consistent with the subject's kinematics data.

Strain energy density as a Gaussian process and its utilization in stochastic finite element analysis: application to planar soft tissues

Data-based approaches are promising alternatives to the traditional analytical constitutive models for solid mechanics. Herein, we propose a Gaussian process (GP) based constitutive modeling framework, specifically focusing on planar, hyperelastic and incompressible soft tissues. The strain energy density of soft tissues is modeled as a GP, which can be regressed to experimental stress-strain data obtained from biaxial experiments. Moreover, the GP model can be weakly constrained to be convex. A key advantage of a GP-based model is that, in addition to the mean value, it provides a probability density (i.e. associated uncertainty) for the strain energy density. To simulate the effect of this uncertainty, a non-intrusive stochastic finite element analysis (SFEA) framework is proposed. The proposed framework is verified against an artificial dataset based on the Gasser-Ogden-Holzapfel model and applied to a real experimental dataset of a porcine aortic valve leaflet tissue. Results show that the proposed framework can be trained with limited experimental data and fits the data better than several existing models. The SFEA framework provides a straightforward way of using the experimental data and quantifying the resulting uncertainty in simulation-based predictions.

A Feature-Encoded Physics-Informed Parameter Identification Neural Network for Musculoskeletal Systems

Identification of muscle-tendon force generation properties and muscle activities from physiological measurements, e.g., motion data and raw surface electromyography (sEMG), offers opportunities to construct a subject-specific musculoskeletal (MSK) digital twin system for health condition assessment and motion prediction. While machine learning approaches with capabilities in extracting complex features and patterns from a large amount of data have been applied to motion prediction given sEMG signals, the learned data-driven mapping is black-box and may not satisfy the underlying physics and has reduced generality. In this work, we propose a feature-encoded physics-informed parameter identification neural network (FEPI-PINN) for simultaneous prediction of motion and parameter identification of human MSK systems. In this approach, features of high-dimensional noisy sEMG signals are projected onto a low-dimensional noise-filtered embedding space for the enhancement of forwarding dynamics prediction. This FEPI-PINN model can be trained to relate sEMG signals to joint motion and simultaneously identify key MSK parameters. The numerical examples demonstrate that the proposed framework can effectively identify subject-specific muscle parameters and the trained physics-informed forward-dynamics surrogate yields accurate motion predictions of elbow flexion-extension motion that are in good agreement with the measured joint motion data.

A Physics-Guided Neural Operator Learning Approach to Model Biological Tissues From Digital Image Correlation Measurements

We present a data-driven workflow to biological tissue modeling, which aims to predict the displacement field based on digital image correlation (DIC) measurements under unseen loading scenarios, without postulating a specific constitutive model form nor possessing knowledge of the material microstructure. To this end, a material database is constructed from the DIC displacement tracking measurements of multiple biaxial stretching protocols on a porcine tricuspid valve anterior leaflet, with which we build a neural operator learning model. The material response is modeled as a solution operator from the loading to the resultant displacement field, with the material microstructure properties learned implicitly from the data and naturally embedded in the network parameters. Using various combinations of loading protocols, we compare the predictivity of this framework with finite element analysis based on three conventional constitutive models. From in-distribution tests, the predictivity of our approach presents good generalizability to different loading conditions and outperforms the conventional constitutive modeling at approximately one order of magnitude. When tested on out-of-distribution loading ratios, the neural operator learning approach becomes less effective. To improve the generalizability of our framework, we propose a physics-guided neural operator learning model via imposing partial physics knowledge. This method is shown to improve the model's extrapolative performance in the small-deformation regime. Our results demonstrate that with sufficient data coverage and/or guidance from partial physics constraints, the data-driven approach can be a more effective method for modeling biological materials than the traditional constitutive modeling.

Data-driven Modeling of the Mechanical Behavior of Anisotropic Soft Biological Tissue

Closed-form constitutive models are the standard to describe soft tissue mechanical behavior. However, inherent pitfalls of an explicit functional form include poor fits to the data, non-uniqueness of fit, and sensitivity to parameters. Here we design deep neural networks (DNN) that satisfy desirable physics constraints in order to replace expert models of tissue mechanics. To guarantee stress-objectivity, the DNN takes strain (pseudo)-invariants as inputs, and outputs the strain energy and its derivatives. Polyconvexity of strain energy is enforced through the loss function. Direct prediction of both energy and derivative functions enables the computation of the elasticity tensor needed for a finite element implementation. We showcase the DNN ability to learn the anisotropic mechanical behavior of porcine and murine skin from biaxial test data. A multi-fidelity scheme that combines high fidelity experimental data with a low fidelity analytical approximation yields the best performance. Finite element simulations of tissue expansion with the DNN model illustrate the potential of this method to impact medical device design for skin therapeutics. We expect that the open data and software from this work will broaden the use of data-driven constitutive models of tissue mechanics.

Machine Learning for Cardiovascular Biomechanics Modeling: Challenges and Beyond

Recent progress in machine learning (ML), together with advanced computational power, have provided new research opportunities in cardiovascular modeling. While classifying patient outcomes and medical image segmentation with ML have already shown significant promising results, ML for the prediction of biomechanics such as blood flow or tissue dynamics is in its infancy. This perspective article discusses some of the challenges in using ML for replacing well-established physics-based models in cardiovascular biomechanics. Specifically, we discuss the large landscape of input features in 3D patient-specific modeling as well as the high-dimensional output space of field variables that vary in space and time. We argue that the end purpose of such ML models needs to be clearly defined and the tradeoff between the loss in accuracy and the gained speedup carefully interpreted in the context of translational modeling. We also discuss several exciting venues where ML could be strategically used to augment traditional physics-based modeling in cardiovascular biomechanics. In these applications, ML is not replacing physics-based modeling, but providing opportunities to solve ill-defined problems, improve measurement data quality, enable a solution to computationally expensive problems, and interpret complex spatiotemporal data by extracting hidden patterns. In summary, we suggest a strategic integration of ML in cardiovascular biomechanics modeling where the ML model is not the end goal but rather a tool to facilitate enhanced modeling.

Linking collagen fiber architecture to tissue-level biaxial mechanical behaviors of porcine semilunar heart valve cusps

The semilunar heart valves regulate the blood flow from the ventricles to the major arteries through the opening and closing of the scallop shaped cusps. These cusps are composed of collagen fibers that act as the primary loading-bearing component. The load-dependent collagen fiber architecture has been previously examined in the existing literature; however, these studies relied on chemical clearing and tissue modifications to observe the underlying changes in response to mechanical loads. In the present study, we address this gap in knowledge by quantifying the collagen fiber orientations and alignments of the aortic and pulmonary cusps through a multi-scale, non-destructive experimental approach. This opto-mechanical approach, which combines polarized spatial frequency domain imaging and biaxial mechanical testing, provides a greater field of view (10-25mm) and faster imaging time (45-50s) than other traditional collagen imaging techniques. The birefringent response of the collagen fibers was fit with a von Mises distribution, while the biaxial mechanical testing data was implemented into a modified full structural model for further analysis. Our results showed that the semilunar heart valve cusps are more extensible in the tissue's radial direction than the circumferential direction under all the varied biaxial testing protocols, together with greater material anisotropy among the pulmonary valve cusps compared to the aortic valve cusps. The collagen fibers were shown to reorient towards the direction of the greatest applied loading and incrementally realign with the increased applied stress. The collagen fiber architecture within the aortic valve cusps were found to be more homogeneous than the pulmonary valve counterparts, reflecting the differences in the physiological environments experienced by these two semilunar heart valves. Further, the von Mises distribution fitting highlighted the presence and contribution of two distinct fiber families for each of the two semilunar heart valves. The results from this work would provide valuable insight into connecting tissue-level mechanics to the underlying collagen fiber architecture-an essential information for the future development of high-fidelity aortic/pulmonary valve computational models.