Simulation-assisted machine learning

Simulation-Based Design and Machine Learning Optimization of a Novel Liquid Cooling System for Radio Frequency Coils in Magnetic Hyperthermia

Magnetic hyperthermia is a promising cancer treatment technique that relies on Néel and Brownian relaxation mechanisms to heat superparamagnetic nanoparticles injected into tumor sites. Under low-frequency magnetic fields, nanoparticles generate localized heat, inducing controlled thermal damage to cancer cells. However, radio frequency coils used to generate alternating magnetic fields may suffer from excessive heating, leading to efficiency losses and unintended thermal effects on surrounding healthy tissues. This study proposes novel liquid cooling systems, leveraging the skin effect phenomenon, to improve thermal management and reduce coil size. Finite element method-based simulation studies evaluated coil electrical current and temperature distributions under varying applied frequencies, water flow rates, and cooling microchannel dimensions. A dataset of 300 simulation cases was generated to train a Gaussian Process Regression-based machine learning model. The performance index was also developed and modeled using Gaussian Process Regression, enabling rapid performance prediction without requiring extensive numerical studies. Sensitivity analysis and the ReliefF algorithm were applied for a thorough analysis. Simulation results indicate that the proposed novel liquid cooling system demonstrates higher performance compared to conventional systems that utilize direct liquid cooling, offering a computationally efficient method for pre-manufacturing design optimization of radio frequency coil cooling systems in magnetic hyperthermia applications.

Biologically informed deep neural networks provide quantitative assessment of intratumoral heterogeneity in post treatment glioblastoma

Intratumoral heterogeneity poses a significant challenge to the diagnosis and treatment of recurrent glioblastoma. This study addresses the need for non-invasive approaches to map heterogeneous landscape of histopathological alterations throughout the entire lesion for each patient. We developed BioNet, a biologically-informed neural network, to predict regional distributions of two primary tissue-specific gene modules: proliferating tumor (Pro) and reactive/inflammatory cells (Inf). BioNet significantly outperforms existing methods (p < 2e-26). In cross-validation, BioNet achieved AUCs of 0.80 (Pro) and 0.81 (Inf), with accuracies of 80% and 75%, respectively. In blind tests, BioNet achieved AUCs of 0.80 (Pro) and 0.76 (Inf), with accuracies of 81% and 74%. Competing methods had AUCs lower or around 0.6 and accuracies lower or around 70%. BioNet's voxel-level prediction maps reveal intratumoral heterogeneity, potentially improving biopsy targeting and treatment evaluation. This non-invasive approach facilitates regular monitoring and timely therapeutic adjustments, highlighting the role of ML in precision medicine.

Biologically-informed deep neural networks provide quantitative assessment of intratumoral heterogeneity in post-treatment glioblastoma

Intratumoral heterogeneity poses a significant challenge to the diagnosis and treatment of glioblastoma (GBM). This heterogeneity is further exacerbated during GBM recurrence, as treatment-induced reactive changes produce additional intratumoral heterogeneity that is ambiguous to differentiate on clinical imaging. There is an urgent need to develop non-invasive approaches to map the heterogeneous landscape of histopathological alterations throughout the entire lesion for each patient. We propose to predictively fuse Magnetic Resonance Imaging (MRI) with the underlying intratumoral heterogeneity in recurrent GBM using machine learning (ML) by leveraging image-localized biopsies with their associated locoregional MRI features. To this end, we develop BioNet, a biologically-informed neural network model, to predict regional distributions of three tissue-specific gene modules: proliferating tumor, reactive/inflammatory cells, and infiltrated brain tissue. BioNet offers valuable insights into the integration of multiple implicit and qualitative biological domain knowledge, which are challenging to describe in mathematical formulations. BioNet performs significantly better than a range of existing methods on cross-validation and blind test datasets. Voxel-level prediction maps of the gene modules by BioNet help reveal intratumoral heterogeneity, which can improve surgical targeting of confirmatory biopsies and evaluation of neuro-oncological treatment effectiveness. The non-invasive nature of the approach can potentially facilitate regular monitoring of the gene modules over time, and making timely therapeutic adjustment. These results also highlight the emerging role of ML in precision medicine.

Combined mechanistic modeling and machine-learning approaches in systems biology - A systematic literature review

BACKGROUND AND OBJECTIVE

Mechanistic-based Model simulations (MM) are an effective approach commonly employed, for research and learning purposes, to better investigate and understand the inherent behavior of biological systems. Recent advancements in modern technologies and the large availability of omics data allowed the application of Machine Learning (ML) techniques to different research fields, including systems biology. However, the availability of information regarding the analyzed biological context, sufficient experimental data, as well as the degree of computational complexity, represent some of the issues that both MMs and ML techniques could present individually. For this reason, recently, several studies suggest overcoming or significantly reducing these drawbacks by combining the above-mentioned two methods. In the wake of the growing interest in this hybrid analysis approach, with the present review, we want to systematically investigate the studies available in the scientific literature in which both MMs and ML have been combined to explain biological processes at genomics, proteomics, and metabolomics levels, or the behavior of entire cellular populations.

METHODS

Elsevier Scopus®, Clarivate Web of Science™ and National Library of Medicine PubMed® databases were enquired using the queries reported in Table 1, resulting in 350 scientific articles.

RESULTS

Only 14 of the 350 documents returned by the comprehensive search conducted on the three major online databases met our search criteria, i.e. present a hybrid approach consisting of the synergistic combination of MMs and ML to treat a particular aspect of systems biology.

CONCLUSIONS

Despite the recent interest in this methodology, from a careful analysis of the selected papers, it emerged how examples of integration between MMs and ML are already present in systems biology, highlighting the great potential of this hybrid approach to both at micro and macro biological scales.

Thermodynamically-motivated chemo-mechanical models and multicellular simulation to provide new insight into active cell and tumour remodelling

Computational models can shape our understanding of cell and tissue remodelling, from cell spreading, to active force generation, adhesion, and growth. In this mini-review, we discuss recent progress in modelling of chemo-mechanical cell behaviour and the evolution of multicellular systems. In particular, we highlight recent advances in (i) free-energy based single cell models that can provide new fundamental insight into cell spreading, cancer cell invasion, stem cell differentiation, and remodelling in disease, and (ii) mechanical agent-based models to simulate large numbers of discrete interacting cells in proliferative tumours. We describe how new biological understanding has emerged from such theoretical models, and the trade-offs and constraints associated with current approaches. Ultimately, we aim to make a case for why theory should be integrated with an experimental workflow to optimise new in-vitro studies, to predict feedback between cells and their microenvironment, and to deepen understanding of active cell behaviour.

Challenges and opportunities of integrating imaging and mathematical modelling to interrogate biological processes

Advances in biological imaging have accelerated our understanding of human physiology in both health and disease. As these advances have developed, the opportunities gained by integrating with cutting-edge mathematical models have become apparent yet remain challenging. Combined imaging-modelling approaches provide unprecedented opportunity to correlate data on tissue architecture and function, across length and time scales, to better understand the mechanisms that underpin fundamental biology and also to inform clinical decisions. Here we discuss the opportunities and challenges of such approaches, providing literature examples across a range of organ systems. Given the breadth of the field we focus on the intersection of continuum modelling and in vivo imaging applied to the vasculature and blood flow, though our rationale and conclusions extend widely. We propose three key research pillars (image acquisition, image processing, mathematical modelling) and present their respective advances as well as future opportunity via better integration. Multidisciplinary efforts that develop imaging and modelling tools concurrently, and share them open-source with the research community, provide exciting opportunity for advancing these fields.

Classification of Non-Functional Requirements From IoT Oriented Healthcare Requirement Document

Internet of Things (IoT) involves a set of devices that aids in achieving a smart environment. Healthcare systems, which are IoT-oriented, provide monitoring services of patients' data and help take immediate steps in an emergency. Currently, machine learning-based techniques are adopted to ensure security and other non-functional requirements in smart health care systems. However, no attention is given to classifying the non-functional requirements from requirement documents. The manual process of classifying the non-functional requirements from documents is erroneous and laborious. Missing non-functional requirements in the Requirement Engineering (RE) phase results in IoT oriented healthcare system with compromised security and performance. In this research, an experiment is performed where non-functional requirements are classified from the IoT-oriented healthcare system's requirement document. The machine learning algorithms considered for classification are Logistic Regression (LR), Support Vector Machine (SVM), Multinomial Naive Bayes (MNB), K-Nearest Neighbors (KNN), ensemble, Random Forest (RF), and hybrid KNN rule-based machine learning (ML) algorithms. The results show that our novel hybrid KNN rule-based machine learning algorithm outperforms others by showing an average classification accuracy of 75.9% in classifying non-functional requirements from IoT-oriented healthcare requirement documents. This research is not only novel in its concept of using a machine learning approach for classification of non-functional requirements from IoT-oriented healthcare system requirement documents, but it also proposes a novel hybrid KNN-rule based machine learning algorithm for classification with better accuracy. A new dataset is also created for classification purposes, comprising requirements related to IoT-oriented healthcare systems. However, since this dataset is small and consists of only 104 requirements, this might affect the generalizability of the results of this research.

Online Machine Learning for Accelerating Molecular Dynamics Modeling of Cells

We developed a biomechanics-informed online learning framework to learn the dynamics with ground truth generated with multiscale modeling simulation. It was built on Summit-like supercomputers, which were also used to benchmark and validate our framework on one physiologically significant modeling of deformable biological cells. We generalized the century-old equation of Jeffery orbits to a new equation of motion with additional parameters to account for the flow conditions and the cell deformability. Using simulation data at particle-based resolutions for flowing cells and the learned parameters from our framework, we validated the new equation by the motions, mostly rotations, of a human platelet in shear blood flow at various shear stresses and platelet deformability. Our online framework, which surrogates redundant computations in the conventional multiscale modeling by solutions of our learned equation, accelerates the conventional modeling by three orders of magnitude without visible loss of accuracy.

Prediction of tuberculosis using an automated machine learning platform for models trained on synthetic data

High-quality medical data is critical to the development and implementation of machine learning (ML) algorithms in healthcare; however, security, and privacy concerns continue to limit access. We sought to determine the utility of “synthetic data” in training ML algorithms for the detection of tuberculosis (TB) from inflammatory biomarker profiles. A retrospective dataset (A) comprised of 278 patients was used to generate synthetic datasets (B, C, and D) for training models prior to secondary validation on a generalization dataset. ML models trained and validated on the Dataset A (real) demonstrated an accuracy of 90%, a sensitivity of 89% (95% CI, 83–94%), and a specificity of 100% (95% CI, 81–100%). Models trained using the optimal synthetic dataset B showed an accuracy of 91%, a sensitivity of 93% (95% CI, 87–96%), and a specificity of 77% (95% CI, 50–93%). Synthetic datasets C and D displayed diminished performance measures (respective accuracies of 71% and 54%). This pilot study highlights the promise of synthetic data as an expedited means for ML algorithm development.

Learning from Scarce Information: Using Synthetic Data to Classify Roman Fine Ware Pottery

In this article, we consider a version of the challenging problem of learning from datasets whose size is too limited to allow generalisation beyond the training set. To address the challenge, we propose to use a transfer learning approach whereby the model is first trained on a synthetic dataset replicating features of the original objects. In this study, the objects were smartphone photographs of near-complete Roman terra sigillata pottery vessels from the collection of the Museum of London. Taking the replicated features from published profile drawings of pottery forms allowed the integration of expert knowledge into the process through our synthetic data generator. After this first initial training the model was fine-tuned with data from photographs of real vessels. We show, through exhaustive experiments across several popular deep learning architectures, different test priors, and considering the impact of the photograph viewpoint and excessive damage to the vessels, that the proposed hybrid approach enables the creation of classifiers with appropriate generalisation performance. This performance is significantly better than that of classifiers trained exclusively on the original data, which shows the promise of the approach to alleviate the fundamental issue of learning from small datasets.

Multiscale modeling meets machine learning: What can we learn?

Machine learning is increasingly recognized as a promising technology in the biological, biomedical, and behavioral sciences. There can be no argument that this technique is incredibly successful in image recognition with immediate applications in diagnostics including electrophysiology, radiology, or pathology, where we have access to massive amounts of annotated data. However, machine learning often performs poorly in prognosis, especially when dealing with sparse data. This is a field where classical physics-based simulation seems to remain irreplaceable. In this review, we identify areas in the biomedical sciences where machine learning and multiscale modeling can mutually benefit from one another: Machine learning can integrate physics-based knowledge in the form of governing equations, boundary conditions, or constraints to manage ill-posted problems and robustly handle sparse and noisy data; multiscale modeling can integrate machine learning to create surrogate models, identify system dynamics and parameters, analyze sensitivities, and quantify uncertainty to bridge the scales and understand the emergence of function. With a view towards applications in the life sciences, we discuss the state of the art of combining machine learning and multiscale modeling, identify applications and opportunities, raise open questions, and address potential challenges and limitations. We anticipate that it will stimulate discussion within the community of computational mechanics and reach out to other disciplines including mathematics, statistics, computer science, artificial intelligence, biomedicine, systems biology, and precision medicine to join forces towards creating robust and efficient models for biological systems.

Data-Efficient Neural Network for Track Profile Modelling in Cold Spray Additive Manufacturing

Cold spray is emerging as an additive manufacturing technique, particularly advantageous when high production rate and large build sizes are in demand. To further accelerate technology’s industrial maturity, the problem of geometric control must be improved, and a neural network model has emerged to predict additively manufactured geometry. However, limited data on the effect of deposition conditions on geometry growth is often problematic. Therefore, this study presents data-efficient neural network modelling of a single-track profile in cold spray additive manufacturing. Two modelling techniques harnessing prior knowledge or existing model were proposed, and both were found to be effective in achieving the data-efficient development of a neural network model. We also showed that the proposed data-efficient neural network model provided better predictive performance than the previously proposed Gaussian function model and purely data-driven neural network. The results indicate that a neural network model can outperform a widely used mathematical model with data-efficient modelling techniques and be better suited to improving geometric control in cold spray additive manufacturing.

Including Social and Behavioral Determinants in Predictive Models: Trends, Challenges, and Opportunities

In an era of accelerated health information technology capability, health care organizations increasingly use digital data to predict outcomes such as emergency department use, hospitalizations, and health care costs. This trend occurs alongside a growing recognition that social and behavioral determinants of health (SBDH) influence health and medical care use. Consequently, health providers and insurers are starting to incorporate new SBDH data sources into a wide range of health care prediction models, although existing models that use SBDH variables have not been shown to improve health care predictions more than models that use exclusively clinical variables. In this viewpoint, we review the rationale behind the push to integrate SBDH data into health care predictive models and explore the technical, strategic, and ethical challenges faced as this process unfolds across the United States. We also offer several recommendations to overcome these challenges to reach the promise of SBDH predictive analytics to improve health and reduce health care disparities.

Predicting in vivo MRI Gradient-Field Induced Voltage Levels on Implanted Deep Brain Stimulation Systems Using Neural Networks

Introduction

MRI gradient-fields may induce extrinsic voltage between electrodes and conductive neurostimulator enclosure of implanted deep brain stimulation (DBS) systems, and may cause unintended stimulation and/or malfunction. Electromagnetic (EM) simulations using detailed anatomical human models, therapy implant trajectories, and gradient coil models can be used to calculate clinically relevant induced voltage levels. Incorporating additional anatomical human models into the EM simulation library can help to achieve more clinically relevant and accurate induced voltage levels, however, adding new anatomical human models and developing implant trajectories is time-consuming, expensive and not always feasible.

Methods

MRI gradient-field induced voltage levels are simulated in six adult human anatomical models, along clinically relevant DBS implant trajectories to generate the dataset. Predictive artificial neural network (ANN) regression models are trained on the simulated dataset. Leave-one-out cross validation is performed to assess the performance of ANN regressors and quantify model prediction errors.

Results

More than 180,000 unique gradient-induced voltage levels are simulated. ANN algorithm with two fully connected layers is selected due to its superior generalizability compared to support vector machine and tree-based algorithms in this particular application. The ANN regression model is capable of producing thousands of gradient-induced voltage predictions in less than a second with mean-squared-error less than 200 mV.

Conclusion

We have integrated machine learning (ML) with computational modeling and simulations and developed an accurate predictive model to determine MRI gradient-field induced voltage levels on implanted DBS systems.

Integrating machine learning and multiscale modeling-perspectives, challenges, and opportunities in the biological, biomedical, and behavioral sciences

Fueled by breakthrough technology developments, the biological, biomedical, and behavioral sciences are now collecting more data than ever before. There is a critical need for time- and cost-efficient strategies to analyze and interpret these data to advance human health. The recent rise of machine learning as a powerful technique to integrate multimodality, multifidelity data, and reveal correlations between intertwined phenomena presents a special opportunity in this regard. However, machine learning alone ignores the fundamental laws of physics and can result in ill-posed problems or non-physical solutions. Multiscale modeling is a successful strategy to integrate multiscale, multiphysics data and uncover mechanisms that explain the emergence of function. However, multiscale modeling alone often fails to efficiently combine large datasets from different sources and different levels of resolution. Here we demonstrate that machine learning and multiscale modeling can naturally complement each other to create robust predictive models that integrate the underlying physics to manage ill-posed problems and explore massive design spaces. We review the current literature, highlight applications and opportunities, address open questions, and discuss potential challenges and limitations in four overarching topical areas: ordinary differential equations, partial differential equations, data-driven approaches, and theory-driven approaches. Towards these goals, we leverage expertise in applied mathematics, computer science, computational biology, biophysics, biomechanics, engineering mechanics, experimentation, and medicine. Our multidisciplinary perspective suggests that integrating machine learning and multiscale modeling can provide new insights into disease mechanisms, help identify new targets and treatment strategies, and inform decision making for the benefit of human health.

Toward a grey box approach for cardiovascular physiome

The physiomic approach is now widely used in the diagnosis of cardiovascular diseases. There are two possible methods for cardiovascular physiome: the traditional mathematical model and the machine learning (ML) algorithm. ML is used in almost every area of society for various tasks formerly performed by humans. Specifically, various ML techniques in cardiovascular medicine are being developed and improved at unprecedented speed. The benefits of using ML for various tasks is that the inner working mechanism of the system does not need to be known, which can prove convenient in situations where determining the inner workings of the system can be difficult. The computation speed is also often higher than that of the traditional mathematical models. The limitations with ML are that it inherently leads to an approximation, and special care must be taken in cases where a high accuracy is required. Traditional mathematical models are, however, constructed based on underlying laws either proven or assumed. The results from the mathematical models are accurate as long as the model is. Combining the advantages of both the mathematical models and ML would increase both the accuracy and efficiency of the simulation for many problems. In this review, examples of cardiovascular physiome where approaches of mathematical modeling and ML can be combined are introduced.