Reinforcement Learning for Precision Oncology

Precision Dosing in Presence of Multiobjective Therapies by Integrating Reinforcement Learning and PK-PD Models: Application to Givinostat Treatment of Polycythemia Vera

Precision dosing aims to optimize and customize pharmacological treatment at the individual level. The integration of pharmacometric models with Reinforcement Learning (RL) algorithms is currently under investigation to support the personalization of adaptive dosing therapies. In this study, this hybrid technique is applied to the real multiobjective precision dosing problem of givinostat treatment in polycythemia vera (PV) patients. PV is a chronic myeloproliferative disease with an overproduction of platelets (PLT), white blood cells (WBC), and hematocrit (HCT). The therapeutic goal is to simultaneously normalize the levels of these efficacy/safety biomarkers, thus inducing a complete hematological response (CHR). An RL algorithm, Q-Learning (QL), was integrated with a PK-PD model describing the givinostat effect on PLT, WBC, and HCT to derive both an adaptive dosing protocol (QLpop-agent) for the whole population and personalized dosing strategies by coupling a specific QL-agent to each patient (QLind-agents). QLpop-agent learned a general adaptive dosing protocol that achieved a similar CHR rate (77% vs. 83%) when compared to the actual givinostat clinical protocol on 10 simulated populations. Treatment efficacy and safety increased with a deeper dosing personalization by QLind-agents. These QL-based patient-specific adaptive dosing rules outperformed both the clinical protocol and QLpop-agent by reaching the CHR in 93% of the test patients and completely avoided severe toxicities during the whole treatment period. These results confirm that RL and PK-PD models can be valid tools for supporting adaptive dosing strategies as interesting performances were achieved in both learning a general set of rules and in customizing treatment for each patient.

Personalized decision making for coronary artery disease treatment using offline reinforcement learning

Choosing optimal revascularization strategies for patients with obstructive coronary artery disease (CAD) remains a clinical challenge. While randomized controlled trials offer population-level insights, gaps remain regarding personalized decision-making for individual patients. We applied off-policy reinforcement learning (RL) to a composite data model from 41,328 unique patients with angiography-confirmed obstructive CAD. In an offline setting, we estimated optimal treatment policies and evaluated these policies using weighted importance sampling. Our findings indicate that RL-guided therapy decisions outperformed physician-based decision making, with RL policies achieving up to 32% improvement in expected rewards based on composite major cardiovascular events outcomes. Additionally, we introduced methods to ensure that RL CAD treatment policies remain compatible with locally achievable clinical practice models, presenting an interpretable RL policy with a limited number of states. Overall, this novel RL-based clinical decision support tool, RL4CAD, demonstrates potential to optimize care in patients with obstructive CAD referred for invasive coronary angiography.

Artificial intelligence in breast cancer survival prediction: a comprehensive systematic review and meta-analysis

Background

Breast cancer (BC), as a leading cause of cancer mortality in women, demands robust prediction models for early diagnosis and personalized treatment. Artificial Intelligence (AI) and Machine Learning (ML) algorithms offer promising solutions for automated survival prediction, driving this study's systematic review and meta-analysis.

Methods

Three online databases (Web of Science, PubMed, and Scopus) were comprehensively searched (January 2016-August 2023) using key terms ("Breast Cancer", "Survival Prediction", and "Machine Learning") and their synonyms. Original articles applying ML algorithms for BC survival prediction using clinical data were included. The quality of studies was assessed via the Qiao Quality Assessment tool.

Results

Amongst 140 identified articles, 32 met the eligibility criteria. Analyzed ML methods achieved a mean validation accuracy of 89.73%. Hybrid models, combining traditional and modern ML techniques, were mostly considered to predict survival rates (40.62%). Supervised learning was the dominant ML paradigm (75%). Common ML methodologies included pre-processing, feature extraction, dimensionality reduction, and classification. Deep Learning (DL), particularly Convolutional Neural Networks (CNNs), emerged as the preferred modern algorithm within these methodologies. Notably, 81.25% of studies relied on internal validation, primarily using K-fold cross-validation and train/test split strategies.

Conclusion

The findings underscore the significant potential of AI-based algorithms in enhancing the accuracy of BC survival predictions. However, to ensure the robustness and generalizability of these predictive models, future research should emphasize the importance of rigorous external validation. Such endeavors will not only validate the efficacy of these models across diverse populations but also pave the way for their integration into clinical practice, ultimately contributing to personalized patient care and improved survival outcomes.

Systematic Review Registration

https://www.crd.york.ac.uk/prospero/, identifier CRD42024513350.

Comprehensive review of reinforcement learning in lung cancer diagnosis and treatment: Taxonomy, challenges and recommendations

Lung cancer (LuC) is one of the leading causes of death in the world, and due to the complex mechanisms and widespread metastasis, diagnosis and treatment are challenging. In recent years, the application of reinforcement learning (RL) techniques as a new tool to improve LuC diagnosis and treatment has been dramatically expanded. These techniques can potentially increase the accuracy of diagnosis and optimize treatment processes by learning from limited data and improving clinical decisions. However, RL in LuC diagnosis and treatment faces challenges such as limited access to clinical data, the complexity of algorithms, and the need for technical expertise for proper implementation. Our systematic review article aims to evaluate the latest developments in applications and challenges of using RL techniques in LuC diagnosis and treatment. The findings showed that RL has increased the accuracy of identifying disease trends by 37 % and enhancing treatment decisions by 23 %. Also, using this approach reduces data processing time by 17 % and streamlining treatment processes by 12 %. Ultimately, analyzing the current challenges and offering recommendations to researchers could help develop new strategies for improving the diagnosis and treatment of LuC.

Machine learning approaches for the discovery of clinical pathways from patient data: A systematic review

BACKGROUND

Clinical pathways are sequences of events followed during the clinical care of a group of patients who meet pre-defined criteria. They have many applications ranging from healthcare evaluation and optimization to clinical decision support. These pathways can be discovered from existing healthcare data, in particular with machine learning which is a family of methods used to learn patterns from data. This review provides a comprehensive overview of the literature concerning the use of machine learning methods for clinical pathway discovery from patient data.

METHODS

Guided by the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) method , we conducted a systematic review of the existing literature. We searched 6 databases, i.e., ACM Digital Library, ScienceDirect, Web of Science, PubMed, IEEE Xplore, and Scopus spanning from January 2004 to December 2023 using search terms pertinent to clinical pathways and their development. Subsequently, the retrieved papers were analyzed to assess their relevance to the scope of this study.

RESULTS

In total, 131 papers that met the specified inclusion criteria were identified. These papers expressed diverse motivations behind data-driven clinical pathway discovery ranging from knowledge discovery to conformance checking with established clinical guidelines (derived from existing literature and clinical experts). Notably, the predominant methods employed (67.2%, n=88) involved unsupervised machine learning techniques, such as clustering and process mining.

CONCLUSIONS

Relevant clinical pathways can be discovered from patient data using machine learning methods, with the desirable potential to aid clinical decision-making in healthcare. However, to reach this objective, the methods used to discover pathways should be reproducible, and rigorous performance evaluation by clinical experts needs to be conducted for validation.

Artificial Intelligence in Head and Neck Cancer: Innovations, Applications, and Future Directions

Artificial intelligence (AI) is revolutionizing head and neck cancer (HNC) care by providing innovative tools that enhance diagnostic accuracy and personalize treatment strategies. This review highlights the advancements in AI technologies, including deep learning and natural language processing, and their applications in HNC. The integration of AI with imaging techniques, genomics, and electronic health records is explored, emphasizing its role in early detection, biomarker discovery, and treatment planning. Despite noticeable progress, challenges such as data quality, algorithmic bias, and the need for interdisciplinary collaboration remain. Emerging innovations like explainable AI, AI-powered robotics, and real-time monitoring systems are poised to further advance the field. Addressing these challenges and fostering collaboration among AI experts, clinicians, and researchers is crucial for developing equitable and effective AI applications. The future of AI in HNC holds significant promise, offering potential breakthroughs in diagnostics, personalized therapies, and improved patient outcomes.

Model-Informed Reinforcement Learning for Enabling Precision Dosing Via Adaptive Dosing

Precision dosing, the tailoring of drug doses to optimize therapeutic benefits and minimize risks in each patient, is essential for drugs with a narrow therapeutic window and severe adverse effects. Adaptive dosing strategies extend the precision dosing concept to time-varying treatments which require sequential dose adjustments based on evolving patient conditions. Reinforcement learning (RL) naturally fits this paradigm: it perfectly mimics the sequential decision-making process where clinicians adapt dose administration based on patient response and evolution monitoring. This paper aims to investigate the potentiality of coupling RL with population PK/PD models to develop precision dosing algorithms, reviewing the most relevant works in the field. Case studies in which PK/PD models were integrated within RL algorithms as simulation engine to predict consequences of any dosing action have been considered and discussed. They mainly concern propofol-induced anesthesia, anticoagulant therapy with warfarin and a variety of anticancer treatments differing for administered agents and/or monitored biomarkers. The resulted picture highlights a certain heterogeneity in terms of precision dosing approaches, applied methodologies, and degree of adherence to the clinical domain. In addition, a tutorial on how a precision dosing problem should be formulated in terms of the key elements composing the RL framework (i.e., system state, agent actions and reward function), and on how PK/PD models could enhance RL approaches is proposed for readers interested in delving in this field. Overall, the integration of PK/PD models into a RL-framework holds great promise for precision dosing, but further investigations and advancements are still needed to address current limitations and extend the applicability of this methodology to drugs requiring adaptive dosing strategies.

Systematic literature review on reinforcement learning in non-communicable disease interventions

There is evidence that reducing modifiable risk factors and strengthening medical and health interventions can reduce early mortality and economic losses from non-communicable diseases (NCDs). Machine learning (ML) algorithms have been successfully applied to preventing and controlling NCDs. Reinforcement learning (RL) is the most promising of these approaches because of its ability to dynamically adapt interventions to NCD disease progression and its commitment to achieving long-term intervention goals. This paper reviews the preferred algorithms, data sources, design details, and obstacles to clinical application in existing studies to facilitate the early application of RL algorithms in clinical practice research for NCD interventions. We screened 40 relevant papers for quantitative and qualitative analysis using the PRISMA review flow diagram. The results show that researchers tend to use Deep Q-Network (DQN) and Actor-Critic as well as their improved or hybrid algorithms to train and validate RL models on retrospective datasets. Often, the patient's physical condition is the main defining parameter of the state space, while interventions are the main defining parameter of the action space. Mostly, changes in the patient's physical condition are used as a basis for immediate rewards to the agent. Various attempts have been made to address the challenges to clinical application, and several approaches have been proposed from existing research. However, as there is currently no universally accepted solution, the use of RL algorithms in clinical practice for NCD interventions necessitates more comprehensive responses to the issues addressed in this paper, which are safety, interpretability, training efficiency, and the technical aspect of exploitation and exploration in RL algorithms.

Review: Cancer and neurodevelopmental disorders: multi-scale reasoning and computational guide

The connection and causality between cancer and neurodevelopmental disorders have been puzzling. How can the same cellular pathways, proteins, and mutations lead to pathologies with vastly different clinical presentations? And why do individuals with neurodevelopmental disorders, such as autism and schizophrenia, face higher chances of cancer emerging throughout their lifetime? Our broad review emphasizes the multi-scale aspect of this type of reasoning. As these examples demonstrate, rather than focusing on a specific organ system or disease, we aim at the new understanding that can be gained. Within this framework, our review calls attention to computational strategies which can be powerful in discovering connections, causalities, predicting clinical outcomes, and are vital for drug discovery. Thus, rather than centering on the clinical features, we draw on the rapidly increasing data on the molecular level, including mutations, isoforms, three-dimensional structures, and expression levels of the respective disease-associated genes. Their integrated analysis, together with chromatin states, can delineate how, despite being connected, neurodevelopmental disorders and cancer differ, and how the same mutations can lead to different clinical symptoms. Here, we seek to uncover the emerging connection between cancer, including pediatric tumors, and neurodevelopmental disorders, and the tantalizing questions that this connection raises.

Machine Learning Approach in Dosage Individualization of Isoniazid for Tuberculosis

INTRODUCTION

Isoniazid is a first-line antituberculosis agent with high variability, which would profit from individualized dosing. Concentrations of isoniazid at 2 h (C2h), as an indicator of safety and efficacy, are important for optimizing therapy.

OBJECTIVE

The objective of this study was to establish machine learning (ML) models to predict the C2h, that can be used for establishing an individualized dosing regimen in clinical practice.

METHODS

Published population pharmacokinetic (PopPK) models for adults were searched based on PubMed and ultimately four reliable models were selected for simulating individual C2h datasets under different conditions (demographics, genotype, ethnicity, etc.). Machine learning models were trained on simulated C2h obtained from the four PopPK models. Five different algorithms were used for ML model building to predict C2h. Real-world data were used for predictive performance evaluations. Virtual trials were used to compare ML-optimized doses with PopPK model-optimized doses.

RESULTS

Categorical boosting (CatBoost) exhibited the highest prediction ability. Target C2h can be predicted using the ML model combined with the dosing regimen and three covariates (N-acetyltransferase 2 [NAT2] genotypes, weight and race [Asians and Africans]). Real-world data validation results showed that the ML model can achieve an overall prediction accuracy of 93.4%. Using the final ML model, the mean absolute prediction error value decreased by 45.7% relative to the average of PopPK models. Using the ML-optimized dosing regimen, the probability of target attainment increased by 43.7% relative to the PopPK model-optimized dosing regimens.

CONCLUSION

Machine learning models were developed with great predictive performance, which can be used to determine the individualized initial dose of isoniazid in adult patients.

Mathematical Model-Driven Deep Learning Enables Personalized Adaptive Therapy

Standard-of-care treatment regimens have long been designed for maximal cell killing, yet these strategies often fail when applied to metastatic cancers due to the emergence of drug resistance. Adaptive treatment strategies have been developed as an alternative approach, dynamically adjusting treatment to suppress the growth of treatment-resistant populations and thereby delay, or even prevent, tumor progression. Promising clinical results in prostate cancer indicate the potential to optimize adaptive treatment protocols. Here, we applied deep reinforcement learning (DRL) to guide adaptive drug scheduling and demonstrated that these treatment schedules can outperform the current adaptive protocols in a mathematical model calibrated to prostate cancer dynamics, more than doubling the time to progression. The DRL strategies were robust to patient variability, including both tumor dynamics and clinical monitoring schedules. The DRL framework could produce interpretable, adaptive strategies based on a single tumor burden threshold, replicating and informing optimal treatment strategies. The DRL framework had no knowledge of the underlying mathematical tumor model, demonstrating the capability of DRL to help develop treatment strategies in novel or complex settings. Finally, a proposed five-step pathway, which combined mechanistic modeling with the DRL framework and integrated conventional tools to improve interpretability compared with traditional "black-box" DRL models, could allow translation of this approach to the clinic. Overall, the proposed framework generated personalized treatment schedules that consistently outperformed clinical standard-of-care protocols.

SIGNIFICANCE

Generation of interpretable and personalized adaptive treatment schedules using a deep reinforcement framework that interacts with a virtual patient model overcomes the limitations of standardized strategies caused by heterogeneous treatment responses.

Artificial intelligence in the clinical laboratory

Laboratory medicine has become a highly automated medical discipline. Nowadays, artificial intelligence (AI) applied to laboratory medicine is also gaining more and more attention, which can optimize the entire laboratory workflow and even revolutionize laboratory medicine in the future. However, only a few commercially available AI models are currently approved for use in clinical laboratories and have drawbacks such as high cost, lack of accuracy, and the need for manual review of model results. Furthermore, there are a limited number of literature reviews that comprehensively address the research status, challenges, and future opportunities of AI applications in laboratory medicine. Our article begins with a brief introduction to AI and some of its subsets, then reviews some AI models that are currently being used in clinical laboratories or that have been described in emerging studies, and explains the existing challenges associated with their application and possible solutions, finally provides insights into the future opportunities of the field. We highlight the current status of implementation and potential applications of AI models in different stages of the clinical testing process.

Reinforcement Learning Algorithms and Applications in Healthcare and Robotics: A Comprehensive and Systematic Review

Reinforcement learning (RL) has emerged as a dynamic and transformative paradigm in artificial intelligence, offering the promise of intelligent decision-making in complex and dynamic environments. This unique feature enables RL to address sequential decision-making problems with simultaneous sampling, evaluation, and feedback. As a result, RL techniques have become suitable candidates for developing powerful solutions in various domains. In this study, we present a comprehensive and systematic review of RL algorithms and applications. This review commences with an exploration of the foundations of RL and proceeds to examine each algorithm in detail, concluding with a comparative analysis of RL algorithms based on several criteria. This review then extends to two key applications of RL: robotics and healthcare. In robotics manipulation, RL enhances precision and adaptability in tasks such as object grasping and autonomous learning. In healthcare, this review turns its focus to the realm of cell growth problems, clarifying how RL has provided a data-driven approach for optimizing the growth of cell cultures and the development of therapeutic solutions. This review offers a comprehensive overview, shedding light on the evolving landscape of RL and its potential in two diverse yet interconnected fields.

Machine Learning: A New Approach for Dose Individualization

The application of machine learning (ML) has shown promising results in precision medicine due to its exceptional performance in dealing with complex multidimensional data. However, using ML for individualized dosing of medicines is still in its early stage, meriting further exploration. A systematic review of study designs and modeling details of using ML for individualized dosing of different drugs was performed. We have summarized the status of the study populations, predictive targets, and data sources for ML modeling, the selection of ML algorithms and features, and the evaluation and validation of their predictive performance. We also used the Prediction model Risk of Bias Assessment Tool (PROBAST) to assess the risk of bias of included studies. Currently, ML can be used for both a priori and a posteriori dose selection and optimization, and it can also assist the implementation of therapeutic drug monitoring. However, studies are mainly focused on drugs with narrow therapeutic windows, predominantly immunosuppressants (N = 23, 35.9%) and anti-infectives (N = 21, 32.8%), and there is currently only very limited attention for special populations, such as children (N = 22, 34.4%). Most studies showed poor methodological quality and a high risk of bias. The lack of external validation and clinical utility evaluation currently limits the further clinical implementation of ML for dose individualization. We therefore have proposed several ways to improve the clinical relevance of the studies and facilitate the translation of ML models into clinical practice.

Reinforcement Learning and PK-PD Models Integration to Personalize the Adaptive Dosing Protocol of Erdafitinib in Patients with Metastatic Urothelial Carcinoma

The integration of pharmacokinetic-pharmacodynamic (PK-PD) modeling and simulations with artificial intelligence/machine learning algorithms is one of the most attractive areas of the pharmacometric research. These hybrid techniques are currently under investigation to perform several tasks, among which precision dosing. In this scenario, this paper presents and evaluates a new framework embedding PK-PD models into a reinforcement learning (RL) algorithm, Q-learning (QL), to personalize pharmacological treatment. Each patient is represented with a set of PK-PD parameters and has a personal QL agent which optimizes the individual treatment. In the training phase, leveraging PK-PD simulations, the QL agent assesses different actions, defined consistently with the clinical knowledge to consider only plausible dose-adjustments, in order to find the optimal rules. The proposed framework was evaluated to optimize the erdafitinib treatment in patients with metastatic urothelial carcinoma. This drug was approved by the US Food and Drug Administration (FDA) with a dose-adaptive protocol based on monitoring the levels of serum phosphate, which represent a biomarker of both treatment efficacy and toxicity. To evaluate the flexibility of the methodology, a heterogeneous virtual population of 141 patients was generated using an erdafitinib population PK (PopPK)-PD literature model. For each patient, treatment response was simulated by using both QL-optimized protocol and the clinical one. QL agents outperform the approved dose-adaptive rules, increasing more than 10% the efficacy and the safety of treatment at each end point. Results confirm the great potentialities of the integration of PopPK-PD models and RL algorithms to optimize precision dosing tasks.

Just how transformative will AI/ML be for immuno-oncology?

Immuno-oncology involves the study of approaches which harness the patient's immune system to fight malignancies. Immuno-oncology, as with every other biomedical and clinical research field as well as clinical operations, is in the midst of technological revolutions, which vastly increase the amount of available data. Recent advances in artificial intelligence and machine learning (AI/ML) have received much attention in terms of their potential to harness available data to improve insights and outcomes in many areas including immuno-oncology. In this review, we discuss important aspects to consider when evaluating the potential impact of AI/ML applications in the clinic. We highlight four clinical/biomedical challenges relevant to immuno-oncology and how they may be able to be addressed by the latest advancements in AI/ML. These challenges include (1) efficiency in clinical workflows, (2) curation of high-quality image data, (3) finding, extracting and synthesizing text knowledge as well as addressing, and (4) small cohort size in immunotherapeutic evaluation cohorts. Finally, we outline how advancements in reinforcement and federated learning, as well as the development of best practices for ethical and unbiased data generation, are likely to drive future innovations.

Machine learning in onco-pharmacogenomics: a path to precision medicine with many challenges

Over the past two decades, Next-Generation Sequencing (NGS) has revolutionized the approach to cancer research. Applications of NGS include the identification of tumor specific alterations that can influence tumor pathobiology and also impact diagnosis, prognosis and therapeutic options. Pharmacogenomics (PGx) studies the role of inheritance of individual genetic patterns in drug response and has taken advantage of NGS technology as it provides access to high-throughput data that can, however, be difficult to manage. Machine learning (ML) has recently been used in the life sciences to discover hidden patterns from complex NGS data and to solve various PGx problems. In this review, we provide a comprehensive overview of the NGS approaches that can be employed and the different PGx studies implicating the use of NGS data. We also provide an excursus of the ML algorithms that can exert a role as fundamental strategies in the PGx field to improve personalized medicine in cancer.

Machine learning applications and challenges in graft-versus-host disease: a scoping review

PURPOSE OF REVIEW

This review delves into the potential of artificial intelligence (AI), particularly machine learning (ML), in enhancing graft-versus-host disease (GVHD) risk assessment, diagnosis, and personalized treatment.

RECENT FINDINGS

Recent studies have demonstrated the superiority of ML algorithms over traditional multivariate statistical models in donor selection for allogeneic hematopoietic stem cell transplantation. ML has recently enabled dynamic risk assessment by modeling time-series data, an upgrade from the static, "snapshot" assessment of patients that conventional statistical models and older ML algorithms offer. Regarding diagnosis, a deep learning model, a subset of ML, can accurately identify skin segments affected with chronic GVHD with satisfactory results. ML methods such as Q-learning and deep reinforcement learning have been utilized to develop adaptive treatment strategies (ATS) for the personalized prevention and treatment of acute and chronic GVHD.

SUMMARY

To capitalize on these promising advancements, there is a need for large-scale, multicenter collaborations to develop generalizable ML models. Furthermore, addressing pertinent issues such as the implementation of stringent ethical guidelines is crucial before the widespread introduction of AI into GVHD care.

Consensus Statements on Precision Oncology in the China Greater Bay Area

BACKGROUND

Next-generation sequencing comprehensive genomic panels (NGS CGPs) have enabled the delivery of tailor-made therapeutic approaches to improve survival outcomes in patients with cancer. Within the China Greater Bay Area (GBA), territorial differences in clinical practices and health care systems and strengthening collaboration warrant a regional consensus to consolidate the development and integration of precision oncology (PO). Therefore, the Precision Oncology Working Group (POWG) formulated standardized principles for the clinical application of molecular profiling, interpretation of genomic alterations, and alignment of actionable mutations with sequence-directed therapy to deliver clinical services of excellence and evidence-based care to patients with cancer in the China GBA.

METHODS

Thirty experts used a modified Delphi method. The evidence extracted to support the statements was graded according to the GRADE system and reported according to the Revised Standards for Quality Improvement Reporting Excellence guidelines, version 2.0.

RESULTS

The POWG reached consensus in six key statements: harmonization of reporting and quality assurance of NGS; molecular tumor board and clinical decision support systems for PO; education and training; research and real-world data collection, patient engagement, regulations, and financial reimbursement of PO treatment strategies; and clinical recommendations and implementation of PO in clinical practice.

CONCLUSION

POWG consensus statements standardize the clinical application of NGS CGPs, streamline the interpretation of clinically significant genomic alterations, and align actionable mutations with sequence-directed therapies. The POWG consensus statements may harmonize the utility and delivery of PO in China's GBA.

Reinforcement learning strategies in cancer chemotherapy treatments: A review

BACKGROUND AND OBJECTIVE

Cancer is one of the major causes of death worldwide and chemotherapies are the most significant anti-cancer therapy, in spite of the emerging precision cancer medicines in the last 2 decades. The growing interest in developing the effective chemotherapy regimen with optimal drug dosing schedule to benefit the clinical cancer patients has spawned innovative solutions involving mathematical modeling since the chemotherapy regimens are administered cyclically until the futility or the occurrence of intolerable adverse events. Thus, in this present work, we reviewed the emerging trends involved in forming a computational solution from the aspect of reinforcement learning.

METHODS

Initially, this survey in-depth focused on the details of the dynamic treatment regimens from a broad perspective and then narrowed down to inspirations from reinforcement learning that were advantageous to chemotherapy dosing, including both offline reinforcement learning and supervised reinforcement learning.

RESULTS

The insights established in the chemotherapy-planning problem associated with the Reinforcement Learning (RL) has been discussed in this study. It showed that the researchers were able to widen their perspectives in comprehending the theoretical basis, dynamic treatment regimens (DTR), use of the adaptive control on DTR, and the associated RL techniques.

CONCLUSIONS

This study reviewed the recent researches relevant to the topic, and highlighted the challenges, open questions, possible solutions, and future steps in inventing a realistic solution for the aforementioned problem.

Translating Data Science Results into Precision Oncology Decisions: A Mini Review

While reviewing and discussing the potential of data science in oncology, we emphasize medical imaging and radiomics as the leading contextual frameworks to measure the impacts of Artificial Intelligence (AI) and Machine Learning (ML) developments. We envision some domains and research directions in which radiomics should become more significant in view of current barriers and limitations.

Current status and future developments in predicting outcomes in radiation oncology

Advancements in data-driven technologies and the inclusion of information-rich multiomics features have significantly improved the performance of outcomes modeling in radiation oncology. For this current trend to be sustainable, challenges related to robust data modeling such as small sample size, low size to feature ratio, noisy data, as well as issues related to algorithmic modeling such as complexity, uncertainty, and interpretability, need to be mitigated if not resolved. Emerging computational technologies and new paradigms such as federated learning, human-in-the-loop, quantum computing, and novel interpretability methods show great potential in overcoming these challenges and bridging the gap towards precision outcome modeling in radiotherapy. Examples of these promising technologies will be presented and their potential role in improving outcome modeling will be discussed.

Unsupervised and semi-supervised learning: the next frontier in machine learning for plant systems biology

Advances in high-throughput omics technologies are leading plant biology research into the era of big data. Machine learning (ML) performs an important role in plant systems biology because of its excellent performance and wide application in the analysis of big data. However, to achieve ideal performance, supervised ML algorithms require large numbers of labeled samples as training data. In some cases, it is impossible or prohibitively expensive to obtain enough labeled training data; here, the paradigms of unsupervised learning (UL) and semi-supervised learning (SSL) play an indispensable role. In this review, we first introduce the basic concepts of ML techniques, as well as some representative UL and SSL algorithms, including clustering, dimensionality reduction, self-supervised learning (self-SL), positive-unlabeled (PU) learning and transfer learning. We then review recent advances and applications of UL and SSL paradigms in both plant systems biology and plant phenotyping research. Finally, we discuss the limitations and highlight the significance and challenges of UL and SSL strategies in plant systems biology.

Translational Bioinformatics to Enable Precision Medicine for All: Elevating Equity across Molecular, Clinical, and Digital Realms

OBJECTIVES

Over the past few years, challenges from the pandemic have led to an explosion of data sharing and algorithmic development efforts in the areas of molecular measurements, clinical data, and digital health. We aim to characterize and describe recent advanced computational approaches in translational bioinformatics across these domains in the context of issues or progress related to equity and inclusion.

METHODS

We conducted a literature assessment of the trends and approaches in translational bioinformatics in the past few years.

RESULTS

We present a review of recent computational approaches across molecular, clinical, and digital realms. We discuss applications of phenotyping, disease subtype characterization, predictive modeling, biomarker discovery, and treatment selection. We consider these methods and applications through the lens of equity and inclusion in biomedicine.

CONCLUSION

Equity and inclusion should be incorporated at every step of translational bioinformatics projects, including project design, data collection, model creation, and clinical implementation. These considerations, coupled with the exciting breakthroughs in big data and machine learning, are pivotal to reach the goals of precision medicine for all.

Organized Breast and Cervical Cancer Screening: Attendance and Determinants in Rural China

To evaluate the attendance and determinants of organized cervical and breast cancer (two-cancer) screening, especially higher-level factors, we conducted a cross-sectional survey in central China from June 2018 to November 2019 among 1949 women (age ≥ 35 years). We examined organizer-level factors, provider-level factors, receiver-lever factors and attendance and participation willingness of screening. The results indicate that the attendance and participation willingness of organized two-cancer screening was 61.19% and 77.15%, respectively. After adjustment for potential confounders, women who received screening notification were more likely to have greater participation willingness and higher attendance than those who received no notification (adjusted odds ratio [aOR] = 1.59, 95% confidence interval [CI]: 1.27-1.99; aOR = 98.03, 95% CI: 51.44-186.82, respectively). Compared with being notified about screening by GPs, being notified by community women's leaders and other community leaders were more likely to lead to greater willingness to participate again (aOR = 2.86, 95% CI: 1.13-7.24; aOR = 3.27, 95% CI: 1.26-8.48, respectively) and recommending screening to others (aOR = 2.18, 95% CI: 1.02-4.65; aOR = 4.14, 95% CI: 1.84-9.30, respectively). The results suggest that notification of women about screening by community leaders is an important organizer-level factor. As a part of public health services, the design and implementation of optimal cancer screening strategies may require public-sector involvement at the organizer level instead of a one-man show by the health sector.

Machine learning approaches for biomolecular, biophysical, and biomaterials research

A fluent conversation with a virtual assistant, person-tailored news feeds, and deep-fake images created within seconds-all those things that have been unthinkable for a long time are now a part of our everyday lives. What these examples have in common is that they are realized by different means of machine learning (ML), a technology that has fundamentally changed many aspects of the modern world. The possibility to process enormous amount of data in multi-hierarchical, digital constructs has paved the way not only for creating intelligent systems but also for obtaining surprising new insight into many scientific problems. However, in the different areas of biosciences, which typically rely heavily on the collection of time-consuming experimental data, applying ML methods is a bit more challenging: Here, difficulties can arise from small datasets and the inherent, broad variability, and complexity associated with studying biological objects and phenomena. In this Review, we give an overview of commonly used ML algorithms (which are often referred to as "machines") and learning strategies as well as their applications in different bio-disciplines such as molecular biology, drug development, biophysics, and biomaterials science. We highlight how selected research questions from those fields were successfully translated into machine readable formats, discuss typical problems that can arise in this context, and provide an overview of how to resolve those encountered difficulties.

Machine Learning and Deep Learning Applications in Multiple Myeloma Diagnosis, Prognosis, and Treatment Selection

Simple Summary

Multiple myeloma is a malignant neoplasm of plasma cells with complex pathogenesis. With major progresses in multiple myeloma research, it is essential that we reconsider our methods for diagnosing and monitoring multiple myeloma disease. This fact needs the integration of serology, histology, radiology, and genetic data; therefore, multiple myeloma study has generated massive quantities of granular high-dimensional data exceeding human understanding. With improved computational techniques, artificial intelligence tools for data processing and analysis are becoming more and more relevant. Artificial intelligence represents a wide set of algorithms for which machine learning and deep learning are presently among the most impactful. This review focuses on artificial intelligence applications in multiple myeloma research, first illustrating machine learning and deep learning procedures and workflow, followed by how these algorithms are used for multiple myeloma diagnosis, prognosis, bone lesions identification, and evaluation of response to the treatment.

Abstract

Artificial intelligence has recently modified the panorama of oncology investigation thanks to the use of machine learning algorithms and deep learning strategies. Machine learning is a branch of artificial intelligence that involves algorithms that analyse information, learn from that information, and then employ their discoveries to make abreast choice, while deep learning is a field of machine learning basically represented by algorithms inspired by the organization and function of the brain, named artificial neural networks. In this review, we examine the possibility of the artificial intelligence applications in multiple myeloma evaluation, and we report the most significant experimentations with respect to the machine and deep learning procedures in the relevant field. Multiple myeloma is one of the most common haematological malignancies in the world, and among them, it is one of the most difficult ones to cure due to the high occurrence of relapse and chemoresistance. Machine learning- and deep learning-based studies are expected to be among the future strategies to challenge this negative-prognosis tumour via the detection of new markers for their prompt discovery and therapy selection and by a better evaluation of its relapse and survival.