From multisource data to clinical decision aids in radiation oncology: The need for a clinical data science community

Advancing Privacy-Preserving Health Care Analytics and Implementation of the Personal Health Train: Federated Deep Learning Study

BACKGROUND

The rapid advancement of deep learning in health care presents significant opportunities for automating complex medical tasks and improving clinical workflows. However, widespread adoption is impeded by data privacy concerns and the necessity for large, diverse datasets across multiple institutions. Federated learning (FL) has emerged as a viable solution, enabling collaborative artificial intelligence model development without sharing individual patient data. To effectively implement FL in health care, robust and secure infrastructures are essential. Developing such federated deep learning frameworks is crucial to harnessing the full potential of artificial intelligence while ensuring patient data privacy and regulatory compliance.

OBJECTIVE

The objective is to introduce an innovative FL infrastructure called the Personal Health Train (PHT) that includes the procedural, technical, and governance components needed to implement FL on real-world health care data, including training deep learning neural networks. The study aims to apply this federated deep learning infrastructure to the use case of gross tumor volume segmentation on chest computed tomography images of patients with lung cancer and present the results from a proof-of-concept experiment.

METHODS

The PHT framework addresses the challenges of data privacy when sharing data, by keeping data close to the source and instead bringing the analysis to the data. Technologically, PHT requires 3 interdependent components: "tracks" (protected communication channels), "trains" (containerized software apps), and "stations" (institutional data repositories), which are supported by the open source "Vantage6" software. The study applies this federated deep learning infrastructure to the use case of gross tumor volume segmentation on chest computed tomography images of patients with lung cancer, with the introduction of an additional component called the secure aggregation server, where the model averaging is done in a trusted and inaccessible environment.

RESULTS

We demonstrated the feasibility of executing deep learning algorithms in a federated manner using PHT and presented the results from a proof-of-concept study. The infrastructure linked 12 hospitals across 8 nations, covering 4 continents, demonstrating the scalability and global reach of the proposed approach. During the execution and training of the deep learning algorithm, no data were shared outside the hospital.

CONCLUSIONS

The findings of the proof-of-concept study, as well as the implications and limitations of the infrastructure and the results, are discussed. The application of federated deep learning to unstructured medical imaging data, facilitated by the PHT framework and Vantage6 platform, represents a significant advancement in the field. The proposed infrastructure addresses the challenges of data privacy and enables collaborative model development, paving the way for the widespread adoption of deep learning-based tools in the medical domain and beyond. The introduction of the secure aggregation server implied that data leakage problems in FL can be prevented by careful design decisions of the infrastructure.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05775068; https://clinicaltrials.gov/study/NCT05775068.

A joint physics and radiobiology DREAM team vision - Towards better response prediction models to advance radiotherapy

Radiotherapy developed empirically through experience balancing tumour control and normal tissue toxicities. Early simple mathematical models formalized this practical knowledge and enabled effective cancer treatment to date. Remarkable advances in technology, computing, and experimental biology now create opportunities to incorporate this knowledge into enhanced computational models. The ESTRO DREAM (Dose Response, Experiment, Analysis, Modelling) workshop brought together experts across disciplines to pursue the vision of personalized radiotherapy for optimal outcomes through advanced modelling. The ultimate vision is leveraging quantitative models dynamically during therapy to ultimately achieve truly adaptive and biologically guided radiotherapy at the population as well as individual patient-based levels. This requires the generation of models that inform response-based adaptations, individually optimized delivery and enable biological monitoring to provide decision support to clinicians. The goal is expanding to models that can drive the realization of personalized therapy for optimal outcomes. This position paper provides their propositions that describe how innovations in biology, physics, mathematics, and data science including AI could inform models and improve predictions. It consolidates the DREAM team's consensus on scientific priorities and organizational requirements. Scientifically, it stresses the need for rigorous, multifaceted model development, comprehensive validation and clinical applicability and significance. Organizationally, it reinforces the prerequisites of interdisciplinary research and collaboration between physicians, medical physicists, radiobiologists, and computational scientists throughout model development. Solely by a shared understanding of clinical needs, biological mechanisms, and computational methods, more informed models can be created. Future research environment and support must facilitate this integrative method of operation across multiple disciplines.

First clinical experience following the consensus guide for calibrating a proton stopping power ratio curve in a new proton centre

BACKGROUND AND PURPOSE

This work introduces the first assessment of CT calibration following the ESTRO's consensus guidelines and validating the HLUT through the irradiation of biological material.

METHODS

Two electron density phantoms were scanned with two CT scanners using two CT scan energies. The stopping power ratio (SPR) and mass density (MD) HLUTs for different CT scan energies were derived using Schneider's and ESTRO's methods. The comparison metric in this work is based on the Water-Equivalent Thickness (WET) difference between the treatment planning system and biological irradiation measurement. The SPR HLUTs were compared between the two calibration methods. To assess the accuracy of using MD HLUT for dose calculation in the treatment planning system, MD vs SPR HLUT was compared. Lastly, the feasibility of using a single SPR HLUT to replace two different energy CT scans was explored.

RESULTS

The results show a WET difference of less than 3.5% except for the result in the Bone region between Schneider's and ESTRO's methods. Comparing MD and SPR HLUT, the results from MD HLUT show less than a 3.5% difference except for the Bone region. However, the SPR HLUT shows a lower mean absolute percentage difference as compared to MD HLUT between the measured and calculated WET difference. Lastly, it is possible to use a single SPR HLUT for two different CT scan energies since both WET differences are within 3.5%.

CONCLUSION

This is the first report on calibrating an HLUT following the ESTRO's guidelines. While our result shows incremental improvement in range uncertainty using the ESTRO's guideline, the prescriptional approach of the guideline does promote harmonization of CT calibration protocols between different centres.

Design and implementation of a prototype radiotherapy menu in a patient portal

PURPOSE

Radiotherapy patients often face undue anxiety due to misconceptions about radiation and their inability to visualize their upcoming treatments. Access to their personal treatment plans is one way in which pre-treatment anxiety may be reduced. But radiotherapy data are quite complex, requiring specialized software for display and necessitating personalized explanations for patients to understand them. Therefore, our goal was to design and implement a novel radiotherapy menu in a patient portal to improve patient access to and understanding of their radiotherapy treatment plans.

METHODS

A prototype radiotherapy menu was developed in our institution's patient portal following a participatory stakeholder co-design methodology. Customizable page templates were designed to render key radiotherapy data in the portal's patient-facing mobile phone app. DICOM-RT data were used to provide patients with relevant treatment parameters and generate pre-treatment 3D visualizations of planned treatment beams, while the mCODE data standard was used to provide post-treatment summaries of the delivered treatments. A focus group was conducted to gather initial patient feedback on the menu.

RESULTS

Pre-treatment: the radiotherapy menu provides patients with a personalized treatment plan overview, including a personalized explanation of their treatment, along with an interactive 3D rendering of their body, and treatment beams for visualization. Post-treatment: a summary of the delivered radiotherapy is provided, allowing patients to retain a concise personal record of their treatment that can easily be shared with future healthcare providers. Focus group feedback was overwhelmingly positive. Patients highlighted how the intuitive presentation of their complex radiotherapy data would better prepare them for their radiation treatments.

CONCLUSIONS

We successfully designed and implemented a prototype radiotherapy menu in our institution's patient portal that improves patient access to and understanding of their radiotherapy data. We used the mCODE data standard to generate post-treatment summaries in a way that is easily shareable and interoperable.

Quantitative MRI-based radiomics analysis identifies blood flow feature associated to overall survival for rectal cancer patients

Radiomics objectively quantifies image information through numerical metrics known as features. In this study, we investigated the stability of magnetic resonance imaging (MRI)-based radiomics features in rectal cancer using both anatomical MRI and quantitative MRI (qMRI), when different methods to define the tumor volume were used. Second, we evaluated the prognostic value of stable features associated to 5-year progression-free survival (PFS) and overall survival (OS). On a 1.5 T MRI scanner, 81 patients underwent diagnostic MRI, an extended diffusion-weighted sequence with calculation of the apparent diffusion coefficient (ADC) and a multiecho dynamic contrast sequence generating both dynamic contrast-enhanced and dynamic susceptibility contrast (DSC) MR, allowing quantification of Ktrans, blood flow (BF) and area under the DSC curve (AUC). Radiomic features were extracted from T2w images and from ADC, Ktrans, BF and AUC maps. Tumor volumes were defined with three methods; machine learning, deep learning and manual delineations. The interclass correlation coefficient (ICC) assessed the stability of features. Internal validation was performed on 1000 bootstrap resamples in terms of discrimination, calibration and decisional benefit. For each combination of image and volume definition, 94 features were extracted. Features from qMRI contained higher prognostic potential than features from anatomical MRI. When stable features (> 90% ICC) were compared with clinical parameters, qMRI features demonstrated the best prognostic potential. A feature extracted from the DSC MRI parameter BF was associated with both PFS (p = 0.004) and OS (p = 0.004). In summary, stable qMRI-based radiomics features was identified, in particular, a feature based on BF from DSC MRI was associated with both PFS and OS.

Artificial intelligence research in radiation oncology: a practical guide for the clinician on concepts and methods

The use of artificial intelligence (AI) holds great promise for radiation oncology, with many applications being reported in the literature, including some of which are already in clinical use. These are mainly in areas where AI provides benefits in efficiency (such as automatic segmentation and treatment planning). Prediction models that directly impact patient decision-making are far less mature in terms of their application in clinical practice. Part of the limited clinical uptake of these models may be explained by the need for broader knowledge, among practising clinicians within the medical community, about the processes of AI development. This lack of understanding could lead to low commitment to AI research, widespread scepticism, and low levels of trust. This attitude towards AI may be further negatively impacted by the perception that deep learning is a "black box" with inherently low transparency. Thus, there is an unmet need to train current and future clinicians in the development and application of AI in medicine. Improving clinicians' AI-related knowledge and skills is necessary to enhance multidisciplinary collaboration between data scientists and physicians, that is, involving a clinician in the loop during AI development. Increased knowledge may also positively affect the acceptance and trust of AI. This paper describes the necessary steps involved in AI research and development, and thus identifies the possibilities, limitations, challenges, and opportunities, as seen from the perspective of a practising radiation oncologist. It offers the clinician with limited knowledge and experience in AI valuable tools to evaluate research papers related to an AI model application.

Recent advancement in integrating artificial intelligence and information technology with real-world data for clinical decision-making in China: A scoping review

OBJECTIVE

Striking innovations and advancements have been achieved with the use of artificial intelligence and healthcare information technology being integrated into clinical real-world data. The current scoping review aimed to provide an overview of the current status of artificial intelligence-/information technology-based clinical decision support tools in China.

METHODS

PubMed/MEDLINE, Embase, China National Knowledge Internet, and Wanfang data were searched for both English and Chinese literature. The gray literature search was conducted for commercially available tools. Original studies that focused on clinical decision support tools driven by artificial intelligence or information technology in China and were published between 2010 and February 2022 were included. Information extracted from each article was further synthesized by themes based on three types of clinical decision-making.

RESULTS

A total of 37 peer-reviewed publications and 13 commercially available tools were included in the final analysis. Among them, 32.0% were developed for disease diagnosis, 54.0% for risk prediction and classification, and 14.0% for disease management. Chronic diseases were the most popular therapeutic areas of exploration, with particular emphasis on cardiovascular and cerebrovascular diseases. Single-center electronic medical records were the mainstream data sources leveraged to inform clinical decision-making, with internal validation being predominately used for model evaluation.

CONCLUSIONS

To effectively promote the extensive use of real-world data and drive a paradigm shift in clinical decision-making in China, multidisciplinary collaboration of key stakeholders is urgently needed.

Multi-institutional Prognostic Modeling in Head and Neck Cancer: Evaluating Impact and Generalizability of Deep Learning and Radiomics

Artificial intelligence (AI) and machine learning (ML) are becoming critical in developing and deploying personalized medicine and targeted clinical trials. Recent advances in ML have enabled the integration of wider ranges of data including both medical records and imaging (radiomics). However, the development of prognostic models is complex as no modeling strategy is universally superior to others and validation of developed models requires large and diverse datasets to demonstrate that prognostic models developed (regardless of method) from one dataset are applicable to other datasets both internally and externally. Using a retrospective dataset of 2,552 patients from a single institution and a strict evaluation framework that included external validation on three external patient cohorts (873 patients), we crowdsourced the development of ML models to predict overall survival in head and neck cancer (HNC) using electronic medical records (EMR) and pretreatment radiological images. To assess the relative contributions of radiomics in predicting HNC prognosis, we compared 12 different models using imaging and/or EMR data. The model with the highest accuracy used multitask learning on clinical data and tumor volume, achieving high prognostic accuracy for 2-year and lifetime survival prediction, outperforming models relying on clinical data only, engineered radiomics, or complex deep neural network architecture. However, when we attempted to extend the best performing models from this large training dataset to other institutions, we observed significant reductions in the performance of the model in those datasets, highlighting the importance of detailed population-based reporting for AI/ML model utility and stronger validation frameworks. We have developed highly prognostic models for overall survival in HNC using EMRs and pretreatment radiological images based on a large, retrospective dataset of 2,552 patients from our institution.Diverse ML approaches were used by independent investigators. The model with the highest accuracy used multitask learning on clinical data and tumor volume.External validation of the top three performing models on three datasets (873 patients) with significant differences in the distributions of clinical and demographic variables demonstrated significant decreases in model performance.

Significance

ML combined with simple prognostic factors outperformed multiple advanced CT radiomics and deep learning methods. ML models provided diverse solutions for prognosis of patients with HNC but their prognostic value is affected by differences in patient populations and require extensive validation.

Clinical Radiobiology for Radiation Oncology

This chapter is focused on radiobiological aspects at the molecular, cellular, and tissue level which are relevant for the clinical use of ionizing radiation (IR) in cancer therapy. For radiation oncology, it is critical to find a balance, i.e., the therapeutic window, between the probability of tumor control and the probability of side effects caused by radiation injury to the healthy tissues and organs. An overview is given about modern precision radiotherapy (RT) techniques, which allow optimal sparing of healthy tissues. Biological factors determining the width of the therapeutic window are explained. The role of the six typical radiobiological phenomena determining the response of both malignant and normal tissues in the clinic, the 6R’s, which are Reoxygenation, Redistribution, Repopulation, Repair, Radiosensitivity, and Reactivation of the immune system, is discussed. Information is provided on tumor characteristics, for example, tumor type, growth kinetics, hypoxia, aberrant molecular signaling pathways, cancer stem cells and their impact on the response to RT. The role of the tumor microenvironment and microbiota is described and the effects of radiation on the immune system including the abscopal effect phenomenon are outlined. A summary is given on tumor diagnosis, response prediction via biomarkers, genetics, and radiomics, and ways to selectively enhance the RT response in tumors. Furthermore, we describe acute and late normal tissue reactions following exposure to radiation: cellular aspects, tissue kinetics, latency periods, permanent or transient injury, and histopathology. Details are also given on the differential effect on tumor and late responding healthy tissues following fractionated and low dose rate irradiation as well as the effect of whole-body exposure.

Advances in screening of thalassaemia

Thalassaemia is a common hereditary haemolytic anaemia. Mild cases of this disease may be asymptomatic, while patients with severe thalassaemias require high-dose blood transfusions and regular iron removal to maintain life or haematopoietic stem cell transplantation to be cured, imposing an enormous familial and social burden. Therefore, early, timely, and accurate screening of patients is of great importance. In recent years, with the continuous development of thalassaemia screening technologies, the accuracy of thalassaemia screening has also improved significantly. This article reviews the current research on thalassaemia screening.

Artificial intelligence in radiation oncology: A review of its current status and potential application for the radiotherapy workforce

OBJECTIVE

Radiation oncology is a continually evolving speciality. With the development of new imaging modalities and advanced imaging processing techniques, there is an increasing amount of data available to practitioners. In this narrative review, Artificial Intelligence (AI) is used as a reference to machine learning, and its potential, along with current problems in the field of radiation oncology, are considered from a technical position.

KEY FINDINGS

AI has the potential to harness the availability of data for improving patient outcomes, reducing toxicity, and easing clinical burdens. However, problems including the requirement of complexity of data, undefined core outcomes and limited generalisability are apparent.

CONCLUSION

This original review highlights considerations for the radiotherapy workforce, particularly therapeutic radiographers, as there will be an increasing requirement for their familiarity with AI due to their unique position as the interface between imaging technology and patients.

IMPLICATIONS FOR PRACTICE

Collaboration between AI experts and the radiotherapy workforce are required to overcome current issues before clinical adoption. The development of educational resources and standardised reporting of AI studies may help facilitate this.

Influential Usage of Big Data and Artificial Intelligence in Healthcare

Artificial intelligence (AI) is making computer systems capable of executing human brain tasks in many fields in all aspects of daily life. The enhancement in information and communications technology (ICT) has indisputably improved the quality of people's lives around the globe. Especially, ICT has led to a very needy and tremendous improvement in the health sector which is commonly known as electronic health (eHealth) and medical health (mHealth). Deep machine learning and AI approaches are commonly presented in many applications using big data, which consists of all relevant data about the medical health and diseases which a model can access at the time of execution or diagnosis of diseases. For example, cardiovascular imaging has now accurate imaging combined with big data from the eHealth record and pathology to better characterize the disease and personalized therapy. In clinical work and imaging, cancer care is getting improved by knowing the tumor biology and helping in the implementation of precision medicine. The Markov model is used to extract new approaches for leveraging cancer. In this paper, we have reviewed existing research relevant to eHealth and mHealth where various models are discussed which uses big data for the diagnosis and healthcare system. This paper summarizes the recent promising applications of AI and big data in medical health and electronic health, which have potentially added value to diagnosis and patient care.

Emerging role of artificial intelligence in nuclear medicine

The role of artificial intelligence is increasing in all branches of medicine. The emerging role of artificial intelligence applications in nuclear medicine is going to improve the nuclear medicine clinical workflow in the coming years. Initial research outcomes are suggestive of increasing role of artificial intelligence in nuclear medicine workflow, particularly where selective automation tasks are of concern. Artificial intelligence-assisted planning, dosimetry and procedure execution appear to be areas for rapid and significant development. The role of artificial intelligence in more directly imaging-related tasks, such as dose optimization, image corrections and image reconstruction, have been particularly strong points of artificial intelligence research in nuclear medicine. Natural Language Processing (NLP)-based text processing task is another area of interest of artificial intelligence implementation in nuclear medicine.

Artificial Intelligence Applications to Improve the Treatment of Locally Advanced Non-Small Cell Lung Cancers

Locally advanced non-small cell lung cancer patients represent around one third of newly diagnosed lung cancer patients. There remains a large unmet need to find treatment strategies that can improve the survival of these patients while minimizing therapeutical side effects. Increasing the availability of patients' data (imaging, electronic health records, patients' reported outcomes, and genomics) will enable the application of AI algorithms to improve therapy selections. In this review, we discuss how artificial intelligence (AI) can be integral to improving clinical decision support systems. To realize this, a roadmap for AI must be defined. We define six milestones involving a broad spectrum of stakeholders, from physicians to patients, that we feel are necessary for an optimal transition of AI into the clinic.

Big Data, Extracting Insights, Comprehension, and Analytics in Cardiology: An Overview

Healthcare system facilitates the treatment of patients with the support of wearable, smart, and handheld devices, as well as many other devices. These devices are producing a huge bulk of data that need to be moulded for extracting meaningful insights from them for the useful use of researchers and practitioners. Various approaches, methods, and tools are in use for doing so and to extract meaningful information in the field of healthcare. This information is being used as evidence to further analyze the data for the early care of patient and to devise treatment. Early care and treatment can facilitate healthcare and the treatment of the patient and can have immense potentiality of dropping the care cost and quality refining of care and can decrease waste and chances of error. To facilitate healthcare in general and cardiology in specific, the proposed study presents an overview of the available literature associated with big data, its insights, and analytics. The presented report will help practitioners and researchers to devise new solutions for early care in healthcare and in cardiology.