Early experience with Watson for Oncology: a clinical decision-support system for prostate cancer treatment recommendations

Implementation of artificial intelligence approaches in oncology clinical trials: A systematic review

INTRODUCTION

There is a growing interest in leveraging artificial intelligence (AI) technologies to enhance various aspects of clinical trials. The goal of this systematic review is to assess the impact of implementing AI approaches on different aspects of oncology clinical trials.

METHODS

Pertinent keywords were used to find relevant articles published in PubMed, Scopus, and Google Scholar databases, which described the clinical application of AI approaches. A quality evaluation utilizing a customized checklist specifically adapted was conducted. This study is registered with PROSPERO (CRD42024537153).

RESULTS

Out of the identified 2833 studies, 72 studies satisfied the inclusion criteria. Clinical Trial Enrollment & Eligibility were among the most commonly studied clinical trial aspects with 30 papers. The prediction of outcomes was covered in 25 studies of which 15 addressed the prediction of patients' survival and 10 addressed the prediction of drug outcomes. The trial design was studied in 10 articles. Three studies addressed each of the personalized treatments and decision-making, while one addressed data management. The results demonstrate using AI in cancer clinical trials has the potential to increase clinical trial enrollment, predict clinical outcomes, improve trial design, enhance personalized treatments, and increase concordance in decision-making. Additionally, automating some areas and tasks, clinical trials were made more efficient, and human error was minimized. Nevertheless, concerns and restrictions related to the application of AI in clinical studies are also noted.

CONCLUSION

AI tools have the potential to revolutionize the design, enrollment rate, and outcome prediction of oncology clinical trials.

Preliminary Evidence of the Use of Generative AI in Health Care Clinical Services: Systematic Narrative Review

BACKGROUND

Generative artificial intelligence tools and applications (GenAI) are being increasingly used in health care. Physicians, specialists, and other providers have started primarily using GenAI as an aid or tool to gather knowledge, provide information, train, or generate suggestive dialogue between physicians and patients or between physicians and patients' families or friends. However, unless the use of GenAI is oriented to be helpful in clinical service encounters that can improve the accuracy of diagnosis, treatment, and patient outcomes, the expected potential will not be achieved. As adoption continues, it is essential to validate the effectiveness of the infusion of GenAI as an intelligent technology in service encounters to understand the gap in actual clinical service use of GenAI.

OBJECTIVE

This study synthesizes preliminary evidence on how GenAI assists, guides, and automates clinical service rendering and encounters in health care The review scope was limited to articles published in peer-reviewed medical journals.

METHODS

We screened and selected 0.38% (161/42,459) of articles published between January 1, 2020, and May 31, 2023, identified from PubMed. We followed the protocols outlined in the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines to select highly relevant studies with at least 1 element on clinical use, evaluation, and validation to provide evidence of GenAI use in clinical services. The articles were classified based on their relevance to clinical service functions or activities using the descriptive and analytical information presented in the articles.

RESULTS

Of 161 articles, 141 (87.6%) reported using GenAI to assist services through knowledge access, collation, and filtering. GenAI was used for disease detection (19/161, 11.8%), diagnosis (14/161, 8.7%), and screening processes (12/161, 7.5%) in the areas of radiology (17/161, 10.6%), cardiology (12/161, 7.5%), gastrointestinal medicine (4/161, 2.5%), and diabetes (6/161, 3.7%). The literature synthesis in this study suggests that GenAI is mainly used for diagnostic processes, improvement of diagnosis accuracy, and screening and diagnostic purposes using knowledge access. Although this solves the problem of knowledge access and may improve diagnostic accuracy, it is oriented toward higher value creation in health care.

CONCLUSIONS

GenAI informs rather than assisting or automating clinical service functions in health care. There is potential in clinical service, but it has yet to be actualized for GenAI. More clinical service-level evidence that GenAI is used to streamline some functions or provides more automated help than only information retrieval is needed. To transform health care as purported, more studies related to GenAI applications must automate and guide human-performed services and keep up with the optimism that forward-thinking health care organizations will take advantage of GenAI.

Digital decision support for structural improvement of melanoma tumor boards: using standard cases to optimize workflow

PURPOSE

Choosing optimal cancer treatment is challenging, and certified cancer centers must present all patients in multidisciplinary tumor boards (MDT). Our aim was to develop a decision support system (DSS) to provide treatment recommendations for apparently simple cases already at conference registration and to classify these as "standard cases". According to certification requirements, discussion of standard cases is optional and would thus allow more time for complex cases.

METHODS

We created a smartphone query that simulated a tumor conference registration and requested all information needed to provide a recommendation. In total, 111 out of 705 malignant melanoma cases discussed at a skin cancer center from 2017 to 2020 were identified as potential standard cases, for which a digital twin recommendation was then generated by DSS.

RESULTS

The system provided reliable advice in all 111 cases and showed 97% concordance of MDT and DSS for therapeutic recommendations, regardless of tumor stage. Discrepancies included two cases (2%) where DSS advised discussions at MDT and one case (1%) with deviating recommendation due to advanced patient age.

CONCLUSIONS

Our work aimed not to replace clinical expertise but to alleviate MDT workload and enhance focus on complex cases. Overall, our DSS proved to be a suitable tool for identifying standard cases as such, providing correct treatment recommendations, and thus reducing the time burden of tumor conferences in favor for the comprehensive discussion of complex cases. The aim is to implement the DSS in routine tumor board software for further qualitative assessment of its impact on oncological care.

Artificial intelligence in urologic oncology: the actual clinical practice results of IBM Watson for Oncology in South Korea

Background

Artificial intelligence (AI) is changing our life, including the medical field. Repeated machine learning using big data made various fields more predictable and accurate. In medicine, IBM Watson for Oncology (WFO), trained by Memorial Slone Kettering Cancer Center (MSKCC), was first introduced and applied in 14 countries worldwide.Our study was designed to assess the feasibility of WFO in actual clinical practice. We aimed to investigate the concordance rate between WFO and multidisciplinary tumor board (MTB) in Urologic cancer patients.

Materials and methods

We reviewed retrospectively collected data for consecutive patients who underwent WFO and MTB simultaneously in the diagnosis of urologic malignancy before determining further treatment between August 2017 and September 2020. We compared the recommendation of the AI system, WFO (IBM Watson Health, Cambridge, MA), with the opinion of MTB for further managing all patients diagnosed with urologic malignancies such as prostate, bladder, and kidney cancer.

Results

A total of 55 patients were enrolled in our study. The number of patients with prostate cancer was 48. The number of bladder and kidney cancer patients was 5 and 2, respectively. The overall concordance rate between WFO and MTB was 92.7%. Three patients could not suggest proper treatment options using WFO, and the recommended choice of WFO was not feasible in the Korean Health Insurance Review and Assessment Service.

Conclusions

The decision of WFO showed a high concordance rate with a multidisciplinary tumor board for urologic oncology. However, some recommendations of WFO were not feasible in actual practice, and WFO still has some points to improve and modify. Interestingly, applying WFO is likely to facilitate a multidisciplinary team approach.

Evaluation of clinical decision support systems in oncology: An updated systematic review

With increasing reliance on technology in oncology, the impact of digital clinical decision support (CDS) tools needs to be examined. A systematic review update was conducted and peer-reviewed literature from 2016 to 2022 were included if CDS tools were used for live decision making and comparatively assessed quantitative outcomes. 3369 studies were screened and 19 were included in this updated review. Combined with a previous review of 24 studies, a total of 43 studies were analyzed. Improvements in outcomes were observed in 42 studies, and 34 of these were of statistical significance. Computerized physician order entry and clinical practice guideline systems comprise the greatest number of evaluated CDS tools (13 and 10 respectively), followed by those that utilize patient-reported outcomes (8), clinical pathway systems (8) and prescriber alerts for best-practice advisories (4). Our review indicates that CDS can improve guideline adherence, patient-centered care, and care delivery processes in oncology.

Novel research and future prospects of artificial intelligence in cancer diagnosis and treatment

Research into the potential benefits of artificial intelligence for comprehending the intricate biology of cancer has grown as a result of the widespread use of deep learning and machine learning in the healthcare sector and the availability of highly specialized cancer datasets. Here, we review new artificial intelligence approaches and how they are being used in oncology. We describe how artificial intelligence might be used in the detection, prognosis, and administration of cancer treatments and introduce the use of the latest large language models such as ChatGPT in oncology clinics. We highlight artificial intelligence applications for omics data types, and we offer perspectives on how the various data types might be combined to create decision-support tools. We also evaluate the present constraints and challenges to applying artificial intelligence in precision oncology. Finally, we discuss how current challenges may be surmounted to make artificial intelligence useful in clinical settings in the future.

Use and accuracy of decision support systems using artificial intelligence for tumor diseases: a systematic review and meta-analysis

Background

For therapy planning in cancer patients multidisciplinary team meetings (MDM) are mandatory. Due to the high number of cases being discussed and significant workload of clinicians, Clinical Decision Support System (CDSS) may improve the clinical workflow.

Methods

This review and meta-analysis aims to provide an overview of the systems utilized and evaluate the correlation between a CDSS and MDM.

Results

A total of 31 studies were identified for final analysis. Analysis of different cancers shows a concordance rate (CR) of 72.7% for stage I-II and 73.4% for III-IV. For breast carcinoma, CR for stage I-II was 72.8% and for III-IV 84.1%, P≤ 0.00001. CR for colorectal carcinoma is 63% for stage I-II and 67% for III-IV, for gastric carcinoma 55% and 45%, and for lung carcinoma 85% and 83% respectively, all P>0.05. Analysis of SCLC and NSCLC yields a CR of 94,3% and 82,7%, P=0.004 and for adenocarcinoma and squamous cell carcinoma in lung cancer a CR of 90% and 86%, P=0.02.

Conclusion

CDSS has already been implemented in clinical practice, and while the findings suggest that its use is feasible for some cancers, further research is needed to fully evaluate its effectiveness.

Assessing the decision quality of artificial intelligence and oncologists of different experience in different regions in breast cancer treatment

Background

AI-based clinical decision support system (CDSS) has important prospects in overcoming the current informational challenges that cancer diseases faced, promoting the homogeneous development of standardized treatment among different geographical regions, and reforming the medical model. However, there are still a lack of relevant indicators to comprehensively assess its decision-making quality and clinical impact, which greatly limits the development of its clinical research and clinical application. This study aims to develop and application an assessment system that can comprehensively assess the decision-making quality and clinical impacts of physicians and CDSS.

Methods

Enrolled adjuvant treatment decision stage early breast cancer cases were randomly assigned to different decision-making physician panels (each panel consisted of three different seniority physicians in different grades hospitals), each physician made an independent "Initial Decision" and then reviewed the CDSS report online and made a "Final Decision". In addition, the CDSS and guideline expert groups independently review all cases and generate "CDSS Recommendations" and "Guideline Recommendations" respectively. Based on the design framework, a multi-level multi-indicator system including "Decision Concordance", "Calibrated Concordance", " Decision Concordance with High-level Physician", "Consensus Rate", "Decision Stability", "Guideline Conformity", and "Calibrated Conformity" were constructed.

Results

531 cases containing 2124 decision points were enrolled; 27 different seniority physicians from 10 different grades hospitals have generated 6372 decision opinions before and after referring to the "CDSS Recommendations" report respectively. Overall, the calibrated decision concordance was significantly higher for CDSS and provincial-senior physicians (80.9%) than other physicians. At the same time, CDSS has a higher " decision concordance with high-level physician" (76.3%-91.5%) than all physicians. The CDSS had significantly higher guideline conformity than all decision-making physicians and less internal variation, with an overall guideline conformity variance of 17.5% (97.5% vs. 80.0%), a standard deviation variance of 6.6% (1.3% vs. 7.9%), and a mean difference variance of 7.8% (1.5% vs. 9.3%). In addition, provincial-middle seniority physicians had the highest decision stability (54.5%). The overall consensus rate among physicians was 64.2%.

Conclusions

There are significant internal variation in the standardization treatment level of different seniority physicians in different geographical regions in the adjuvant treatment of early breast cancer. CDSS has a higher standardization treatment level than all physicians and has the potential to provide immediate decision support to physicians and have a positive impact on standardizing physicians' treatment behaviors.

Validation and implementation of a mobile app decision support system for prostate cancer to improve quality of tumor boards

Certified Cancer Centers must present all patients in multidisciplinary tumor boards (MTB), including standard cases with well-established treatment strategies. Too many standard cases can absorb much of the available time, which can be unfavorable for the discussion of complex cases. In any case, this leads to a high quantity, but not necessarily a high quality of tumor boards. Our aim was to develop a partially algorithm-driven decision support system (DSS) for smart phones to provide evidence-based recommendations for first-line therapy of common urological cancers. To assure quality, we compared each single digital decision with recommendations of an experienced MTB and obtained the concordance.1873 prostate cancer patients presented in the MTB of the urological department of the University Hospital of Cologne from 2014 to 2018 have been evaluated. Patient characteristics included age, disease stage, Gleason Score, PSA and previous therapies. The questions addressed to MTB were again answered using DSS. All blinded pairs of answers were assessed for discrepancies by independent reviewers. Overall concordance rate was 99.1% (1856/1873). Stage specific concordance rates were 97.4% (stage I), 99.2% (stage II), 100% (stage III), and 99.2% (stage IV). Quality of concordance were independent of age and risk profile. The reliability of any DSS is the key feature before implementation in clinical routine. Although our system appears to provide this safety, we are now performing cross-validation with several clinics to further increase decision quality and avoid potential clinic bias.

IPOscore: An interactive web-based platform for postoperative surgical complications analysis and prediction in the oncology domain

BACKGROUND

The performance of traditional risk score systems to predict (post)-operative outcomes is limited. This weakness reduces confidence in its use to support clinical risk mitigation decisions. However, the rapid growth of health data in the last years offers principles to deal with some of these limitations. In this regard, the data allows the extraction of relevant information for both patients stratification and the rigorous identification of associated risk factors. The patients can then be targeted to specific preoperative optimization programs, thus contributing to the reduction of associated morbidity and mortality.

OBJECTIVES

The main goal of this work is, therefore, to provide a clinical decision support system (CDSS) based on data-driven modeling methods for surgical risk prediction specific for cancer patients in Portugal.

RESULTS

The result is IPOscore, a single web-based platform aimed at being an innovative approach to assist clinical decision-making in the surgical oncology domain. This system includes a database to store/manage the clinical data collected in a structured format, data visualization and analysis tools, and predictive machine learning models to predict postoperative outcomes in cancer patients. IPOscore also includes a pattern mining module based on biclustering to assess the discriminative power of a pattern towards postsurgical outcomes. Additionally, a mobile application is provided to this end.

CONCLUSIONS

The IPOscore platform is a valuable tool for surgical oncologists not only for clinical data management but also as a preventative and predictive healthcare system. Currently, this clinical support tool is being tested at the Portuguese Institute of Oncology (IPO-Porto), and can be accessed online at https://iposcore.org.

PCaGuard: A Software Platform to Support Optimal Management of Prostate Cancer

Background and Objective  Prostate cancer (PCa) is a severe public health issue and the most common cancer worldwide in men. Early diagnosis can lead to early treatment and long-term survival. The addition of the multiparametric magnetic resonance imaging in combination with ultrasound (mpMRI-U/S fusion) biopsy to the existing diagnostic tools improved prostate cancer detection. Use of both tools gradually increases in every day urological practice. Furthermore, advances in the area of information technology and artificial intelligence have led to the development of software platforms able to support clinical diagnosis and decision-making using patient data from personalized medicine.

Methods  We investigated the current aspects of implementation, architecture, and design of a health care information system able to handle and store a large number of clinical examination data along with medical images, and produce a risk calculator in a seamless and secure manner complying with data security/accuracy and personal data protection directives and standards simultaneously. Furthermore, we took into account interoperability support and connectivity to legacy and other information management systems. The platform was implemented using open source, modern frameworks, and development tools.

Results  The application showed that software platforms supporting patient follow-up monitoring can be effective, productive, and of extreme value, while at the same time, aiding toward the betterment medicine clinical workflows. Furthermore, it removes access barriers and restrictions to specialized care, especially for rural areas, providing the exchange of medical images and patient data, among hospitals and physicians.

Conclusion  This platform handles data to estimate the risk of prostate cancer detection using current state-of-the-art in eHealth systems and services while fusing emerging multidisciplinary and intersectoral approaches. This work offers the research community an open architecture framework that encourages the broader adoption of more robust and comprehensive systems in standard clinical practice.

Life-Saving Cancer Care

What, precisely, are we seeking to achieve in offering 'life-saving' treatment to patients with cancer? Research funding agencies and pharmaceutical industry media releases, and government cancer screening programs all promise that their cancer programs save lives. But everybody dies. The nature of life and death from cancer is explored philosophically in this essay, with particular reference to the quality of life, and its meaning, during the period of prolongation of survival by 'life-saving' cancer care.

Randomized multi-reader evaluation of automated detection and segmentation of brain tumors in stereotactic radiosurgery with deep neural networks

Background

Stereotactic radiosurgery (SRS), a validated treatment for brain tumors, requires accurate tumor contouring. This manual segmentation process is time-consuming and prone to substantial inter-practitioner variability. Artificial intelligence (AI) with deep neural networks have increasingly been proposed for use in lesion detection and segmentation but have seldom been validated in a clinical setting.

Methods

We conducted a randomized, cross-modal, multi-reader, multispecialty, multi-case study to evaluate the impact of AI assistance on brain tumor SRS. A state-of-the-art auto-contouring algorithm built on multi-modality imaging and ensemble neural networks was integrated into the clinical workflow. Nine medical professionals contoured the same case series in two reader modes (assisted or unassisted) with a memory washout period of 6 weeks between each section. The case series consisted of 10 algorithm-unseen cases, including five cases of brain metastases, three of meningiomas, and two of acoustic neuromas. Among the nine readers, three experienced experts determined the ground truths of tumor contours.

Results

With the AI assistance, the inter-reader agreement significantly increased (Dice similarity coefficient [DSC] from 0.86 to 0.90, P < 0.001). Algorithm-assisted physicians demonstrated a higher sensitivity for lesion detection than unassisted physicians (91.3% vs 82.6%, P = .030). AI assistance improved contouring accuracy, with an average increase in DSC of 0.028, especially for physicians with less SRS experience (average DSC from 0.847 to 0.865, P = .002). In addition, AI assistance improved efficiency with a median of 30.8% time-saving. Less-experienced clinicians gained prominent improvement on contouring accuracy but less benefit in reduction of working hours. By contrast, SRS specialists had a relatively minor advantage in DSC, but greater time-saving with the aid of AI.

Conclusions

Deep learning neural networks can be optimally utilized to improve accuracy and efficiency for the clinical workflow in brain tumor SRS.

Precision medicine in the era of artificial intelligence: implications in chronic disease management

Aberrant metabolism is the root cause of several serious health issues, creating a huge burden to health and leading to diminished life expectancy. A dysregulated metabolism induces the secretion of several molecules which in turn trigger the inflammatory pathway. Inflammation is the natural reaction of the immune system to a variety of stimuli, such as pathogens, damaged cells, and harmful substances. Metabolically triggered inflammation, also called metaflammation or low-grade chronic inflammation, is the consequence of a synergic interaction between the host and the exposome-a combination of environmental drivers, including diet, lifestyle, pollutants and other factors throughout the life span of an individual. Various levels of chronic inflammation are associated with several lifestyle-related diseases such as diabetes, obesity, metabolic associated fatty liver disease (MAFLD), cancers, cardiovascular disorders (CVDs), autoimmune diseases, and chronic lung diseases. Chronic diseases are a growing concern worldwide, placing a heavy burden on individuals, families, governments, and health-care systems. New strategies are needed to empower communities worldwide to prevent and treat these diseases. Precision medicine provides a model for the next generation of lifestyle modification. This will capitalize on the dynamic interaction between an individual's biology, lifestyle, behavior, and environment. The aim of precision medicine is to design and improve diagnosis, therapeutics and prognostication through the use of large complex datasets that incorporate individual gene, function, and environmental variations. The implementation of high-performance computing (HPC) and artificial intelligence (AI) can predict risks with greater accuracy based on available multidimensional clinical and biological datasets. AI-powered precision medicine provides clinicians with an opportunity to specifically tailor early interventions to each individual. In this article, we discuss the strengths and limitations of existing and evolving recent, data-driven technologies, such as AI, in preventing, treating and reversing lifestyle-related diseases.