701
|
Angelaki E, Marketou ME, Barmparis GD, Patrianakos A, Vardas PE, Parthenakis F, Tsironis GP. Detection of abnormal left ventricular geometry in patients without cardiovascular disease through machine learning: An ECG-based approach. J Clin Hypertens (Greenwich) 2021; 23:935-945. [PMID: 33507615 PMCID: PMC8678829 DOI: 10.1111/jch.14200] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2020] [Revised: 01/07/2021] [Accepted: 01/10/2021] [Indexed: 01/19/2023]
Abstract
Cardiac remodeling is recognized as an important aspect of cardiovascular disease (CVD) progression. Machine learning (ML) techniques were applied to basic clinical parameters and electrocardiographic features, in order to detect abnormal left ventricular geometry (LVG) even before the onset of left ventricular hypertrophy (LVH), in a population without established CVD. The authors enrolled 528 patients with and without essential hypertension, but no other indications of CVD. All patients underwent a full echocardiographic evaluation and were classified into 3 groups; normal geometry (NG), concentric remodeling without LVH (CR), and LVH. Abnormal LVG was identified as increased relative wall thickness (RWT) and/or left ventricular mass index (LVMi). The authors trained supervised ML models to classify patients with abnormal LVG and calculated SHAP values to perform feature importance and interaction analysis. Hypertension, age, body mass index over the Sokolow‐Lyon voltage, QRS‐T angle, and QTc duration were some of the most important features. Our model was able to distinguish NG from CR+LVH combined, with 87% accuracy on an unseen test set, 75% specificity, 97% sensitivity, and area under the receiver operating curve (AUC/ROC) equal to 0.91. The authors also trained our model to classify NG and CR (NG + CR) against those with LVH, with 89% test set accuracy, 93% specificity, 67% sensitivity, and an AUC/ROC value of 0.89, for a 0.4 decision threshold. Our ML algorithm effectively detects abnormal LVG even at early stages. Innovative solutions are needed to improve risk stratification of patients without established CVD, and ML may enable progress in this direction.
Collapse
Affiliation(s)
- Eleni Angelaki
- Institute of Theoretical and Computational Physics and Department of Physics, University of Crete, Heraklion, Greece.,Harvard John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, MA, USA
| | - Maria E Marketou
- Department of Cardiology, Heraklion University Hospital, Heraklion, Greece
| | - Georgios D Barmparis
- Institute of Theoretical and Computational Physics and Department of Physics, University of Crete, Heraklion, Greece
| | | | - Panos E Vardas
- Department of Cardiology, Heraklion University Hospital, Heraklion, Greece.,Heart Sector, Hygeia Hospitals Group, Athens, Greece
| | | | - Giorgos P Tsironis
- Institute of Theoretical and Computational Physics and Department of Physics, University of Crete, Heraklion, Greece.,Harvard John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, MA, USA
| |
Collapse
|
702
|
El-Sappagh S, Alonso JM, Islam SMR, Sultan AM, Kwak KS. A multilayer multimodal detection and prediction model based on explainable artificial intelligence for Alzheimer's disease. Sci Rep 2021; 11:2660. [PMID: 33514817 PMCID: PMC7846613 DOI: 10.1038/s41598-021-82098-3] [Citation(s) in RCA: 97] [Impact Index Per Article: 24.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2019] [Accepted: 12/29/2020] [Indexed: 01/30/2023] Open
Abstract
Alzheimer's disease (AD) is the most common type of dementia. Its diagnosis and progression detection have been intensively studied. Nevertheless, research studies often have little effect on clinical practice mainly due to the following reasons: (1) Most studies depend mainly on a single modality, especially neuroimaging; (2) diagnosis and progression detection are usually studied separately as two independent problems; and (3) current studies concentrate mainly on optimizing the performance of complex machine learning models, while disregarding their explainability. As a result, physicians struggle to interpret these models, and feel it is hard to trust them. In this paper, we carefully develop an accurate and interpretable AD diagnosis and progression detection model. This model provides physicians with accurate decisions along with a set of explanations for every decision. Specifically, the model integrates 11 modalities of 1048 subjects from the Alzheimer's Disease Neuroimaging Initiative (ADNI) real-world dataset: 294 cognitively normal, 254 stable mild cognitive impairment (MCI), 232 progressive MCI, and 268 AD. It is actually a two-layer model with random forest (RF) as classifier algorithm. In the first layer, the model carries out a multi-class classification for the early diagnosis of AD patients. In the second layer, the model applies binary classification to detect possible MCI-to-AD progression within three years from a baseline diagnosis. The performance of the model is optimized with key markers selected from a large set of biological and clinical measures. Regarding explainability, we provide, for each layer, global and instance-based explanations of the RF classifier by using the SHapley Additive exPlanations (SHAP) feature attribution framework. In addition, we implement 22 explainers based on decision trees and fuzzy rule-based systems to provide complementary justifications for every RF decision in each layer. Furthermore, these explanations are represented in natural language form to help physicians understand the predictions. The designed model achieves a cross-validation accuracy of 93.95% and an F1-score of 93.94% in the first layer, while it achieves a cross-validation accuracy of 87.08% and an F1-Score of 87.09% in the second layer. The resulting system is not only accurate, but also trustworthy, accountable, and medically applicable, thanks to the provided explanations which are broadly consistent with each other and with the AD medical literature. The proposed system can help to enhance the clinical understanding of AD diagnosis and progression processes by providing detailed insights into the effect of different modalities on the disease risk.
Collapse
Affiliation(s)
- Shaker El-Sappagh
- Centro Singular de Investigación en Tecnoloxías Intelixentes (CiTIUS), Universidade de Santiago de Compostela, 15782, Santiago de Compostela, Spain.
- Information Systems Department, Faculty of Computers and Artificial Intelligence, Benha University, Banha, 13518, Egypt.
| | - Jose M Alonso
- Centro Singular de Investigación en Tecnoloxías Intelixentes, Universidade de Santiago de Compostela, 15703, Santiago, Spain
| | - S M Riazul Islam
- Department of Computer Science and Engineering, Sejong University, 209 Neungdong-ro, Gwangjin-gu, Seoul, 05006, Korea
| | - Ahmad M Sultan
- Gastrointestinal Surgical Center, Faculty of Medicine, Mansoura University, Mansura, 35516, Egypt
| | - Kyung Sup Kwak
- Department of Information and Communication Engineering, Inha University, Incheon, 22212, South Korea.
| |
Collapse
|
703
|
Jalali A, Lonsdale H, Zamora LV, Ahumada L, Nguyen ATH, Rehman M, Fackler J, Stricker PA, Fernandez AM. Machine Learning Applied to Registry Data: Development of a Patient-Specific Prediction Model for Blood Transfusion Requirements During Craniofacial Surgery Using the Pediatric Craniofacial Perioperative Registry Dataset. Anesth Analg 2021; 132:160-171. [PMID: 32618624 DOI: 10.1213/ane.0000000000004988] [Citation(s) in RCA: 24] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
BACKGROUND Craniosynostosis is the premature fusion of ≥1 cranial sutures and often requires surgical intervention. Surgery may involve extensive osteotomies, which can lead to substantial blood loss. Currently, there are no consensus recommendations for guiding blood conservation or transfusion in this patient population. The aim of this study is to develop a machine-learning model to predict blood product transfusion requirements for individual pediatric patients undergoing craniofacial surgery. METHODS Using data from 2143 patients in the Pediatric Craniofacial Surgery Perioperative Registry, we assessed 6 machine-learning classification and regression models based on random forest, adaptive boosting (AdaBoost), neural network, gradient boosting machine (GBM), support vector machine, and elastic net methods with inputs from 22 demographic and preoperative features. We developed classification models to predict an individual's overall need for transfusion and regression models to predict the number of blood product units to be ordered preoperatively. The study is reported according to the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) checklist for prediction model development. RESULTS The GBM performed best in both domains, with an area under receiver operating characteristic curve of 0.87 ± 0.03 (95% confidence interval) and F-score of 0.91 ± 0.04 for classification, and a mean squared error of 1.15 ± 0.12, R-squared (R) of 0.73 ± 0.02, and root mean squared error of 1.05 ± 0.06 for regression. GBM feature ranking determined that the following variables held the most information for prediction: platelet count, weight, preoperative hematocrit, surgical volume per institution, age, and preoperative hemoglobin. We then produced a calculator to show the number of units of blood that should be ordered preoperatively for an individual patient. CONCLUSIONS Anesthesiologists and surgeons can use this continually evolving predictive model to improve clinical care of patients presenting for craniosynostosis surgery.
Collapse
Affiliation(s)
- Ali Jalali
- From the Johns Hopkins All Children's Hospital, St Petersburg, Florida
| | - Hannah Lonsdale
- Department of Anesthesia, Perioperative and Pain Medicine, Johns Hopkins All Children's Hospital, St Petersburg, Florida
| | - Lillian V Zamora
- Department of Anesthesia, Perioperative and Pain Medicine, Johns Hopkins All Children's Hospital, St Petersburg, Florida
| | - Luis Ahumada
- From the Johns Hopkins All Children's Hospital, St Petersburg, Florida
| | - Anh Thy H Nguyen
- Predictive Analytics Core, Johns Hopkins All Children's Hospital, St Petersburg, Florida
| | - Mohamed Rehman
- Department of Anesthesia, Perioperative and Pain Medicine, Johns Hopkins All Children's Hospital, St Petersburg, Florida
| | - James Fackler
- Department of Anesthesiology and Critical Care Medicine, Johns Hopkins University School of Medicine, Baltimore, Maryland
| | - Paul A Stricker
- Department of Anesthesiology and Critical Care Medicine, The Children's Hospital of Philadelphia, Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pennsylvania
| | - Allison M Fernandez
- Department of Anesthesia, Perioperative and Pain Medicine, Johns Hopkins All Children's Hospital, St Petersburg, Florida
| | | |
Collapse
|
704
|
van Doorn WPTM, Stassen PM, Borggreve HF, Schalkwijk MJ, Stoffers J, Bekers O, Meex SJR. A comparison of machine learning models versus clinical evaluation for mortality prediction in patients with sepsis. PLoS One 2021; 16:e0245157. [PMID: 33465096 PMCID: PMC7815112 DOI: 10.1371/journal.pone.0245157] [Citation(s) in RCA: 50] [Impact Index Per Article: 12.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2020] [Accepted: 12/22/2020] [Indexed: 01/04/2023] Open
Abstract
Introduction Patients with sepsis who present to an emergency department (ED) have highly variable underlying disease severity, and can be categorized from low to high risk. Development of a risk stratification tool for these patients is important for appropriate triage and early treatment. The aim of this study was to develop machine learning models predicting 31-day mortality in patients presenting to the ED with sepsis and to compare these to internal medicine physicians and clinical risk scores. Methods A single-center, retrospective cohort study was conducted amongst 1,344 emergency department patients fulfilling sepsis criteria. Laboratory and clinical data that was available in the first two hours of presentation from these patients were randomly partitioned into a development (n = 1,244) and validation dataset (n = 100). Machine learning models were trained and evaluated on the development dataset and compared to internal medicine physicians and risk scores in the independent validation dataset. The primary outcome was 31-day mortality. Results A number of 1,344 patients were included of whom 174 (13.0%) died. Machine learning models trained with laboratory or a combination of laboratory + clinical data achieved an area-under-the ROC curve of 0.82 (95% CI: 0.80–0.84) and 0.84 (95% CI: 0.81–0.87) for predicting 31-day mortality, respectively. In the validation set, models outperformed internal medicine physicians and clinical risk scores in sensitivity (92% vs. 72% vs. 78%;p<0.001,all comparisons) while retaining comparable specificity (78% vs. 74% vs. 72%;p>0.02). The model had higher diagnostic accuracy with an area-under-the-ROC curve of 0.85 (95%CI: 0.78–0.92) compared to abbMEDS (0.63,0.54–0.73), mREMS (0.63,0.54–0.72) and internal medicine physicians (0.74,0.65–0.82). Conclusion Machine learning models outperformed internal medicine physicians and clinical risk scores in predicting 31-day mortality. These models are a promising tool to aid in risk stratification of patients presenting to the ED with sepsis.
Collapse
Affiliation(s)
- William P. T. M. van Doorn
- Department of Clinical Chemistry, Central Diagnostic Laboratory, Maastricht University Medical Center, Maastricht, The Netherlands
- CARIM School for Cardiovascular Diseases, Maastricht University, Maastricht, The Netherlands
| | - Patricia M. Stassen
- Division of General Internal Medicine, Section Acute Medicine, Department of Internal Medicine, Maastricht University Medical Centre, Maastricht University, Maastricht, The Netherlands
- CAPHRI School for Care and Public Health Research Institute, Maastricht University, Maastricht, The Netherlands
| | - Hella F. Borggreve
- Division of General Internal Medicine, Section Acute Medicine, Department of Internal Medicine, Maastricht University Medical Centre, Maastricht University, Maastricht, The Netherlands
| | - Maaike J. Schalkwijk
- Division of General Internal Medicine, Section Acute Medicine, Department of Internal Medicine, Maastricht University Medical Centre, Maastricht University, Maastricht, The Netherlands
| | - Judith Stoffers
- Division of General Internal Medicine, Section Acute Medicine, Department of Internal Medicine, Maastricht University Medical Centre, Maastricht University, Maastricht, The Netherlands
| | - Otto Bekers
- Department of Clinical Chemistry, Central Diagnostic Laboratory, Maastricht University Medical Center, Maastricht, The Netherlands
- CARIM School for Cardiovascular Diseases, Maastricht University, Maastricht, The Netherlands
| | - Steven J. R. Meex
- Department of Clinical Chemistry, Central Diagnostic Laboratory, Maastricht University Medical Center, Maastricht, The Netherlands
- CARIM School for Cardiovascular Diseases, Maastricht University, Maastricht, The Netherlands
- * E-mail:
| |
Collapse
|
705
|
Thakur A, Mishra AP, Panda B, Rodríguez DCS, Gaurav I, Majhi B. Application of Artificial Intelligence in Pharmaceutical and Biomedical Studies. Curr Pharm Des 2021; 26:3569-3578. [PMID: 32410553 DOI: 10.2174/1381612826666200515131245] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2019] [Accepted: 02/01/2020] [Indexed: 12/17/2022]
Abstract
BACKGROUND Artificial intelligence (AI) is the way to model human intelligence to accomplish certain tasks without much intervention of human beings. The term AI was first used in 1956 with The Logic Theorist program, which was designed to simulate problem-solving ability of human beings. There have been a significant amount of research works using AI in order to determine the advantages and disadvantages of its applicabication and, future perspectives that impact different areas of society. Even the remarkable impact of AI can be transferred to the field of healthcare with its use in pharmaceutical and biomedical studies crucial for the socioeconomic development of the population in general within different studies, we can highlight those that have been conducted with the objective of treating diseases, such as cancer, neurodegenerative diseases, among others. In parallel, the long process of drug development also requires the application of AI to accelerate research in medical care. METHODS This review is based on research material obtained from PubMed up to Jan 2020. The search terms include "artificial intelligence", "machine learning" in the context of research on pharmaceutical and biomedical applications. RESULTS This study aimed to highlight the importance of AI in the biomedical research and also recent studies that support the use of AI to generate tools using patient data to improve outcomes. Other studies have demonstrated the use of AI to create prediction models to determine response to cancer treatment. CONCLUSION The application of AI in the field of pharmaceutical and biomedical studies has been extensive, including cancer research, for diagnosis as well as prognosis of the disease state. It has become a tool for researchers in the management of complex data, ranging from obtaining complementary results to conventional statistical analyses. AI increases the precision in the estimation of treatment effect in cancer patients and determines prediction outcomes.
Collapse
Affiliation(s)
- Abhimanyu Thakur
- Department of Biomedical Sciences, City University of Hong Kong, Hong Kong SAR, China
| | - Ambika P Mishra
- Department of Computer Science and Engineering, Institute of Technical Education and Research, Siksha 'O' Anusandhan University, Bhubaneswar, Orissa, India
| | - Bishnupriya Panda
- Department of Computer Science and Engineering, Institute of Technical Education and Research, Siksha 'O' Anusandhan University, Bhubaneswar, Orissa, India
| | - Diana C S Rodríguez
- Foundation for Clinical and Applied Cancer Research-FICMAC, Bogota, Colombia
| | - Isha Gaurav
- Patna Women's College (Autonmous), Patna, Bihar, India
| | - Babita Majhi
- Department of Computer Science and Information Technology, Guru Ghashidas Vishwavidyalaya (A Central University), Bilaspur, Chhattisgarh, India
| |
Collapse
|
706
|
Novel Machine Learning Can Predict Acute Asthma Exacerbation. Chest 2021; 159:1747-1757. [PMID: 33440184 DOI: 10.1016/j.chest.2020.12.051] [Citation(s) in RCA: 37] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2020] [Revised: 12/11/2020] [Accepted: 12/16/2020] [Indexed: 12/24/2022] Open
Abstract
BACKGROUND Asthma exacerbations result in significant health and economic burden, but are difficult to predict. RESEARCH QUESTION Can machine learning (ML) models with large-scale outpatient data predict asthma exacerbations? STUDY DESIGN AND METHODS We analyzed data extracted from electronic health records (EHRs) of asthma patients treated at the Cleveland Clinic from 2010 through 2018. Demographic information, comorbidities, laboratory values, and asthma medications were included as covariates. Three different models were built with logistic regression, random forests, and a gradient boosting decision tree to predict: (1) nonsevere asthma exacerbation requiring oral glucocorticoid burst, (2) ED visits, and (3) hospitalizations. RESULTS Of 60,302 patients, 19,772 (32.8%) had at least one nonsevere exacerbation requiring oral glucocorticoid burst, 1,748 (2.9%) requiring and ED visit and 902 (1.5%) requiring hospitalization. Nonsevere exacerbation, ED visit, and hospitalization were predicted best by light gradient boosting machine, an algorithm used in ML to fit predictive analytic models, and had an area under the receiver operating characteristic curve of 0.71 (95% CI, 0.70-0.72), 0.88 (95% CI, 0.86-0.89), and 0.85 (95% CI, 0.82-0.88), respectively. Risk factors for all three outcomes included age, long-acting β agonist, high-dose inhaled glucocorticoid, or chronic oral glucocorticoid therapy. In subgroup analysis of 9,448 patients with spirometry data, low FEV1 and FEV1 to FVC ratio were identified as top risk factors for asthma exacerbation, ED visits, and hospitalization. However, adding pulmonary function tests did not improve models' prediction performance. INTERPRETATION Models built with an ML algorithm from real-world outpatient EHR data accurately predicted asthma exacerbation and can be incorporated into clinical decision tools to enhance outpatient care and to prevent adverse outcomes.
Collapse
|
707
|
Martini ML, Neifert SN, Gal JS, Oermann EK, Gilligan JT, Caridi JM. Drivers of Prolonged Hospitalization Following Spine Surgery: A Game-Theory-Based Approach to Explaining Machine Learning Models. J Bone Joint Surg Am 2021; 103:64-73. [PMID: 33186002 DOI: 10.2106/jbjs.20.00875] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
BACKGROUND Understanding the interactions between variables that predict prolonged hospital length of stay (LOS) following spine surgery can help uncover drivers of this risk in patients. This study utilized a novel game-theory-based approach to develop explainable machine learning models to understand such interactions in a large cohort of patients treated with spine surgery. METHODS Of 11,150 patients who underwent surgery for degenerative spine conditions at a single institution, 3,310 (29.7%) were characterized as having prolonged LOS. Machine learning models predicting LOS were built for each patient. Shapley additive explanation (SHAP) values were calculated for each patient model to quantify the importance of features and variable interaction effects. RESULTS Models using features identified by SHAP values were highly predictive of prolonged LOS risk (mean C-statistic = 0.87). Feature importance analysis revealed that prolonged LOS risk is multifactorial. Non-elective admission produced elevated SHAP values, indicating a clear, strong risk of prolonged LOS. In contrast, intraoperative and sociodemographic factors displayed bidirectional influences on risk, suggesting potential protective effects with optimization of factors such as estimated blood loss, surgical duration, and comorbidity burden. CONCLUSIONS Meticulous management of patients with high comorbidity burdens or Medicaid insurance who are admitted non-electively or spend clinically indicated time in the intensive care unit (ICU) during their hospitalization course may be warranted to reduce their risk of unanticipated prolonged LOS following spine surgery. LEVEL OF EVIDENCE Prognostic Level III. See Instructions for Authors for a complete description of levels of evidence.
Collapse
Affiliation(s)
- Michael L Martini
- Departments of Neurosurgery (M.L.M., S.N.N., E.K.O., J.T.G., and J.M.C.) and Anesthesiology (J.S.G.), Icahn School of Medicine at Mount Sinai, New York, NY
| | | | | | | | | | | |
Collapse
|
708
|
Kwon H, Kim HH, An J, Lee JH, Park YR. Lifelog Data-Based Prediction Model of Digital Health Care App Customer Churn: Retrospective Observational Study. J Med Internet Res 2021; 23:e22184. [PMID: 33404511 PMCID: PMC7817354 DOI: 10.2196/22184] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2020] [Revised: 11/02/2020] [Accepted: 11/05/2020] [Indexed: 01/22/2023] Open
Abstract
BACKGROUND Customer churn is the rate at which customers stop doing business with an entity. In the field of digital health care, user churn prediction is important not only in terms of company revenue but also for improving the health of users. Churn prediction has been previously studied, but most studies applied time-invariant model structures and used structured data. However, additional unstructured data have become available; therefore, it has become essential to process daily time-series log data for churn predictions. OBJECTIVE We aimed to apply a recurrent neural network structure to accept time-series patterns using lifelog data and text message data to predict the churn of digital health care users. METHODS This study was based on the use data of a digital health care app that provides interactive messages with human coaches regarding food, exercise, and weight logs. Among the users in Korea who enrolled between January 1, 2017 and January 1, 2019, we defined churn users according to the following criteria: users who received a refund before the paid program ended and users who received a refund 7 days after the trial period. We used long short-term memory with a masking layer to receive sequence data with different lengths. We also performed topic modeling to vectorize text messages. To interpret the contributions of each variable to model predictions, we used integrated gradients, which is an attribution method. RESULTS A total of 1868 eligible users were included in this study. The final performance of churn prediction was an F1 score of 0.89; that score decreased by 0.12 when the data of the final week were excluded (F1 score 0.77). Additionally, when text data were included, the mean predicted performance increased by approximately 0.085 at every time point. Steps per day had the largest contribution (0.1085). Among the topic variables, poor habits (eg, drinking alcohol, overeating, and late-night eating) showed the largest contribution (0.0875). CONCLUSIONS The model with a recurrent neural network architecture that used log data and message data demonstrated high performance for churn classification. Additionally, the analysis of the contribution of the variables is expected to help identify signs of user churn in advance and improve the adherence in digital health care.
Collapse
Affiliation(s)
- Hongwook Kwon
- Department of Biomedical Systems Informatics, College of Medicine, Yonsei University, Seoul, Republic of Korea
| | - Ho Heon Kim
- Department of Biomedical Systems Informatics, College of Medicine, Yonsei University, Seoul, Republic of Korea
| | - Jaeil An
- Department of Biomedical Systems Informatics, College of Medicine, Yonsei University, Seoul, Republic of Korea
| | - Jae-Ho Lee
- Department of Information Medicine, Asan Medical Center, College of Medicine, University of Ulsan, Seoul, Republic of Korea
- Department of Emergency Medicine, Asan Medical Center, College of Medicine, University of Ulsan, Seoul, Republic of Korea
| | - Yu Rang Park
- Department of Biomedical Systems Informatics, College of Medicine, Yonsei University, Seoul, Republic of Korea
| |
Collapse
|
709
|
Ahmedt-Aristizabal D, Fernando T, Denman S, Robinson JE, Sridharan S, Johnston PJ, Laurens KR, Fookes C. Identification of Children at Risk of Schizophrenia via Deep Learning and EEG Responses. IEEE J Biomed Health Inform 2021; 25:69-76. [PMID: 32310808 DOI: 10.1109/jbhi.2020.2984238] [Citation(s) in RCA: 33] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
The prospective identification of children likely to develop schizophrenia is a vital tool to support early interventions that can mitigate the risk of progression to clinical psychosis. Electroencephalographic (EEG) patterns from brain activity and deep learning techniques are valuable resources in achieving this identification. We propose automated techniques that can process raw EEG waveforms to identify children who may have an increased risk of schizophrenia compared to typically developing children. We also analyse abnormal features that remain during developmental follow-up over a period of ∼ 4 years in children with a vulnerability to schizophrenia initially assessed when aged 9 to 12 years. EEG data from participants were captured during the recording of a passive auditory oddball paradigm. We undertake a holistic study to identify brain abnormalities, first by exploring traditional machine learning algorithms using classification methods applied to hand-engineered features (event-related potential components). Then, we compare the performance of these methods with end-to-end deep learning techniques applied to raw data. We demonstrate via average cross-validation performance measures that recurrent deep convolutional neural networks can outperform traditional machine learning methods for sequence modeling. We illustrate the intuitive salient information of the model with the location of the most relevant attributes of a post-stimulus window. This baseline identification system in the area of mental illness supports the evidence of developmental and disease effects in a pre-prodromal phase of psychosis. These results reinforce the benefits of deep learning to support psychiatric classification and neuroscientific research more broadly.
Collapse
|
710
|
Zoabi Y, Deri-Rozov S, Shomron N. Machine learning-based prediction of COVID-19 diagnosis based on symptoms. NPJ Digit Med 2021; 4:3. [PMID: 33398013 PMCID: PMC7782717 DOI: 10.1038/s41746-020-00372-6] [Citation(s) in RCA: 180] [Impact Index Per Article: 45.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2020] [Accepted: 11/19/2020] [Indexed: 11/09/2022] Open
Abstract
Effective screening of SARS-CoV-2 enables quick and efficient diagnosis of COVID-19 and can mitigate the burden on healthcare systems. Prediction models that combine several features to estimate the risk of infection have been developed. These aim to assist medical staff worldwide in triaging patients, especially in the context of limited healthcare resources. We established a machine-learning approach that trained on records from 51,831 tested individuals (of whom 4769 were confirmed to have COVID-19). The test set contained data from the subsequent week (47,401 tested individuals of whom 3624 were confirmed to have COVID-19). Our model predicted COVID-19 test results with high accuracy using only eight binary features: sex, age ≥60 years, known contact with an infected individual, and the appearance of five initial clinical symptoms. Overall, based on the nationwide data publicly reported by the Israeli Ministry of Health, we developed a model that detects COVID-19 cases by simple features accessed by asking basic questions. Our framework can be used, among other considerations, to prioritize testing for COVID-19 when testing resources are limited.
Collapse
Affiliation(s)
- Yazeed Zoabi
- Sackler Faculty of Medicine, Tel Aviv University, 6997801, Tel Aviv, Israel
| | - Shira Deri-Rozov
- Sackler Faculty of Medicine, Tel Aviv University, 6997801, Tel Aviv, Israel
| | - Noam Shomron
- Sackler Faculty of Medicine, Tel Aviv University, 6997801, Tel Aviv, Israel.
| |
Collapse
|
711
|
AIM in Oncology. Artif Intell Med 2021. [DOI: 10.1007/978-3-030-58080-3_94-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
712
|
Vázquez B, Fuentes-Pineda G, García F, Borrayo G, Prohías J. Risk markers by sex for in-hospital mortality in patients with acute coronary syndrome: A machine learning approach. INFORMATICS IN MEDICINE UNLOCKED 2021. [DOI: 10.1016/j.imu.2021.100791] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022] Open
|
713
|
Mao H, Deng X, Jiang H, Shi L, Li H, Tuo L, Shi D, Guo F. Driving safety assessment for ride-hailing drivers. ACCIDENT; ANALYSIS AND PREVENTION 2021; 149:105574. [PMID: 32736799 DOI: 10.1016/j.aap.2020.105574] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/25/2019] [Revised: 04/21/2020] [Accepted: 04/21/2020] [Indexed: 06/11/2023]
Abstract
Ride-hailing services, which have become increasingly prevalent in the last decade, provide an efficient travel mode by matching drivers and travelers via smartphone apps. Ride-hailing services enable millions of non-traditional taxi drivers to provide travel services, but may also raise safety concerns due to heterogeneity in the driver population. This study evaluated crash risk factors for ride-hailing drivers, including driving history and ride-hailing operational characteristics, using a sample of 189,815 drivers. We utilized the Poisson generalized additive model to accommodate for the potential nonlinear relationship between crash rate and risk factors. Results showed that crash history, the percentage of long-shift bookings, driving distance, operations during peak hours, years of being a ride-hailing driver, and passenger rating were significantly associated with crash risk. Several factors showed nonlinear relationships with crash risk. We adopted the SHapley Additive exPlanation (SHAP) method to assess and visualize the impact of each risk factor. The results indicated that passenger average rating, total driving distance, and crash history were the leading contributing factors. The findings of this study provide critical information for the development of safety countermeasures, driver education programs, as well as safety regulations for the ride-hailing industry.
Collapse
Affiliation(s)
- Huiying Mao
- Department of Statistics, Virginia Polytechnic Institute and State University, Blacksburg, VA 24061, USA; Didi Chuxing Technology Co., Beijing, China
| | - Xinwei Deng
- Department of Statistics, Virginia Polytechnic Institute and State University, Blacksburg, VA 24061, USA
| | | | - Liang Shi
- Department of Statistics, Virginia Polytechnic Institute and State University, Blacksburg, VA 24061, USA; Didi Chuxing Technology Co., Beijing, China
| | - Hao Li
- Didi Chuxing Technology Co., Beijing, China
| | - Liheng Tuo
- Didi Chuxing Technology Co., Beijing, China
| | | | - Feng Guo
- Department of Statistics, Virginia Polytechnic Institute and State University, Blacksburg, VA 24061, USA; Virginia Tech Transportation Institute, Virginia Polytechnic Institute and State University, Blacksburg, VA 24061, USA.
| |
Collapse
|
714
|
Vo NN, Liu S, Li X, Xu G. Leveraging unstructured call log data for customer churn prediction. Knowl Based Syst 2021. [DOI: 10.1016/j.knosys.2020.106586] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
715
|
Egnell AC, Johansson S, Chen C, Berges A. Clinical Pharmacology Modeling and Simulation in Drug Development. SYSTEMS MEDICINE 2021. [DOI: 10.1016/b978-0-12-801238-3.11546-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022] Open
|
716
|
Radakovich N, Nagy M, Nazha A. Artificial Intelligence in Hematology: Current Challenges and Opportunities. Curr Hematol Malig Rep 2020; 15:203-210. [PMID: 32239350 DOI: 10.1007/s11899-020-00575-4] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
PURPOSE OF REVIEW Artificial intelligence (AI), and in particular its subcategory machine learning, is finding an increasing number of applications in medicine, driven in large part by an abundance of data and powerful, accessible tools that have made AI accessible to a larger circle of investigators. RECENT FINDINGS AI has been employed in the analysis of hematopathological, radiographic, laboratory, genomic, pharmacological, and chemical data to better inform diagnosis, prognosis, treatment planning, and foundational knowledge related to benign and malignant hematology. As more widespread implementation of clinical AI nears, attention has also turned to the effects this will have on other areas in medicine. AI offers many promising tools to clinicians broadly, and specifically in the practice of hematology. Ongoing research into its various applications will likely result in an increasing utilization of AI by a broader swath of clinicians.
Collapse
Affiliation(s)
- Nathan Radakovich
- Cleveland Clinic Lerner College of Medicine of Case Western Reserve University, Cleveland, OH, USA
| | - Matthew Nagy
- Cleveland Clinic Lerner College of Medicine of Case Western Reserve University, Cleveland, OH, USA
| | - Aziz Nazha
- Center for Clinical Artificial Intelligence, Cleveland Clinic, Cleveland, OH, USA.
- Department of Hematology and Medical Oncology, Taussig Cancer Institute, Cleveland Clinic, Desk R35 9500 Euclid Ave., Cleveland, OH, 44195, USA.
| |
Collapse
|
717
|
Gong K, Lee HK, Yu K, Xie X, Li J. A prediction and interpretation framework of acute kidney injury in critical care. J Biomed Inform 2020; 113:103653. [PMID: 33338667 DOI: 10.1016/j.jbi.2020.103653] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2020] [Revised: 11/27/2020] [Accepted: 12/01/2020] [Indexed: 12/28/2022]
Abstract
Acute kidney injury (AKI) is a common clinical condition with high mortality and resource consumption. Early identification of high-risk patients to achieve an appropriate allocation of limited clinical resources and timely interventions is of significant importance, which has attracted substantial research to develop prediction models for AKI risk stratification. However, most available AKI prediction models have moderate performance and lack of interpretability, which limits their applicability in supporting care intervention. In this paper, a machine learning-based framework for AKI prediction and interpretation in critical care is presented. First, an ensemble model is developed to predict a patient's risk of AKI within 72 h of admission to the intensive care units. Next, the model is interpreted both globally and locally. For the global interpretation, the important predictors are pinpointed and the detailed relationships between AKI risk and these predictors are illustrated. For the local interpretation, patient-specific analysis is presented to provide a visualized explanation for each individual prediction. Experimental results show that such a prediction and interpretation framework can lead to good prediction and interpretation performance, which has the potential to provide effective clinical decision support.
Collapse
Affiliation(s)
- Kaidi Gong
- Department of Industrial Engineering, Tsinghua University, Beijing 100084, China.
| | - Hyo Kyung Lee
- Department of Industrial Engineering, University of Pittsburgh, Pittsburgh, PA 15261, USA.
| | - Kaiye Yu
- Department of Industrial Engineering, Tsinghua University, Beijing 100084, China.
| | - Xiaolei Xie
- Department of Industrial Engineering, Tsinghua University, Beijing 100084, China.
| | - Jingshan Li
- Department of Industrial and Systems Engineering, University of Wisconsin-Madison, Madison, WI 53706, USA.
| |
Collapse
|
718
|
Bignami EG, Cozzani F, Del Rio P, Bellini V. The role of artificial intelligence in surgical patient perioperative management. Minerva Anestesiol 2020; 87:817-822. [PMID: 33300328 DOI: 10.23736/s0375-9393.20.14999-x] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/12/2023]
Abstract
Perioperative medicine is a patient-centered, multidisciplinary and integrated clinical practice that starts from the moment of contemplation of surgery until full recovery. Every perioperative phase (preoperative, intraoperative and postoperative) must be studied and planned in order to optimize the entire patient management. Perioperative optimization does not only concern a short-term outcome improvement, but it has also a strong impact on long term survival. Clinical cases variability leads to the collection and analysis of a huge amount of different data, coming from multiple sources, making perioperative management standardization very difficult. Artificial Intelligence (AI) can play a primary role in this challenge, helping human mind in perioperative practice planning and decision-making process. AI refers to the ability of a computer system to perform functions and reasoning typical of the human mind; Machine Learning (ML) could play a fundamental role in presurgical planning, during intraoperative phase and postoperative management. Perioperative medicine is the cornerstone of surgical patient management and the tools deriving from the application of AI seem very promising as a support in optimizing the management of each individual patient. Despite the increasing help that will derive from the use of AI tools, the uniqueness of the patient and the particularity of each individual clinical case will always keep the role of the human mind central in clinical and perioperative management. The role of the physician, who must analyze the outputs provided by AI by following his own experience and knowledge, remains and will always be essential.
Collapse
Affiliation(s)
- Elena G Bignami
- Unit of Anesthesiology, Division of Critical Care and Pain Medicine, Department of Medicine and Surgery, University of Parma, Parma, Italy -
| | - Federico Cozzani
- Unit of General Surgery, Parma University Hospital, Parma, Italy
| | - Paolo Del Rio
- Unit of General Surgery, Parma University Hospital, Parma, Italy
| | - Valentina Bellini
- Unit of Anesthesiology, Division of Critical Care and Pain Medicine, Department of Medicine and Surgery, University of Parma, Parma, Italy
| |
Collapse
|
719
|
|
720
|
Does Artificial Intelligence Outperform Natural Intelligence in Interpreting Musculoskeletal Radiological Studies? A Systematic Review. Clin Orthop Relat Res 2020; 478:2751-2764. [PMID: 32740477 PMCID: PMC7899420 DOI: 10.1097/corr.0000000000001360] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/31/2023]
Abstract
BACKGROUND Machine learning (ML) is a subdomain of artificial intelligence that enables computers to abstract patterns from data without explicit programming. A myriad of impactful ML applications already exists in orthopaedics ranging from predicting infections after surgery to diagnostic imaging. However, no systematic reviews that we know of have compared, in particular, the performance of ML models with that of clinicians in musculoskeletal imaging to provide an up-to-date summary regarding the extent of applying ML to imaging diagnoses. By doing so, this review delves into where current ML developments stand in aiding orthopaedists in assessing musculoskeletal images. QUESTIONS/PURPOSES This systematic review aimed (1) to compare performance of ML models versus clinicians in detecting, differentiating, or classifying orthopaedic abnormalities on imaging by (A) accuracy, sensitivity, and specificity, (B) input features (for example, plain radiographs, MRI scans, ultrasound), (C) clinician specialties, and (2) to compare the performance of clinician-aided versus unaided ML models. METHODS A systematic review was performed in PubMed, Embase, and the Cochrane Library for studies published up to October 1, 2019, using synonyms for machine learning and all potential orthopaedic specialties. We included all studies that compared ML models head-to-head against clinicians in the binary detection of abnormalities in musculoskeletal images. After screening 6531 studies, we ultimately included 12 studies. We conducted quality assessment using the Methodological Index for Non-randomized Studies (MINORS) checklist. All 12 studies were of comparable quality, and they all clearly included six of the eight critical appraisal items (study aim, input feature, ground truth, ML versus human comparison, performance metric, and ML model description). This justified summarizing the findings in a quantitative form by calculating the median absolute improvement of the ML models compared with clinicians for the following metrics of performance: accuracy, sensitivity, and specificity. RESULTS ML models provided, in aggregate, only very slight improvements in diagnostic accuracy and sensitivity compared with clinicians working alone and were on par in specificity (3% (interquartile range [IQR] -2.0% to 7.5%), 0.06% (IQR -0.03 to 0.14), and 0.00 (IQR -0.048 to 0.048), respectively). Inputs used by the ML models were plain radiographs (n = 8), MRI scans (n = 3), and ultrasound examinations (n = 1). Overall, ML models outperformed clinicians more when interpreting plain radiographs than when interpreting MRIs (17 of 34 and 3 of 16 performance comparisons, respectively). Orthopaedists and radiologists performed similarly to ML models, while ML models mostly outperformed other clinicians (outperformance in 7 of 19, 7 of 23, and 6 of 10 performance comparisons, respectively). Two studies evaluated the performance of clinicians aided and unaided by ML models; both demonstrated considerable improvements in ML-aided clinician performance by reporting a 47% decrease of misinterpretation rate (95% confidence interval [CI] 37 to 54; p < 0.001) and a mean increase in specificity of 0.048 (95% CI 0.029 to 0.068; p < 0.001) in detecting abnormalities on musculoskeletal images. CONCLUSIONS At present, ML models have comparable performance to clinicians in assessing musculoskeletal images. ML models may enhance the performance of clinicians as a technical supplement rather than as a replacement for clinical intelligence. Future ML-related studies should emphasize how ML models can complement clinicians, instead of determining the overall superiority of one versus the other. This can be accomplished by improving transparent reporting, diminishing bias, determining the feasibility of implantation in the clinical setting, and appropriately tempering conclusions. LEVEL OF EVIDENCE Level III, diagnostic study.
Collapse
|
721
|
Esmaili N, Buchlak QD, Piccardi M, Kruger B, Girosi F. Multichannel mixture models for time-series analysis and classification of engagement with multiple health services: An application to psychology and physiotherapy utilization patterns after traffic accidents. Artif Intell Med 2020; 111:101997. [PMID: 33461690 DOI: 10.1016/j.artmed.2020.101997] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2020] [Revised: 10/02/2020] [Accepted: 11/23/2020] [Indexed: 10/22/2022]
Abstract
BACKGROUND Motor vehicle accidents (MVA) represent a significant burden on health systems globally. Tens of thousands of people are injured in Australia every year and may experience significant disability. Associated economic costs are substantial. There is little literature on the health service utilization patterns of MVA patients. To fill this gap, this study has been designed to investigate temporal patterns of psychology and physiotherapy service utilization following transport-related injuries. METHOD De-identified compensation data was provided by the Australian Transport Accident Commission. Utilization of physiotherapy and psychology services was analysed. The datasets contained 788 psychology and 3115 physiotherapy claimants and 22,522 and 118,453 episodes of service utilization, respectively. 582 claimants used both services, and their data were preprocessed to generate multidimensional time series. Time series clustering was applied using a mixture of hidden Markov models to identify the main distinct patterns of service utilization. Combinations of hidden states and clusters were evaluated and optimized using the Bayesian information criterion and interpretability. Cluster membership was further investigated using static covariates and multinomial logistic regression, and classified using high-performing classifiers (extreme gradient boosting machine, random forest and support vector machine) with 5-fold cross-validation. RESULTS Four clusters of claimants were obtained from the clustering of the time series of service utilization. Service volumes and costs increased progressively from clusters 1 to 4. Membership of cluster 1 was positively associated with nerve damage and negatively associated with severe ABI and spinal injuries. Cluster 3 was positively associated with severe ABI, brain/head injury and psychiatric injury. Cluster 4 was positively associated with internal injuries. The classifiers were capable of classifying cluster membership with moderate to strong performance (AUC: 0.62-0.96). CONCLUSION The available time series of post-accident psychology and physiotherapy service utilization were coalesced into four clusters that were clearly distinct in terms of patterns of utilization. In addition, pre-treatment covariates allowed prediction of a claimant's post-accident service utilization with reasonable accuracy. Such results can be useful for a range of decision-making processes, including the design of interventions aimed at improving claimant care and recovery.
Collapse
Affiliation(s)
- Nazanin Esmaili
- Faculty of Engineering and IT, University of Technology Sydney, NSW, Australia; School of Medicine, University of Notre Dame Australia, Sydney, NSW, Australia.
| | - Quinlan D Buchlak
- School of Medicine, University of Notre Dame Australia, Sydney, NSW, Australia
| | - Massimo Piccardi
- Faculty of Engineering and IT, University of Technology Sydney, NSW, Australia
| | - Bernie Kruger
- Transport Accident Commission, Geelong, VIC, Australia
| | - Federico Girosi
- Capital Markets Cooperative Research Centre (CMCRC), Sydney, NSW, Australia; Translational Health Research Institute, Western Sydney University, Penrith, NSW, Australia
| |
Collapse
|
722
|
Selecting the most important self-assessed features for predicting conversion to mild cognitive impairment with random forest and permutation-based methods. Sci Rep 2020; 10:20630. [PMID: 33244011 PMCID: PMC7692490 DOI: 10.1038/s41598-020-77296-4] [Citation(s) in RCA: 33] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2019] [Accepted: 11/09/2020] [Indexed: 12/11/2022] Open
Abstract
Alzheimer's Disease is a complex, multifactorial, and comorbid condition. The asymptomatic behavior in the early stages makes the identification of the disease onset particularly challenging. Mild cognitive impairment (MCI) is an intermediary stage between the expected decline of normal aging and the pathological decline associated with dementia. The identification of risk factors for MCI is thus sorely needed. Self-reported personal information such as age, education, income level, sleep, diet, physical exercise, etc. is called to play a key role not only in the early identification of MCI but also in the design of personalized interventions and the promotion of patients empowerment. In this study, we leverage a large longitudinal study on healthy aging in Spain, to identify the most important self-reported features for future conversion to MCI. Using machine learning (random forest) and permutation-based methods we select the set of most important self-reported variables for MCI conversion which includes among others, subjective cognitive decline, educational level, working experience, social life, and diet. Subjective cognitive decline stands as the most important feature for future conversion to MCI across different feature selection techniques.
Collapse
|
723
|
Rodrigues J, Studer E, Streuber S, Meyer N, Sandi C. Locomotion in virtual environments predicts cardiovascular responsiveness to subsequent stressful challenges. Nat Commun 2020; 11:5904. [PMID: 33214564 PMCID: PMC7677550 DOI: 10.1038/s41467-020-19736-3] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2020] [Accepted: 10/22/2020] [Indexed: 12/12/2022] Open
Abstract
Individuals differ in their physiological responsiveness to stressful challenges, and stress potentiates the development of many diseases. Heart rate variability (HRV), a measure of cardiac vagal break, is emerging as a strong index of physiological stress vulnerability. Thus, it is important to develop tools that identify predictive markers of individual differences in HRV responsiveness without exposing subjects to high stress. Here, using machine learning approaches, we show the strong predictive power of high-dimensional locomotor responses during novelty exploration to predict HRV responsiveness during stress exposure. Locomotor responses are collected in two ecologically valid virtual reality scenarios inspired by the animal literature and stress is elicited and measured in a third threatening virtual scenario. Our model's predictions generalize to other stressful challenges and outperforms other stress prediction instruments, such as anxiety questionnaires. Our study paves the way for the development of behavioral digital phenotyping tools for early detection of stress-vulnerable individuals.
Collapse
Affiliation(s)
- João Rodrigues
- Laboratory of Behavioral Genetics, Brain Mind Institute, School of Life Sciences, École Polytechnique Fédérale de Lausanne, EPFL, Lausanne, 1015, Switzerland.
| | - Erik Studer
- Laboratory of Behavioral Genetics, Brain Mind Institute, School of Life Sciences, École Polytechnique Fédérale de Lausanne, EPFL, Lausanne, 1015, Switzerland
| | - Stephan Streuber
- Laboratory of Behavioral Genetics, Brain Mind Institute, School of Life Sciences, École Polytechnique Fédérale de Lausanne, EPFL, Lausanne, 1015, Switzerland
| | - Nathalie Meyer
- Laboratory of Behavioral Genetics, Brain Mind Institute, School of Life Sciences, École Polytechnique Fédérale de Lausanne, EPFL, Lausanne, 1015, Switzerland
| | - Carmen Sandi
- Laboratory of Behavioral Genetics, Brain Mind Institute, School of Life Sciences, École Polytechnique Fédérale de Lausanne, EPFL, Lausanne, 1015, Switzerland.
| |
Collapse
|
724
|
Tsiklidis EJ, Sims C, Sinno T, Diamond SL. Using the National Trauma Data Bank (NTDB) and machine learning to predict trauma patient mortality at admission. PLoS One 2020; 15:e0242166. [PMID: 33201935 PMCID: PMC7671512 DOI: 10.1371/journal.pone.0242166] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2020] [Accepted: 10/27/2020] [Indexed: 11/19/2022] Open
Abstract
A 400-estimator gradient boosting classifier was trained to predict survival probabilities of trauma patients. The National Trauma Data Bank (NTDB) provided 799233 complete patient records (778303 survivors and 20930 deaths) each containing 32 features, a number further reduced to only 8 features via the permutation importance method. Importantly, the 8 features can all be readily determined at admission: systolic blood pressure, heart rate, respiratory rate, temperature, oxygen saturation, gender, age and Glasgow coma score. Since death was rare, a rebalanced training set was used to train the model. The model is able to predict a survival probability for any trauma patient and accurately distinguish between a deceased and survived patient in 92.4% of all cases. Partial dependence curves (Psurvival vs. feature value) obtained from the trained model revealed the global importance of Glasgow coma score, age, and systolic blood pressure while pulse rate, respiratory rate, temperature, oxygen saturation, and gender had more subtle single variable influences. Shapley values, which measure the relative contribution of each of the 8 features to individual patient risk, were computed for several patients and were able to quantify patient-specific warning signs. Using the NTDB to sample across numerous patient traumas and hospital protocols, the trained model and Shapley values rapidly provides quantitative insight into which combination of variables in an 8-dimensional space contributed most to each trauma patient's predicted global risk of death upon emergency room admission.
Collapse
Affiliation(s)
- Evan J. Tsiklidis
- Department of Chemical and Biomolecular Engineering, Institute for Medicine and Engineering, University of Pennsylvania, Philadelphia, Pennsylvania, United States of America
| | - Carrie Sims
- Department of Trauma Surgery, University of Pennsylvania, Philadelphia, Pennsylvania, United States of America
| | - Talid Sinno
- Department of Chemical and Biomolecular Engineering, Institute for Medicine and Engineering, University of Pennsylvania, Philadelphia, Pennsylvania, United States of America
| | - Scott L. Diamond
- Department of Chemical and Biomolecular Engineering, Institute for Medicine and Engineering, University of Pennsylvania, Philadelphia, Pennsylvania, United States of America
| |
Collapse
|
725
|
Li L, Liu ZP. Biomarker discovery for predicting spontaneous preterm birth from gene expression data by regularized logistic regression. Comput Struct Biotechnol J 2020; 18:3434-3446. [PMID: 33294138 PMCID: PMC7689379 DOI: 10.1016/j.csbj.2020.10.028] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2020] [Revised: 10/24/2020] [Accepted: 10/25/2020] [Indexed: 01/23/2023] Open
Abstract
In this work, we provide a computational method of regularized logistic regression for discovering biomarkers of spontaneous preterm birth (SPTB) from gene expression data. The successful identification of SPTB biomarkers will greatly benefit the interference of infant gestational age for reducing the risks of pregnant women and preemies. In recent years, various approaches have been proposed for the feature selection of identifying the subset of meaningful genes that can achieve accurate classification for disease samples from controls. Here, we comprehensively summarize the regularized logistic regression with seven effective penalties developed for the selection of strongly indicative genes of SPTB from microarray data. We compare their properties and assess their classification performances in multiple datasets. It shows that elastic net, lasso,L 1 / 2 and SCAD penalties get the better performance than others and can be successfully used to identify biomarkers of SPTB. Particularly, we make a functional enrichment analysis on these biomarkers and construct a logistic regression classifier based on them. The classifier generates an indicator of preterm risk score (PRS) for predicting SPTB. Based on the trained predictor, we verify the identified biomarkers on an independent dataset. The biomarkers achieve the AUC value of 0.933 in the SPTB classification. The results demonstrate the effectiveness and efficiency of the built-up strategy of biomarker discovery with regularized logistic regression. Obviously, the proposed method of discovering biomarkers for SPTB can be easily extended for other complex diseases.
Collapse
Affiliation(s)
- Lingyu Li
- Center for Intelligent Medicine, School of Control Science and Engineering, Shandong University, Jinan, Shandong 250061, China
| | - Zhi-Ping Liu
- Center for Intelligent Medicine, School of Control Science and Engineering, Shandong University, Jinan, Shandong 250061, China
| |
Collapse
|
726
|
Barda AJ, Horvat CM, Hochheiser H. A qualitative research framework for the design of user-centered displays of explanations for machine learning model predictions in healthcare. BMC Med Inform Decis Mak 2020; 20:257. [PMID: 33032582 PMCID: PMC7545557 DOI: 10.1186/s12911-020-01276-x] [Citation(s) in RCA: 27] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2020] [Accepted: 09/23/2020] [Indexed: 01/08/2023] Open
Abstract
BACKGROUND There is an increasing interest in clinical prediction tools that can achieve high prediction accuracy and provide explanations of the factors leading to increased risk of adverse outcomes. However, approaches to explaining complex machine learning (ML) models are rarely informed by end-user needs and user evaluations of model interpretability are lacking in the healthcare domain. We used extended revisions of previously-published theoretical frameworks to propose a framework for the design of user-centered displays of explanations. This new framework served as the basis for qualitative inquiries and design review sessions with critical care nurses and physicians that informed the design of a user-centered explanation display for an ML-based prediction tool. METHODS We used our framework to propose explanation displays for predictions from a pediatric intensive care unit (PICU) in-hospital mortality risk model. Proposed displays were based on a model-agnostic, instance-level explanation approach based on feature influence, as determined by Shapley values. Focus group sessions solicited critical care provider feedback on the proposed displays, which were then revised accordingly. RESULTS The proposed displays were perceived as useful tools in assessing model predictions. However, specific explanation goals and information needs varied by clinical role and level of predictive modeling knowledge. Providers preferred explanation displays that required less information processing effort and could support the information needs of a variety of users. Providing supporting information to assist in interpretation was seen as critical for fostering provider understanding and acceptance of the predictions and explanations. The user-centered explanation display for the PICU in-hospital mortality risk model incorporated elements from the initial displays along with enhancements suggested by providers. CONCLUSIONS We proposed a framework for the design of user-centered displays of explanations for ML models. We used the proposed framework to motivate the design of a user-centered display of an explanation for predictions from a PICU in-hospital mortality risk model. Positive feedback from focus group participants provides preliminary support for the use of model-agnostic, instance-level explanations of feature influence as an approach to understand ML model predictions in healthcare and advances the discussion on how to effectively communicate ML model information to healthcare providers.
Collapse
Affiliation(s)
- Amie J Barda
- Department of Biomedical Informatics, School of Medicine, University of Pittsburgh, 5607 Baum Boulevard, Pittsburgh, PA, 15206, USA
| | - Christopher M Horvat
- Children's Hospital of Pittsburgh of UPMC, Pittsburgh, PA, 15224, USA.,Department of Critical Care Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, 15213, USA.,Safar Center for Resuscitation Research, University of Pittsburgh, Pittsburgh, PA, 15224, USA.,Brain Care Institute, Children's Hospital of Pittsburgh of UPMC, Pittsburgh, PA, 15261, USA
| | - Harry Hochheiser
- Department of Biomedical Informatics, School of Medicine, University of Pittsburgh, 5607 Baum Boulevard, Pittsburgh, PA, 15206, USA. .,Intelligent Systems Program, University of Pittsburgh, Pittsburgh, PA, 15213, USA.
| |
Collapse
|
727
|
Haimovich AD, Ravindra NG, Stoytchev S, Young HP, Wilson FP, van Dijk D, Schulz WL, Taylor RA. Development and Validation of the Quick COVID-19 Severity Index: A Prognostic Tool for Early Clinical Decompensation. Ann Emerg Med 2020; 76:442-453. [PMID: 33012378 PMCID: PMC7373004 DOI: 10.1016/j.annemergmed.2020.07.022] [Citation(s) in RCA: 199] [Impact Index Per Article: 39.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2020] [Revised: 07/02/2020] [Accepted: 07/13/2020] [Indexed: 12/15/2022]
Abstract
STUDY OBJECTIVE The goal of this study is to create a predictive, interpretable model of early hospital respiratory failure among emergency department (ED) patients admitted with coronavirus disease 2019 (COVID-19). METHODS This was an observational, retrospective, cohort study from a 9-ED health system of admitted adult patients with severe acute respiratory syndrome coronavirus 2 (COVID-19) and an oxygen requirement less than or equal to 6 L/min. We sought to predict respiratory failure within 24 hours of admission as defined by oxygen requirement of greater than 10 L/min by low-flow device, high-flow device, noninvasive or invasive ventilation, or death. Predictive models were compared with the Elixhauser Comorbidity Index, quick Sequential [Sepsis-related] Organ Failure Assessment, and the CURB-65 pneumonia severity score. RESULTS During the study period, from March 1 to April 27, 2020, 1,792 patients were admitted with COVID-19, 620 (35%) of whom had respiratory failure in the ED. Of the remaining 1,172 admitted patients, 144 (12.3%) met the composite endpoint within the first 24 hours of hospitalization. On the independent test cohort, both a novel bedside scoring system, the quick COVID-19 Severity Index (area under receiver operating characteristic curve mean 0.81 [95% confidence interval {CI} 0.73 to 0.89]), and a machine-learning model, the COVID-19 Severity Index (mean 0.76 [95% CI 0.65 to 0.86]), outperformed the Elixhauser mortality index (mean 0.61 [95% CI 0.51 to 0.70]), CURB-65 (0.50 [95% CI 0.40 to 0.60]), and quick Sequential [Sepsis-related] Organ Failure Assessment (0.59 [95% CI 0.50 to 0.68]). A low quick COVID-19 Severity Index score was associated with a less than 5% risk of respiratory decompensation in the validation cohort. CONCLUSION A significant proportion of admitted COVID-19 patients progress to respiratory failure within 24 hours of admission. These events are accurately predicted with bedside respiratory examination findings within a simple scoring system.
Collapse
Affiliation(s)
- Adrian D Haimovich
- Department of Emergency Medicine, Yale University School of Medicine, New Haven, CT
| | - Neal G Ravindra
- Department of Internal Medicine, Section of Cardiovascular Medicine, Yale University School of Medicine, New Haven, CT; Department of Computer Science, Yale University, New Haven, CT
| | - Stoytcho Stoytchev
- Department of Emergency Medicine, Yale University School of Medicine, New Haven, CT
| | - H Patrick Young
- Department of Internal Medicine, Yale University School of Medicine, New Haven, CT; Center for Outcomes Research and Evaluation, Yale New Haven Hospital, New Haven, CT
| | - Francis P Wilson
- Department of Internal Medicine, Yale University School of Medicine, New Haven, CT; Clinical and Translational Research Accelerator, Department of Medicine, Yale University School of Medicine, New Haven, CT
| | - David van Dijk
- Department of Internal Medicine, Section of Cardiovascular Medicine, Yale University School of Medicine, New Haven, CT; Department of Computer Science, Yale University, New Haven, CT
| | - Wade L Schulz
- Center for Medical Informatics, Yale University School of Medicine, New Haven, CT; Department of Laboratory Medicine, Yale University School of Medicine, New Haven, CT; Center for Outcomes Research and Evaluation, Yale New Haven Hospital, New Haven, CT
| | - R Andrew Taylor
- Department of Emergency Medicine, Yale University School of Medicine, New Haven, CT; Center for Medical Informatics, Yale University School of Medicine, New Haven, CT.
| |
Collapse
|
728
|
Malgaroli M, Schultebraucks K. Artificial Intelligence and Posttraumatic Stress Disorder (PTSD). EUROPEAN PSYCHOLOGIST 2020. [DOI: 10.1027/1016-9040/a000423] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
Abstract
Abstract. Posttraumatic stress disorder (PTSD) is a debilitating disease that can occur after experiencing a traumatic event. Despite recent progress in computational research, it has not yet been possible to identify precise and reliable risk factors that enable predictive models of individual risk for posttraumatic stress after trauma. In this overview, we discuss recent advances in the use of Machine Learning (ML) and Artificial Intelligence (AI) for risk stratification and targeted treatment allocation in the context of stress pathologies and we critically review the benefits and challenges of emerging approaches. The vast heterogeneity in the manifestation and the etiology of PTSD is discussed as one major reason for the need to deploy ML-based computational models to better account for individual differences between patients. Striving for personalized medicine is one of the most important goals of current clinical research and is of great potential for the field of posttraumatic stress research. The use of ML is a promising and necessary approach for reaching more personalized treatments and to make further progress in the field of precision psychiatry.
Collapse
Affiliation(s)
- Matteo Malgaroli
- Department of Psychiatry, NYU Grossman School of Medicine, New York, NY, USA
| | - Katharina Schultebraucks
- Department of Emergency Medicine, Vagelos School of Physicians and Surgeon, Columbia University Irving Medical Center, New York, NY, USA
- Data Science Institute, Columbia University, New York, NY, USA
| |
Collapse
|
729
|
Abstract
The tremendous and rapid technological advances that humans have achieved in the last decade have definitely impacted how surgical tasks are performed in the operating room (OR). As a high-tech work environment, the contemporary OR has incorporated novel computational systems into the clinical workflow, aiming to optimize processes and support the surgical team. Artificial intelligence (AI) is increasingly important for surgical decision making to help address diverse sources of information, such as patient risk factors, anatomy, disease natural history, patient values and cost, and assist surgeons and patients to make better predictions regarding the consequences of surgical decisions. In this review, we discuss the current initiatives that are using AI in cardiothoracic surgery and surgical care in general. We also address the future of AI and how high-tech ORs will leverage human-machine teaming to optimize performance and enhance patient safety.
Collapse
Affiliation(s)
- Roger D Dias
- STRATUS Center for Medical Simulation, Brigham Health, Boston, MA, USA -
- Department of Emergency Medicine, Harvard Medical School, Boston, MA, USA -
| | - Julie A Shah
- Laboratory of Computer Science and Artificial Intelligence, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Marco A Zenati
- Laboratory of Medical Robotics and Computer Assisted Surgery (MRCAS), Division of Cardiothoracic Surgery, VA Boston Healthcare System, Boston, MA, USA
- Department of Surgery, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
730
|
Abstract
INTRODUCTION Acute gastrointestinal (GI) bleed is a common reason for hospitalization with 2%-10% risk of mortality. In this study, we developed a machine learning (ML) model to calculate the risk of mortality in intensive care unit patients admitted for GI bleed and compared it with APACHE IVa risk score. We used explainable ML methods to provide insight into the model's prediction and outcome. METHODS We analyzed the patient data in the Electronic Intensive Care Unit Collaborative Research Database and extracted data for 5,691 patients (mean age = 67.4 years; 61% men) admitted with GI bleed. The data were used in training a ML model to identify patients who died in the intensive care unit. We compared the predictive performance of the ML model with the APACHE IVa risk score. Performance was measured by area under receiver operating characteristic curve (AUC) analysis. This study also used explainable ML methods to provide insights into the model's outcome or prediction using the SHAP (SHapley Additive exPlanations) method. RESULTS The ML model performed better than the APACHE IVa risk score in correctly classifying the low-risk patients. The ML model had a specificity of 27% (95% confidence interval [CI]: 25-36) at a sensitivity of 100% compared with the APACHE IVa score, which had a specificity of 4% (95% CI: 3-31) at a sensitivity of 100%. The model identified patients who died with an AUC of 0.85 (95% CI: 0.80-0.90) in the internal validation set, whereas the APACHE IVa clinical scoring systems identified patients who died with AUC values of 0.80 (95% CI: 0.73-0.86) with P value <0.001. DISCUSSION We developed a ML model that predicts the mortality in patients with GI bleed with a greater accuracy than the current scoring system. By making the ML model explainable, clinicians would be able to better understand the reasoning behind the outcome.
Collapse
|
731
|
Chen T, Wang X, Chu Y, Wang Y, Jiang M, Wei DQ, Xiong Y. T4SE-XGB: Interpretable Sequence-Based Prediction of Type IV Secreted Effectors Using eXtreme Gradient Boosting Algorithm. Front Microbiol 2020; 11:580382. [PMID: 33072049 PMCID: PMC7541839 DOI: 10.3389/fmicb.2020.580382] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2020] [Accepted: 08/21/2020] [Indexed: 12/19/2022] Open
Abstract
Type IV secreted effectors (T4SEs) can be translocated into the cytosol of host cells via type IV secretion system (T4SS) and cause diseases. However, experimental approaches to identify T4SEs are time- and resource-consuming, and the existing computational tools based on machine learning techniques have some obvious limitations such as the lack of interpretability in the prediction models. In this study, we proposed a new model, T4SE-XGB, which uses the eXtreme gradient boosting (XGBoost) algorithm for accurate identification of type IV effectors based on optimal features based on protein sequences. After trying 20 different types of features, the best performance was achieved when all features were fed into XGBoost by the 5-fold cross validation in comparison with other machine learning methods. Then, the ReliefF algorithm was adopted to get the optimal feature set on our dataset, which further improved the model performance. T4SE-XGB exhibited highest predictive performance on the independent test set and outperformed other published prediction tools. Furthermore, the SHAP method was used to interpret the contribution of features to model predictions. The identification of key features can contribute to improved understanding of multifactorial contributors to host-pathogen interactions and bacterial pathogenesis. In addition to type IV effector prediction, we believe that the proposed framework can provide instructive guidance for similar studies to construct prediction methods on related biological problems. The data and source code of this study can be freely accessed at https://github.com/CT001002/T4SE-XGB.
Collapse
Affiliation(s)
- Tianhang Chen
- State Key Laboratory of Microbial Metabolism, School of Life Sciences and Biotechnology, Shanghai Jiao Tong University, Shanghai, China
| | - Xiangeng Wang
- State Key Laboratory of Microbial Metabolism, School of Life Sciences and Biotechnology, Shanghai Jiao Tong University, Shanghai, China.,Department of Biomedical Sciences, City University of Hong Kong, Hong Kong, China
| | - Yanyi Chu
- State Key Laboratory of Microbial Metabolism, School of Life Sciences and Biotechnology, Shanghai Jiao Tong University, Shanghai, China.,Peng Cheng Laboratory, Shenzhen, China
| | - Yanjing Wang
- State Key Laboratory of Microbial Metabolism, School of Life Sciences and Biotechnology, Shanghai Jiao Tong University, Shanghai, China
| | - Mingming Jiang
- State Key Laboratory of Microbial Metabolism, School of Life Sciences and Biotechnology, Shanghai Jiao Tong University, Shanghai, China
| | - Dong-Qing Wei
- State Key Laboratory of Microbial Metabolism, School of Life Sciences and Biotechnology, Shanghai Jiao Tong University, Shanghai, China.,Peng Cheng Laboratory, Shenzhen, China
| | - Yi Xiong
- State Key Laboratory of Microbial Metabolism, School of Life Sciences and Biotechnology, Shanghai Jiao Tong University, Shanghai, China
| |
Collapse
|
732
|
Improving Model Performance on the Stratification of Breast Cancer Patients by Integrating Multiscale Genomic Features. BIOMED RESEARCH INTERNATIONAL 2020; 2020:1475368. [PMID: 32908867 PMCID: PMC7471833 DOI: 10.1155/2020/1475368] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/05/2020] [Revised: 05/26/2020] [Accepted: 07/18/2020] [Indexed: 11/17/2022]
Abstract
In clinical cancer research, it is a hot topic on how to accurately stratify patients based on genomic data. With the development of next-generation sequencing technology, more and more types of genomic features, such as mRNA expression level, can be used to distinguish cancer patients. Previous studies commonly stratified patients by using a single type of genomic features, which can only reflect one aspect of the cancer. In fact, multiscale genomic features will provide more information and may be helpful for clinical prediction. In addition, most of the conventional machine learning algorithms use a handcrafted gene set as features to construct models, which is generally selected by a statistical method with an arbitrary cut-off, e.g., p value < 0.05. The genes in the gene set are not necessarily related to the cancer and will make the model unreliable. Therefore, in our study, we thoroughly investigated the performance of different machine learning methods on stratifying breast cancer patients with a single type of genomic features. Then, we proposed a strategy, which can take into account the degree of correlation between genes and cancer patients, to identify the features from mRNAs and microRNAs, and evaluated the performance of the models with the new combined features of the multiscale genomic features. The results showed that, compared with the models constructed with a single type of features, the models with the multiscale genomic features generated by our proposed method achieved better performance on stratifying the ER status of breast cancer patients. Moreover, we found that the identified multiscale genomic features were closely related to the cancer by gene set enrichment analysis, indicating that our proposed strategy can well reflect the biological relevance of the genes to breast cancer. In conclusion, modelling with multiscale genomic features closely related to the cancer not only can guarantee the prediction performance of the models but also can effectively provide candidate genes for interpreting the mechanisms of cancer.
Collapse
|
733
|
Bertini JR. Graph embedded rules for explainable predictions in data streams. Neural Netw 2020; 129:174-192. [DOI: 10.1016/j.neunet.2020.05.035] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2019] [Revised: 05/25/2020] [Accepted: 05/28/2020] [Indexed: 12/11/2022]
|
734
|
Ioannou GN, Tang W, Beste LA, Tincopa MA, Su GL, Van T, Tapper EB, Singal AG, Zhu J, Waljee AK. Assessment of a Deep Learning Model to Predict Hepatocellular Carcinoma in Patients With Hepatitis C Cirrhosis. JAMA Netw Open 2020; 3:e2015626. [PMID: 32870314 PMCID: PMC7489819 DOI: 10.1001/jamanetworkopen.2020.15626] [Citation(s) in RCA: 86] [Impact Index Per Article: 17.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/12/2022] Open
Abstract
IMPORTANCE Deep learning, a family of machine learning models that use artificial neural networks, has achieved great success at predicting outcomes in nonmedical domains. OBJECTIVE To examine whether deep learning recurrent neural network (RNN) models that use raw longitudinal data extracted directly from electronic health records outperform conventional regression models in predicting the risk of developing hepatocellular carcinoma (HCC). DESIGN, SETTING, AND PARTICIPANTS This prognostic study included 48 151 patients with hepatitis C virus (HCV)-related cirrhosis in the national Veterans Health Administration who had at least 3 years of follow-up after the diagnosis of cirrhosis. Patients were identified by having at least 1 positive HCV RNA test between January 1, 2000, to January 1, 2016, and were followed up from the diagnosis of cirrhosis to January 1, 2019, for the development of incident HCC. A total of 3 models predicting HCC during a 3-year period were developed and compared, as follows: (1) logistic regression (LR) with cross-sectional inputs (cross-sectional LR); (2) LR with longitudinal inputs (longitudinal LR); and (3) RNN with longitudinal inputs. Data analysis was conducted from April 2018 to August 2020. EXPOSURES Development of HCC. MAIN OUTCOMES AND MEASURES Area under the receiver operating characteristic curve, area under the precision-recall curve, and Brier score. RESULTS During a mean (SD) follow-up of 11.6 (5.0) years, 10 741 of 48 151 patients (22.3%) developed HCC (annual incidence, 3.1%), and a total of 52 983 samples (51 948 [98.0%] from men) were collected. Patients who developed HCC within 3 years were older than patients who did not (mean [SD] age, 58.2 [6.6] years vs 56.9 [6.9] years). RNN models had superior mean (SD) area under the receiver operating characteristic curve (0.759 [0.009]) and mean (SD) Brier score (0.136 [0.003]) than cross-sectional LR (0.689 [0.009] and 0.149 [0.003], respectively) and longitudinal LR (0.682 [0.007] and 0.150 [0.003], respectively) models. Using the RNN model, the samples with the mean (SD) highest 51% (1.5%) of HCC risk, in which 80% of all HCCs occurred, or the mean (SD) highest 66% (1.2%) of HCC risk, in which 90% of all HCCs occurred, could potentially be targeted. Among samples from patients who achieved sustained virologic response, the performance of the RNN models was even better (mean [SD] area under receiver operating characteristic curve, 0.806 [0.025]; mean [SD] Brier score, 0.117 [0.007]). CONCLUSIONS AND RELEVANCE In this study, deep learning RNN models outperformed conventional LR models, suggesting that RNN models could be used to identify patients with HCV-related cirrhosis with a high risk of developing HCC for risk-based HCC outreach and surveillance strategies.
Collapse
Affiliation(s)
- George N. Ioannou
- Division of Gastroenterology, Department of Medicine, Veterans Affairs Puget Sound Healthcare System and University of Washington, Seattle
- Research and Development, Veterans Affairs Puget Sound Healthcare System, Seattle, Washington
| | - Weijing Tang
- Department of Statistics, University of Michigan, Ann Arbor
| | - Lauren A. Beste
- Division of General Internal Medicine, Department of Medicine, Veterans Affairs Puget Sound Healthcare System and University of Washington, Seattle
| | - Monica A. Tincopa
- Michigan Medicine, Division of Gastroenterology and Hepatology, Department of Internal Medicine, Ann Arbor
| | - Grace L. Su
- Michigan Medicine, Division of Gastroenterology and Hepatology, Department of Internal Medicine, Ann Arbor
- VA Ann Arbor Health Services Research and Development Center of Clinical Management Research, Ann Arbor, Michigan
| | - Tony Van
- Michigan Integrated Center for Health Analytics and Medical Prediction (MiCHAMP), Ann Arbor
| | - Elliot B. Tapper
- Michigan Medicine, Division of Gastroenterology and Hepatology, Department of Internal Medicine, Ann Arbor
- VA Ann Arbor Health Services Research and Development Center of Clinical Management Research, Ann Arbor, Michigan
| | - Amit G. Singal
- Division of Gastroenterology, Department of Medicine, University of Texas Southwestern, Dallas
| | - Ji Zhu
- Department of Statistics, University of Michigan, Ann Arbor
- Michigan Integrated Center for Health Analytics and Medical Prediction (MiCHAMP), Ann Arbor
| | - Akbar K. Waljee
- Michigan Medicine, Division of Gastroenterology and Hepatology, Department of Internal Medicine, Ann Arbor
- VA Ann Arbor Health Services Research and Development Center of Clinical Management Research, Ann Arbor, Michigan
- Michigan Integrated Center for Health Analytics and Medical Prediction (MiCHAMP), Ann Arbor
| |
Collapse
|
735
|
The present and future role of artificial intelligence and machine learning in anesthesiology. Int Anesthesiol Clin 2020; 58:7-16. [PMID: 32841964 DOI: 10.1097/aia.0000000000000294] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
|
736
|
Abdulaal A, Patel A, Charani E, Denny S, Mughal N, Moore L. Prognostic Modeling of COVID-19 Using Artificial Intelligence in the United Kingdom: Model Development and Validation. J Med Internet Res 2020; 22:e20259. [PMID: 32735549 PMCID: PMC7451108 DOI: 10.2196/20259] [Citation(s) in RCA: 47] [Impact Index Per Article: 9.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2020] [Revised: 06/25/2020] [Accepted: 07/24/2020] [Indexed: 12/13/2022] Open
Abstract
BACKGROUND The current severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) outbreak is a public health emergency and the case fatality rate in the United Kingdom is significant. Although there appear to be several early predictors of outcome, there are no currently validated prognostic models or scoring systems applicable specifically to patients with confirmed SARS-CoV-2. OBJECTIVE We aim to create a point-of-admission mortality risk scoring system using an artificial neural network (ANN). METHODS We present an ANN that can provide a patient-specific, point-of-admission mortality risk prediction to inform clinical management decisions at the earliest opportunity. The ANN analyzes a set of patient features including demographics, comorbidities, smoking history, and presenting symptoms and predicts patient-specific mortality risk during the current hospital admission. The model was trained and validated on data extracted from 398 patients admitted to hospital with a positive real-time reverse transcription polymerase chain reaction (RT-PCR) test for SARS-CoV-2. RESULTS Patient-specific mortality was predicted with 86.25% accuracy, with a sensitivity of 87.50% (95% CI 61.65%-98.45%) and specificity of 85.94% (95% CI 74.98%-93.36%). The positive predictive value was 60.87% (95% CI 45.23%-74.56%), and the negative predictive value was 96.49% (95% CI 88.23%-99.02%). The area under the receiver operating characteristic curve was 90.12%. CONCLUSIONS This analysis demonstrates an adaptive ANN trained on data at a single site, which demonstrates the early utility of deep learning approaches in a rapidly evolving pandemic with no established or validated prognostic scoring systems.
Collapse
Affiliation(s)
- Ahmed Abdulaal
- Chelsea and Westminster NHS Foundation Trust, London, United Kingdom
| | - Aatish Patel
- Chelsea and Westminster NHS Foundation Trust, London, United Kingdom
| | - Esmita Charani
- NIHR Health Protection Research Unit in Healthcare Associated Infections and Antimicrobial Resistance, Imperial College London, London, United Kingdom
| | - Sarah Denny
- Chelsea and Westminster NHS Foundation Trust, London, United Kingdom
| | - Nabeela Mughal
- Chelsea and Westminster NHS Foundation Trust, London, United Kingdom
| | - Luke Moore
- Chelsea and Westminster NHS Foundation Trust, London, United Kingdom
- NIHR Health Protection Research Unit in Healthcare Associated Infections and Antimicrobial Resistance, Imperial College London, London, United Kingdom
| |
Collapse
|
737
|
A supervised machine learning-based methodology for analyzing dysregulation in splicing machinery: An application in cancer diagnosis. Artif Intell Med 2020; 108:101950. [PMID: 32972670 DOI: 10.1016/j.artmed.2020.101950] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2019] [Revised: 08/15/2020] [Accepted: 08/18/2020] [Indexed: 02/06/2023]
Abstract
Deregulated splicing machinery components have shown to be associated with the development of several types of cancer and, therefore, the determination of such alterations can help the development of tumor-specific molecular targets for early prognosis and therapy. Determining such splicing components, however, is not a straightforward task mainly due to the heterogeneity of tumors, the variability across samples, and the fat-short characteristic of genomic datasets. In this work, a supervised machine learning-based methodology is proposed, allowing the determination of subsets of relevant splicing components that best discriminate samples. The methodology comprises three main phases: first, a ranking of features is determined by means of applying feature weighting algorithms that compute the importance of each splicing component; second, the best subset of features that allows the induction of an accurate classifier is determined by means of conducting an effective heuristic search; then the confidence over the induced classifier is assessed by means of explaining the individual predictions and its global behavior. At the end, an extensive experimental study was conducted on a large collection of transcript-based datasets, illustrating the utility and benefit of the proposed methodology for analyzing dysregulation in splicing machinery.
Collapse
|
738
|
Sabol P, Sinčák P, Hartono P, Kočan P, Benetinová Z, Blichárová A, Verbóová Ľ, Štammová E, Sabolová-Fabianová A, Jašková A. Explainable classifier for improving the accountability in decision-making for colorectal cancer diagnosis from histopathological images. J Biomed Inform 2020; 109:103523. [PMID: 32758538 DOI: 10.1016/j.jbi.2020.103523] [Citation(s) in RCA: 30] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2020] [Revised: 07/22/2020] [Accepted: 07/27/2020] [Indexed: 10/23/2022]
Abstract
Pathologists are responsible for cancer type diagnoses from histopathological cancer tissues. However, it is known that microscopic examination is tedious and time-consuming. In recent years, a long list of machine learning approaches to image classification and whole-slide segmentation has been developed to support pathologists. Although many showed exceptional performances, the majority of them are not able to rationalize their decisions. In this study, we developed an explainable classifier to support decision making for medical diagnoses. The proposed model does not provide an explanation about the causality between the input and the decisions, but offers a human-friendly explanation about the plausibility of the decision. Cumulative Fuzzy Class Membership Criterion (CFCMC) explains its decisions in three ways: through a semantical explanation about the possibilities of misclassification, showing the training sample responsible for a certain prediction and showing training samples from conflicting classes. In this paper, we explain about the mathematical structure of the classifier, which is not designed to be used as a fully automated diagnosis tool but as a support system for medical experts. We also report on the accuracy of the classifier against real world histopathological data for colorectal cancer. We also tested the acceptability of the system through clinical trials by 14 pathologists. We show that the proposed classifier is comparable to state of the art neural networks in accuracy, but more importantly it is more acceptable to be used by human experts as a diagnosis tool in the medical domain.
Collapse
Affiliation(s)
- Patrik Sabol
- Department of Cybernetics and Artificial Intelligence, Technical University of Košice, Košice, Slovakia.
| | - Peter Sinčák
- Department of Cybernetics and Artificial Intelligence, Technical University of Košice, Košice, Slovakia.
| | | | - Pavel Kočan
- Department of Pathology, Pavol Jozef Šafárik University in Košice, Košice, Slovakia
| | - Zuzana Benetinová
- Department of Pathology, Pavol Jozef Šafárik University in Košice, Košice, Slovakia
| | - Alžbeta Blichárová
- Department of Pathology, Pavol Jozef Šafárik University in Košice, Košice, Slovakia
| | - Ľudmila Verbóová
- Department of Pathology, Pavol Jozef Šafárik University in Košice, Košice, Slovakia
| | - Erika Štammová
- Department of Pathology, Pavol Jozef Šafárik University in Košice, Košice, Slovakia
| | | | - Anna Jašková
- The Faculty of Arts of Prešov University, Prešov, Slovakia
| |
Collapse
|
739
|
Rytky SJO, Tiulpin A, Frondelius T, Finnilä MAJ, Karhula SS, Leino J, Pritzker KPH, Valkealahti M, Lehenkari P, Joukainen A, Kröger H, Nieminen HJ, Saarakkala S. Automating three-dimensional osteoarthritis histopathological grading of human osteochondral tissue using machine learning on contrast-enhanced micro-computed tomography. Osteoarthritis Cartilage 2020; 28:1133-1144. [PMID: 32437969 DOI: 10.1016/j.joca.2020.05.002] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/22/2019] [Revised: 04/16/2020] [Accepted: 05/01/2020] [Indexed: 02/02/2023]
Abstract
OBJECTIVE To develop and validate a machine learning (ML) approach for automatic three-dimensional (3D) histopathological grading of osteochondral samples imaged with contrast-enhanced micro-computed tomography (CEμCT). DESIGN A total of 79 osteochondral cores from 24 total knee arthroplasty patients and two asymptomatic donors were imaged using CEμCT with phosphotungstic acid -staining. Volumes-of-interest (VOI) in surface (SZ), deep (DZ) and calcified (CZ) zones were extracted depth-wise and subjected to dimensionally reduced Local Binary Pattern -textural feature analysis. Regularized linear and logistic regression (LR) models were trained zone-wise against the manually assessed semi-quantitative histopathological CEμCT grades (diameter = 2 mm samples). Models were validated using nested leave-one-out cross-validation and an independent test set (4 mm samples). The performance was primarily assessed using Mean Squared Error (MSE) and Average Precision (AP, confidence intervals are given in square brackets). RESULTS Highest performance on cross-validation was observed for SZ, both on linear regression (MSE = 0.49, 0.69 and 0.71 for SZ, DZ and CZ, respectively) and LR (AP = 0.9 [0.77-0.99], 0.46 [0.28-0.67] and 0.65 [0.41-0.85] for SZ, DZ and CZ, respectively). The test set evaluations yielded increased MSE on all zones. For LR, the performance was also best for the SZ (AP = 0.85 [0.73-0.93], 0.82 [0.70-0.92] and 0.8 [0.67-0.9], for SZ, DZ and CZ, respectively). CONCLUSION We present the first ML-based automatic 3D histopathological osteoarthritis (OA) grading method which also adequately perform on grading unseen data, especially in SZ. After further development, the method could potentially be applied by OA researchers since the grading software and all source codes are publicly available.
Collapse
Affiliation(s)
- S J O Rytky
- Research Unit of Medical Imaging, Physics and Technology, University of Oulu, Oulu, Finland.
| | - A Tiulpin
- Research Unit of Medical Imaging, Physics and Technology, University of Oulu, Oulu, Finland; Department of Diagnostic Radiology, Oulu University Hospital, Oulu, Finland.
| | - T Frondelius
- Research Unit of Medical Imaging, Physics and Technology, University of Oulu, Oulu, Finland.
| | - M A J Finnilä
- Research Unit of Medical Imaging, Physics and Technology, University of Oulu, Oulu, Finland; Medical Research Center, University of Oulu, Oulu, Finland.
| | - S S Karhula
- Research Unit of Medical Imaging, Physics and Technology, University of Oulu, Oulu, Finland; Department of Diagnostic Radiology, Oulu University Hospital, Oulu, Finland.
| | - J Leino
- Research Unit of Medical Imaging, Physics and Technology, University of Oulu, Oulu, Finland.
| | - K P H Pritzker
- Department of Laboratory Medicine and Pathobiology, Surgery University of Toronto, Toronto, Ontario, Canada; Mount Sinai Hospital, Toronto, Ontario, Canada.
| | - M Valkealahti
- Department of Surgery and Intensive Care, Oulu University Hospital, Oulu, Finland.
| | - P Lehenkari
- Medical Research Center, University of Oulu, Oulu, Finland; Department of Surgery and Intensive Care, Oulu University Hospital, Oulu, Finland; Cancer and Translational Medical Research Unit, Faculty of Medicine, University of Oulu, Oulu, Finland.
| | - A Joukainen
- Department of Orthopaedics, Traumatology and Hand Surgery, Kuopio University Hospital, Kuopio, Finland.
| | - H Kröger
- Department of Orthopaedics, Traumatology and Hand Surgery, Kuopio University Hospital, Kuopio, Finland.
| | - H J Nieminen
- Dept. of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland; Research Unit of Medical Imaging, Physics and Technology, University of Oulu, Oulu, Finland.
| | - S Saarakkala
- Research Unit of Medical Imaging, Physics and Technology, University of Oulu, Oulu, Finland; Department of Diagnostic Radiology, Oulu University Hospital, Oulu, Finland.
| |
Collapse
|
740
|
Gordon L, Grantcharov T, Rudzicz F. Explainable Artificial Intelligence for Safe Intraoperative Decision Support. JAMA Surg 2020; 154:1064-1065. [PMID: 31509185 DOI: 10.1001/jamasurg.2019.2821] [Citation(s) in RCA: 40] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Affiliation(s)
- Lauren Gordon
- International Centre for Surgical Safety, Li Ka Shing Knowledge Institute of St Michael's Hospital, Toronto, Ontario, Canada.,Department of Surgery, University of Toronto, Toronto, Ontario, Canada
| | - Teodor Grantcharov
- International Centre for Surgical Safety, Li Ka Shing Knowledge Institute of St Michael's Hospital, Toronto, Ontario, Canada.,Department of Surgery, University of Toronto, Toronto, Ontario, Canada
| | - Frank Rudzicz
- International Centre for Surgical Safety, Li Ka Shing Knowledge Institute of St Michael's Hospital, Toronto, Ontario, Canada.,Department of Computer Science, University of Toronto, Toronto, Ontario, Canada
| |
Collapse
|
741
|
Koshimizu H, Kojima R, Okuno Y. Future possibilities for artificial intelligence in the practical management of hypertension. Hypertens Res 2020; 43:1327-1337. [PMID: 32655135 DOI: 10.1038/s41440-020-0498-x] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2020] [Revised: 05/13/2020] [Accepted: 05/17/2020] [Indexed: 11/09/2022]
Abstract
The use of artificial intelligence in numerous prediction and classification tasks, including clinical research and healthcare management, is becoming increasingly more common. This review describes the current status and a future possibility for artificial intelligence in blood pressure management, that is, the possibility of accurately predicting and estimating blood pressure using large-scale data, such as personal health records and electronic medical records. Individual blood pressure continuously changes because of lifestyle habits and the environment. This review focuses on two topics regarding controlling changing blood pressure: a novel blood pressure measurement system and blood pressure analysis using artificial intelligence. Regarding the novel blood pressure measurement system, we compare the conventional cuff-less method with the analysis of pulse waves using artificial intelligence for blood pressure estimation. Then, we describe the prediction of future blood pressure values using machine learning and deep learning. In addition, we summarize factor analysis using "explainable AI" to solve a black-box problem of artificial intelligence. Overall, we show that artificial intelligence is advantageous for hypertension management and can be used to establish clinical evidence for the practical management of hypertension.
Collapse
Affiliation(s)
- Hiroshi Koshimizu
- Department of Biomedical Data Intelligence, Graduate School of Medicine, Kyoto University, Kyoto, 606-8507, Japan.,Development Center, Omron Healthcare Co., Ltd., Kyoto, 617-0002, Japan
| | - Ryosuke Kojima
- Department of Biomedical Data Intelligence, Graduate School of Medicine, Kyoto University, Kyoto, 606-8507, Japan
| | - Yasushi Okuno
- Department of Biomedical Data Intelligence, Graduate School of Medicine, Kyoto University, Kyoto, 606-8507, Japan.
| |
Collapse
|
742
|
Madurai Elavarasan R, Pugazhendhi R. Restructured society and environment: A review on potential technological strategies to control the COVID-19 pandemic. THE SCIENCE OF THE TOTAL ENVIRONMENT 2020; 725:138858. [PMID: 32336562 PMCID: PMC7180041 DOI: 10.1016/j.scitotenv.2020.138858] [Citation(s) in RCA: 99] [Impact Index Per Article: 19.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/12/2020] [Revised: 04/18/2020] [Accepted: 04/19/2020] [Indexed: 04/15/2023]
Abstract
The emergence of Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) in China at December 2019 had led to a global outbreak of coronavirus disease 2019 (COVID-19) and the disease started to spread all over the world and became an international public health issue. The entire humanity has to fight in this war against the unexpected and each and every individual role is important. Healthcare system is doing exceptional work and the government is taking various measures that help the society to control the spread. Public, on the other hand, coordinates with the policies and act accordingly in most state of affairs. But the role of technologies in assisting different social bodies to fight against the pandemic remains hidden. The intention of our study is to uncover the hidden roles of technologies that ultimately help for controlling the pandemic. On investigating, it is found that the strategies utilizing potential technologies would yield better benefits and these technological strategies can be framed either to control the pandemic or to support the confinement of the society during pandemic which in turn aids in controlling the spreading of infection. This study enlightens the various implemented technologies that assists the healthcare systems, government and public in diverse aspects for fighting against COVID-19. Furthermore, the technological swift that happened during the pandemic and their influence in the environment and society is discussed. Besides the implemented technologies, this work also deals with untapped potential technologies that have prospective applications in controlling the pandemic circumstances. Alongside the various discussion, our suggested solution for certain situational issues is also presented.
Collapse
Affiliation(s)
- Rajvikram Madurai Elavarasan
- Department of Electrical and Electronics Engineering, Sri Venkateswara College of Engineering, Chennai 602117, India.
| | - Rishi Pugazhendhi
- Department of Mechanical Engineering, Sri Venkateswara College of Engineering, Chennai 602117, India
| |
Collapse
|
743
|
Machine learning in haematological malignancies. LANCET HAEMATOLOGY 2020; 7:e541-e550. [PMID: 32589980 DOI: 10.1016/s2352-3026(20)30121-6] [Citation(s) in RCA: 59] [Impact Index Per Article: 11.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/17/2020] [Revised: 04/02/2020] [Accepted: 04/14/2020] [Indexed: 02/06/2023]
Abstract
Machine learning is a branch of computer science and statistics that generates predictive or descriptive models by learning from training data rather than by being rigidly programmed. It has attracted substantial attention for its many applications in medicine, both as a catalyst for research and as a means of improving clinical care across the cycle of diagnosis, prognosis, and treatment of disease. These applications include the management of haematological malignancy, in which machine learning has created inroads in pathology, radiology, genomics, and the analysis of electronic health record data. As computational power becomes cheaper and the tools for implementing machine learning become increasingly democratised, it is likely to become increasingly integrated into the research and practice landscape of haematology. As such, machine learning merits understanding and attention from researchers and clinicians alike. This narrative Review describes important concepts in machine learning for unfamiliar readers, details machine learning's current applications in haematological malignancy, and summarises important concepts for clinicians to be aware of when appraising research that uses machine learning.
Collapse
|
744
|
Chun JY, Sendi MSE, Sui J, Zhi D, Calhoun VD. Visualizing Functional Network Connectivity Difference between Healthy Control and Major Depressive Disorder Using an Explainable Machine-learning Method. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2020:1424-1427. [PMID: 33018257 DOI: 10.1109/embc44109.2020.9175685] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Major depressive disorder (MDD) is a complex mental disorder characterized by a persistent sad feeling and depressed mood. Recent studies reported differences between healthy control (HC) and MDD by looking to brain networks including default mode and cognitive control networks. More recently there has been interest in studying the brain using advanced machine learning-based classification approaches. However, interpreting the model used in the classification between MDD and HC has not been explored yet. In the current study, we classified MDD from HC by estimating whole-brain connectivity using several classification methods including support vector machine, random forest, XGBoost, and convolutional neural network. In addition, we leveraged the SHapley Additive exPlanations (SHAP) approach as a feature learning method to model the difference between these two groups. We found a consistent result among all classification method in regard of the classification accuracy and feature learning. Also, we highlighted the role of other brain networks particularly visual and sensory motor network in the classification between MDD and HC subjects.
Collapse
|
745
|
Abstract
PURPOSE OF REVIEW The Covid-19 pandemic has daunted the world with its enormous impact on healthcare, economic recession, and psychological distress. Nutrition is an integral part of every person life care, and should also be mandatorily integrated to patient care under the Covid-19 pandemic. It is crucial to understand how the Covid-19 does develop and which risk factors are associated with negative outcomes and death. Therefore, it is of utmost importance to have studies that respect the basic tenets of the scientific method in order to be trusted. The goal of this review is to discuss the deluge of scientific data and how it might influence clinical reasoning and practice. RECENT FINDINGS A large number of scientific manuscripts are daily published worldwide, and the Covid-19 makes no exception. Up to now, data on Covid-19 have come from countries initially affected by the disease and mostly pertain either epidemiological observations or opinion papers. Many of them do not fulfil the essential principles characterizing the adequate scientific method. SUMMARY It is crucial to be able to critical appraise the scientific literature, in order to provide adequate nutrition therapy to patients, and in particular, to Covid-19 infected individuals.
Collapse
|
746
|
A case-based ensemble learning system for explainable breast cancer recurrence prediction. Artif Intell Med 2020; 107:101858. [DOI: 10.1016/j.artmed.2020.101858] [Citation(s) in RCA: 31] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2019] [Revised: 04/02/2020] [Accepted: 04/03/2020] [Indexed: 02/06/2023]
|
747
|
Abstract
PURPOSE OF REVIEW Acute care technologies, including novel monitoring devices, big data, increased computing capabilities, machine-learning algorithms and automation, are converging. This enables the application of augmented intelligence for improved outcome predictions, clinical decision-making, and offers unprecedented opportunities to improve patient outcomes, reduce costs, and improve clinician workflow. This article briefly explores recent work in the areas of automation, artificial intelligence and outcome prediction models in pediatric anesthesia and pediatric critical care. RECENT FINDINGS Recent years have yielded little published research into pediatric physiological closed loop control (a type of automation) beyond studies focused on glycemic control for type 1 diabetes. However, there has been a greater range of research in augmented decision-making, leveraging artificial intelligence and machine-learning techniques, in particular, for pediatric ICU outcome prediction. SUMMARY Most studies focusing on artificial intelligence demonstrate good performance on prediction or classification, whether they use traditional statistical tools or novel machine-learning approaches. Yet the challenges of implementation, user acceptance, ethics and regulation cannot be underestimated. Areas in which there is easy access to routinely labeled data and robust outcomes, such as those collected through national networks and quality improvement programs, are likely to be at the forefront of the adoption of these advances.
Collapse
|
748
|
Iglesias-Puzas Á, Conde-Taboada A, López-Bran E. [Artificial Intelligence in surgery: The Precision Medicine revolution]. J Healthc Qual Res 2020; 35:330-331. [PMID: 32561322 DOI: 10.1016/j.jhqr.2020.03.009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2020] [Revised: 03/06/2020] [Accepted: 03/15/2020] [Indexed: 11/28/2022]
Affiliation(s)
- Á Iglesias-Puzas
- Servicio de Dermatología, Hospital Universitario Clínico San Carlos, Madrid, España.
| | - A Conde-Taboada
- Servicio de Dermatología, Hospital Universitario Clínico San Carlos, Madrid, España
| | - E López-Bran
- Servicio de Dermatología, Hospital Universitario Clínico San Carlos, Madrid, España
| |
Collapse
|
749
|
Singh A, Sengupta S, Lakshminarayanan V. Explainable Deep Learning Models in Medical Image Analysis. J Imaging 2020; 6:52. [PMID: 34460598 PMCID: PMC8321083 DOI: 10.3390/jimaging6060052] [Citation(s) in RCA: 219] [Impact Index Per Article: 43.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2020] [Revised: 06/16/2020] [Accepted: 06/17/2020] [Indexed: 01/05/2023] Open
Abstract
Deep learning methods have been very effective for a variety of medical diagnostic tasks and have even outperformed human experts on some of those. However, the black-box nature of the algorithms has restricted their clinical use. Recent explainability studies aim to show the features that influence the decision of a model the most. The majority of literature reviews of this area have focused on taxonomy, ethics, and the need for explanations. A review of the current applications of explainable deep learning for different medical imaging tasks is presented here. The various approaches, challenges for clinical deployment, and the areas requiring further research are discussed here from a practical standpoint of a deep learning researcher designing a system for the clinical end-users.
Collapse
Affiliation(s)
- Amitojdeep Singh
- Theoretical and Experimental Epistemology Laboratory, School of Optometry and Vision Science, University of Waterloo, Waterloo, ON N2L 3G1, Canada; (S.S.); (V.L.)
- Department of Systems Design Engineering, University of Waterloo, Waterloo, ON N2L 3G1, Canada
| | - Sourya Sengupta
- Theoretical and Experimental Epistemology Laboratory, School of Optometry and Vision Science, University of Waterloo, Waterloo, ON N2L 3G1, Canada; (S.S.); (V.L.)
- Department of Systems Design Engineering, University of Waterloo, Waterloo, ON N2L 3G1, Canada
| | - Vasudevan Lakshminarayanan
- Theoretical and Experimental Epistemology Laboratory, School of Optometry and Vision Science, University of Waterloo, Waterloo, ON N2L 3G1, Canada; (S.S.); (V.L.)
- Department of Systems Design Engineering, University of Waterloo, Waterloo, ON N2L 3G1, Canada
| |
Collapse
|
750
|
Zhang K, Liu X, Shen J, Li Z, Sang Y, Wu X, Zha Y, Liang W, Wang C, Wang K, Ye L, Gao M, Zhou Z, Li L, Wang J, Yang Z, Cai H, Xu J, Yang L, Cai W, Xu W, Wu S, Zhang W, Jiang S, Zheng L, Zhang X, Wang L, Lu L, Li J, Yin H, Wang W, Li O, Zhang C, Liang L, Wu T, Deng R, Wei K, Zhou Y, Chen T, Lau JYN, Fok M, He J, Lin T, Li W, Wang G. Clinically Applicable AI System for Accurate Diagnosis, Quantitative Measurements, and Prognosis of COVID-19 Pneumonia Using Computed Tomography. Cell 2020; 181:1423-1433.e11. [PMID: 32416069 PMCID: PMC7196900 DOI: 10.1016/j.cell.2020.04.045] [Citation(s) in RCA: 424] [Impact Index Per Article: 84.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2020] [Revised: 04/06/2020] [Accepted: 04/23/2020] [Indexed: 02/05/2023]
Abstract
Many COVID-19 patients infected by SARS-CoV-2 virus develop pneumonia (called novel coronavirus pneumonia, NCP) and rapidly progress to respiratory failure. However, rapid diagnosis and identification of high-risk patients for early intervention are challenging. Using a large computed tomography (CT) database from 3,777 patients, we developed an AI system that can diagnose NCP and differentiate it from other common pneumonia and normal controls. The AI system can assist radiologists and physicians in performing a quick diagnosis especially when the health system is overloaded. Significantly, our AI system identified important clinical markers that correlated with the NCP lesion properties. Together with the clinical data, our AI system was able to provide accurate clinical prognosis that can aid clinicians to consider appropriate early clinical management and allocate resources appropriately. We have made this AI system available globally to assist the clinicians to combat COVID-19.
Collapse
Affiliation(s)
- Kang Zhang
- Faculty of Medicine, Macau University of Science and Technology, Macau, China.
| | - Xiaohong Liu
- Department of Computer Science and Technology & BNRist, Tsinghua University, Beijing, China
| | - Jun Shen
- Departments of Urology, Radiology, Emergency Medicine, and Respiratory Medicine, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, Guangzhou, China
| | - Zhihuan Li
- Center for Translational Innovations and Department of Respiratory and Critical Care Medicine, West China Hospital, West China School of Medicine, Sichuan University, Chengdu, China; Guangzhou Regenerative Medicine and Health Guangdong Laboratory, Guangzhou, China
| | - Ye Sang
- The First College of Clinical Medical Science, China Three Gorges University, Yichang, China
| | - Xingwang Wu
- Department of Radiology, The First Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Yunfei Zha
- Department of Radiology, Department of Infection Prevention and Control, Renmin Hospital, Wuhan University, Wuhan, China
| | - Wenhua Liang
- Department of Thoracic Surgery/Oncology, the First Affiliated Hospital of Guangzhou Medical University, China State Key Laboratory and National Clinical Research Center for Respiratory Disease, Guangzhou, China
| | - Chengdi Wang
- Center for Translational Innovations and Department of Respiratory and Critical Care Medicine, West China Hospital, West China School of Medicine, Sichuan University, Chengdu, China
| | - Ke Wang
- Department of Computer Science and Technology & BNRist, Tsinghua University, Beijing, China
| | - Linsen Ye
- Department of Radiology, and Liver Disease Center, Sun Yat-Sen Third Affiliated Hospital, Sun Yat-Sen University, Guangzhou, China
| | - Ming Gao
- Departments of Urology, Radiology, Emergency Medicine, and Respiratory Medicine, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, Guangzhou, China
| | - Zhongguo Zhou
- Faculty of Medicine, Macau University of Science and Technology, Macau, China
| | - Liang Li
- Department of Radiology, Department of Infection Prevention and Control, Renmin Hospital, Wuhan University, Wuhan, China
| | - Jin Wang
- Department of Radiology, and Liver Disease Center, Sun Yat-Sen Third Affiliated Hospital, Sun Yat-Sen University, Guangzhou, China
| | - Zehong Yang
- Departments of Urology, Radiology, Emergency Medicine, and Respiratory Medicine, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, Guangzhou, China
| | - Huimin Cai
- Guangzhou Regenerative Medicine and Health Guangdong Laboratory, Guangzhou, China
| | - Jie Xu
- Faculty of Medicine, Macau University of Science and Technology, Macau, China
| | - Lei Yang
- Guangzhou Regenerative Medicine and Health Guangdong Laboratory, Guangzhou, China
| | - Wenjia Cai
- Guangzhou Regenerative Medicine and Health Guangdong Laboratory, Guangzhou, China
| | - Wenqin Xu
- Faculty of Medicine, Macau University of Science and Technology, Macau, China
| | - Shaoxu Wu
- Departments of Urology, Radiology, Emergency Medicine, and Respiratory Medicine, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, Guangzhou, China
| | - Wei Zhang
- Departments of Urology, Radiology, Emergency Medicine, and Respiratory Medicine, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, Guangzhou, China
| | - Shanping Jiang
- Departments of Urology, Radiology, Emergency Medicine, and Respiratory Medicine, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, Guangzhou, China
| | - Lianghong Zheng
- Guangzhou Regenerative Medicine and Health Guangdong Laboratory, Guangzhou, China; Guangzhou Kangrui AI Technology Co. and Guangzhou HuiBoRui Biological Pharmaceutical Technology Co., Ltd, Guangzhou, China
| | - Xuan Zhang
- Department of Computer Science and Technology & BNRist, Tsinghua University, Beijing, China
| | - Li Wang
- Department of Radiology, Department of Infection Prevention and Control, Renmin Hospital, Wuhan University, Wuhan, China
| | - Liu Lu
- Guangzhou Regenerative Medicine and Health Guangdong Laboratory, Guangzhou, China; Guangzhou Kangrui AI Technology Co. and Guangzhou HuiBoRui Biological Pharmaceutical Technology Co., Ltd, Guangzhou, China
| | - Jiaming Li
- Guangzhou Regenerative Medicine and Health Guangdong Laboratory, Guangzhou, China; Guangzhou Kangrui AI Technology Co. and Guangzhou HuiBoRui Biological Pharmaceutical Technology Co., Ltd, Guangzhou, China
| | - Haiping Yin
- The First People's Hospital of Yunnan Province, Kunmin, China
| | - Winston Wang
- Faculty of Medicine, Macau University of Science and Technology, Macau, China
| | - Oulan Li
- Guangzhou Regenerative Medicine and Health Guangdong Laboratory, Guangzhou, China
| | - Charlotte Zhang
- Guangzhou Regenerative Medicine and Health Guangdong Laboratory, Guangzhou, China
| | - Liang Liang
- The First College of Clinical Medical Science, China Three Gorges University, Yichang, China
| | - Tao Wu
- The First College of Clinical Medical Science, China Three Gorges University, Yichang, China
| | - Ruiyun Deng
- Faculty of Medicine, Macau University of Science and Technology, Macau, China; Guangzhou Kangrui AI Technology Co. and Guangzhou HuiBoRui Biological Pharmaceutical Technology Co., Ltd, Guangzhou, China
| | - Kang Wei
- Faculty of Medicine, Macau University of Science and Technology, Macau, China
| | - Yong Zhou
- Faculty of Medicine, Macau University of Science and Technology, Macau, China
| | - Ting Chen
- Department of Computer Science and Technology & BNRist, Tsinghua University, Beijing, China
| | - Johnson Yiu-Nam Lau
- Department of Applied Biology and Chemical Technology, Hong Kong Polytechnic University, Hong Kong, China
| | - Manson Fok
- Faculty of Medicine, Macau University of Science and Technology, Macau, China
| | - Jianxing He
- Department of Thoracic Surgery/Oncology, the First Affiliated Hospital of Guangzhou Medical University, China State Key Laboratory and National Clinical Research Center for Respiratory Disease, Guangzhou, China.
| | - Tianxin Lin
- Departments of Urology, Radiology, Emergency Medicine, and Respiratory Medicine, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, Guangzhou, China.
| | - Weimin Li
- Center for Translational Innovations and Department of Respiratory and Critical Care Medicine, West China Hospital, West China School of Medicine, Sichuan University, Chengdu, China.
| | - Guangyu Wang
- Department of Computer Science and Technology & BNRist, Tsinghua University, Beijing, China.
| |
Collapse
|