1
|
Wang Q, Chang Z, Liu X, Wang Y, Feng C, Ping Y, Feng X. Predictive Value of Machine Learning for Platinum Chemotherapy Responses in Ovarian Cancer: Systematic Review and Meta-Analysis. J Med Internet Res 2024; 26:e48527. [PMID: 38252469 PMCID: PMC10845031 DOI: 10.2196/48527] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2023] [Revised: 11/23/2023] [Accepted: 11/24/2023] [Indexed: 01/23/2024] Open
Abstract
BACKGROUND Machine learning is a potentially effective method for predicting the response to platinum-based treatment for ovarian cancer. However, the predictive performance of various machine learning methods and variables is still a matter of controversy and debate. OBJECTIVE This study aims to systematically review relevant literature on the predictive value of machine learning for platinum-based chemotherapy responses in patients with ovarian cancer. METHODS Following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines, we systematically searched the PubMed, Embase, Web of Science, and Cochrane databases for relevant studies on predictive models for platinum-based therapies for the treatment of ovarian cancer published before April 26, 2023. The Prediction Model Risk of Bias Assessment tool was used to evaluate the risk of bias in the included articles. Concordance index (C-index), sensitivity, and specificity were used to evaluate the performance of the prediction models to investigate the predictive value of machine learning for platinum chemotherapy responses in patients with ovarian cancer. RESULTS A total of 1749 articles were examined, and 19 of them involving 39 models were eligible for this study. The most commonly used modeling methods were logistic regression (16/39, 41%), Extreme Gradient Boosting (4/39, 10%), and support vector machine (4/39, 10%). The training cohort reported C-index in 39 predictive models, with a pooled value of 0.806; the validation cohort reported C-index in 12 predictive models, with a pooled value of 0.831. Support vector machine performed well in both the training and validation cohorts, with a C-index of 0.942 and 0.879, respectively. The pooled sensitivity was 0.890, and the pooled specificity was 0.790 in the training cohort. CONCLUSIONS Machine learning can effectively predict how patients with ovarian cancer respond to platinum-based chemotherapy and may provide a reference for the development or updating of subsequent scoring systems.
Collapse
Affiliation(s)
- Qingyi Wang
- Department of First Clinical Medical College, Heilongjiang University of Chinese Medicine, Harbin, China
| | - Zhuo Chang
- Basic Medical College, Heilongjiang University of Chinese Medicine, Harbin, China
| | - Xiaofang Liu
- Department of First Clinical Medical College, Heilongjiang University of Chinese Medicine, Harbin, China
| | - Yunrui Wang
- Department of First Clinical Medical College, Heilongjiang University of Chinese Medicine, Harbin, China
| | - Chuwen Feng
- Department of First Clinical Medical College, Heilongjiang University of Chinese Medicine, Harbin, China
| | - Yunlu Ping
- Department of First Clinical Medical College, Heilongjiang University of Chinese Medicine, Harbin, China
| | - Xiaoling Feng
- Department of Gynecology, First Affiliated Hospital of Heilongjiang University of Chinese Medicine, Harbin, China
| |
Collapse
|
2
|
Sheehy J, Rutledge H, Acharya UR, Loh HW, Gururajan R, Tao X, Zhou X, Li Y, Gurney T, Kondalsamy-Chennakesavan S. Gynecological cancer prognosis using machine learning techniques: A systematic review of last three decades (1990–2022). Artif Intell Med 2023; 139:102536. [PMID: 37100507 DOI: 10.1016/j.artmed.2023.102536] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2021] [Revised: 03/19/2023] [Accepted: 03/23/2023] [Indexed: 03/30/2023]
Abstract
OBJECTIVE Many Computer Aided Prognostic (CAP) systems based on machine learning techniques have been proposed in the field of oncology. The objective of this systematic review was to assess and critically appraise the methodologies and approaches used in predicting the prognosis of gynecological cancers using CAPs. METHODS Electronic databases were used to systematically search for studies utilizing machine learning methods in gynecological cancers. Study risk of bias (ROB) and applicability were assessed using the PROBAST tool. 139 studies met the inclusion criteria, of which 71 predicted outcomes for ovarian cancer patients, 41 predicted outcomes for cervical cancer patients, 28 predicted outcomes for uterine cancer patients, and 2 predicted outcomes for gynecological malignancies broadly. RESULTS Random forest (22.30 %) and support vector machine (21.58 %) classifiers were used most commonly. Use of clinicopathological, genomic and radiomic data as predictors was observed in 48.20 %, 51.08 % and 17.27 % of studies, respectively, with some studies using multiple modalities. 21.58 % of studies were externally validated. Twenty-three individual studies compared ML and non-ML methods. Study quality was highly variable and methodologies, statistical reporting and outcome measures were inconsistent, preventing generalized commentary or meta-analysis of performance outcomes. CONCLUSION There is significant variability in model development when prognosticating gynecological malignancies with respect to variable selection, machine learning (ML) methods and endpoint selection. This heterogeneity prevents meta-analysis and conclusions regarding the superiority of ML methods. Furthermore, PROBAST-mediated ROB and applicability analysis demonstrates concern for the translatability of existing models. This review identifies ways that this can be improved upon in future works to develop robust, clinically translatable models within this promising field.
Collapse
|
3
|
Carroll MJ, Kaipio K, Hynninen J, Carpen O, Hautaniemi S, Page D, Kreeger PK. A Subset of Secreted Proteins in Ascites Can Predict Platinum-Free Interval in Ovarian Cancer. Cancers (Basel) 2022; 14:4291. [PMID: 36077825 PMCID: PMC9454800 DOI: 10.3390/cancers14174291] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2022] [Revised: 08/25/2022] [Accepted: 08/29/2022] [Indexed: 11/16/2022] Open
Abstract
The time between the last cycle of chemotherapy and recurrence, the platinum-free interval (PFI), predicts overall survival in high-grade serous ovarian cancer (HGSOC). To identify secreted proteins associated with a shorter PFI, we utilized machine learning to predict the PFI from ascites composition. Ascites from stage III/IV HGSOC patients treated with neoadjuvant chemotherapy (NACT) or primary debulking surgery (PDS) were screened for secreted proteins and Lasso regression models were built to predict the PFI. Through regularization techniques, the number of analytes used in each model was reduced; to minimize overfitting, we utilized an analysis of model robustness. This resulted in models with 26 analytes and a root-mean-square error (RMSE) of 19 days for the NACT cohort and 16 analytes and an RMSE of 7 days for the PDS cohort. High concentrations of MMP-2 and EMMPRIN correlated with a shorter PFI in the NACT patients, whereas high concentrations of uPA Urokinase and MMP-3 correlated with a shorter PFI in PDS patients. Our results suggest that the analysis of ascites may be useful for outcome prediction and identified factors in the tumor microenvironment that may lead to worse outcomes. Our approach to tuning for model stability, rather than only model accuracy, may be applicable to other biomarker discovery tasks.
Collapse
Affiliation(s)
- Molly J. Carroll
- Department of Biomedical Engineering, University of Wisconsin-Madison, Madison, WI 53706, USA
| | - Katja Kaipio
- Research Center for Cancer, Infections and Immunity, Institute of Biomedicine, University of Turku, FI-20014 Turku, Finland
| | - Johanna Hynninen
- Department of Obstetrics and Gynecology, Turku University Hospital and University of Turku, FI-20014 Turku, Finland
| | - Olli Carpen
- Research Center for Cancer, Infections and Immunity, Institute of Biomedicine, University of Turku, FI-20014 Turku, Finland
- Research Program in Systems Oncology, Research Programs Unit, Faculty of Medicine, University of Helsinki, FI-00014 Helsinki, Finland
- Department of Pathology, Helsinki University Hospital, University of Helsinki, FI-00014 Helsinki, Finland
| | - Sampsa Hautaniemi
- Research Program in Systems Oncology, Research Programs Unit, Faculty of Medicine, University of Helsinki, FI-00014 Helsinki, Finland
| | - David Page
- Department of Biostatistics and Bioinformatics, Duke University, Durham, NC 27710, USA
| | - Pamela K. Kreeger
- Department of Biomedical Engineering, University of Wisconsin-Madison, Madison, WI 53706, USA
- University of Wisconsin Carbone Cancer Center, University of Wisconsin School of Medicine and Public Health, Madison, WI 53705, USA
- Department of Obstetrics and Gynecology, University of Wisconsin School of Medicine and Public Health, Madison, WI 53705, USA
- Department of Cell and Regenerative Biology, University of Wisconsin School of Medicine and Public Health, Madison, WI 53705, USA
| |
Collapse
|
7
|
Sessa M, Khan AR, Liang D, Andersen M, Kulahci M. Artificial Intelligence in Pharmacoepidemiology: A Systematic Review. Part 1-Overview of Knowledge Discovery Techniques in Artificial Intelligence. Front Pharmacol 2020; 11:1028. [PMID: 32765261 PMCID: PMC7378532 DOI: 10.3389/fphar.2020.01028] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2019] [Accepted: 06/24/2020] [Indexed: 12/14/2022] Open
Abstract
Aim To perform a systematic review on the application of artificial intelligence (AI) based knowledge discovery techniques in pharmacoepidemiology. Study Eligibility Criteria Clinical trials, meta-analyses, narrative/systematic review, and observational studies using (or mentioning articles using) artificial intelligence techniques were eligible. Articles without a full text available in the English language were excluded. Data Sources Articles recorded from 1950/01/01 to 2019/05/06 in Ovid MEDLINE were screened. Participants Studies including humans (real or simulated) exposed to a drug. Results In total, 72 original articles and 5 reviews were identified via Ovid MEDLINE. Twenty different knowledge discovery methods were identified, mainly from the area of machine learning (66/72; 91.7%). Classification/regression (44/72; 61.1%), classification/regression + model optimization (13/72; 18.0%), and classification/regression + features selection (12/72; 16.7%) were the three most frequent tasks in reviewed literature that machine learning methods has been applied to solve. The top three used techniques were artificial neural networks, random forest, and support vector machines models. Conclusions The use of knowledge discovery techniques of artificial intelligence techniques has increased exponentially over the years covering numerous sub-topics of pharmacoepidemiology. Systematic Review Registration Systematic review registration number in PROSPERO: CRD42019136552.
Collapse
Affiliation(s)
- Maurizio Sessa
- Department of Drug Design and Pharmacology, University of Copenhagen, Copenhagen, Denmark
| | - Abdul Rauf Khan
- Department of Drug Design and Pharmacology, University of Copenhagen, Copenhagen, Denmark.,Department of Applied Mathematics and Computer Science, Technical University of Denmark, Lyngby, Denmark
| | - David Liang
- Department of Drug Design and Pharmacology, University of Copenhagen, Copenhagen, Denmark
| | - Morten Andersen
- Department of Drug Design and Pharmacology, University of Copenhagen, Copenhagen, Denmark
| | - Murat Kulahci
- Department of Applied Mathematics and Computer Science, Technical University of Denmark, Lyngby, Denmark.,Department of Business Administration, Technology and Social Sciences, Luleå University of Technology, Luleå, Sweden
| |
Collapse
|
8
|
Teixeira LA, Candido Dos Reis FJ. Immunohistochemistry for the detection of BRCA1 and BRCA2 proteins in patients with ovarian cancer: a systematic review. J Clin Pathol 2019; 73:191-196. [PMID: 31719105 DOI: 10.1136/jclinpath-2019-206276] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2019] [Accepted: 10/28/2019] [Indexed: 01/07/2023]
Abstract
BACKGROUND Loss of function in either breast cancer type 1 susceptibility protein (BRCA1) or breast cancer type 2 susceptibility protein (BRCA2) is a major risk factor for epithelial ovarian cancer (EOC) development. BRCA1 or BRCA2 deficiencies are associated with short-term prognosis and might have importance for the treatment of women with the disease. However, the screening of all possible mechanisms of dysfunction is expensive, time-consuming and difficult to apply in clinical practice. On the other hand, immunohistochemistry (IHC) is a simple and reliable method to access the expression of several proteins in tumour tissues. MATERIALS AND METHODS This systematic review aims to evaluate the current usage of IHC to detect BRCA1 and BRCA2 deficiencies in EOC. We searched and evaluated all primary literature on the use of IHC for evaluating BRCA1 and BRCA2 proteins expression in EOC. The main concepts for the search were: ovarian neoplasms, IHC, BRCA1 and BRCA2. RESULTS Forty-four studies from 925 unique titles were included. A total of 4206 tumour samples were evaluated for BRCA1 and 1041 for BRCA2 expression. Twelve BRCA1 primary antibodies were used in 41 studies, and the most common was the MS110 clone (75.6%). Seven BRCA2 primary antibodies were used in ten studies. Using the cut-off of 10%, 47.0% of EOCs are associated with loss of BRCA1 and 34.5% with the loss of BRCA2 expression. CONCLUSION IHC was effective to detect loss of BRCA1 protein expression in EOC; however, data on BRCA2 expression were heterogeneous and difficult to interpret.
Collapse
Affiliation(s)
- Lorena Alves Teixeira
- Postgraduate Program in Gynecology and Obstetrics, Department of Gynecology and Obstetrics, Ribeirao Preto Medical School, University of Sao Paulo, Ribeirao Preto, Sao Paulo, Brazil
| | - Francisco Jose Candido Dos Reis
- Postgraduate Program in Gynecology and Obstetrics, Department of Gynecology and Obstetrics, Ribeirao Preto Medical School, University of Sao Paulo, Ribeirao Preto, Sao Paulo, Brazil
| |
Collapse
|
9
|
Sun C, Guo E, Zhou B, Shan W, Huang J, Weng D, Wu P, Wang C, Wang S, Zhang W, Gao Q, Xu X, Wang B, Hu J, Ma D, Chen G. A reactive oxygen species scoring system predicts cisplatin sensitivity and prognosis in ovarian cancer patients. BMC Cancer 2019; 19:1061. [PMID: 31703584 PMCID: PMC6839150 DOI: 10.1186/s12885-019-6288-7] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2019] [Accepted: 10/24/2019] [Indexed: 12/11/2022] Open
Abstract
Background To reveal roles of reactive oxygen species (ROS) status in chemotherapy resistance and to develop a ROS scoring system for prognosis prediction in ovarian cancer. Methods We tested the sensitizing effects of ROS elevating drugs to cisplatin (cDDP) in ovarian cancer both in vitro and in vivo. A ROS scoring system was developed using The Cancer Genome Atlas (TCGA) database of ovarian cancer. The associations between ROS scores and overall survival (OS) were analyzed in TCGA, Tothill dataset, and our in-house dataset (TJ dataset). Results ROS-inducing drugs increased cisplatin-induced ovarian cancer cell injury in vitro and in vivo. ROS scoring system was established using 25 ROS-related genes. Patients were divided into low (scores 0–12) and high (scores 13–25) score groups. Improved patient survival was associated with higher scores (TCGA dataset hazard ratio (HR) = 0.43, P < 0.001; Tothill dataset HR = 0.65, P = 0.022; TJ dataset HR = 0.40, P = 0.003). The score was also significantly associated with OS in multiple datasets (TCGA dataset r2 = 0.574, P = 0.032; Thothill dataset r2 = 0.266, P = 0.049; TJ dataset r2 = 0.632, P = 0.001) and with cisplatin sensitivity in ovarian cancer cell lines (r2 = 0.799, P = 0.016) when used as a continuous variable. The scoring system showed better prognostic performance than other clinical factors by receiver operating characteristic (ROC) curves (TCGA dataset area under the curve (AUC) = 0.71 v.s. 0.65, Tothill dataset AUC = 0.73 v.s. 0.67, TJ dataset AUC = 0.74 v.s. 0.66). Conclusions ROS status is associated with chemotherapy resistance. ROS score system might be a prognostic biomarker in predicting the survival benefit from ovarian cancer patients.
Collapse
Affiliation(s)
- Chaoyang Sun
- Cancer Biology Research Center (Key laboratory of Chinese Ministry of Education), Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, People's Republic of China.,Department of Gynecology and Obstetrics, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Ensong Guo
- Cancer Biology Research Center (Key laboratory of Chinese Ministry of Education), Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, People's Republic of China.,Department of Gynecology and Obstetrics, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Bo Zhou
- Cancer Biology Research Center (Key laboratory of Chinese Ministry of Education), Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, People's Republic of China.,Department of Gynecology and Obstetrics, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Wanying Shan
- Cancer Biology Research Center (Key laboratory of Chinese Ministry of Education), Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, People's Republic of China.,Department of Gynecology and Obstetrics, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Jia Huang
- Cancer Biology Research Center (Key laboratory of Chinese Ministry of Education), Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, People's Republic of China.,Department of Gynecology and Obstetrics, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Danhui Weng
- Cancer Biology Research Center (Key laboratory of Chinese Ministry of Education), Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, People's Republic of China.,Department of Gynecology and Obstetrics, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Peng Wu
- Cancer Biology Research Center (Key laboratory of Chinese Ministry of Education), Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, People's Republic of China.,Department of Gynecology and Obstetrics, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Changyu Wang
- Cancer Biology Research Center (Key laboratory of Chinese Ministry of Education), Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, People's Republic of China.,Department of Gynecology and Obstetrics, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Shixuan Wang
- Cancer Biology Research Center (Key laboratory of Chinese Ministry of Education), Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, People's Republic of China.,Department of Gynecology and Obstetrics, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Wei Zhang
- Cancer Biology Research Center (Key laboratory of Chinese Ministry of Education), Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, People's Republic of China.,Department of Gynecology and Obstetrics, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Qinglei Gao
- Cancer Biology Research Center (Key laboratory of Chinese Ministry of Education), Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, People's Republic of China.,Department of Gynecology and Obstetrics, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Xiaoyan Xu
- Cancer Biology Research Center (Key laboratory of Chinese Ministry of Education), Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, People's Republic of China.,Department of Gynecology and Obstetrics, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Beibei Wang
- Cancer Biology Research Center (Key laboratory of Chinese Ministry of Education), Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, People's Republic of China.,Department of Gynecology and Obstetrics, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Junbo Hu
- Cancer Biology Research Center (Key laboratory of Chinese Ministry of Education), Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, People's Republic of China.,Department of Surgery, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Ding Ma
- Cancer Biology Research Center (Key laboratory of Chinese Ministry of Education), Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, People's Republic of China.,Department of Gynecology and Obstetrics, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Gang Chen
- Cancer Biology Research Center (Key laboratory of Chinese Ministry of Education), Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, People's Republic of China. .,Department of Gynecology and Obstetrics, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, People's Republic of China.
| |
Collapse
|