1
|
Leary OP, Zhong Z, Bi L, Jiao Z, Dai YW, Ma K, Sayied S, Kargilis D, Imami M, Zhao LM, Feng X, Riccardello G, Collins S, Svokos K, Moghekar A, Yang L, Bai H, Klinge PM, Boxerman JL. MRI-Based Prediction of Clinical Improvement after Ventricular Shunt Placement for Normal Pressure Hydrocephalus: Development and Evaluation of an Integrated Multisequence Machine Learning Algorithm. AJNR Am J Neuroradiol 2024; 45:1536-1544. [PMID: 38866432 PMCID: PMC11448992 DOI: 10.3174/ajnr.a8372] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2024] [Accepted: 05/16/2024] [Indexed: 06/14/2024]
Abstract
BACKGROUND AND PURPOSE Symptoms of normal pressure hydrocephalus (NPH) are sometimes refractory to shunt placement, with limited ability to predict improvement for individual patients. We evaluated an MRI-based artificial intelligence method to predict postshunt NPH symptom improvement. MATERIALS AND METHODS Patients with NPH who underwent MRI before shunt placement at a single center (2014-2021) were identified. Twelve-month postshunt improvement in mRS, incontinence, gait, and cognition were retrospectively abstracted from clinical documentation. 3D deep residual neural networks were built on skull-stripped T2-weighted and FLAIR images. Predictions based on both sequences were fused by additional network layers. Patients from 2014-2019 were used for parameter optimization, while those from 2020-2021 were used for testing. Models were validated on an external validation data set from a second institution (n = 33). RESULTS Of 249 patients, n = 201 and n = 185 were included in the T2-based and FLAIR-based models according to imaging availability. The combination of T2-weighted and FLAIR sequences offered the best performance in mRS and gait improvement predictions relative to models trained on imaging acquired by using only 1 sequence, with area under the receiver operating characteristic (AUROC) values of 0.7395 [0.5765-0.9024] for mRS and 0.8816 [0.8030-0.9602] for gait. For urinary incontinence and cognition, combined model performances on predicting outcomes were similar to FLAIR-only performance, with AUROC values of 0.7874 [0.6845-0.8903] and 0.7230 [0.5600-0.8859]. CONCLUSIONS Application of a combined algorithm by using both T2-weighted and FLAIR sequences offered the best image-based prediction of postshunt symptom improvement, particularly for gait and overall function in terms of mRS.
Collapse
Affiliation(s)
- Owen P Leary
- From the Department of Neurosurgery (O.P.L., K.M., S.S., K.S., P.M.K.), Brown University Warren Alpert Medical School, Providence, Rhode Island
| | - Zhusi Zhong
- Department of Diagnostic Imaging (Z.Z., L.B., Z.J., G.R., S.C., J.L.B.), Brown University Warren Alpert Medical School, Providence, Rhode Island
- School of Electronic Engineering (Z.Z.), Xidian University, Xi'an, China
| | - Lulu Bi
- Department of Diagnostic Imaging (Z.Z., L.B., Z.J., G.R., S.C., J.L.B.), Brown University Warren Alpert Medical School, Providence, Rhode Island
| | - Zhicheng Jiao
- Department of Diagnostic Imaging (Z.Z., L.B., Z.J., G.R., S.C., J.L.B.), Brown University Warren Alpert Medical School, Providence, Rhode Island
| | - Yu-Wei Dai
- Department of Neurology (Y.-W.D., L.Y.), The Second Xiangya Hospital, Central South University, Hunan, China
| | - Kevin Ma
- From the Department of Neurosurgery (O.P.L., K.M., S.S., K.S., P.M.K.), Brown University Warren Alpert Medical School, Providence, Rhode Island
- Columbia University Vagelos College of Physicians and Surgeons (K.M.), New York, New York
| | - Shanzeh Sayied
- From the Department of Neurosurgery (O.P.L., K.M., S.S., K.S., P.M.K.), Brown University Warren Alpert Medical School, Providence, Rhode Island
| | - Daniel Kargilis
- Department of Radiology (D.K., M.I., L.-M.Z., H.B.), Johns Hopkins University School of Medicine, Baltimore, Maryland
| | - Maliha Imami
- Department of Radiology (D.K., M.I., L.-M.Z., H.B.), Johns Hopkins University School of Medicine, Baltimore, Maryland
| | - Lin-Mei Zhao
- Department of Radiology (D.K., M.I., L.-M.Z., H.B.), Johns Hopkins University School of Medicine, Baltimore, Maryland
| | - Xue Feng
- Carina Medical (X.F.), Lexington, Kentucky
- Department of Biomedical Engineering (X.F.), University of Virginia, Charlottesville, Virginia
| | - Gerald Riccardello
- Department of Diagnostic Imaging (Z.Z., L.B., Z.J., G.R., S.C., J.L.B.), Brown University Warren Alpert Medical School, Providence, Rhode Island
| | - Scott Collins
- Department of Diagnostic Imaging (Z.Z., L.B., Z.J., G.R., S.C., J.L.B.), Brown University Warren Alpert Medical School, Providence, Rhode Island
| | - Konstantina Svokos
- From the Department of Neurosurgery (O.P.L., K.M., S.S., K.S., P.M.K.), Brown University Warren Alpert Medical School, Providence, Rhode Island
| | - Abhay Moghekar
- Department of Neurology (A.M.), Johns Hopkins University School of Medicine, Baltimore, Maryland
| | - Li Yang
- Department of Neurology (Y.-W.D., L.Y.), The Second Xiangya Hospital, Central South University, Hunan, China
| | - Harrison Bai
- Department of Radiology (D.K., M.I., L.-M.Z., H.B.), Johns Hopkins University School of Medicine, Baltimore, Maryland
| | - Petra M Klinge
- From the Department of Neurosurgery (O.P.L., K.M., S.S., K.S., P.M.K.), Brown University Warren Alpert Medical School, Providence, Rhode Island
| | - Jerrold L Boxerman
- Department of Diagnostic Imaging (Z.Z., L.B., Z.J., G.R., S.C., J.L.B.), Brown University Warren Alpert Medical School, Providence, Rhode Island
| |
Collapse
|
2
|
Kazemi F, Ahmed AK, Roy JM, Kuo CC, Jimenez AE, Rincon-Torroella J, Jackson C, Bettegowda C, Weingart J, Mukherjee D. Hospital frailty risk score predicts high-value care outcomes following brain metastasis resection. Clin Neurol Neurosurg 2024; 245:108497. [PMID: 39116796 DOI: 10.1016/j.clineuro.2024.108497] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2024] [Accepted: 08/04/2024] [Indexed: 08/10/2024]
Abstract
OBJECTIVE Brain metastases (BM) are the most common adult intracranial tumors, representing a significant source of morbidity in patients with systemic malignancy. Frailty indices, including 11- and 5-factor modified frailty indices (mFI-11 and mFI-5), American Society of Anesthesiologists (ASA) physical status classification, and Charlson Comorbidity Index (CCI), have recently demonstrated an important role in predicting high-value care outcomes in neurosurgery. This study aims to investigate the efficacy of the newly developed Hospital Frailty Risk Score (HFRS) on postoperative outcomes in BM patients. METHODS Adult patients with BM treated surgically at a single institution were identified (2017-2019). HFRS was calculated using ICD-10 codes, and patients were subsequently separated into low (<5), intermediate (5-15), and high (>15) HFRS cohorts. Multivariate logistic regressions were utilized to identify associations between HFRS and complications, length of stay (LOS), hospital charges, and discharge disposition. Model discrimination was assessed using receiver operating characteristic (ROC) curves. RESULTS A total of 356 patients (mean age: 61.81±11.63 years; 50.6 % female) were included. The mean±SD for HFRS, mFI-11, mFI-5, ASA, and CCI were 6.46±5.73, 1.31±1.24, 0.95±0.86, 2.94±0.48, and 8.69±2.07, respectively. On multivariate analysis, higher HFRS was significantly associated with greater complication rate (OR=1.10, p<0.001), extended LOS (OR=1.13, p<0.001), high hospital charges (OR=1.14, p<0.001), and nonroutine discharge disposition (OR=1.12, p<0.001), and comparing the ROC curves of mFI-11, mFI-5, ASA,and CCI, the predictive accuracy of HFRS was the most superior for all four outcomes assessed. CONCLUSION The predictive ability of HFRS on BM resection outcomes may be superior than other frailty indices, offering a new avenue for routine preoperative frailty assessment and for managing postoperative expectations.
Collapse
Affiliation(s)
- Foad Kazemi
- Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore, MD, United States
| | - A Karim Ahmed
- Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore, MD, United States
| | - Joanna M Roy
- Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore, MD, United States
| | - Cathleen C Kuo
- Department of Neurosurgery, University at Buffalo, Buffalo, NY, United States
| | - Adrian E Jimenez
- Department of Neurosurgery, Columbia University Medical Center, New York City, NY, United States
| | - Jordina Rincon-Torroella
- Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore, MD, United States
| | - Christopher Jackson
- Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore, MD, United States
| | - Chetan Bettegowda
- Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore, MD, United States
| | - Jon Weingart
- Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore, MD, United States
| | - Debraj Mukherjee
- Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore, MD, United States.
| |
Collapse
|
3
|
Yuri Ferreira M, Oliveira LB, Porto Júnior S, Semione G, Palavani LB, Batista S, Pari Mitre L, Borges PGLB, Abrantes Barros E, Andreão F, Porto Sousa M, Gomez D, Bertani R, Hakim F. Enhancing the quality of evidence, comparability, and reproducibility in ventriculoatrial shunt research for normal pressure hydrocephalus: A systematic review and VAS-NPH reporting guideline. J Clin Neurosci 2024; 126:328-337. [PMID: 39024937 DOI: 10.1016/j.jocn.2024.06.026] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2024] [Revised: 06/03/2024] [Accepted: 06/30/2024] [Indexed: 07/20/2024]
Abstract
BACKGROUND Ventriculoatrial shunt (VAS) is an important treatment option for normal pressure hydrocephalus (NPH). However, clinical studies reporting the use of VAS for NPH lack sufficient standardization for meta-analytic comparisons that could provide robust evidence regarding its use. This study aims to assess the quality of reporting in these studies and develop a reporting guideline checklist to standardize terminology, concepts, and reporting while reinforcing the essential elements to ensure comparability and reproducibility. METHODS This is a systematic literature review that followed the PRISMA guidelines with the search in Medline, Embase, and Web of Science databases, with no timeframe restriction. The level of evidence of the studies was assessed using the GRADE system, and the rigor used in the publication of the results was assessed concerning adherence to the guidelines indicated by the EQUATOR Network Group. Furthermore, the studies were scrutinized focusing on eight domains: (1) Characteristics of the included studies and baseline characteristics of the patients; (2) Reporting methodology; (3) Pivotal concepts definition; (4) Adverse events assessment; (5) Data writing and reporting; (6) Detailed outcomes reporting; (7) Specific clinical outcomes assessment and reporting; and (8) Complications reporting. RESULTS A total of 14 studies with 734 patients and 753 shunts were included in this review, and the assessment exposes notable deficiencies in reporting, specifically in baseline patient details, methodology, and outcome assessments. Only two studies followed reporting guidelines, prompting concerns about comprehensive reporting of adverse events and intraoperative complications. Varied reporting completeness existed for shunt-related issues. The absence of standardized definitions for key concepts and insufficient intervention details were observed. A VAS-NPH reporting guideline, encompassing 36 items across eight domains, was developed to address these shortcomings. CONCLUSION This systematic review reveals significant deficiencies in methodological rigor and reporting quality. The proposed VAS-NPH Reporting Guideline covers all essential aspects and is a potential solution to rectify these shortcomings and increase transparency, comparability, and reproducibility. This initiative aims to advance the level of evidence and enhance knowledge regarding the use of VAS in NPH.
Collapse
Affiliation(s)
- Marcio Yuri Ferreira
- Department of Neurosurgery, Lenox Hill Hospital/Northwell Health, New York, NY, USA
| | - Leonardo B Oliveira
- Department of Neurosurgery, State University of Ponta Grossa, Ponta Grossa, PR, Brazil
| | | | | | | | - Savio Batista
- Federal University of Rio de Janeiro, Rio de Janeiro, RJ, Brazil
| | - Lucas Pari Mitre
- Santa Casa de São Paulo School of Medical Sciences, São Paulo, SP, Brazil
| | - Pedro G L B Borges
- Fundação Técnico-Educacional Souza Marques, Rio de Janeiro, Rio de Janeiro, Brazil
| | | | - Filipi Andreão
- Federal University of Rio de Janeiro, Rio de Janeiro, RJ, Brazil
| | | | - Diego Gomez
- Department of Neurosurgery, Hospital Universitario Fundación Santa Fé de Bogotá, Bogotá, Cundinamarca, Colombia
| | - Raphael Bertani
- Department of Neurosurgery, University of São Paulo, São Paulo, São Paulo, Brazil
| | - Fernando Hakim
- Department of Neurosurgery, Hospital Universitario Fundación Santa Fé de Bogotá, Bogotá, Cundinamarca, Colombia
| |
Collapse
|
4
|
Covell MM, Roy JM, Rumalla K, Dicpinigaitis AJ, Kazim SF, Hall DE, Schmidt MH, Bowers CA. The Limited Utility of the Hospital Frailty Risk Score as a Frailty Assessment Tool in Neurosurgery: A Systematic Review. Neurosurgery 2024; 94:251-262. [PMID: 37695046 DOI: 10.1227/neu.0000000000002668] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2023] [Accepted: 07/13/2023] [Indexed: 09/12/2023] Open
Abstract
BACKGROUND AND OBJECTIVES The Hospital Frailty Risk Score (HFRS) is an International Classification of Disease 10th Revision-based scale that was originally designed for, and validated in, the assessment of patients 75 years or older presenting in an acute care setting. This study highlights central tenets inherent to the concept of frailty; questions the logic behind, and utility of, HFRS' recent implementation in the neurosurgical literature; and discusses why there is no useful role for HFRS as a frailty-based neurosurgical risk assessment (FBNRA) tool. METHODS The authors performed a systematic review of the literature per Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines, including all cranial and spinal studies that used HFRS as their primary frailty tool. Seventeen (N = 17) studies used HFRS to assess frailty's impact on neurosurgical outcomes. Thirteen total journals, 10 of which were neurosurgical journals, including the highest impact factor journals, published the 17 papers. RESULTS Increasing HFRS score was associated with adverse outcomes, including prolonged length of stay (11 of 17 studies), nonroutine discharge (10 of 17 studies), and increased hospital costs (9 of 17 studies). Four different HFRS studies, of the 17, predicted one of the following 4 adverse outcomes: worse quality of life, worse functional outcomes, reoperation, or in-hospital mortality. CONCLUSION Despite its rapid acceptance and widespread proliferation through the leading neurosurgical journals, HFRS lacks any conceptual relationship to the frailty syndrome or FBNRA for individual patients. HFRS measures acute conditions using International Classification of Disease 10th Revision codes and awards "frailty" points for symptoms and examination findings unrelated to the impaired baseline physiological reserve inherent to the very definition of frailty. HFRS lacks clinical utility as it cannot be deployed point-of-care at the bedside to risk stratify patients. HFRS has never been validated in any patient population younger than 75 years or in any nonacute care setting. We recommend HFRS be discontinued as an individual FBNRA tool.
Collapse
Affiliation(s)
- Michael M Covell
- School of Medicine, Georgetown University, Washington , District of Columbia , USA
- Bowers Neurosurgical Frailty and Outcomes Data Science Lab, Albuquerque , New Mexico , USA
| | - Joanna Mary Roy
- Topiwala National Medical College, Mumbai , India
- Bowers Neurosurgical Frailty and Outcomes Data Science Lab, Albuquerque , New Mexico , USA
| | - Kavelin Rumalla
- Department of Neurosurgery, University of New Mexico Hospital, Albuquerque , New Mexico , USA
- Bowers Neurosurgical Frailty and Outcomes Data Science Lab, Albuquerque , New Mexico , USA
| | - Alis J Dicpinigaitis
- Department of Neurosurgery, Westchester Medical Center & New York Medical College, Valhalla , New York , USA
| | - Syed Faraz Kazim
- Department of Neurosurgery, University of New Mexico Hospital, Albuquerque , New Mexico , USA
- Bowers Neurosurgical Frailty and Outcomes Data Science Lab, Albuquerque , New Mexico , USA
| | - Daniel E Hall
- Department of Surgery, University of Pittsburgh, Pittsburgh , Pennsylvania , USA
- Center for Health Equity Research and Promotion, Virginia Pittsburgh Healthcare System, Pittsburgh , Pennsylvania , USA
- Wolff Center at UPMC, Pittsburgh , Pennsylvania , USA
| | - Meic H Schmidt
- Department of Neurosurgery, University of New Mexico Hospital, Albuquerque , New Mexico , USA
- Bowers Neurosurgical Frailty and Outcomes Data Science Lab, Albuquerque , New Mexico , USA
| | - Christian A Bowers
- Department of Neurosurgery, University of New Mexico Hospital, Albuquerque , New Mexico , USA
- Bowers Neurosurgical Frailty and Outcomes Data Science Lab, Albuquerque , New Mexico , USA
| |
Collapse
|
5
|
Estes E, Rumalla K, Schmidt MH, Bowers C. Correspondence on "Higher hospital frailty risk score is associated with increased complications and healthcare resource utilization after endovascular treatment of ruptured intracranial aneurysms" by Koo et al. J Neurointerv Surg 2023; 15:305-306. [PMID: 36150898 DOI: 10.1136/jnis-2022-019604] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2022] [Accepted: 09/18/2022] [Indexed: 11/03/2022]
Affiliation(s)
- Emily Estes
- Neurosurgery, TTUHSC El Paso Foster School of Medicine, El Paso, Texas, USA
| | - Kavelin Rumalla
- Neurosurgery, University of New Mexico Health Sciences Center, Albuquerque, New Mexico, USA
| | - Meic H Schmidt
- Neurosurgery, University of New Mexico Health Sciences Center, Albuquerque, New Mexico, USA
| | - Christian Bowers
- Neurosurgery, University of New Mexico Health Sciences Center, Albuquerque, New Mexico, USA
| |
Collapse
|
6
|
Koo AB, Elsamadicy AA, Matouk CC. In Reply to the Letter to Editor Regarding "Hospital Frailty Risk Score Predicts Adverse Events and Readmission Following Ventriculoperitoneal Shunt Surgery for Normal Pressure Hydrocephalus". World Neurosurg 2023; 169:124. [PMID: 36585096 DOI: 10.1016/j.wneu.2022.11.023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2022] [Accepted: 11/07/2022] [Indexed: 12/31/2022]
Affiliation(s)
- Andrew B Koo
- Department of Neurosurgery, Yale University School of Medicine, New Haven, Connecticut, USA
| | - Aladine A Elsamadicy
- Department of Neurosurgery, Yale University School of Medicine, New Haven, Connecticut, USA
| | - Charles C Matouk
- Department of Neurosurgery, Yale University School of Medicine, New Haven, Connecticut, USA.
| |
Collapse
|
7
|
Zohdy YM, Rumalla K, Schmidt MH, Bowers CA. Letter to Editor: Does the "Hospital Frailty Risk Score" Measure Frailty in Patients Undergoing Surgery for Primary Spinal Cord Tumors? Global Spine J 2023; 13:254-255. [PMID: 36154317 PMCID: PMC9837514 DOI: 10.1177/21925682221129559] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/17/2023] Open
Affiliation(s)
| | - Kavelin Rumalla
- Department of Neurosurgery, University of New Mexico Hospital
(UNMH), Albuquerque, NM, USA
| | - Meic H. Schmidt
- Department of Neurosurgery, University of New Mexico Hospital
(UNMH), Albuquerque, NM, USA
| | - Christian A. Bowers
- Department of Neurosurgery, University of New Mexico Hospital
(UNMH), Albuquerque, NM, USA,Christian A. Bowers, MD, Department of
Neurosurgery, University of New Mexico Health Sciences Center, 1 University New Mexico,
MSC10 5615, Albuquerque, NM 81731, USA.
| |
Collapse
|