1
|
Beers A, Nguyễn S, Starbird K, West JD, Spiro ES. Selective and deceptive citation in the construction of dueling consensuses. Sci Adv 2023; 9:eadh1933. [PMID: 37738338 PMCID: PMC10516490 DOI: 10.1126/sciadv.adh1933] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/01/2023] [Accepted: 08/18/2023] [Indexed: 09/24/2023]
Abstract
The COVID-19 pandemic provides a unique opportunity to study science communication and, in particular, the transmission of consensus. In this study, we show how "science communicators," writ large to include both mainstream science journalists and practiced conspiracy theorists, transform scientific evidence into two dueling consensuses using the effectiveness of masks as a case study. We do this by compiling one of the largest, hand-coded citation datasets of cross-medium science communication, derived from 5 million Twitter posts of people discussing masks. We find that science communicators selectively uplift certain published works while denigrating others to create bodies of evidence that support and oppose masks, respectively. Anti-mask communicators in particular often use selective and deceptive quotation of scientific work and criticize opposing science more than pro-mask communicators. Our findings have implications for scientists, science communicators, and scientific publishers, whose systems of sharing (and correcting) knowledge are highly vulnerable to what we term adversarial science communication.
Collapse
Affiliation(s)
- Andrew Beers
- Department of Human Centered Design and Engineering, University of Washington, WA 98195, USA
| | - Sarah Nguyễn
- Information School, University of Washington Seattle, WA 98195, USA
| | - Kate Starbird
- Department of Human Centered Design and Engineering, University of Washington, WA 98195, USA
| | - Jevin D. West
- Information School, University of Washington Seattle, WA 98195, USA
| | - Emma S. Spiro
- Information School, University of Washington Seattle, WA 98195, USA
| |
Collapse
|
2
|
Beers A, Schafer JS, Kennedy I, Wack M, Spiro ES, Starbird K. Followback Clusters, Satellite Audiences, and Bridge Nodes: Coengagement Networks for the 2020 US Election. Proc Int AAAI Conf Weblogs Soc Media 2023; 17:59-71. [PMID: 38655460 PMCID: PMC11037522 DOI: 10.1609/icwsm.v17i1.22126] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/26/2024]
Abstract
The 2020 United States (US) presidential election was - and has continued to be - the focus of pervasive and persistent mis- and disinformation spreading through our media ecosystems, including social media. This event has driven the collection and analysis of large, directed social network datasets, but such datasets can resist intuitive understanding. In such large datasets, the overwhelming number of nodes and edges present in typical representations create visual artifacts, such as densely overlapping edges and tightly-packed formations of low-degree nodes, which obscure many features of more practical interest. We apply a method, coengagement transformations, to convert such networks of social data into tractable images. Intuitively, this approach allows for parameterized network visualizations that make shared audiences of engaged viewers salient to viewers. Using the interpretative capabilities of this method, we perform an extensive case study of the 2020 United States presidential election on Twitter, contributing an empirical analysis of coengagement. By creating and contrasting different networks at different parameter sets, we define and characterize several structures in this discourse network, including bridging accounts, satellite audiences, and followback communities. We discuss the importance and implications of these empirical network features in this context. In addition, we release open-source code for creating coengagement networks from Twitter and other structured interaction data.
Collapse
Affiliation(s)
- Andrew Beers
- Department of Human Centered Design and Engineering. University of Washington, Seattle, WA
| | - Joseph S Schafer
- Department of Human Centered Design and Engineering. University of Washington, Seattle, WA
| | - Ian Kennedy
- Department of Sociology. University of Washington, Seattle, WA
| | - Morgan Wack
- Department of Political Science. University of Washington, Seattle, WA
| | - Emma S Spiro
- Information School. University of Washington, Seattle, WA
| | - Kate Starbird
- Department of Human Centered Design and Engineering. University of Washington, Seattle, WA
| |
Collapse
|
3
|
Bak-Coleman JB, Kennedy I, Wack M, Beers A, Schafer JS, Spiro ES, Starbird K, West JD. Combining interventions to reduce the spread of viral misinformation. Nat Hum Behav 2022; 6:1372-1380. [PMID: 35739250 PMCID: PMC9584817 DOI: 10.1038/s41562-022-01388-6] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2021] [Accepted: 05/13/2022] [Indexed: 01/22/2023]
Abstract
Misinformation online poses a range of threats, from subverting democratic processes to undermining public health measures. Proposed solutions range from encouraging more selective sharing by individuals to removing false content and accounts that create or promote it. Here we provide a framework to evaluate interventions aimed at reducing viral misinformation online both in isolation and when used in combination. We begin by deriving a generative model of viral misinformation spread, inspired by research on infectious disease. By applying this model to a large corpus (10.5 million tweets) of misinformation events that occurred during the 2020 US election, we reveal that commonly proposed interventions are unlikely to be effective in isolation. However, our framework demonstrates that a combined approach can achieve a substantial reduction in the prevalence of misinformation. Our results highlight a practical path forward as misinformation online continues to threaten vaccination efforts, equity and democratic processes around the globe.
Collapse
Affiliation(s)
- Joseph B Bak-Coleman
- Center for an Informed Public, University of Washington, Seattle, WA, USA.
- eScience Institute, University of Washington, Seattle, WA, USA.
- The Information School, University of Washington, Seattle, WA, USA.
| | - Ian Kennedy
- Center for an Informed Public, University of Washington, Seattle, WA, USA
- Department of Sociology, University of Washington, Seattle, WA, USA
| | - Morgan Wack
- Center for an Informed Public, University of Washington, Seattle, WA, USA
- Department of Political Science, University of Washington, Seattle, WA, USA
| | - Andrew Beers
- Center for an Informed Public, University of Washington, Seattle, WA, USA
- Paul G. Allen School of Computer Science and Engineering, University of Washington, Seattle, WA, USA
| | - Joseph S Schafer
- Center for an Informed Public, University of Washington, Seattle, WA, USA
- Paul G. Allen School of Computer Science and Engineering, University of Washington, Seattle, WA, USA
| | - Emma S Spiro
- Center for an Informed Public, University of Washington, Seattle, WA, USA
- The Information School, University of Washington, Seattle, WA, USA
- Department of Sociology, University of Washington, Seattle, WA, USA
| | - Kate Starbird
- Center for an Informed Public, University of Washington, Seattle, WA, USA
- Human Centered Design and Engineering, University of Washington, Seattle, WA, USA
| | - Jevin D West
- Center for an Informed Public, University of Washington, Seattle, WA, USA
- The Information School, University of Washington, Seattle, WA, USA
| |
Collapse
|
4
|
Balagurunathan Y, Beers A, McNitt-Gray M, Hadjiiski L, Napel S, Goldgof D, Perez G, Arbelaez P, Mehrtash A, Kapur T, Yang E, Moon JW, Bernardino G, Delgado-Gonzalo R, Farhangi MM, Amini AA, Ni R, Feng X, Bagari A, Vaidhya K, Veasey B, Safta W, Frigui H, Enguehard J, Gholipour A, Castillo LS, Daza LA, Pinsky P, Kalpathy-Cramer J, Farahani K. Lung Nodule Malignancy Prediction in Sequential CT Scans: Summary of ISBI 2018 Challenge. IEEE Trans Med Imaging 2021; 40:3748-3761. [PMID: 34264825 PMCID: PMC9531053 DOI: 10.1109/tmi.2021.3097665] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Lung cancer is by far the leading cause of cancer death in the US. Recent studies have demonstrated the effectiveness of screening using low dose CT (LDCT) in reducing lung cancer related mortality. While lung nodules are detected with a high rate of sensitivity, this exam has a low specificity rate and it is still difficult to separate benign and malignant lesions. The ISBI 2018 Lung Nodule Malignancy Prediction Challenge, developed by a team from the Quantitative Imaging Network of the National Cancer Institute, was focused on the prediction of lung nodule malignancy from two sequential LDCT screening exams using automated (non-manual) algorithms. We curated a cohort of 100 subjects who participated in the National Lung Screening Trial and had established pathological diagnoses. Data from 30 subjects were randomly selected for training and the remaining was used for testing. Participants were evaluated based on the area under the receiver operating characteristic curve (AUC) of nodule-wise malignancy scores generated by their algorithms on the test set. The challenge had 17 participants, with 11 teams submitting reports with method description, mandated by the challenge rules. Participants used quantitative methods, resulting in a reporting test AUC ranging from 0.698 to 0.913. The top five contestants used deep learning approaches, reporting an AUC between 0.87 - 0.91. The team's predictor did not achieve significant differences from each other nor from a volume change estimate (p =.05 with Bonferroni-Holm's correction).
Collapse
Affiliation(s)
| | | | | | | | - Sandy Napel
- Dept. of Radiology, School of Medicine, Stanford University (SU), CA
| | | | - Gustavo Perez
- Biomedical computer vision lab (BCV), Universidad de los Andes, Colombia
| | - Pablo Arbelaez
- Biomedical computer vision lab (BCV), Universidad de los Andes, Colombia
| | - Alireza Mehrtash
- Robotics and Control Laboratory (RCL), Department of Electrical and Computer Engineering, University of British Columbia, Vancouver, BC
- Surgical Planning Laboratory (SPL), Radiology Department, Brigham and Women’s Hospital, Boston, MA, 02130
| | - Tina Kapur
- Surgical Planning Laboratory (SPL), Radiology Department, Brigham and Women’s Hospital, Boston, MA, 02130
| | - Ehwa Yang
- Sungkyunkwan University School of Medicine, Seoul 06351, Korea
| | - Jung Won Moon
- Human Medical Imaging & Intervention Center, Seoul 06524, Korea
| | - Gabriel Bernardino
- Centre Suisse d’Électronique et de Microtechnique, Neuchâtel, Switzerland
| | | | - M. Mehdi Farhangi
- Medical Imaging Laboratory, University of Louisville, Louisville, KY. USA
- Computer Engineering and Computer Science, University of Louisville
| | - Amir A. Amini
- Medical Imaging Laboratory, University of Louisville, Louisville, KY. USA
- Electrical and Computer Engineering Department, University of Louisville, Louisville, KY. USA
| | | | - Xue Feng
- Spingbok Inc
- Department of Biomedical Engineering, University of Virginia, Charlottesville
| | | | | | - Benjamin Veasey
- Medical Imaging Laboratory, University of Louisville, Louisville, KY. USA
- Electrical and Computer Engineering Department, University of Louisville, Louisville, KY. USA
| | - Wiem Safta
- Computer Engineering and Computer Science, University of Louisville
| | - Hichem Frigui
- Computer Engineering and Computer Science, University of Louisville
| | - Joseph Enguehard
- Department of Radiology, Boston Children’s Hospital, and Harvard Medical School
| | - Ali Gholipour
- Department of Radiology, Boston Children’s Hospital, and Harvard Medical School
| | | | - Laura Alexandra Daza
- Department of Biomedical Engineering, Universidad de los Andes, Bogota, Colombia
| | - Paul Pinsky
- Divsion of Cancer Prevention, National Cancer Institute (NCI), Washington DC
| | | | - Keyvan Farahani
- Center for Biomedical Informatics and Information Technology, National Cancer Institute (NCI), Washington DC
| |
Collapse
|
5
|
Fedorov A, Beichel R, Kalpathy-Cramer J, Clunie D, Onken M, Riesmeier J, Herz C, Bauer C, Beers A, Fillion-Robin JC, Lasso A, Pinter C, Pieper S, Nolden M, Maier-Hein K, Herrmann MD, Saltz J, Prior F, Fennessy F, Buatti J, Kikinis R. Quantitative Imaging Informatics for Cancer Research. JCO Clin Cancer Inform 2021; 4:444-453. [PMID: 32392097 PMCID: PMC7265794 DOI: 10.1200/cci.19.00165] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/06/2023] Open
Abstract
PURPOSE We summarize Quantitative Imaging Informatics for Cancer Research (QIICR; U24 CA180918), one of the first projects funded by the National Cancer Institute (NCI) Informatics Technology for Cancer Research program. METHODS QIICR was motivated by the 3 use cases from the NCI Quantitative Imaging Network. 3D Slicer was selected as the platform for implementation of open-source quantitative imaging (QI) tools. Digital Imaging and Communications in Medicine (DICOM) was chosen for standardization of QI analysis outputs. Support of improved integration with community repositories focused on The Cancer Imaging Archive (TCIA). Priorities included improved capabilities of the standard, toolkits and tools, reference datasets, collaborations, and training and outreach. RESULTS Fourteen new tools to support head and neck cancer, glioblastoma, and prostate cancer QI research were introduced and downloaded over 100,000 times. DICOM was amended, with over 40 correction proposals addressing QI needs. Reference implementations of the standard in a popular toolkit and standalone tools were introduced. Eight datasets exemplifying the application of the standard and tools were contributed. An open demonstration/connectathon was organized, attracting the participation of academic groups and commercial vendors. Integration of tools with TCIA was improved by implementing programmatic communication interface and by refining best practices for QI analysis results curation. CONCLUSION Tools, capabilities of the DICOM standard, and datasets we introduced found adoption and utility within the cancer imaging community. A collaborative approach is critical to addressing challenges in imaging informatics at the national and international levels. Numerous challenges remain in establishing and maintaining the infrastructure of analysis tools and standardized datasets for the imaging community. Ideas and technology developed by the QIICR project are contributing to the NCI Imaging Data Commons currently being developed.
Collapse
Affiliation(s)
- Andrey Fedorov
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA
| | | | | | | | | | | | - Christian Herz
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA
| | | | | | | | | | | | | | - Marco Nolden
- German Cancer Research Center, Heidelberg, Germany
| | | | - Markus D Herrmann
- Department of Pathology, Massachusetts General Hospital, Harvard Medical School, Boston, MA
| | | | - Fred Prior
- University of Arkansas for Medical Sciences, Little Rock, AR
| | - Fiona Fennessy
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA
| | | | - Ron Kikinis
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA
| |
Collapse
|
6
|
Beers A, Brown J, Chang K, Hoebel K, Patel J, Ly KI, Tolaney SM, Brastianos P, Rosen B, Gerstner ER, Kalpathy-Cramer J. DeepNeuro: an open-source deep learning toolbox for neuroimaging. Neuroinformatics 2021; 19:127-140. [PMID: 32578020 DOI: 10.1007/s12021-020-09477-5] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/16/2023]
Abstract
Translating deep learning research from theory into clinical practice has unique challenges, specifically in the field of neuroimaging. In this paper, we present DeepNeuro, a Python-based deep learning framework that puts deep neural networks for neuroimaging into practical usage with a minimum of friction during implementation. We show how this framework can be used to design deep learning pipelines that can load and preprocess data, design and train various neural network architectures, and evaluate and visualize the results of trained networks on evaluation data. We present a way of reproducibly packaging data pre- and postprocessing functions common in the neuroimaging community, which facilitates consistent performance of networks across variable users, institutions, and scanners. We show how deep learning pipelines created with DeepNeuro can be concisely packaged into shareable Docker and Singularity containers with user-friendly command-line interfaces.
Collapse
Affiliation(s)
- Andrew Beers
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA, USA
| | - James Brown
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA, USA
| | - Ken Chang
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA, USA
| | - Katharina Hoebel
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA, USA
| | - Jay Patel
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA, USA
| | - K Ina Ly
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA, USA.,Division of Neuro-Oncology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Sara M Tolaney
- Department of Medical Oncology, Dana-Farber Cancer Institute, Boston, MA, USA
| | - Priscilla Brastianos
- Division of Neuro-Oncology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Bruce Rosen
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA, USA
| | - Elizabeth R Gerstner
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA, USA.,Division of Neuro-Oncology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Jayashree Kalpathy-Cramer
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA, USA.
| |
Collapse
|
7
|
Kim A, Cardona J, Chang K, Beers A, Brown J, Emblem K, Kalpathy-Cramer J, Lee E, Lin N, Tolaney S, Nayak L, Chukwueke U, Oh K, Shih H, White M, Lawrence D, Moy B, Cohen J, Giobbie-Hurder A, Cahill D, Sullivan R, Brastianos P, Gerstner E. NIMG-05. ADVANCED IMAGING TO ASSESS LONGITUDINAL VASCULAR CHANGES IN BRAIN METASTASES TREATED WITH CHECKPOINT INHIBITION. Neuro Oncol 2020. [DOI: 10.1093/neuonc/noaa215.618] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
Abstract
Immune checkpoint inhibitors (ICI) have recently been shown to be effective for brain metastases (BM) in melanoma and lung cancer. However, accurately assessing intracranial response in patients undergoing ICI is a challenge, as current measures cannot reliably distinguish pseudoprogression from true tumor progression. To identify potential biomarkers of response, we analyzed standard post-contrast and dynamic susceptibility contrast MRI to identify characteristic vascular signatures as part of an ongoing Phase 2 study of pembrolizumab for patients with untreated or progressive, previously treated BM from any histology. Tumor volume measurements were calculated by summating all enhancing voxels. A volumetric increase of >40% was categorized as progressive disease (PD), a decrease of >60% as partial response (PR), and stable disease (SD) as between -60% and +40%. 78 patients have been enrolled, of whom 44 have received at least baseline advanced MR imaging. Histologies include 21 with breast cancer, 5 with non-small cell lung cancer, 4 with melanoma, and 13 with other cancers. At baseline, the total number of BM was 1-50+ per patient. Based on summing the entire enhancing intracranial disease burden, best volumetric responses for the 33 evaluable patients include 4 PR, 10 SD, and 19 PD. On preliminary analysis, there was a correlation between increased tumor cerebral blood volume/flow with tumor progression. Correlation of additional vascular physiologic parameters (e.g. vessel caliber, tissue oxygenation) to volumetric response, patient outcome, and standardized response criteria (iRANO) are ongoing. Our data provides potential evidence that effective ICI is associated with a decrease in perfusion. Ongoing analyses to uncover additional vascular changes – specifically longitudinal metrics reflecting vascular structure and function - within BM to ICI are pending. These findings have potential to explore mechanisms of ICI response and resistance, as well as biomarkers of response.
Collapse
Affiliation(s)
- Albert Kim
- Massachusetts General Hospital, Boston, MA, USA
| | | | - Ken Chang
- Massachusetts General Hospital, Boston, MA, USA
| | | | - James Brown
- Massachusetts General Hospital, Boston, MA, USA
| | | | | | - Eudocia Lee
- Dana Farber Cancer Institute, Boston, MA, USA
| | - Nancy Lin
- Dana Farber Cancer Institute, Boston, MA, USA
| | | | | | | | - Kevin Oh
- Massachusetts General Hospital, Boston, MA, USA
| | - Helen Shih
- Massachusetts General Hospital, Boston, MA, USA
| | | | | | - Beverly Moy
- Massachusetts General Hospital, Boston, MA, USA
| | | | | | - Daniel Cahill
- Department of Neurosurgery, Translational Neuro-Oncology Laboratory, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | | | | | | |
Collapse
|
8
|
Kim AE, Chang K, Beers A, Emblem KE, Kalpathy-Cramer J, Lee EQ, Lin NU, Nayak L, Chukwueke UN, Oh KS, Shih HA, White M, Lawrence DP, Moy B, Cohen JV, Giobbie-Hurder A, Cahill DP, Sullivan RJ, Brastianos PK, Gerstner ER. Advanced imaging to assess longitudinal vascular changes in brain metastases treated with immune checkpoint inhibition. J Clin Oncol 2020. [DOI: 10.1200/jco.2020.38.15_suppl.2529] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Abstract
2529 Background: Immune checkpoint inhibitors (ICI) have recently been shown to be effective for brain metastases (BM) for melanoma and lung cancer. This breakthrough has prompted interest in evaluating ICI in BM of other histologies. However, accurately assessing intracranial response in patients undergoing ICI is a challenge, as current measures cannot distinguish pseudoprogression from true tumor progression. To shed light on potential biomarkers of response, we prospectively use perfusion MRI to identify characteristic vascular signatures in a BM-specific trial of ICI. Methods: As part of an ongoing phase II study of pembrolizumab for patients with untreated or progressive, previously treated BM from any histology, patients underwent advanced MRI that includes tumor volume measurements and perfusion imaging with dynamic susceptibility contrast MRI. To calculate volumetric radiographic response, all enhancing voxels were summated. A volumetric increase of >40% was categorized as progressive disease (PD), a decrease of >60% as partial response (PR), and stable disease (SD) as between -60% and +40%. Results: 53 patients have been enrolled, of whom 44 have received at least baseline advanced MR imaging. Histologies include 21 with breast cancer, 5 with non-small cell lung cancer, 4 with melanoma, and 13 with other cancers. At baseline, the total number of BM was 1-50+ per patient. Based on summing the entire enhancing intracranial disease burden, best volumetric responses for the 33 evaluable patients include 4 PR, 10 SD, and 19 PD. On preliminary analysis, there was a correlation between increased tumor cerebral blood volume/flow with tumor progression. Correlation of additional vascular physiologic parameters (e.g. vessel caliber, tissue oxygenation) and volumetric response to patient outcome and standardized response criteria (iRANO) are ongoing. Conclusions: Pembrolizumab likely has anti-tumor efficacy in BM. Our data provides potential evidence that effective ICI is associated with a decrease in perfusion. Ongoing analyses to uncover additional vascular changes – specifically longitudinal metrics reflecting vascular structure and function - within BM to ICI are pending. These findings have potential to illustrate mechanisms of efficacy for ICI and biomarkers of response in this patient population.
Collapse
Affiliation(s)
| | | | | | | | | | | | | | | | | | | | | | | | | | - Beverly Moy
- Massachusetts General Hospital Cancer Center, Boston, MA
| | | | | | | | | | | | | |
Collapse
|
9
|
Ly I, Cardona J, Lou K, Beers A, Chang K, Brown J, Reardon DA, Arrillaga-Romany I, Forst DA, Jordan JT, Lee EQ, Dietrich J, Nayak L, Wen PY, Chukwueke UN, Batchelor T, Curry WT, Kalpathy-Cramer J, Gerstner ER. MRI changes in patients with newly diagnosed glioblastoma treated as part of a phase II trial with bavituximab, radiation, and temozolomide. J Clin Oncol 2020. [DOI: 10.1200/jco.2020.38.15_suppl.2546] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Abstract
2546 Background: Glioblastoma and tumor endothelial cells express phosphatidylserine (PS), a highly immunosuppressive membrane phospholipid. Bavituximab – a chimeric monoclonal antibody – binds to β2-glycoprotein 1 (β2-GP1) to form a complex of β2-GP1 with PS, resulting in immune activation against tumor cells and anti-angiogenic effects. Phase I/II trials in other solid cancers demonstrated response rates up to 75% when bavituximab was given with cytotoxic chemotherapy. Pre-clinical data in glioblastoma models suggested synergistic effects of PS blockade, radiation, and temozolomide. Methods: 33 adult patients with IDH-wild-type, MGMT-methylated or -unmethylated newly diagnosed glioblastoma were enrolled in this phase II trial (NCT03139916) and received 6 weeks of chemoradiation, followed by 6 cycles of adjuvant temozolomide (C1-C6 aTMZ). Bavituximab (3 mg/kg) was given weekly, starting week 1 of chemoradiation, for 18 weeks with the option to continue if tolerated. Physiologic MRIs were performed pre-treatment, pre-C1, pre-C3, and pre-C5 aTMZ. Within the enhancing tumor region, median tumor Ktrans (reflecting vascular permeability) and relative cerebral blood flow (rCBF) were measured. Median percent changes during treatment were compared to pre-treatment values. Results: Median progression-free survival (mPFS) was 8 months. Based on a median overall survival (mOS) of 17.1 months, patients were categorized into above-median survivors (AMS) and below-median survivors (BMS). All patients had pre-treatment scans. 31 had evaluable pre-C1, 25 had pre-C3, and 7 had pre-C5 scans. Compared to BMS, AMS had a greater reuction in enhancing tumor volume and rCBF, and a greater increase in Ktrans during treatment (table). One patient remains on study; 23 patients have died. Bavituximab was well tolerated. Conclusions: mPFS and mOS in patients treated with bavituximab, radiation and temozolomide were comparable to standard chemoradiation and aTMZ. Lower rCBF in AMS may reflect decreased tumor perfusion while higher Ktrans could imply enhanced drug delivery to the tumor. Bavituximab induces changes in tumor vasculature that may improve survival in a subset of patients. Clinical trial information: NCT03139916 . [Table: see text]
Collapse
Affiliation(s)
- Ina Ly
- Massachusetts General Hospital, Boston, MA
| | - Jonathan Cardona
- Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, MA
| | - Kevin Lou
- Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, MA
| | | | - Ken Chang
- Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, MA
| | - James Brown
- Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, MA
| | - David A. Reardon
- Dana-Farber Cancer Institute and Harvard Medical School, Boston, MA
| | | | | | | | | | | | | | - Patrick Y. Wen
- Dana-Farber/Brigham and Women's Cancer Center, Harvard Medical School, Boston, MA
| | | | | | | | | | | |
Collapse
|
10
|
Chang K, Balachandar N, Lam C, Yi D, Brown J, Beers A, Rosen B, Rubin DL, Kalpathy-Cramer J. Distributed deep learning networks among institutions for medical imaging. J Am Med Inform Assoc 2019; 25:945-954. [PMID: 29617797 PMCID: PMC6077811 DOI: 10.1093/jamia/ocy017] [Citation(s) in RCA: 134] [Impact Index Per Article: 26.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2017] [Accepted: 02/15/2018] [Indexed: 11/13/2022] Open
Abstract
Objective Deep learning has become a promising approach for automated support for clinical diagnosis. When medical data samples are limited, collaboration among multiple institutions is necessary to achieve high algorithm performance. However, sharing patient data often has limitations due to technical, legal, or ethical concerns. In this study, we propose methods of distributing deep learning models as an attractive alternative to sharing patient data. Methods We simulate the distribution of deep learning models across 4 institutions using various training heuristics and compare the results with a deep learning model trained on centrally hosted patient data. The training heuristics investigated include ensembling single institution models, single weight transfer, and cyclical weight transfer. We evaluated these approaches for image classification in 3 independent image collections (retinal fundus photos, mammography, and ImageNet). Results We find that cyclical weight transfer resulted in a performance that was comparable to that of centrally hosted patient data. We also found that there is an improvement in the performance of cyclical weight transfer heuristic with a high frequency of weight transfer. Conclusions We show that distributing deep learning models is an effective alternative to sharing patient data. This finding has implications for any collaborative deep learning study.
Collapse
Affiliation(s)
- Ken Chang
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Charlestown, MA, 02129, USA
| | - Niranjan Balachandar
- Department of Radiology and Biomedical Data Science, Stanford University, Palo Alto, CA, 94305, USA
| | - Carson Lam
- Department of Radiology and Biomedical Data Science, Stanford University, Palo Alto, CA, 94305, USA
| | - Darvin Yi
- Department of Radiology and Biomedical Data Science, Stanford University, Palo Alto, CA, 94305, USA
| | - James Brown
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Charlestown, MA, 02129, USA
| | - Andrew Beers
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Charlestown, MA, 02129, USA
| | - Bruce Rosen
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Charlestown, MA, 02129, USA
| | - Daniel L Rubin
- Department of Radiology and Biomedical Data Science, Stanford University, Palo Alto, CA, 94305, USA
| | - Jayashree Kalpathy-Cramer
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Charlestown, MA, 02129, USA.,MGH and BWH Center for Clinical Data Science, Massachusetts General Hospital, Boston, MA, 02114, USA
| |
Collapse
|
11
|
Patel J, Beers A, Chang K, Brown J, Hoebel K, Rosen B, Huang R, Brastianos P, Gerstner E, Kalpathy-Cramer J. NIMG-43. LONGITUDINAL TRACKING AND GROWTH RATE CHARACTERIZATION OF BRAIN METASTASES ON MAGNETIC RESONANCE IMAGING. Neuro Oncol 2019. [DOI: 10.1093/neuonc/noz175.713] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
Abstract
PURPOSE
Measuring treatment response is vital for assessing efficacy of treatment regimen for patients with brain metastases (BM). Unfortunately, manual delineation of all lesions on MRI across time-points is prohibitively time-consuming, making it infeasible to track individual lesion growth/shrinkage rates as part of the clinical workflow. To overcome this challenge, we propose a deep learning approach to segment all BM, and furthermore, show that certain brain regions are more prone to high-growth rate lesions.
METHODS
163 longitudinal MRIs from 77 patients with MPRAGE-post contrast imaging protocol were prospectively obtained from Massachusetts General Hospital (MGH). An expert neuro-oncologist provided ground truth segmentations for all patients. A 3D U-Net architecture was trained to automatically segment BM; training was stopped when validation set Dice score plateaued to prevent overfitting. To enable lesion tracking, all time-points per patient were affinely registered to each other. Every lesion was subsequently classified based on its growth rate (responder: overall lesion shrinkage; inconclusive: 0% to 40% lesion growth; non-responder: more than 40% lesion growth). Characterization of global lesion growth rate patterns was accomplished by affinely registering all time-points to the MNI brain atlas. Segmented lesions were projected onto the atlas, which was qualitatively analyzed to identify spatial regions composed primarily of one class of lesion.
RESULTS
For automatic segmentation, we report a mean dice score of 0.778, 0.737, and 0.704 on training, validation, and testing sets respectively. Furthermore, we find that the largest BM with the highest average growth rate (non-responders) tend to be located in the posterior frontal/parietal lobes, while smaller, lower growth rate lesions (responders) tend to be localized in the frontal lobes. The posterior fossa was found to be heterogeneous in lesion size and growth rate.
CONCLUSION
We developed automatic metastatic lesion tracking over time-points and identified brain regions associated with differing growth rate lesions.
Collapse
Affiliation(s)
- Jay Patel
- Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, MA, USA
| | - Andrew Beers
- Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, MA, USA
| | - Ken Chang
- Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, MA, USA
| | - James Brown
- Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, MA, USA
| | - Katharina Hoebel
- Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, MA, USA
| | - Bruce Rosen
- Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, MA, USA
| | | | | | | | | |
Collapse
|
12
|
Chang K, Brown J, Beers A, Rosen B, Kalpathy-Cramer J, Ay H. Abstract WMP17: Fully-Automated Ischemic Brain Infarct Volumetric Segmentation in Diffusion Weighted MR using Deep Learning. Stroke 2019. [DOI: 10.1161/str.50.suppl_1.wmp17] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Introduction:
Brain imaging is a key step in the clinical evaluation of ischemic stroke, with Diffusion Weighted Magnetic Resonance (DWI) being a key imaging modality, as it allows for assessment of extent of acute ischemic brain injury. Manual delineation of stroke regions is expensive, time-consuming, and subject to inter-rater variability. In this study, we develop a deep learning approach for ischemic stroke volumetric segmentation in a large clinical dataset of 1,239 patients from the NIH-funded Heart-Brain Interactions in Human Acute Ischemic Stroke Study utilizing only DWI imaging.
Hypothesis:
Deep learning can be used to automatically calculate stroke volumes in high agreement with manual human expert segmentations.
Methods:
The patients were randomly divided into Training (n = 743), Validation (n=248), and Testing (n=248). We implemented the 3D U-Net neural network architecture. Additionally, we modified the 3D U-Net by incorporating incorporate state-of-the-art components that have improved neural network architectures for classification tasks, namely residual connections, inception modules, dense connections, and squeeze-and-excitation modules.
Results:
The best performing individual model was the Inception U-Net, which had a median dice similarity coefficient of 0.720 (0.011-0.920) within the Testing Set. In comparing manually and automatically derived infarct volumes, the Intraclass Correlation Coefficient was 0.974 (p<.0001) in the Testing Set.
Conclusions:
Our fully-automatic pipeline for stroke segmentation demonstrates the potential for deep learning-based tools to automate ischemic stroke volumetrics.
Collapse
|
13
|
Chang K, Brown J, Beers A, Kalpathy-Cramer J, Ay H. Abstract 162: Viscerotoxic Brain Infarcts: The Results of Heart-Brain Interactions Study. Stroke 2019. [DOI: 10.1161/str.50.suppl_1.162] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Introduction:
Acute brain infarcts can provoke functional and morphologic changes in internal organs in the absence of primary visceral causes. We tested the hypothesis that infarcts in certain regions of the brain were much more likely to be associated with internal organ injury (IOI) than other regions using a method that was free from the bias of a-priori hypothesis as to any specific location.
Methods:
We generated neuroanatomic maps of brain infarcts for plasma troponin T elevation (structural cardiac marker), QTc prolongation on ECG (electrophysiological cardiac marker), pneumonia and urinary tract infection (marker for altered immune/pulmonary/urinary physiology), acute stress hyperglycemia (hepatic marker of glycogenolysis) in 1208 consecutive patients who were prospectively recruited into the NIH-funded HBI study. We utilized Threshold-Free Cluster Enhancement to examine the relationship between infarct location and IOI. We generated voxel-wise p-value maps using a permutation-based approach and identified clusters of contiguous voxels associated with IOI with a p-value <0.05.
Results:
We identified significant clusters of voxels for each form of IOI. The clusters for troponin elevation and QTc prolongation encompassed similar regions in the right insular cortex. The cluster for acute stress hyperglycemia involved the left insula. We found two large clusters for post-stroke infection, one for pneumonia in the left and one for urinary tract infection in the right hemisphere, both encompassing the insular cortex. The relationship between infarct location and IOI persisted after adjusting for infarct volume, vascular risk factors, and stroke etiology.
Conclusion:
Our results uncover the neuroanatomical substrate of post-stroke IOI. Localizing discrete regions of brain infarcts associated with IOI could be used to bootstrap towards new markers for better differentiation between neurogenic and non-neurogenic mechanisms of post-stroke IOI.
Collapse
|
14
|
Ly I, Cardona J, Beers A, Chang K, Brown J, Reardon D, Arrillaga-Romany I, Dietrich J, Forst D, Lee E, Jordan J, Nayak L, Wen P, Batchelor T, Kalpathy-Cramer J, Gerstner E. NIMG-68. MRI CHANGES IN NEWLY DIAGNOSED GLIOBLASTOMA PATIENTS TREATED AS PART OF A PHASE II TRIAL WITH BAVITUXIMAB, RADIATION, AND TEMOZOLOMIDE. Neuro Oncol 2018. [DOI: 10.1093/neuonc/noy148.792] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Affiliation(s)
- Ina Ly
- Massachusetts General Hospital, Boston, MA, USA
| | - Jonathan Cardona
- Massachusetts General Hospital, Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, MA, USA
| | - Andrew Beers
- Massachusetts General Hospital, Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, MA, USA
| | - Ken Chang
- Massachusetts General Hospital, Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, MA, USA
| | - James Brown
- Massachusetts General Hospital, Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, MA, USA
| | | | | | | | | | - Eudocia Lee
- Dana-Farber Cancer Institute, Boston, MA, USA
| | - Justin Jordan
- Massachusetts General Hospital, Department of Neurology, Boston, MA, USA
| | | | - Patrick Wen
- Dana-Farber Cancer Institute, Harvard Medical School, Boston, MA, USA
| | - Tracy Batchelor
- Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | | | | |
Collapse
|
15
|
Gerstner E, Cardona J, Chang K, Beers A, Brown J, Kalpathy-Cramer J, Lee E, Lin N, Tolaney S, Nayak L, Chukwueke U, Oh K, Shih H, White M, Lawrence D, Moy B, Cohen J, Giobbie-Hurder A, Cahill D, Sullivan R, Brastianos P. NIMG-63. ADVANCED IMAGING FOR ASSESSING VOLUMETRIC RESPONSES IN BRAIN METASTASES TREATED WITH CHECKPOINT BLOCKADE. Neuro Oncol 2018. [DOI: 10.1093/neuonc/noy148.787] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022] Open
Affiliation(s)
| | - Jonathan Cardona
- Massachusetts General Hospital, Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, MA, USA
| | - Ken Chang
- Massachusetts General Hospital, Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, MA, USA
| | - Andrew Beers
- Massachusetts General Hospital, Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, MA, USA
| | - James Brown
- Massachusetts General Hospital, Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, MA, USA
| | | | - Eudocia Lee
- Dana-Farber Cancer Institute, Boston, MA, USA
| | - Nancy Lin
- Dana-Farber Cancer Institute, Boston, MA, USA
| | | | | | | | - Kevin Oh
- Massachusetts General Hospital, Boston, MA, USA
| | - Helen Shih
- Department of Radiation Oncology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | | | | | - Beverly Moy
- Massachusetts General Hospital, Boston, MA, USA
| | | | | | - Daniel Cahill
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | | | - Priscilla Brastianos
- Divisions of Neuro-Oncology and Hematology/Oncology, Departments of Medicine and Neurology, Massachusetts General Hospital Cancer Center, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
16
|
Brown JM, Campbell JP, Beers A, Chang K, Ostmo S, Chan RVP, Dy J, Erdogmus D, Ioannidis S, Kalpathy-Cramer J, Chiang MF. Automated Diagnosis of Plus Disease in Retinopathy of Prematurity Using Deep Convolutional Neural Networks. JAMA Ophthalmol 2018; 136:803-810. [PMID: 29801159 PMCID: PMC6136045 DOI: 10.1001/jamaophthalmol.2018.1934] [Citation(s) in RCA: 318] [Impact Index Per Article: 53.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2018] [Accepted: 04/10/2018] [Indexed: 12/21/2022]
Abstract
Importance Retinopathy of prematurity (ROP) is a leading cause of childhood blindness worldwide. The decision to treat is primarily based on the presence of plus disease, defined as dilation and tortuosity of retinal vessels. However, clinical diagnosis of plus disease is highly subjective and variable. Objective To implement and validate an algorithm based on deep learning to automatically diagnose plus disease from retinal photographs. Design, Setting, and Participants A deep convolutional neural network was trained using a data set of 5511 retinal photographs. Each image was previously assigned a reference standard diagnosis (RSD) based on consensus of image grading by 3 experts and clinical diagnosis by 1 expert (ie, normal, pre-plus disease, or plus disease). The algorithm was evaluated by 5-fold cross-validation and tested on an independent set of 100 images. Images were collected from 8 academic institutions participating in the Imaging and Informatics in ROP (i-ROP) cohort study. The deep learning algorithm was tested against 8 ROP experts, each of whom had more than 10 years of clinical experience and more than 5 peer-reviewed publications about ROP. Data were collected from July 2011 to December 2016. Data were analyzed from December 2016 to September 2017. Exposures A deep learning algorithm trained on retinal photographs. Main Outcomes and Measures Receiver operating characteristic analysis was performed to evaluate performance of the algorithm against the RSD. Quadratic-weighted κ coefficients were calculated for ternary classification (ie, normal, pre-plus disease, and plus disease) to measure agreement with the RSD and 8 independent experts. Results Of the 5511 included retinal photographs, 4535 (82.3%) were graded as normal, 805 (14.6%) as pre-plus disease, and 172 (3.1%) as plus disease, based on the RSD. Mean (SD) area under the receiver operating characteristic curve statistics were 0.94 (0.01) for the diagnosis of normal (vs pre-plus disease or plus disease) and 0.98 (0.01) for the diagnosis of plus disease (vs normal or pre-plus disease). For diagnosis of plus disease in an independent test set of 100 retinal images, the algorithm achieved a sensitivity of 93% with 94% specificity. For detection of pre-plus disease or worse, the sensitivity and specificity were 100% and 94%, respectively. On the same test set, the algorithm achieved a quadratic-weighted κ coefficient of 0.92 compared with the RSD, outperforming 6 of 8 ROP experts. Conclusions and Relevance This fully automated algorithm diagnosed plus disease in ROP with comparable or better accuracy than human experts. This has potential applications in disease detection, monitoring, and prognosis in infants at risk of ROP.
Collapse
Affiliation(s)
- James M. Brown
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Charlestown
| | - J. Peter Campbell
- Department of Ophthalmology, Casey Eye Institute, Oregon Health and Science University, Portland
| | - Andrew Beers
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Charlestown
| | - Ken Chang
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Charlestown
| | - Susan Ostmo
- Department of Ophthalmology, Casey Eye Institute, Oregon Health and Science University, Portland
| | - R. V. Paul Chan
- Department of Ophthalmology and Visual Sciences, Illinois Eye and Ear Infirmary, University of Illinois at Chicago
| | - Jennifer Dy
- Department of Electrical and Computer Engineering, Northeastern University, Boston, Massachusetts
| | - Deniz Erdogmus
- Department of Electrical and Computer Engineering, Northeastern University, Boston, Massachusetts
| | - Stratis Ioannidis
- Department of Electrical and Computer Engineering, Northeastern University, Boston, Massachusetts
| | - Jayashree Kalpathy-Cramer
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Charlestown
- Massachusetts General Hospital and Brigham and Women’s Hospital Center for Clinical Data Science, Boston
| | - Michael F. Chiang
- Department of Ophthalmology, Casey Eye Institute, Oregon Health and Science University, Portland
- Department of Medical Informatics and Clinical Epidemiology, Oregon Health and Science University, Portland
| |
Collapse
|
17
|
Balagurunathan Y, Beers A, Kalpathy-Cramer J, McNitt-Gray M, Hadjiiski L, Zhao B, Zhu J, Yang H, Yip SSF, Aerts HJWL, Napel S, Cherezov D, Cha K, Chan HP, Flores C, Garcia A, Gillies R, Goldgof D. Erratum: Semi-automated pulmonary nodule interval segmentation using the NLST data. Med Phys 2018; 45:2689-2690. [PMID: 29894564 DOI: 10.1002/mp.12905] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2018] [Accepted: 01/04/2018] [Indexed: 11/08/2022] Open
Affiliation(s)
| | - Andrew Beers
- Massachusetts General Hospital (MGH), Boston, MA, USA
| | | | | | | | | | - Jianguo Zhu
- Columbia University (CUMU), New York, NY, USA
| | - Hao Yang
- Columbia University (CUMU), New York, NY, USA
| | - Stephen S F Yip
- Radiation Oncology, Dana-Farber Cancer Institute (DFCC), Brigham and Women's Hospital (BWH), Harvard Medical School (HMC), Boston, MA, USA.,Radiology, Dana-Farber Cancer Institute (DFCC), Brigham and Women's Hospital (BWH), Harvard Medical School (HMC), Boston, MA, USA
| | - Hugo J W L Aerts
- Radiation Oncology, Dana-Farber Cancer Institute (DFCC), Brigham and Women's Hospital (BWH), Harvard Medical School (HMC), Boston, MA, USA.,Radiology, Dana-Farber Cancer Institute (DFCC), Brigham and Women's Hospital (BWH), Harvard Medical School (HMC), Boston, MA, USA
| | | | - Dmitrii Cherezov
- H.L.Moffitt Cancer Center (MCC), Tampa, FL, USA.,University of South Florida (USF), Tampa, FL, USA
| | - Kenny Cha
- University of Michigan (UMICH), Ann Arbor, MI, USA
| | | | - Carlos Flores
- University of California Los Angeles (UCLA), Los Angeles, CA, USA
| | | | | | - Dmitry Goldgof
- H.L.Moffitt Cancer Center (MCC), Tampa, FL, USA.,University of South Florida (USF), Tampa, FL, USA
| |
Collapse
|
18
|
Balagurunathan Y, Beers A, Kalpathy-Cramer J, McNitt-Gray M, Hadjiiski L, Zhao B, Zhu J, Yang H, Yip SSF, Aerts HJWL, Napel S, Cherezov D, Cha K, Chan HP, Flores C, Garcia A, Gillies R, Goldgof D. Semi-automated pulmonary nodule interval segmentation using the NLST data. Med Phys 2018; 45:1093-1107. [PMID: 29363773 DOI: 10.1002/mp.12766] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2017] [Revised: 01/04/2018] [Accepted: 01/04/2018] [Indexed: 01/26/2023] Open
Abstract
PURPOSE To study the variability in volume change estimates of pulmonary nodules due to segmentation approaches used across several algorithms and to evaluate these effects on the ability to predict nodule malignancy. METHODS We obtained 100 patient image datasets from the National Lung Screening Trial (NLST) that had a nodule detected on each of two consecutive low dose computed tomography (LDCT) scans, with an equal proportion of malignant and benign cases (50 malignant, 50 benign). Information about the nodule location for the cases was provided by a screen capture with a bounding box and its axial location was indicated. Five participating quantitative imaging network (QIN) institutions performed nodule segmentation using their preferred semi-automated algorithms with no manual correction; teams were allowed to provide additional manually corrected segmentations (analyzed separately). The teams were asked to provide segmentation masks for each nodule at both time points. From these masks, the volume was estimated for the nodule at each time point; the change in volume (absolute and percent change) across time points was estimated as well. We used the concordance correlation coefficient (CCC) to compare the similarity of computed nodule volumes (absolute and percent change) across algorithms. We used Logistic regression model on the change in volume (absolute change and percent change) of the nodules to predict the malignancy status, the area under the receiver operating characteristic curve (AUROC) and confidence intervals were reported. Because the size of nodules was expected to have a substantial effect on segmentation variability, analysis of change in volumes was stratified by lesion size, where lesions were grouped into those with a longest diameter of <8 mm and those with longest diameter ≥ 8 mm. RESULTS We find that segmentation of the nodules shows substantial variability across algorithms, with the CCC ranging from 0.56 to 0.95 for change in volume (percent change in volume range was [0.15 to 0.86]) across the nodules. When examining nodules based on their longest diameter, we find the CCC had higher values for large nodules with a range of [0.54 to 0.93] among the algorithms, while percent change in volume was [0.3 to 0.95]. Compared to that of smaller nodules which had a range of [-0.0038 to 0.69] and percent change in volume was [-0.039 to 0.92]. The malignancy prediction results showed fairly consistent results across the institutions, the AUC using change in volume ranged from 0.65 to 0.89 (Percent change in volume was 0.64 to 0.86) for entire nodule range. Prediction improves for large nodule range (≥ 8 mm) with AUC range 0.75 to 0.90 (percent change in volume was 0.74 to 0.92). Compared to smaller nodule range (<8 mm) with AUC range 0.57 to 0.78 (percent change in volume was 0.59 to 0.77). CONCLUSIONS We find there is a fairly high concordance in the size measurements for larger nodules (≥8 mm) than the lower sizes (<8 mm) across algorithms. We find the change in nodule volume (absolute and percent change) were consistent predictors of malignancy across institutions, despite using different segmentation algorithms. Using volume change estimates without corrections shows slightly lower predictability (for two teams).
Collapse
Affiliation(s)
| | - Andrew Beers
- Massachusetts General Hospital (MGH), Boston, MA, USA
| | | | | | | | | | | | - Hao Yang
- Columbia University (CUMU), New York, NY, USA
| | - Stephen S F Yip
- Radiation Oncology, Dana-Farber Cancer Institute (DFCC), Brigham and Women's Hospital (BWH) and Harvard Medical School (HMC), Boston, MA, USA.,Radiology, Dana-Farber Cancer Institute (DFCC) Brigham and Women's Hospital (BWH) and Harvard Medical School (HMC), Boston, MA, USA
| | - Hugo J W L Aerts
- Radiation Oncology, Dana-Farber Cancer Institute (DFCC), Brigham and Women's Hospital (BWH) and Harvard Medical School (HMC), Boston, MA, USA.,Radiology, Dana-Farber Cancer Institute (DFCC) Brigham and Women's Hospital (BWH) and Harvard Medical School (HMC), Boston, MA, USA
| | | | - Dmitrii Cherezov
- H.L.Moffitt Cancer Center (MCC), Tampa, FL, USA.,University of South Florida (USF), Tampa, FL, USA
| | - Kenny Cha
- University of Michigan (UMICH), Ann Arbor, MI, USA
| | | | - Carlos Flores
- University of California Los Angeles (UCLA), Los Angeles, CA, USA
| | | | | | - Dmitry Goldgof
- H.L.Moffitt Cancer Center (MCC), Tampa, FL, USA.,University of South Florida (USF), Tampa, FL, USA
| |
Collapse
|
19
|
Chang K, Bai HX, Zhou H, Su C, Bi WL, Agbodza E, Kavouridis VK, Senders JT, Boaro A, Beers A, Zhang B, Capellini A, Liao W, Shen Q, Li X, Xiao B, Cryan J, Ramkissoon S, Ramkissoon L, Ligon K, Wen PY, Bindra RS, Woo J, Arnaout O, Gerstner ER, Zhang PJ, Rosen BR, Yang L, Huang RY, Kalpathy-Cramer J. Residual Convolutional Neural Network for the Determination of IDH Status in Low- and High-Grade Gliomas from MR Imaging. Clin Cancer Res 2017; 24:1073-1081. [PMID: 29167275 DOI: 10.1158/1078-0432.ccr-17-2236] [Citation(s) in RCA: 224] [Impact Index Per Article: 32.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2017] [Revised: 10/12/2017] [Accepted: 11/16/2017] [Indexed: 01/23/2023]
Abstract
Purpose: Isocitrate dehydrogenase (IDH) mutations in glioma patients confer longer survival and may guide treatment decision making. We aimed to predict the IDH status of gliomas from MR imaging by applying a residual convolutional neural network to preoperative radiographic data.Experimental Design: Preoperative imaging was acquired for 201 patients from the Hospital of University of Pennsylvania (HUP), 157 patients from Brigham and Women's Hospital (BWH), and 138 patients from The Cancer Imaging Archive (TCIA) and divided into training, validation, and testing sets. We trained a residual convolutional neural network for each MR sequence (FLAIR, T2, T1 precontrast, and T1 postcontrast) and built a predictive model from the outputs. To increase the size of the training set and prevent overfitting, we augmented the training set images by introducing random rotations, translations, flips, shearing, and zooming.Results: With our neural network model, we achieved IDH prediction accuracies of 82.8% (AUC = 0.90), 83.0% (AUC = 0.93), and 85.7% (AUC = 0.94) within training, validation, and testing sets, respectively. When age at diagnosis was incorporated into the model, the training, validation, and testing accuracies increased to 87.3% (AUC = 0.93), 87.6% (AUC = 0.95), and 89.1% (AUC = 0.95), respectively.Conclusions: We developed a deep learning technique to noninvasively predict IDH genotype in grade II-IV glioma using conventional MR imaging using a multi-institutional data set. Clin Cancer Res; 24(5); 1073-81. ©2017 AACR.
Collapse
Affiliation(s)
- Ken Chang
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Boston, Massachusetts
| | - Harrison X Bai
- Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pennsylvania
| | - Hao Zhou
- Department of Neurology, Xiangya Hospital, Central South University, Changsha, Hunan, China
| | - Chang Su
- Department of Therapeutic Radiology, Yale School of Medicine, New Haven, Connecticut
| | - Wenya Linda Bi
- Department of Neurosurgery, Brigham and Women's Hospital, Boston, Massachusetts
| | - Ena Agbodza
- Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pennsylvania
| | - Vasileios K Kavouridis
- Department of Neurosurgery, Computational Neuroscience Outcomes Center, Brigham and Women's Hospital, Boston, Massachusetts
| | - Joeky T Senders
- Department of Neurosurgery, Computational Neuroscience Outcomes Center, Brigham and Women's Hospital, Boston, Massachusetts
| | - Alessandro Boaro
- Department of Neurosurgery, Computational Neuroscience Outcomes Center, Brigham and Women's Hospital, Boston, Massachusetts
| | - Andrew Beers
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Boston, Massachusetts
| | - Biqi Zhang
- Department of Radiology, Brigham and Women's Hospital, Boston, Massachusetts
| | - Alexandra Capellini
- Department of Radiology, Brigham and Women's Hospital, Boston, Massachusetts
| | - Weihua Liao
- Department of Radiology, Xiangya Hospital, Central South University, Changsha, Hunan, China
| | - Qin Shen
- Department of Radiology, The Second Xiangya Hospital, Central South University, Changsha, Hunan, China
| | - Xuejun Li
- Department of Neurosurgery, Xiangya Hospital, Central South University, Changsha, Hunan China
| | - Bo Xiao
- Department of Neurology, Xiangya Hospital, Central South University, Changsha, Hunan, China
| | - Jane Cryan
- Department of Pathology, Brigham and Women's Hospital, Boston, Massachusetts
| | - Shakti Ramkissoon
- Department of Pathology, Brigham and Women's Hospital, Boston, Massachusetts
| | - Lori Ramkissoon
- Department of Pathology, Brigham and Women's Hospital, Boston, Massachusetts
| | - Keith Ligon
- Department of Pathology, Brigham and Women's Hospital, Boston, Massachusetts
| | - Patrick Y Wen
- Department of Medical Oncology, Dana-Farber Cancer Institute, Harvard Medical School, Boston, Massachusetts
| | - Ranjit S Bindra
- Department of Therapeutic Radiology, Yale School of Medicine, New Haven, Connecticut
| | - John Woo
- Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pennsylvania
| | - Omar Arnaout
- Department of Neurosurgery, Computational Neuroscience Outcomes Center, Brigham and Women's Hospital, Boston, Massachusetts
| | | | - Paul J Zhang
- Department of Pathology and Laboratory Medicine, Hospital of the University of Pennsylvania, Philadelphia, Pennsylvania
| | - Bruce R Rosen
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Boston, Massachusetts
| | - Li Yang
- Department of Neurology, The Second Xiangya Hospital, Central South University, Changsha, Hunan, China.
| | - Raymond Y Huang
- Department of Radiology, Brigham and Women's Hospital, Boston, Massachusetts.
| | - Jayashree Kalpathy-Cramer
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Boston, Massachusetts.
| |
Collapse
|
20
|
Chandra V, Salcedo S, Yen YF, Cardona J, Beers A, Catana C, Kalpathy-Cramer J, Curry WT, Gerstner E. NIMG-85. PBR28 PET-MRI IN GBM PATIENTS TREATED WITH IMMUNOTHERAPY OR SUSPECTED PSUEDOPROGRESSION. Neuro Oncol 2017. [DOI: 10.1093/neuonc/nox168.655] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022] Open
|
21
|
Beers A, Slugocki M, Lewis T, Sekuler A, Bennett P. Characterizing perceptual alternations during binocular rivalry in children. J Vis 2014. [DOI: 10.1167/14.15.47] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
|
22
|
Phillips F, Norman JF, Holmin J, Beers A, Boswell A, Norman H. Visual and Haptic Perception of 3D Shape. J Vis 2012. [DOI: 10.1167/12.9.1317] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
|
23
|
Norman JF, Holmin J, Beers A, Frost A. Aging and Stereoscopic Shape Discrimination. J Vis 2011. [DOI: 10.1167/11.11.466] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
|
24
|
Beers A, Norman JF, Swindle J, Boswell A. Large Amounts of Optical Blur Greatly Reduce Visual Acuity but Have Minimal Impacts upon 3-D Shape Discrimination. J Vis 2010. [DOI: 10.1167/10.7.72] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
|
25
|
Beers A. Optimization of zeolite Beta by steaming and acid leaching for the acylation of anisole with octanoic acid: a structure–activity relation. J Catal 2003. [DOI: 10.1016/s0021-9517(03)00022-8] [Citation(s) in RCA: 73] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
|
26
|
Baumrind S, Carlson S, Beers A, Curry S, Norris K, Boyd RL. Using three-dimensional imaging to assess treatment outcomes in orthodontics: a progress report from the University of the Pacific. Orthod Craniofac Res 2003; 6 Suppl 1:132-42. [PMID: 14606546 DOI: 10.1034/j.1600-0544.2003.246.x] [Citation(s) in RCA: 42] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
Past research in integrated three-dimensional (3D) craniofacial mapping at the Craniofacial Research Instrumentation Laboratory (CRIL) of the University of the Pacific is summarized in narrative form. The advantages and limitations of recent commercial developments in the application of cone beam geometry volumetric X-ray scanners in dentistry and surface digital mapping of study casts are discussed. The rationale for methods currently in development at CRIL for merging longitudinal information from existing 3D study casts and two-dimensional lateral X-ray cephalograms in studies of orthodontic treatment outcome is presented.
Collapse
Affiliation(s)
- S Baumrind
- Craniofacial Research Instrumentation Laboratory, University of the Pacific School of Dentistry, San Francisco, CA 94115, USA
| | | | | | | | | | | |
Collapse
|
27
|
Curry S, Baumrind S, Carlson S, Beers A, Boyd R. Integrated three-dimensional ciraniofacial mapping at the Craniofacial Research Instrumentation Laboratory/University of the Pacific. Semin Orthod 2001. [DOI: 10.1053/sodo.2001.25422] [Citation(s) in RCA: 19] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
|
28
|
Stock MD, Beers A, Smith GD. PReDS: a graphics program to aid in the solution of difficult structures. J Mol Graph 1995; 13:309-11, 303-4. [PMID: 8603059 DOI: 10.1016/0263-7855(95)00069-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/31/2023]
Affiliation(s)
- M D Stock
- Molecular Biophysics Department, Hauptman-Woodward Medical Research Institute, Inc, Buffalo, New York 14203, USA
| | | | | |
Collapse
|
29
|
Pimentel D, Allen J, Beers A, Guinand L, Linder R, McLaughlin P, Meer B, Musonda D, Perdue D, Poisson S, Siebert S, Stoner K, Salazar R, Hawkins A. World Agriculture and Soil Erosion. Bioscience 1987. [DOI: 10.2307/1310591] [Citation(s) in RCA: 124] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022] Open
|