7
|
Blain M, Kassin MT, Varble N, Wang X, Xu Z, Xu D, Carrafiello G, Vespro V, Stellato E, Ierardi AM, Di Meglio L, Suh RD, Walker SA, Xu S, Sanford TH, Turkbey EB, Harmon S, Turkbey B, Wood BJ. Determination of disease severity in COVID-19 patients using deep learning in chest X-ray images. Diagn Interv Radiol 2021; 27:20-27. [PMID: 32815519 PMCID: PMC7837735 DOI: 10.5152/dir.2020.20205] [Citation(s) in RCA: 36] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2020] [Revised: 05/19/2020] [Accepted: 05/29/2020] [Indexed: 12/11/2022]
Abstract
PURPOSE Chest X-ray plays a key role in diagnosis and management of COVID-19 patients and imaging features associated with clinical elements may assist with the development or validation of automated image analysis tools. We aimed to identify associations between clinical and radiographic features as well as to assess the feasibility of deep learning applied to chest X-rays in the setting of an acute COVID-19 outbreak. METHODS A retrospective study of X-rays, clinical, and laboratory data was performed from 48 SARS-CoV-2 RT-PCR positive patients (age 60±17 years, 15 women) between February 22 and March 6, 2020 from a tertiary care hospital in Milan, Italy. Sixty-five chest X-rays were reviewed by two radiologists for alveolar and interstitial opacities and classified by severity on a scale from 0 to 3. Clinical factors (age, symptoms, comorbidities) were investigated for association with opacity severity and also with placement of central line or endotracheal tube. Deep learning models were then trained for two tasks: lung segmentation and opacity detection. Imaging characteristics were compared to clinical datapoints using the unpaired student's t-test or Mann-Whitney U test. Cohen's kappa analysis was used to evaluate the concordance of deep learning to conventional radiologist interpretation. RESULTS Fifty-six percent of patients presented with alveolar opacities, 73% had interstitial opacities, and 23% had normal X-rays. The presence of alveolar or interstitial opacities was statistically correlated with age (P = 0.008) and comorbidities (P = 0.005). The extent of alveolar or interstitial opacities on baseline X-ray was significantly associated with the presence of endotracheal tube (P = 0.0008 and P = 0.049) or central line (P = 0.003 and P = 0.007). In comparison to human interpretation, the deep learning model achieved a kappa concordance of 0.51 for alveolar opacities and 0.71 for interstitial opacities. CONCLUSION Chest X-ray analysis in an acute COVID-19 outbreak showed that the severity of opacities was associated with advanced age, comorbidities, as well as acuity of care. Artificial intelligence tools based upon deep learning of COVID-19 chest X-rays are feasible in the acute outbreak setting.
Collapse
Affiliation(s)
| | | | | | - Xiaosong Wang
- From the Center for Interventional Oncology (M.B., M.K., S.X., T.S., B.J.W. ), National Institutes of Health Clinical Center and National Cancer Institute, Bethesda, Maryland, USA; Philips Research North America (N.V.), Cambridge, Massachusetts, USA; NVIDIA Corporation (Z.X., D.X., X.W.), Bethesda, Maryland, USA; Department of Radiology (G.C., V.V., E.S., A.M.I., L.D.M.), Fondazione IRCCS Cà Granda Ospedale Maggiore Policlinico, University of Milan, Italy; Department of Radiology (R.D.S., B.J.W.), University of California Los Angeles, Los Angeles, California, USA; Molecular Imaging Program (B.T.), National Cancer Institute (S.W., T.S., S.H., B.J.W.), National Institutes of Health, Bethesda, Maryland, USA; State University of New York Upstate Medical University (T.S.), Syracuse, Newyork, USA; Department of Radiology and Imaging Sciences (E.T., B.T., B.J.W.), National Institutes of Health, Bethesda, Mayland, USA; Clinical Research Directorate (S.H.), Frederick National Laboratory for Cancer Research, Frederick, Maryland, USA; National Institute of Biomedical Imaging and Bioengineering (B.J.W.), Bethesda, Maryland, USA
| | - Ziyue Xu
- From the Center for Interventional Oncology (M.B., M.K., S.X., T.S., B.J.W. ), National Institutes of Health Clinical Center and National Cancer Institute, Bethesda, Maryland, USA; Philips Research North America (N.V.), Cambridge, Massachusetts, USA; NVIDIA Corporation (Z.X., D.X., X.W.), Bethesda, Maryland, USA; Department of Radiology (G.C., V.V., E.S., A.M.I., L.D.M.), Fondazione IRCCS Cà Granda Ospedale Maggiore Policlinico, University of Milan, Italy; Department of Radiology (R.D.S., B.J.W.), University of California Los Angeles, Los Angeles, California, USA; Molecular Imaging Program (B.T.), National Cancer Institute (S.W., T.S., S.H., B.J.W.), National Institutes of Health, Bethesda, Maryland, USA; State University of New York Upstate Medical University (T.S.), Syracuse, Newyork, USA; Department of Radiology and Imaging Sciences (E.T., B.T., B.J.W.), National Institutes of Health, Bethesda, Mayland, USA; Clinical Research Directorate (S.H.), Frederick National Laboratory for Cancer Research, Frederick, Maryland, USA; National Institute of Biomedical Imaging and Bioengineering (B.J.W.), Bethesda, Maryland, USA
| | - Daguang Xu
- From the Center for Interventional Oncology (M.B., M.K., S.X., T.S., B.J.W. ), National Institutes of Health Clinical Center and National Cancer Institute, Bethesda, Maryland, USA; Philips Research North America (N.V.), Cambridge, Massachusetts, USA; NVIDIA Corporation (Z.X., D.X., X.W.), Bethesda, Maryland, USA; Department of Radiology (G.C., V.V., E.S., A.M.I., L.D.M.), Fondazione IRCCS Cà Granda Ospedale Maggiore Policlinico, University of Milan, Italy; Department of Radiology (R.D.S., B.J.W.), University of California Los Angeles, Los Angeles, California, USA; Molecular Imaging Program (B.T.), National Cancer Institute (S.W., T.S., S.H., B.J.W.), National Institutes of Health, Bethesda, Maryland, USA; State University of New York Upstate Medical University (T.S.), Syracuse, Newyork, USA; Department of Radiology and Imaging Sciences (E.T., B.T., B.J.W.), National Institutes of Health, Bethesda, Mayland, USA; Clinical Research Directorate (S.H.), Frederick National Laboratory for Cancer Research, Frederick, Maryland, USA; National Institute of Biomedical Imaging and Bioengineering (B.J.W.), Bethesda, Maryland, USA
| | - Gianpaolo Carrafiello
- From the Center for Interventional Oncology (M.B., M.K., S.X., T.S., B.J.W. ), National Institutes of Health Clinical Center and National Cancer Institute, Bethesda, Maryland, USA; Philips Research North America (N.V.), Cambridge, Massachusetts, USA; NVIDIA Corporation (Z.X., D.X., X.W.), Bethesda, Maryland, USA; Department of Radiology (G.C., V.V., E.S., A.M.I., L.D.M.), Fondazione IRCCS Cà Granda Ospedale Maggiore Policlinico, University of Milan, Italy; Department of Radiology (R.D.S., B.J.W.), University of California Los Angeles, Los Angeles, California, USA; Molecular Imaging Program (B.T.), National Cancer Institute (S.W., T.S., S.H., B.J.W.), National Institutes of Health, Bethesda, Maryland, USA; State University of New York Upstate Medical University (T.S.), Syracuse, Newyork, USA; Department of Radiology and Imaging Sciences (E.T., B.T., B.J.W.), National Institutes of Health, Bethesda, Mayland, USA; Clinical Research Directorate (S.H.), Frederick National Laboratory for Cancer Research, Frederick, Maryland, USA; National Institute of Biomedical Imaging and Bioengineering (B.J.W.), Bethesda, Maryland, USA
| | - Valentina Vespro
- From the Center for Interventional Oncology (M.B., M.K., S.X., T.S., B.J.W. ), National Institutes of Health Clinical Center and National Cancer Institute, Bethesda, Maryland, USA; Philips Research North America (N.V.), Cambridge, Massachusetts, USA; NVIDIA Corporation (Z.X., D.X., X.W.), Bethesda, Maryland, USA; Department of Radiology (G.C., V.V., E.S., A.M.I., L.D.M.), Fondazione IRCCS Cà Granda Ospedale Maggiore Policlinico, University of Milan, Italy; Department of Radiology (R.D.S., B.J.W.), University of California Los Angeles, Los Angeles, California, USA; Molecular Imaging Program (B.T.), National Cancer Institute (S.W., T.S., S.H., B.J.W.), National Institutes of Health, Bethesda, Maryland, USA; State University of New York Upstate Medical University (T.S.), Syracuse, Newyork, USA; Department of Radiology and Imaging Sciences (E.T., B.T., B.J.W.), National Institutes of Health, Bethesda, Mayland, USA; Clinical Research Directorate (S.H.), Frederick National Laboratory for Cancer Research, Frederick, Maryland, USA; National Institute of Biomedical Imaging and Bioengineering (B.J.W.), Bethesda, Maryland, USA
| | - Elvira Stellato
- From the Center for Interventional Oncology (M.B., M.K., S.X., T.S., B.J.W. ), National Institutes of Health Clinical Center and National Cancer Institute, Bethesda, Maryland, USA; Philips Research North America (N.V.), Cambridge, Massachusetts, USA; NVIDIA Corporation (Z.X., D.X., X.W.), Bethesda, Maryland, USA; Department of Radiology (G.C., V.V., E.S., A.M.I., L.D.M.), Fondazione IRCCS Cà Granda Ospedale Maggiore Policlinico, University of Milan, Italy; Department of Radiology (R.D.S., B.J.W.), University of California Los Angeles, Los Angeles, California, USA; Molecular Imaging Program (B.T.), National Cancer Institute (S.W., T.S., S.H., B.J.W.), National Institutes of Health, Bethesda, Maryland, USA; State University of New York Upstate Medical University (T.S.), Syracuse, Newyork, USA; Department of Radiology and Imaging Sciences (E.T., B.T., B.J.W.), National Institutes of Health, Bethesda, Mayland, USA; Clinical Research Directorate (S.H.), Frederick National Laboratory for Cancer Research, Frederick, Maryland, USA; National Institute of Biomedical Imaging and Bioengineering (B.J.W.), Bethesda, Maryland, USA
| | - Anna Maria Ierardi
- From the Center for Interventional Oncology (M.B., M.K., S.X., T.S., B.J.W. ), National Institutes of Health Clinical Center and National Cancer Institute, Bethesda, Maryland, USA; Philips Research North America (N.V.), Cambridge, Massachusetts, USA; NVIDIA Corporation (Z.X., D.X., X.W.), Bethesda, Maryland, USA; Department of Radiology (G.C., V.V., E.S., A.M.I., L.D.M.), Fondazione IRCCS Cà Granda Ospedale Maggiore Policlinico, University of Milan, Italy; Department of Radiology (R.D.S., B.J.W.), University of California Los Angeles, Los Angeles, California, USA; Molecular Imaging Program (B.T.), National Cancer Institute (S.W., T.S., S.H., B.J.W.), National Institutes of Health, Bethesda, Maryland, USA; State University of New York Upstate Medical University (T.S.), Syracuse, Newyork, USA; Department of Radiology and Imaging Sciences (E.T., B.T., B.J.W.), National Institutes of Health, Bethesda, Mayland, USA; Clinical Research Directorate (S.H.), Frederick National Laboratory for Cancer Research, Frederick, Maryland, USA; National Institute of Biomedical Imaging and Bioengineering (B.J.W.), Bethesda, Maryland, USA
| | - Letizia Di Meglio
- From the Center for Interventional Oncology (M.B., M.K., S.X., T.S., B.J.W. ), National Institutes of Health Clinical Center and National Cancer Institute, Bethesda, Maryland, USA; Philips Research North America (N.V.), Cambridge, Massachusetts, USA; NVIDIA Corporation (Z.X., D.X., X.W.), Bethesda, Maryland, USA; Department of Radiology (G.C., V.V., E.S., A.M.I., L.D.M.), Fondazione IRCCS Cà Granda Ospedale Maggiore Policlinico, University of Milan, Italy; Department of Radiology (R.D.S., B.J.W.), University of California Los Angeles, Los Angeles, California, USA; Molecular Imaging Program (B.T.), National Cancer Institute (S.W., T.S., S.H., B.J.W.), National Institutes of Health, Bethesda, Maryland, USA; State University of New York Upstate Medical University (T.S.), Syracuse, Newyork, USA; Department of Radiology and Imaging Sciences (E.T., B.T., B.J.W.), National Institutes of Health, Bethesda, Mayland, USA; Clinical Research Directorate (S.H.), Frederick National Laboratory for Cancer Research, Frederick, Maryland, USA; National Institute of Biomedical Imaging and Bioengineering (B.J.W.), Bethesda, Maryland, USA
| | - Robert D. Suh
- From the Center for Interventional Oncology (M.B., M.K., S.X., T.S., B.J.W. ), National Institutes of Health Clinical Center and National Cancer Institute, Bethesda, Maryland, USA; Philips Research North America (N.V.), Cambridge, Massachusetts, USA; NVIDIA Corporation (Z.X., D.X., X.W.), Bethesda, Maryland, USA; Department of Radiology (G.C., V.V., E.S., A.M.I., L.D.M.), Fondazione IRCCS Cà Granda Ospedale Maggiore Policlinico, University of Milan, Italy; Department of Radiology (R.D.S., B.J.W.), University of California Los Angeles, Los Angeles, California, USA; Molecular Imaging Program (B.T.), National Cancer Institute (S.W., T.S., S.H., B.J.W.), National Institutes of Health, Bethesda, Maryland, USA; State University of New York Upstate Medical University (T.S.), Syracuse, Newyork, USA; Department of Radiology and Imaging Sciences (E.T., B.T., B.J.W.), National Institutes of Health, Bethesda, Mayland, USA; Clinical Research Directorate (S.H.), Frederick National Laboratory for Cancer Research, Frederick, Maryland, USA; National Institute of Biomedical Imaging and Bioengineering (B.J.W.), Bethesda, Maryland, USA
| | - Stephanie A. Walker
- From the Center for Interventional Oncology (M.B., M.K., S.X., T.S., B.J.W. ), National Institutes of Health Clinical Center and National Cancer Institute, Bethesda, Maryland, USA; Philips Research North America (N.V.), Cambridge, Massachusetts, USA; NVIDIA Corporation (Z.X., D.X., X.W.), Bethesda, Maryland, USA; Department of Radiology (G.C., V.V., E.S., A.M.I., L.D.M.), Fondazione IRCCS Cà Granda Ospedale Maggiore Policlinico, University of Milan, Italy; Department of Radiology (R.D.S., B.J.W.), University of California Los Angeles, Los Angeles, California, USA; Molecular Imaging Program (B.T.), National Cancer Institute (S.W., T.S., S.H., B.J.W.), National Institutes of Health, Bethesda, Maryland, USA; State University of New York Upstate Medical University (T.S.), Syracuse, Newyork, USA; Department of Radiology and Imaging Sciences (E.T., B.T., B.J.W.), National Institutes of Health, Bethesda, Mayland, USA; Clinical Research Directorate (S.H.), Frederick National Laboratory for Cancer Research, Frederick, Maryland, USA; National Institute of Biomedical Imaging and Bioengineering (B.J.W.), Bethesda, Maryland, USA
| | - Sheng Xu
- From the Center for Interventional Oncology (M.B., M.K., S.X., T.S., B.J.W. ), National Institutes of Health Clinical Center and National Cancer Institute, Bethesda, Maryland, USA; Philips Research North America (N.V.), Cambridge, Massachusetts, USA; NVIDIA Corporation (Z.X., D.X., X.W.), Bethesda, Maryland, USA; Department of Radiology (G.C., V.V., E.S., A.M.I., L.D.M.), Fondazione IRCCS Cà Granda Ospedale Maggiore Policlinico, University of Milan, Italy; Department of Radiology (R.D.S., B.J.W.), University of California Los Angeles, Los Angeles, California, USA; Molecular Imaging Program (B.T.), National Cancer Institute (S.W., T.S., S.H., B.J.W.), National Institutes of Health, Bethesda, Maryland, USA; State University of New York Upstate Medical University (T.S.), Syracuse, Newyork, USA; Department of Radiology and Imaging Sciences (E.T., B.T., B.J.W.), National Institutes of Health, Bethesda, Mayland, USA; Clinical Research Directorate (S.H.), Frederick National Laboratory for Cancer Research, Frederick, Maryland, USA; National Institute of Biomedical Imaging and Bioengineering (B.J.W.), Bethesda, Maryland, USA
| | - Thomas H. Sanford
- From the Center for Interventional Oncology (M.B., M.K., S.X., T.S., B.J.W. ), National Institutes of Health Clinical Center and National Cancer Institute, Bethesda, Maryland, USA; Philips Research North America (N.V.), Cambridge, Massachusetts, USA; NVIDIA Corporation (Z.X., D.X., X.W.), Bethesda, Maryland, USA; Department of Radiology (G.C., V.V., E.S., A.M.I., L.D.M.), Fondazione IRCCS Cà Granda Ospedale Maggiore Policlinico, University of Milan, Italy; Department of Radiology (R.D.S., B.J.W.), University of California Los Angeles, Los Angeles, California, USA; Molecular Imaging Program (B.T.), National Cancer Institute (S.W., T.S., S.H., B.J.W.), National Institutes of Health, Bethesda, Maryland, USA; State University of New York Upstate Medical University (T.S.), Syracuse, Newyork, USA; Department of Radiology and Imaging Sciences (E.T., B.T., B.J.W.), National Institutes of Health, Bethesda, Mayland, USA; Clinical Research Directorate (S.H.), Frederick National Laboratory for Cancer Research, Frederick, Maryland, USA; National Institute of Biomedical Imaging and Bioengineering (B.J.W.), Bethesda, Maryland, USA
| | - Evrim B. Turkbey
- From the Center for Interventional Oncology (M.B., M.K., S.X., T.S., B.J.W. ), National Institutes of Health Clinical Center and National Cancer Institute, Bethesda, Maryland, USA; Philips Research North America (N.V.), Cambridge, Massachusetts, USA; NVIDIA Corporation (Z.X., D.X., X.W.), Bethesda, Maryland, USA; Department of Radiology (G.C., V.V., E.S., A.M.I., L.D.M.), Fondazione IRCCS Cà Granda Ospedale Maggiore Policlinico, University of Milan, Italy; Department of Radiology (R.D.S., B.J.W.), University of California Los Angeles, Los Angeles, California, USA; Molecular Imaging Program (B.T.), National Cancer Institute (S.W., T.S., S.H., B.J.W.), National Institutes of Health, Bethesda, Maryland, USA; State University of New York Upstate Medical University (T.S.), Syracuse, Newyork, USA; Department of Radiology and Imaging Sciences (E.T., B.T., B.J.W.), National Institutes of Health, Bethesda, Mayland, USA; Clinical Research Directorate (S.H.), Frederick National Laboratory for Cancer Research, Frederick, Maryland, USA; National Institute of Biomedical Imaging and Bioengineering (B.J.W.), Bethesda, Maryland, USA
| | - Stephanie Harmon
- From the Center for Interventional Oncology (M.B., M.K., S.X., T.S., B.J.W. ), National Institutes of Health Clinical Center and National Cancer Institute, Bethesda, Maryland, USA; Philips Research North America (N.V.), Cambridge, Massachusetts, USA; NVIDIA Corporation (Z.X., D.X., X.W.), Bethesda, Maryland, USA; Department of Radiology (G.C., V.V., E.S., A.M.I., L.D.M.), Fondazione IRCCS Cà Granda Ospedale Maggiore Policlinico, University of Milan, Italy; Department of Radiology (R.D.S., B.J.W.), University of California Los Angeles, Los Angeles, California, USA; Molecular Imaging Program (B.T.), National Cancer Institute (S.W., T.S., S.H., B.J.W.), National Institutes of Health, Bethesda, Maryland, USA; State University of New York Upstate Medical University (T.S.), Syracuse, Newyork, USA; Department of Radiology and Imaging Sciences (E.T., B.T., B.J.W.), National Institutes of Health, Bethesda, Mayland, USA; Clinical Research Directorate (S.H.), Frederick National Laboratory for Cancer Research, Frederick, Maryland, USA; National Institute of Biomedical Imaging and Bioengineering (B.J.W.), Bethesda, Maryland, USA
| | - Baris Turkbey
- From the Center for Interventional Oncology (M.B., M.K., S.X., T.S., B.J.W. ), National Institutes of Health Clinical Center and National Cancer Institute, Bethesda, Maryland, USA; Philips Research North America (N.V.), Cambridge, Massachusetts, USA; NVIDIA Corporation (Z.X., D.X., X.W.), Bethesda, Maryland, USA; Department of Radiology (G.C., V.V., E.S., A.M.I., L.D.M.), Fondazione IRCCS Cà Granda Ospedale Maggiore Policlinico, University of Milan, Italy; Department of Radiology (R.D.S., B.J.W.), University of California Los Angeles, Los Angeles, California, USA; Molecular Imaging Program (B.T.), National Cancer Institute (S.W., T.S., S.H., B.J.W.), National Institutes of Health, Bethesda, Maryland, USA; State University of New York Upstate Medical University (T.S.), Syracuse, Newyork, USA; Department of Radiology and Imaging Sciences (E.T., B.T., B.J.W.), National Institutes of Health, Bethesda, Mayland, USA; Clinical Research Directorate (S.H.), Frederick National Laboratory for Cancer Research, Frederick, Maryland, USA; National Institute of Biomedical Imaging and Bioengineering (B.J.W.), Bethesda, Maryland, USA
| | - Bradford J. Wood
- From the Center for Interventional Oncology (M.B., M.K., S.X., T.S., B.J.W. ), National Institutes of Health Clinical Center and National Cancer Institute, Bethesda, Maryland, USA; Philips Research North America (N.V.), Cambridge, Massachusetts, USA; NVIDIA Corporation (Z.X., D.X., X.W.), Bethesda, Maryland, USA; Department of Radiology (G.C., V.V., E.S., A.M.I., L.D.M.), Fondazione IRCCS Cà Granda Ospedale Maggiore Policlinico, University of Milan, Italy; Department of Radiology (R.D.S., B.J.W.), University of California Los Angeles, Los Angeles, California, USA; Molecular Imaging Program (B.T.), National Cancer Institute (S.W., T.S., S.H., B.J.W.), National Institutes of Health, Bethesda, Maryland, USA; State University of New York Upstate Medical University (T.S.), Syracuse, Newyork, USA; Department of Radiology and Imaging Sciences (E.T., B.T., B.J.W.), National Institutes of Health, Bethesda, Mayland, USA; Clinical Research Directorate (S.H.), Frederick National Laboratory for Cancer Research, Frederick, Maryland, USA; National Institute of Biomedical Imaging and Bioengineering (B.J.W.), Bethesda, Maryland, USA
| |
Collapse
|
8
|
Harmon SA, Sanford TH, Xu S, Turkbey EB, Roth H, Xu Z, Yang D, Myronenko A, Anderson V, Amalou A, Blain M, Kassin M, Long D, Varble N, Walker SM, Bagci U, Ierardi AM, Stellato E, Plensich GG, Franceschelli G, Girlando C, Irmici G, Labella D, Hammoud D, Malayeri A, Jones E, Summers RM, Choyke PL, Xu D, Flores M, Tamura K, Obinata H, Mori H, Patella F, Cariati M, Carrafiello G, An P, Wood BJ, Turkbey B. Artificial intelligence for the detection of COVID-19 pneumonia on chest CT using multinational datasets. Nat Commun 2020; 11:4080. [PMID: 32796848 PMCID: PMC7429815 DOI: 10.1038/s41467-020-17971-2] [Citation(s) in RCA: 254] [Impact Index Per Article: 63.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2020] [Accepted: 07/13/2020] [Indexed: 02/06/2023] Open
Abstract
Chest CT is emerging as a valuable diagnostic tool for clinical management of COVID-19 associated lung disease. Artificial intelligence (AI) has the potential to aid in rapid evaluation of CT scans for differentiation of COVID-19 findings from other clinical entities. Here we show that a series of deep learning algorithms, trained in a diverse multinational cohort of 1280 patients to localize parietal pleura/lung parenchyma followed by classification of COVID-19 pneumonia, can achieve up to 90.8% accuracy, with 84% sensitivity and 93% specificity, as evaluated in an independent test set (not included in training and validation) of 1337 patients. Normal controls included chest CTs from oncology, emergency, and pneumonia-related indications. The false positive rate in 140 patients with laboratory confirmed other (non COVID-19) pneumonias was 10%. AI-based algorithms can readily identify CT scans with COVID-19 associated pneumonia, as well as distinguish non-COVID related pneumonias with high specificity in diverse patient populations.
Collapse
Affiliation(s)
- Stephanie A Harmon
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD, USA
- Clinical Research Directorate, Frederick National Laboratory for Cancer Research, Frederick, MD, USA
| | - Thomas H Sanford
- State University of New York-Upstate Medical Center, Syracuse, NY, USA
| | - Sheng Xu
- Center for Interventional Oncology, Radiology and Imaging Sciences, NIH Clinical Center and National Cancer Institute, Center for Cancer Research, National Institutes of Health, Bethesda, MD, USA
| | - Evrim B Turkbey
- Radiology and Imaging Sciences, Clinical Center, National Institutes of Health, Bethesda, MD, USA
| | | | - Ziyue Xu
- NVIDIA Corporation, Bethesda, MD, USA
| | - Dong Yang
- NVIDIA Corporation, Bethesda, MD, USA
| | | | - Victoria Anderson
- Center for Interventional Oncology, Radiology and Imaging Sciences, NIH Clinical Center and National Cancer Institute, Center for Cancer Research, National Institutes of Health, Bethesda, MD, USA
| | - Amel Amalou
- Center for Interventional Oncology, Radiology and Imaging Sciences, NIH Clinical Center and National Cancer Institute, Center for Cancer Research, National Institutes of Health, Bethesda, MD, USA
| | - Maxime Blain
- Center for Interventional Oncology, Radiology and Imaging Sciences, NIH Clinical Center and National Cancer Institute, Center for Cancer Research, National Institutes of Health, Bethesda, MD, USA
| | - Michael Kassin
- Center for Interventional Oncology, Radiology and Imaging Sciences, NIH Clinical Center and National Cancer Institute, Center for Cancer Research, National Institutes of Health, Bethesda, MD, USA
| | - Dilara Long
- Center for Interventional Oncology, Radiology and Imaging Sciences, NIH Clinical Center and National Cancer Institute, Center for Cancer Research, National Institutes of Health, Bethesda, MD, USA
| | - Nicole Varble
- Center for Interventional Oncology, Radiology and Imaging Sciences, NIH Clinical Center and National Cancer Institute, Center for Cancer Research, National Institutes of Health, Bethesda, MD, USA
- Philips Research North America, Cambridge, MA, USA
| | - Stephanie M Walker
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD, USA
| | - Ulas Bagci
- Center for Research in Computer Vision, University of Central Florida, Orlando, FL, USA
| | - Anna Maria Ierardi
- Department of Radiology Fondazione IRCCS Cà Granda, Ospedale Maggiore Policlinico Milano, Milan, Italy
| | - Elvira Stellato
- Department of Radiology Fondazione IRCCS Cà Granda, Ospedale Maggiore Policlinico Milano, Milan, Italy
| | - Guido Giovanni Plensich
- Department of Radiology Fondazione IRCCS Cà Granda, Ospedale Maggiore Policlinico Milano, Milan, Italy
| | - Giuseppe Franceschelli
- Diagnostic and Interventional Radiology Service, ASST Santi Paolo e Carlo, San Paolo Hospital, Milan, Italy
| | - Cristiano Girlando
- Postgraduation School in Radiodiagnostics, Università Degli Studi di Milano, Via Festa del Perdono 7, 20122, Milan, Italy
| | - Giovanni Irmici
- Postgraduation School in Radiodiagnostics, Università Degli Studi di Milano, Via Festa del Perdono 7, 20122, Milan, Italy
| | - Dominic Labella
- State University of New York-Upstate Medical Center, Syracuse, NY, USA
| | - Dima Hammoud
- Radiology and Imaging Sciences, Clinical Center, National Institutes of Health, Bethesda, MD, USA
| | - Ashkan Malayeri
- Radiology and Imaging Sciences, Clinical Center, National Institutes of Health, Bethesda, MD, USA
| | - Elizabeth Jones
- Radiology and Imaging Sciences, Clinical Center, National Institutes of Health, Bethesda, MD, USA
| | - Ronald M Summers
- Radiology and Imaging Sciences, Clinical Center, National Institutes of Health, Bethesda, MD, USA
| | - Peter L Choyke
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD, USA
| | | | | | - Kaku Tamura
- Self-Defense Forces Central Hospital, Tokyo, Japan
| | | | - Hitoshi Mori
- Self-Defense Forces Central Hospital, Tokyo, Japan
| | - Francesca Patella
- Diagnostic and Interventional Radiology Service, ASST Santi Paolo e Carlo, San Paolo Hospital, Milan, Italy
| | - Maurizio Cariati
- Diagnostic and Interventional Radiology Service, ASST Santi Paolo e Carlo, San Paolo Hospital, Milan, Italy
| | - Gianpaolo Carrafiello
- Department of Radiology Fondazione IRCCS Cà Granda, Ospedale Maggiore Policlinico Milano, Milan, Italy
- Department of Health Sciences, University of Milano, Milan, Italy
| | - Peng An
- Department of Radiology, Xiangyang NO.1 People's Hospital Affiliated to Hubei University of Medicine Xiangyang, Hubei, China
| | - Bradford J Wood
- Center for Interventional Oncology, Radiology and Imaging Sciences, NIH Clinical Center and National Cancer Institute, Center for Cancer Research, National Institutes of Health, Bethesda, MD, USA.
| | - Baris Turkbey
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD, USA.
| |
Collapse
|