1
|
Wang C, Wang X, Gao Z, Ran C, Li C, Ding C. Multiple serous cavity effusion screening based on smear images using vision transformer. Sci Rep 2024; 14:7395. [PMID: 38548898 PMCID: PMC10978834 DOI: 10.1038/s41598-024-58151-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2023] [Accepted: 03/26/2024] [Indexed: 04/01/2024] Open
Abstract
Serous cavity effusion is a prevalent pathological condition encountered in clinical settings. Fluid samples obtained from these effusions are vital for diagnostic and therapeutic purposes. Traditionally, cytological examination of smears is a common method for diagnosing serous cavity effusion, renowned for its convenience. However, this technique presents limitations that can compromise its efficiency and diagnostic accuracy. This study aims to overcome these challenges and introduce an improved method for the precise detection of malignant cells in serous cavity effusions. We have developed a transformer-based classification framework, specifically employing the vision transformer (ViT) model, to fulfill this objective. Our research involved collecting smear images and corresponding cytological reports from 161 patients who underwent serous cavity drainage. We meticulously annotated 4836 patches from these images, identifying regions with and without malignant cells, thus creating a unique dataset for smear image classification. The findings of our study reveal that deep learning models, particularly the ViT model, exhibit remarkable accuracy in classifying patches as malignant or non-malignant. The ViT model achieved an impressive area under the receiver operating characteristic curve (AUROC) of 0.99, surpassing the performance of the convolutional neural network (CNN) model, which recorded an AUROC of 0.86. Additionally, we validated our models using an external cohort of 127 patients. The ViT model sustained its high-level screening performance, achieving an AUROC of 0.98 at the patient level, compared to the CNN model's AUROC of 0.84. The visualization of our ViT models confirmed their capability to precisely identify regions containing malignant cells in multiple serous cavity effusion smear images. In summary, our study demonstrates the potential of deep learning models, particularly the ViT model, in automating the screening process for serous cavity effusions. These models offer significant assistance to cytologists in enhancing diagnostic accuracy and efficiency. The ViT model stands out for its advanced self-attention mechanism, making it exceptionally suitable for tasks that necessitate detailed analysis of small, sparsely distributed targets like cellular clusters in serous cavity effusions.
Collapse
Affiliation(s)
- Chunbao Wang
- Department of Pathology, The First Affiliated Hospital of Xi'an Jiaotong University, Xi'an, 710061, China
- School of Computer Science and Technology, Xi'an Jiaotong University, Xi'an, 710049, China
| | - Xiangyu Wang
- School of Computer Science and Technology, Xi'an Jiaotong University, Xi'an, 710049, China
| | - Zeyu Gao
- CRUK Cambridge Centre, University of Cambridge, Cambridge, CB2 0RE, UK
| | - Caihong Ran
- Department of Pathology, Ngari Prefecture People's Hospital, Ngari of Tibet, 859000, China
| | - Chen Li
- School of Computer Science and Technology, Xi'an Jiaotong University, Xi'an, 710049, China.
| | - Caixia Ding
- Department of Pathology, Shaanxi Provincial Tumor Hospital, Xi'an, 710061, China.
| |
Collapse
|
2
|
Laurie MA, Zhou SR, Islam MT, Shkolyar E, Xing L, Liao JC. Bladder Cancer and Artificial Intelligence: Emerging Applications. Urol Clin North Am 2024; 51:63-75. [PMID: 37945103 PMCID: PMC10697017 DOI: 10.1016/j.ucl.2023.07.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2023]
Abstract
Bladder cancer is a common and heterogeneous disease that poses a significant burden to the patient and health care system. Major unmet needs include effective early detection strategy, imprecision of risk stratification, and treatment-associated morbidities. The existing clinical paradigm is imprecise, which results in missed tumors, suboptimal therapy, and disease progression. Artificial intelligence holds immense potential to address many unmet needs in bladder cancer, including early detection, risk stratification, treatment planning, quality assessment, and outcome prediction. Despite recent advances, extensive work remains to affirm the efficacy of artificial intelligence as a decision-making tool for bladder cancer management.
Collapse
Affiliation(s)
- Mark A Laurie
- Department of Urology, Stanford University School of Medicine, 453 Quarry Road, Mail Code 5656, Palo Alto, CA 94304, USA; Department of Radiation Oncology, Stanford University School of Medicine, 875 Blake Wilbur Drive Room G204, Stanford, CA 94305-5847, USA; Veterans Affairs Palo Alto Health Care System, Palo Alto, CA 94304, USA; Institute for Computational and Mathematical Engineering, Stanford University School of Engineering, Stanford, CA 94305, USA
| | - Steve R Zhou
- Department of Urology, Stanford University School of Medicine, 453 Quarry Road, Mail Code 5656, Palo Alto, CA 94304, USA
| | - Md Tauhidul Islam
- Department of Radiation Oncology, Stanford University School of Medicine, 875 Blake Wilbur Drive Room G204, Stanford, CA 94305-5847, USA
| | - Eugene Shkolyar
- Department of Urology, Stanford University School of Medicine, 453 Quarry Road, Mail Code 5656, Palo Alto, CA 94304, USA; Veterans Affairs Palo Alto Health Care System, Palo Alto, CA 94304, USA
| | - Lei Xing
- Department of Radiation Oncology, Stanford University School of Medicine, 875 Blake Wilbur Drive Room G204, Stanford, CA 94305-5847, USA
| | - Joseph C Liao
- Department of Urology, Stanford University School of Medicine, 453 Quarry Road, Mail Code 5656, Palo Alto, CA 94304, USA; Veterans Affairs Palo Alto Health Care System, Palo Alto, CA 94304, USA.
| |
Collapse
|
3
|
Chen J, Han J. A study on the recognition of monkeypox infection based on deep convolutional neural networks. Front Immunol 2023; 14:1225557. [PMID: 38130718 PMCID: PMC10733491 DOI: 10.3389/fimmu.2023.1225557] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2023] [Accepted: 10/23/2023] [Indexed: 12/23/2023] Open
Abstract
Introduction The World Health Organization (WHO) has assessed the global public risk of monkeypox as moderate, and 71 WHO member countries have reported more than 14,000 cases of monkeypox infection. At present, the identification of clinical symptoms of monkeypox mainly depends on traditional medical means, which has the problems of low detection efficiency and high detection cost. The deep learning algorithm is excellent in image recognition and can extract and recognize image features quickly and reliably. Methods Therefore, this paper proposes a residual convolutional neural network based on the λ function and contextual transformer (LaCTResNet) for the image recognition of monkeypox cases. Results The average recognition accuracy of the neural network model is 91.85%, which is 15.82% higher than that of the baseline model ResNet50 and better than the classical convolutional neural networks models such as AlexNet, VGG16, Inception-V3, and EfficientNet-B5. Discussion This method realizes high-precision identification of skin symptoms of the monkeypox virus to provide a fast and reliable auxiliary diagnosis method for monkeypox cases for front-line medical staff.
Collapse
Affiliation(s)
| | - Junying Han
- College of Information Science and Technology, Gansu Agricultural University, Lanzhou, China
| |
Collapse
|
4
|
Levy JJ, Chan N, Marotti JD, Rodrigues NJ, Ismail AAO, Kerr DA, Gutmann EJ, Glass RE, Dodge CP, Suriawinata AA, Christensen B, Liu X, Vaickus LJ. Examining longitudinal markers of bladder cancer recurrence through a semiautonomous machine learning system for quantifying specimen atypia from urine cytology. Cancer Cytopathol 2023; 131:561-573. [PMID: 37358142 PMCID: PMC10527805 DOI: 10.1002/cncy.22725] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2023] [Revised: 03/31/2023] [Accepted: 04/20/2023] [Indexed: 06/27/2023]
Abstract
BACKGROUND Urine cytology is generally considered the primary approach for screening for recurrence of bladder cancer. However, it is currently unclear how best to use cytological examinations for assessment and early detection of recurrence, beyond identifying a positive finding that requires more invasive methods to confirm recurrence and decide on therapeutic options. Because screening programs are frequent, and can be burdensome, finding quantitative means to reduce this burden for patients, cytopathologists, and urologists is an important endeavor and can improve both the efficiency and reliability of findings. Additionally, identifying ways to risk-stratify patients is crucial for improving quality of life while reducing the risk of future recurrence or progression of the cancer. METHODS In this study, a computational machine learning tool, AutoParis-X, was leveraged to extract imaging features from urine cytology examinations longitudinally to study the predictive potential of urine cytology for assessing recurrence risk. This study examined how the significance of imaging predictors changes over time before and after surgery to determine which predictors and time periods are most relevant for assessing recurrence risk. RESULTS Results indicate that imaging predictors extracted using AutoParis-X can predict recurrence as well or better than traditional cytological/histological assessments alone and that the predictiveness of these features is variable across time, with key differences in overall specimen atypia identified immediately before tumor recurrence. CONCLUSIONS Further research will clarify how computational methods can be effectively used in high-volume screening programs to improve recurrence detection and complement traditional modes of assessment.
Collapse
Affiliation(s)
- Joshua J. Levy
- Emerging Diagnostic and Investigative Technologies, Department of Pathology and Laboratory Medicine, Dartmouth Hitchcock Medical Center, Lebanon, NH, 03766
- Department of Dermatology, Dartmouth Hitchcock Medical Center, Lebanon, NH, 03766
- Department of Epidemiology, Dartmouth College Geisel School of Medicine, Hanover, NH, 03756
- Program in Quantitative Biomedical Sciences, Dartmouth College Geisel School of Medicine, Hanover, NH, 03756
| | - Natt Chan
- Program in Quantitative Biomedical Sciences, Dartmouth College Geisel School of Medicine, Hanover, NH, 03756
| | - Jonathan D. Marotti
- Emerging Diagnostic and Investigative Technologies, Department of Pathology and Laboratory Medicine, Dartmouth Hitchcock Medical Center, Lebanon, NH, 03766
- Dartmouth College Geisel School of Medicine, Hanover, NH, 03756
| | - Nathalie J. Rodrigues
- Emerging Diagnostic and Investigative Technologies, Department of Pathology and Laboratory Medicine, Dartmouth Hitchcock Medical Center, Lebanon, NH, 03766
| | - A. Aziz O. Ismail
- Emerging Diagnostic and Investigative Technologies, Department of Pathology and Laboratory Medicine, Dartmouth Hitchcock Medical Center, Lebanon, NH, 03766
- White River Junction VA Medical Center, White River Junction, VT, 05009
| | - Darcy A. Kerr
- Emerging Diagnostic and Investigative Technologies, Department of Pathology and Laboratory Medicine, Dartmouth Hitchcock Medical Center, Lebanon, NH, 03766
- Dartmouth College Geisel School of Medicine, Hanover, NH, 03756
| | - Edward J. Gutmann
- Emerging Diagnostic and Investigative Technologies, Department of Pathology and Laboratory Medicine, Dartmouth Hitchcock Medical Center, Lebanon, NH, 03766
- Dartmouth College Geisel School of Medicine, Hanover, NH, 03756
| | | | | | - Arief A. Suriawinata
- Emerging Diagnostic and Investigative Technologies, Department of Pathology and Laboratory Medicine, Dartmouth Hitchcock Medical Center, Lebanon, NH, 03766
- Dartmouth College Geisel School of Medicine, Hanover, NH, 03756
| | - Brock Christensen
- Department of Epidemiology, Dartmouth College Geisel School of Medicine, Hanover, NH, 03756
- Department of Molecular and Systems Biology, Dartmouth College Geisel School of Medicine, Hanover, NH, 03756
- Department of Community and Family Medicine, Dartmouth College Geisel School of Medicine, Hanover, NH, 03756
| | - Xiaoying Liu
- Emerging Diagnostic and Investigative Technologies, Department of Pathology and Laboratory Medicine, Dartmouth Hitchcock Medical Center, Lebanon, NH, 03766
- Dartmouth College Geisel School of Medicine, Hanover, NH, 03756
| | - Louis J. Vaickus
- Emerging Diagnostic and Investigative Technologies, Department of Pathology and Laboratory Medicine, Dartmouth Hitchcock Medical Center, Lebanon, NH, 03766
- Dartmouth College Geisel School of Medicine, Hanover, NH, 03756
| |
Collapse
|