1
|
Lacoste-Collin L. [What contribution can make artificial intelligence to urinary cytology?]. Ann Pathol 2024; 44:195-203. [PMID: 38614871 DOI: 10.1016/j.annpat.2024.03.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2023] [Revised: 01/30/2024] [Accepted: 03/24/2024] [Indexed: 04/15/2024]
Abstract
Urinary cytology using the Paris system is still the method of choice for screening high-grade urothelial carcinomas. However, the use of the objective criteria described in this terminology shows a lack of inter- and intra-observer reproducibility. Moreover, if its sensitivity is excellent on instrumented urine, it remains insufficient on voided urine samples. Urinary cytology appears to be an excellent model for the application of artificial intelligence to improve performance, since the objective criteria of the Paris system are defined at cellular level, and the resulting diagnostic approach is presented in a highly "algorithmic" way. Nevertheless, there is no commercially available morphological diagnostic aid, and very few predictive devices are still undergoing clinical validation. The analysis of different systems using artificial intelligence in urinary cytology rises clear prospects for mutual contributions.
Collapse
|
2
|
Wu S, Shen R, Hong G, Luo Y, Wan H, Feng J, Chen Z, Jiang F, Wang Y, Liao C, Li X, Liu B, Huang X, Liu K, Qin P, Wang Y, Xie Y, Ouyang N, Huang J, Lin T. Development and validation of an artificial intelligence-based model for detecting urothelial carcinoma using urine cytology images: a multicentre, diagnostic study with prospective validation. EClinicalMedicine 2024; 71:102566. [PMID: 38686219 PMCID: PMC11056596 DOI: 10.1016/j.eclinm.2024.102566] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/30/2023] [Revised: 03/01/2024] [Accepted: 03/12/2024] [Indexed: 05/02/2024] Open
Abstract
Background Urine cytology is an important non-invasive examination for urothelial carcinoma (UC) diagnosis and follow-up. We aimed to explore whether artificial intelligence (AI) can enhance the sensitivity of urine cytology and help avoid unnecessary endoscopy. Methods In this multicentre diagnostic study, consecutive patients who underwent liquid-based urine cytology examinations at four hospitals in China were included for model development and validation. Patients who declined surgery and lacked associated histopathology results, those diagnosed with rare subtype tumours of the urinary tract, or had low-quality images were excluded from the study. All liquid-based cytology slides were scanned into whole-slide images (WSIs) at 40 × magnification and the WSI-labels were derived from the corresponding histopathology results. The Precision Urine Cytology AI Solution (PUCAS) was composed of three distinct stages (patch extraction, features extraction, and classification diagnosis) and was trained to identify important WSI features associated with UC diagnosis. The diagnostic sensitivity was mainly used to validate the performance of PUCAS in retrospective and prospective validation cohorts. This study is registered with the ChiCTR, ChiCTR2300073192. Findings Between January 1, 2018 and October 31, 2022, 2641 patients were retrospectively recruited in the training cohort, and 2335 in retrospective validation cohorts; 400 eligible patients were enrolled in the prospective validation cohort between July 7, 2023 and September 15, 2023. The sensitivity of PUCAS ranged from 0.922 (95% CI: 0.811-0.978) to 1.000 (0.782-1.000) in retrospective validation cohorts, and was 0.896 (0.837-0.939) in prospective validation cohort. The PUCAS model also exhibited a good performance in detecting malignancy within atypical urothelial cells cases, with a sensitivity of over 0.84. In the recurrence detection scenario, PUCAS could reduce 57.5% of endoscopy use with a negative predictive value of 96.4%. Interpretation PUCAS may help to improve the sensitivity of urine cytology, reduce misdiagnoses of UC, avoid unnecessary endoscopy, and reduce the clinical burden in resource-limited areas. The further validation in other countries is needed. Funding National Natural Science Foundation of China; Key Program of the National Natural Science Foundation of China; the National Science Foundation for Distinguished Young Scholars; the Science and Technology Planning Project of Guangdong Province; the National Key Research and Development Programme of China; Guangdong Provincial Clinical Research Centre for Urological Diseases.
Collapse
Affiliation(s)
- Shaoxu Wu
- Department of Urology, Sun Yat-sen Memorial Hospital of Sun Yat-sen University, Guangzhou, China
- Guangdong Provincial Key Laboratory of Malignant Tumour Epigenetics and Gene Regulation, Guangdong-Hong Kong Joint Laboratory for RNA Medicine, Sun Yat-sen Memorial Hospital of Sun Yat-sen University, Guangzhou, China
- Guangdong Provincial Clinical Research Centre for Urological Diseases, Guangzhou, China
| | - Runnan Shen
- Department of Urology, Sun Yat-sen Memorial Hospital of Sun Yat-sen University, Guangzhou, China
| | - Guibin Hong
- Department of Urology, Sun Yat-sen Memorial Hospital of Sun Yat-sen University, Guangzhou, China
| | - Yun Luo
- Department of Urology, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Huan Wan
- Department of Pathology, Sun Yat-sen Memorial Hospital of Sun Yat-sen University, Guangzhou, China
| | - Jiahao Feng
- CellsVision Medical Technology Services Co., Ltd., Guangzhou, China
| | - Zeshi Chen
- Department of Urology, Sun Yat-sen Memorial Hospital of Sun Yat-sen University, Guangzhou, China
| | - Fan Jiang
- Department of Urology, Sun Yat-sen Memorial Hospital of Sun Yat-sen University, Guangzhou, China
| | - Yun Wang
- Department of Urology, Sun Yat-sen Memorial Hospital of Sun Yat-sen University, Guangzhou, China
| | - Chengxiao Liao
- Department of Urology, Sun Yat-sen Memorial Hospital of Sun Yat-sen University, Guangzhou, China
| | - Xiaoyang Li
- Department of Urology, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Bohao Liu
- Department of Urology, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Xiaowei Huang
- CellsVision Medical Technology Services Co., Ltd., Guangzhou, China
| | - Kai Liu
- CellsVision Medical Technology Services Co., Ltd., Guangzhou, China
| | - Ping Qin
- Department of Pathology, The Third Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Yahui Wang
- Department of Urology, The Shen-Shan Central Hospital, Shanwei, China
| | - Ye Xie
- Department of Urology, Sun Yat-sen Memorial Hospital of Sun Yat-sen University, Guangzhou, China
| | - Nengtai Ouyang
- Department of Pathology, Sun Yat-sen Memorial Hospital of Sun Yat-sen University, Guangzhou, China
| | - Jian Huang
- Department of Urology, Sun Yat-sen Memorial Hospital of Sun Yat-sen University, Guangzhou, China
- Guangdong Provincial Key Laboratory of Malignant Tumour Epigenetics and Gene Regulation, Guangdong-Hong Kong Joint Laboratory for RNA Medicine, Sun Yat-sen Memorial Hospital of Sun Yat-sen University, Guangzhou, China
- Guangdong Provincial Clinical Research Centre for Urological Diseases, Guangzhou, China
| | - Tianxin Lin
- Department of Urology, Sun Yat-sen Memorial Hospital of Sun Yat-sen University, Guangzhou, China
- Guangdong Provincial Key Laboratory of Malignant Tumour Epigenetics and Gene Regulation, Guangdong-Hong Kong Joint Laboratory for RNA Medicine, Sun Yat-sen Memorial Hospital of Sun Yat-sen University, Guangzhou, China
- Guangdong Provincial Clinical Research Centre for Urological Diseases, Guangzhou, China
| |
Collapse
|
3
|
van Diest PJ, Flach RN, van Dooijeweert C, Makineli S, Breimer GE, Stathonikos N, Pham P, Nguyen TQ, Veta M. Pros and cons of artificial intelligence implementation in diagnostic pathology. Histopathology 2024; 84:924-934. [PMID: 38433288 DOI: 10.1111/his.15153] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2023] [Revised: 12/29/2023] [Accepted: 01/19/2024] [Indexed: 03/05/2024]
Abstract
The rapid introduction of digital pathology has greatly facilitated development of artificial intelligence (AI) models in pathology that have shown great promise in assisting morphological diagnostics and quantitation of therapeutic targets. We are now at a tipping point where companies have started to bring algorithms to the market, and questions arise whether the pathology community is ready to implement AI in routine workflow. However, concerns also arise about the use of AI in pathology. This article reviews the pros and cons of introducing AI in diagnostic pathology.
Collapse
Affiliation(s)
- Paul J van Diest
- Department of Pathology, University Medical Center Utrecht, Utrecht, the Netherlands
| | - Rachel N Flach
- Department of Pathology, University Medical Center Utrecht, Utrecht, the Netherlands
- Department of Oncological Urology, University Medical Center Utrecht, Utrecht, the Netherlands
| | | | - Seher Makineli
- Department of Pathology, University Medical Center Utrecht, Utrecht, the Netherlands
- Department of Surgical Oncology, University Medical Center Utrecht, Utrecht, the Netherlands
| | - Gerben E Breimer
- Department of Pathology, University Medical Center Utrecht, Utrecht, the Netherlands
| | - Nikolas Stathonikos
- Department of Pathology, University Medical Center Utrecht, Utrecht, the Netherlands
| | - Paul Pham
- Department of Pathology, University Medical Center Utrecht, Utrecht, the Netherlands
| | - Tri Q Nguyen
- Department of Pathology, University Medical Center Utrecht, Utrecht, the Netherlands
| | - Mitko Veta
- Department of Oncological Urology, University Medical Center Utrecht, Utrecht, the Netherlands
- Department of Biomedical Engineering, Eindhoven University of Technology, Eindhoven, the Netherlands
| |
Collapse
|
4
|
Tsuji K, Kaneko M, Harada Y, Fujihara A, Ueno K, Nakanishi M, Konishi E, Takamatsu T, Horiguchi G, Teramukai S, Ito-Ihara T, Ukimura O. A Fully Automated Artificial Intelligence System to Assist Pathologists' Diagnosis to Predict Histologically High-grade Urothelial Carcinoma from Digitized Urine Cytology Slides Using Deep Learning. Eur Urol Oncol 2024; 7:258-265. [PMID: 38065702 DOI: 10.1016/j.euo.2023.11.009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2023] [Revised: 10/27/2023] [Accepted: 11/14/2023] [Indexed: 03/23/2024]
Abstract
BACKGROUND Urine cytology, although a useful screening method for urothelial carcinoma, lacks sensitivity. As an emerging technology, artificial intelligence (AI) improved image analysis accuracy significantly. OBJECTIVE To develop a fully automated AI system to assist pathologists in the histological prediction of high-grade urothelial carcinoma (HGUC) from digitized urine cytology slides. DESIGN, SETTING, AND PARTICIPANTS We digitized 535 consecutive urine cytology slides for AI use. Among these slides, 181 were used for AI development, 39 were used as AI test data to identify HGUC by cell-level classification, and 315 were used as AI test data for slide-level classification. OUTCOME MEASUREMENTS AND STATISTICAL ANALYSIS Out of the 315 slides, 171 were collected immediately prior to bladder biopsy or transurethral resection of bladder tumor, and then outcomes were compared with the histological presence of HGUC in the surgical specimen. The primary aim was to compare AI prediction of the histological presence of HGUC with the pathologist's histological diagnosis of HGUC. Secondary aims were to compare the time required for AI evaluation and concordance between the AI's classification and pathologist's cytology diagnosis. RESULTS AND LIMITATIONS The AI capability for predicting the histological presence of HGUC was 0.78 for the area under the curve. Comparing the AI predictive performance with pathologists' diagnosis, the AI sensitivity of 63% for histological HGUC prediction was superior to a pathologists' cytology sensitivity of 46% (p = 0.0037). On the contrary, there was no significant difference between the AI specificity of 83% and pathologists' specificity of 89% (p = 0.13), and AI accuracy of 74% and pathologists' accuracy of 68% (p = 0.08). The time required for AI evaluation was 139 s. With respect to the concordance between the AI prediction and pathologist's cytology diagnosis, the accuracy was 86%. Agreements with positive and negative findings were 92% and 84%, respectively. CONCLUSIONS We developed a fully automated AI system to assist pathologists' histological diagnosis of HGUC using digitized slides. This AI system showed significantly higher sensitivity than a board-certified cytopathologist and may assist pathologists in making urine cytology diagnoses, reducing their workload. PATIENT SUMMARY In this study, we present a deep learning-based artificial intelligence (AI) system that classifies urine cytology slides according to the Paris system. An automated AI system was developed and validated with 535 consecutive urine cytology slides. The AI predicted histological high-grade urothelial carcinoma from digitized urine cytology slides with superior sensitivity than pathologists, while maintaining comparable specificity and accuracy.
Collapse
Affiliation(s)
- Keisuke Tsuji
- Department of Urology, Graduate School of Medical Science, Kyoto Prefectural University of Medicine, Kyoto, Japan
| | - Masatomo Kaneko
- Department of Urology, Graduate School of Medical Science, Kyoto Prefectural University of Medicine, Kyoto, Japan
| | - Yuki Harada
- Department of Urology, Graduate School of Medical Science, Kyoto Prefectural University of Medicine, Kyoto, Japan
| | - Atsuko Fujihara
- Department of Urology, Graduate School of Medical Science, Kyoto Prefectural University of Medicine, Kyoto, Japan
| | - Kengo Ueno
- KYOCERA Communication Systems Co., Ltd, Kyoto, Japan
| | | | - Eiichi Konishi
- Department of Surgical Pathology, Kyoto Prefectural University of Medicine, Kyoto, Japan
| | - Tetsuro Takamatsu
- Department of Medical Photonics, Kyoto Prefectural University of Medicine, Kyoto, Japan
| | - Go Horiguchi
- Department of Biostatistics, Kyoto Prefectural University of Medicine, Kyoto, Japan
| | - Satoshi Teramukai
- Department of Biostatistics, Kyoto Prefectural University of Medicine, Kyoto, Japan
| | - Toshiko Ito-Ihara
- Department of Clinical and Translational Research Center, Kyoto Prefectural University of Medicine, Kyoto, Japan
| | - Osamu Ukimura
- Department of Urology, Graduate School of Medical Science, Kyoto Prefectural University of Medicine, Kyoto, Japan.
| |
Collapse
|
5
|
Kim D, Sundling KE, Virk R, Thrall MJ, Alperstein S, Bui MM, Chen-Yost H, Donnelly AD, Lin O, Liu X, Madrigal E, Michelow P, Schmitt FC, Vielh PR, Zakowski MF, Parwani AV, Jenkins E, Siddiqui MT, Pantanowitz L, Li Z. Digital cytology part 2: artificial intelligence in cytology: a concept paper with review and recommendations from the American Society of Cytopathology Digital Cytology Task Force. J Am Soc Cytopathol 2024; 13:97-110. [PMID: 38158317 DOI: 10.1016/j.jasc.2023.11.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2023] [Revised: 11/28/2023] [Accepted: 11/29/2023] [Indexed: 01/03/2024]
Abstract
Digital cytology and artificial intelligence (AI) are gaining greater adoption in the cytology laboratory. However, peer-reviewed real-world data and literature are lacking in regard to the current clinical landscape. The American Society of Cytopathology in conjunction with the International Academy of Cytology and the Digital Pathology Association established a special task force comprising 20 members with expertise and/or interest in digital cytology. The aim of the group was to investigate the feasibility of incorporating digital cytology, specifically cytology whole slide scanning and AI applications, into the workflow of the laboratory. In turn, the impact on cytopathologists, cytologists (cytotechnologists), and cytology departments were also assessed. The task force reviewed existing literature on digital cytology, conducted a worldwide survey, and held a virtual roundtable discussion on digital cytology and AI with multiple industry corporate representatives. This white paper, presented in 2 parts, summarizes the current state of digital cytology and AI practice in global cytology practice. Part 1 of the white paper is presented as a separate paper which details a review and best practice recommendations for incorporating digital cytology into practice. Part 2 of the white paper presented here provides a comprehensive review of AI in cytology practice along with best practice recommendations and legal considerations. Additionally, the cytology global survey results highlighting current AI practices by various laboratories, as well as current attitudes, are reported.
Collapse
Affiliation(s)
- David Kim
- Department of Pathology & Laboratory Medicine, Memorial Sloan-Kettering Cancer Center, New York, New York
| | - Kaitlin E Sundling
- The Wisconsin State Laboratory of Hygiene and Department of Pathology and Laboratory Medicine, University of Wisconsin-Madison, Madison, Wisconsin
| | - Renu Virk
- Department of Pathology and Cell Biology, Columbia University, New York, New York
| | - Michael J Thrall
- Department of Pathology and Genomic Medicine, Houston Methodist Hospital, Houston, Texas
| | - Susan Alperstein
- Department of Pathology and Laboratory Medicine, New York Presbyterian-Weill Cornell Medicine, New York, New York
| | - Marilyn M Bui
- The Department of Pathology, Moffitt Cancer Center & Research Institute, Tampa, Florida
| | | | - Amber D Donnelly
- Diagnostic Cytology Education, University of Nebraska Medical Center, College of Allied Health Professions, Omaha, Nebraska
| | - Oscar Lin
- Department of Pathology & Laboratory Medicine, Memorial Sloan-Kettering Cancer Center, New York, New York
| | - Xiaoying Liu
- Department of Pathology and Laboratory Medicine, Dartmouth Hitchcock Medical Center, Lebanon, New Hampshire
| | - Emilio Madrigal
- Department of Pathology, Massachusetts General Hospital, Boston, Massachusetts
| | - Pamela Michelow
- Division of Anatomical Pathology, School of Pathology, University of the Witwatersrand, Johannesburg, South Africa; Department of Pathology, National Health Laboratory Services, Johannesburg, South Africa
| | - Fernando C Schmitt
- Department of Pathology, Medical Faculty of Porto University, Porto, Portugal
| | - Philippe R Vielh
- Department of Pathology, Medipath and American Hospital of Paris, Paris, France
| | | | - Anil V Parwani
- Department of Pathology, The Ohio State University Wexner Medical Center, Columbus, Ohio
| | | | - Momin T Siddiqui
- Department of Pathology and Laboratory Medicine, New York Presbyterian-Weill Cornell Medicine, New York, New York
| | - Liron Pantanowitz
- Department of Pathology, University of Pittsburgh Medical Center, Pittsburgh, Pennsylvania.
| | - Zaibo Li
- Department of Pathology, The Ohio State University Wexner Medical Center, Columbus, Ohio.
| |
Collapse
|