1
|
Levy J, Yao K. The future of digital cytology and artificial intelligence: an editorial commentary for Digital Cytology part 1 and 2. J Am Soc Cytopathol 2024; 13:81-85. [PMID: 38267293 DOI: 10.1016/j.jasc.2023.12.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2023] [Accepted: 12/20/2023] [Indexed: 01/26/2024]
Affiliation(s)
- Joshua Levy
- Department of Pathology & Laboratory Medicine, Cedars-Sinai Medical Center, Los Angeles, California
| | - Keluo Yao
- Department of Pathology & Laboratory Medicine, Cedars-Sinai Medical Center, Los Angeles, California; Enterprise Information Services, Cedars-Sinai, Los Angeles, California.
| |
Collapse
|
2
|
Levy JJ, Chan N, Marotti JD, Kerr DA, Gutmann EJ, Glass RE, Dodge CP, Suriawinata AA, Christensen BC, Liu X, Vaickus LJ. Large-scale validation study of an improved semiautonomous urine cytology assessment tool: AutoParis-X. Cancer Cytopathol 2023; 131:637-654. [PMID: 37377320 DOI: 10.1002/cncy.22732] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2023] [Revised: 05/11/2023] [Accepted: 05/12/2023] [Indexed: 06/29/2023]
Abstract
BACKGROUND Adopting a computational approach for the assessment of urine cytology specimens has the potential to improve the efficiency, accuracy, and reliability of bladder cancer screening, which has heretofore relied on semisubjective manual assessment methods. As rigorous, quantitative criteria and guidelines have been introduced for improving screening practices (e.g., The Paris System for Reporting Urinary Cytology), algorithms to emulate semiautonomous diagnostic decision-making have lagged behind, in part because of the complex and nuanced nature of urine cytology reporting. METHODS In this study, the authors report on the development and large-scale validation of a deep-learning tool, AutoParis-X, which can facilitate rapid, semiautonomous examination of urine cytology specimens. RESULTS The results of this large-scale, retrospective validation study indicate that AutoParis-X can accurately determine urothelial cell atypia and aggregate a wide variety of cell-related and cluster-related information across a slide to yield an atypia burden score, which correlates closely with overall specimen atypia and is predictive of Paris system diagnostic categories. Importantly, this approach accounts for challenges associated with the assessment of overlapping cell cluster borders, which improve the ability to predict specimen atypia and accurately estimate the nuclear-to-cytoplasm ratio for cells in these clusters. CONCLUSIONS The authors developed a publicly available, open-source, interactive web application that features a simple, easy-to-use display for examining urine cytology whole-slide images and determining the level of atypia in specific cells, flagging the most abnormal cells for pathologist review. The accuracy of AutoParis-X (and other semiautomated digital pathology systems) indicates that these technologies are approaching clinical readiness and necessitates full evaluation of these algorithms in head-to-head clinical trials.
Collapse
Affiliation(s)
- Joshua J Levy
- Emerging Diagnostic and Investigative Technologies, Department of Pathology and Laboratory Medicine, Dartmouth Hitchcock Medical Center, Lebanon, New Hampshire, USA
- Department of Dermatology, Dartmouth Hitchcock Medical Center, Lebanon, New Hampshire, USA
- Department of Epidemiology, Dartmouth College Geisel School of Medicine, Hanover, New Hampshire, USA
- Program in Quantitative Biomedical Sciences, Dartmouth College Geisel School of Medicine, Hanover, New Hampshire, USA
| | - Natt Chan
- Program in Quantitative Biomedical Sciences, Dartmouth College Geisel School of Medicine, Hanover, New Hampshire, USA
| | - Jonathan D Marotti
- Emerging Diagnostic and Investigative Technologies, Department of Pathology and Laboratory Medicine, Dartmouth Hitchcock Medical Center, Lebanon, New Hampshire, USA
- Dartmouth College Geisel School of Medicine, Hanover, New Hampshire, USA
| | - Darcy A Kerr
- Emerging Diagnostic and Investigative Technologies, Department of Pathology and Laboratory Medicine, Dartmouth Hitchcock Medical Center, Lebanon, New Hampshire, USA
- Dartmouth College Geisel School of Medicine, Hanover, New Hampshire, USA
| | - Edward J Gutmann
- Emerging Diagnostic and Investigative Technologies, Department of Pathology and Laboratory Medicine, Dartmouth Hitchcock Medical Center, Lebanon, New Hampshire, USA
- Dartmouth College Geisel School of Medicine, Hanover, New Hampshire, USA
| | - Ryan E Glass
- Department of Pathology, University of Pittsburgh Medical Center East, Pittsburgh, Pennsylvania, USA
| | | | - Arief A Suriawinata
- Emerging Diagnostic and Investigative Technologies, Department of Pathology and Laboratory Medicine, Dartmouth Hitchcock Medical Center, Lebanon, New Hampshire, USA
- Dartmouth College Geisel School of Medicine, Hanover, New Hampshire, USA
| | - Brock C Christensen
- Department of Epidemiology, Dartmouth College Geisel School of Medicine, Hanover, New Hampshire, USA
- Department of Molecular and Systems Biology, Dartmouth College Geisel School of Medicine, Hanover, New Hampshire, USA
- Department of Community and Family Medicine, Dartmouth College Geisel School of Medicine, Hanover, New Hampshire, USA
| | - Xiaoying Liu
- Emerging Diagnostic and Investigative Technologies, Department of Pathology and Laboratory Medicine, Dartmouth Hitchcock Medical Center, Lebanon, New Hampshire, USA
- Dartmouth College Geisel School of Medicine, Hanover, New Hampshire, USA
| | - Louis J Vaickus
- Emerging Diagnostic and Investigative Technologies, Department of Pathology and Laboratory Medicine, Dartmouth Hitchcock Medical Center, Lebanon, New Hampshire, USA
- Dartmouth College Geisel School of Medicine, Hanover, New Hampshire, USA
| |
Collapse
|
3
|
Levy JJ, Chan N, Marotti JD, Rodrigues NJ, Ismail AAO, Kerr DA, Gutmann EJ, Glass RE, Dodge CP, Suriawinata AA, Christensen B, Liu X, Vaickus LJ. Examining longitudinal markers of bladder cancer recurrence through a semiautonomous machine learning system for quantifying specimen atypia from urine cytology. Cancer Cytopathol 2023; 131:561-573. [PMID: 37358142 PMCID: PMC10527805 DOI: 10.1002/cncy.22725] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2023] [Revised: 03/31/2023] [Accepted: 04/20/2023] [Indexed: 06/27/2023]
Abstract
BACKGROUND Urine cytology is generally considered the primary approach for screening for recurrence of bladder cancer. However, it is currently unclear how best to use cytological examinations for assessment and early detection of recurrence, beyond identifying a positive finding that requires more invasive methods to confirm recurrence and decide on therapeutic options. Because screening programs are frequent, and can be burdensome, finding quantitative means to reduce this burden for patients, cytopathologists, and urologists is an important endeavor and can improve both the efficiency and reliability of findings. Additionally, identifying ways to risk-stratify patients is crucial for improving quality of life while reducing the risk of future recurrence or progression of the cancer. METHODS In this study, a computational machine learning tool, AutoParis-X, was leveraged to extract imaging features from urine cytology examinations longitudinally to study the predictive potential of urine cytology for assessing recurrence risk. This study examined how the significance of imaging predictors changes over time before and after surgery to determine which predictors and time periods are most relevant for assessing recurrence risk. RESULTS Results indicate that imaging predictors extracted using AutoParis-X can predict recurrence as well or better than traditional cytological/histological assessments alone and that the predictiveness of these features is variable across time, with key differences in overall specimen atypia identified immediately before tumor recurrence. CONCLUSIONS Further research will clarify how computational methods can be effectively used in high-volume screening programs to improve recurrence detection and complement traditional modes of assessment.
Collapse
Affiliation(s)
- Joshua J. Levy
- Emerging Diagnostic and Investigative Technologies, Department of Pathology and Laboratory Medicine, Dartmouth Hitchcock Medical Center, Lebanon, NH, 03766
- Department of Dermatology, Dartmouth Hitchcock Medical Center, Lebanon, NH, 03766
- Department of Epidemiology, Dartmouth College Geisel School of Medicine, Hanover, NH, 03756
- Program in Quantitative Biomedical Sciences, Dartmouth College Geisel School of Medicine, Hanover, NH, 03756
| | - Natt Chan
- Program in Quantitative Biomedical Sciences, Dartmouth College Geisel School of Medicine, Hanover, NH, 03756
| | - Jonathan D. Marotti
- Emerging Diagnostic and Investigative Technologies, Department of Pathology and Laboratory Medicine, Dartmouth Hitchcock Medical Center, Lebanon, NH, 03766
- Dartmouth College Geisel School of Medicine, Hanover, NH, 03756
| | - Nathalie J. Rodrigues
- Emerging Diagnostic and Investigative Technologies, Department of Pathology and Laboratory Medicine, Dartmouth Hitchcock Medical Center, Lebanon, NH, 03766
| | - A. Aziz O. Ismail
- Emerging Diagnostic and Investigative Technologies, Department of Pathology and Laboratory Medicine, Dartmouth Hitchcock Medical Center, Lebanon, NH, 03766
- White River Junction VA Medical Center, White River Junction, VT, 05009
| | - Darcy A. Kerr
- Emerging Diagnostic and Investigative Technologies, Department of Pathology and Laboratory Medicine, Dartmouth Hitchcock Medical Center, Lebanon, NH, 03766
- Dartmouth College Geisel School of Medicine, Hanover, NH, 03756
| | - Edward J. Gutmann
- Emerging Diagnostic and Investigative Technologies, Department of Pathology and Laboratory Medicine, Dartmouth Hitchcock Medical Center, Lebanon, NH, 03766
- Dartmouth College Geisel School of Medicine, Hanover, NH, 03756
| | | | | | - Arief A. Suriawinata
- Emerging Diagnostic and Investigative Technologies, Department of Pathology and Laboratory Medicine, Dartmouth Hitchcock Medical Center, Lebanon, NH, 03766
- Dartmouth College Geisel School of Medicine, Hanover, NH, 03756
| | - Brock Christensen
- Department of Epidemiology, Dartmouth College Geisel School of Medicine, Hanover, NH, 03756
- Department of Molecular and Systems Biology, Dartmouth College Geisel School of Medicine, Hanover, NH, 03756
- Department of Community and Family Medicine, Dartmouth College Geisel School of Medicine, Hanover, NH, 03756
| | - Xiaoying Liu
- Emerging Diagnostic and Investigative Technologies, Department of Pathology and Laboratory Medicine, Dartmouth Hitchcock Medical Center, Lebanon, NH, 03766
- Dartmouth College Geisel School of Medicine, Hanover, NH, 03756
| | - Louis J. Vaickus
- Emerging Diagnostic and Investigative Technologies, Department of Pathology and Laboratory Medicine, Dartmouth Hitchcock Medical Center, Lebanon, NH, 03766
- Dartmouth College Geisel School of Medicine, Hanover, NH, 03756
| |
Collapse
|
4
|
Levy JJ, Liu X, Marotti JD, Kerr DA, Gutmann EJ, Glass RE, Dodge CP, Vaickus LJ. Large-scale longitudinal comparison of urine cytological classification systems reveals potential early adoption of The Paris System criteria. J Am Soc Cytopathol 2022; 11:394-402. [PMID: 36068164 DOI: 10.1016/j.jasc.2022.08.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2022] [Revised: 07/27/2022] [Accepted: 08/09/2022] [Indexed: 06/15/2023]
Abstract
INTRODUCTION Urine cytology is used to screen for urothelial carcinoma in patients with hematuria or risk factors (eg, smoking, industrial dye exposure) and is an essential clinical triage and longitudinal monitoring tool for patients with known bladder cancer. However, urine cytology is semisubjective and thus susceptible to issues including specimen quality, interobserver variability, and "hedging" towards equivocal ("atypical") diagnoses. These factors limit the predictive value of urine cytology and increase reliance on invasive procedures (cystoscopy). The Paris System for Reporting Urine Cytology (TPS) was formulated to provide more quantitative/reproducible endpoints with well-defined criteria for urothelial atypia. TPS is often compared to other assessment techniques to justify its adoption. TPS results in decreased use of the atypical category and better reproducibility. Previous reports comparing diagnoses pre- and post-TPS have not considered temporal differences between diagnoses made under prior systems and TPS. By aggregating across time, studies may underestimate the magnitude of differences between assessment methods. MATERIALS AND METHODS We conducted a large-scale longitudinal reassessment of urine cytology using TPS criteria from specimens collected from 2008 to 2018, prior to the mid-2018 adoption of TPS at an academic medical center. RESULTS Findings indicate that differences in atypical assignment were largest at the start of the period and these differences progressively decreased towards insignificance just prior to TPS implementation. CONCLUSIONS This finding suggests that cytopathologists had begun to utilize the quantitative TPS criteria prior to official adoption, which may more broadly inform adoption strategies, communication, and understanding for evolving classification systems in cytology.
Collapse
Affiliation(s)
- Joshua J Levy
- Emerging Diagnostic and Investigative Technologies, Department of Pathology and Laboratory Medicine, Dartmouth Hitchcock Medical Center, Lebanon, New Hampshire; Department of Dermatology, Dartmouth Hitchcock Medical Center, Lebanon, New Hampshire; Department of Epidemiology, Dartmouth College Geisel School of Medicine, Hanover, New Hampshire; Program in Quantitative Biomedical Sciences, Dartmouth College Geisel School of Medicine, Hanover, New Hampshire.
| | - Xiaoying Liu
- Emerging Diagnostic and Investigative Technologies, Department of Pathology and Laboratory Medicine, Dartmouth Hitchcock Medical Center, Lebanon, New Hampshire; Dartmouth College Geisel School of Medicine, Hanover, New Hampshire
| | - Jonathan D Marotti
- Emerging Diagnostic and Investigative Technologies, Department of Pathology and Laboratory Medicine, Dartmouth Hitchcock Medical Center, Lebanon, New Hampshire; Dartmouth College Geisel School of Medicine, Hanover, New Hampshire
| | - Darcy A Kerr
- Emerging Diagnostic and Investigative Technologies, Department of Pathology and Laboratory Medicine, Dartmouth Hitchcock Medical Center, Lebanon, New Hampshire; Dartmouth College Geisel School of Medicine, Hanover, New Hampshire
| | - Edward J Gutmann
- Emerging Diagnostic and Investigative Technologies, Department of Pathology and Laboratory Medicine, Dartmouth Hitchcock Medical Center, Lebanon, New Hampshire; Dartmouth College Geisel School of Medicine, Hanover, New Hampshire
| | | | - Caroline P Dodge
- Dartmouth College Geisel School of Medicine, Hanover, New Hampshire
| | - Louis J Vaickus
- Emerging Diagnostic and Investigative Technologies, Department of Pathology and Laboratory Medicine, Dartmouth Hitchcock Medical Center, Lebanon, New Hampshire; Dartmouth College Geisel School of Medicine, Hanover, New Hampshire
| |
Collapse
|